Computing and Library Services - delivering an inspiring information environment

Panoramic imaging - a review

Gledhill, Duke, Tian, Gui Yun, Taylor, D. and Clarke, David (2003) Panoramic imaging - a review. Computers and Graphics, 27 (3). pp. 435-445. ISSN 0097-8493

[img] PDF
Restricted to Registered users only

Download (697kB)


Panoramic imaging has important implications in robotics, computer vision and virtual reality. This paper reviews representative work in the design and development of 2D/3D panoramic image capturing systems, the advancement of auto-calibration, registration and corresponding techniques, stereo vision, 3D reconstruction and image-based rendering. The paper discusses the above work within four parts of the panoramic imaging process: capturing system, image processing for panoramic imaging, image stitching and 3D reconstruction, image-based rending and visualisation. The design and development of a panoramic system pays careful attention to the following issues: image capturing, image registration, camera calibration, feature extraction, image understanding and image stitching. The objective of this review paper is to summarise and compare some of the methods in the various stages and identify research topics and applications, which are at the forefront of this exciting and challenge field.

Item Type: Article
Additional Information: © 2003 Elsevier Science Ltd.
Uncontrolled Keywords: 3D panoramic imaging; Correspondence; Image-based rendering; 3D modelling; Stereo vision; Virtual environment
Subjects: Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Q Science > QA Mathematics > QA76 Computer software
Schools: School of Computing and Engineering
School of Computing and Engineering > High-Performance Intelligent Computing > Visualisation, Interaction and Vision
School of Computing and Engineering > Serious Games Research Group

[1] Rotography Ltd.,
[2] Helmut Dersch free software http://www.fh-furtwangen.
[3] Chen SE. QuickTime VR—an image based approach to
virtual environment navigation. Proceedings of the SIGGRAPH
’95, Los Angeles, CA, 1995. p. 29–38.
[4] Pixaround
[5] iMove Inc.
[6] Ipix Corporation
[7] Park J, Inoue S. Hierarchical depth mapping from multiple
cameras. Proceedings of the ICIAP ’97, vol. 1, Florence,
Italy, September 1997. p. 685–92.
[8] Hamden HM, Hemayed EE, Farag AA. A fast 3D object
reconstruction using trinocular vision and structured light.
Proceedings of the SPIE Conference, vol. 3522, San Diego,
CA, November 1998.
[9] Valkenburg RJ, McIror AM. Accurate 3D measurement
using a structured light system, image and vision computing.
[10] Nikon Cameras
[11] Kodak Cameras
[12] Kaidan Products
[13] MGI Webtools
[14] Rees DW. Panoramic television viewing system. US Patent
No. 3,505,465, April 1970.
[15] Nayar SK. Omnidirectional video camera. Proceedings of
the DARPA Image Understanding Workshop, New
Orleans, 1997.
[16] Yagi Y, Kawato S. Panoramic scene analysis with conic
projection. Proceedings of the International Conference on
Robots and Systems (IROS), Tsuchiura, Ibaraki, Japan,
[17] Hong J. Image based homing. Proceedings of the IEEE
International Conference on Robotics and Automation,
Sacramento, CA, May 1991.
[18] Yamazawa K, Yagi Y, Yachida M. Obstacle avoidance
with omnidirectional image sensor hyperomni
vision. Proceedings of the IEEE International Conference
on Robotics and Automation, May 1995.
p. 1062–7.
[19] Nalwa V. A true omnidirectional viewer. Technical
Report, Bell Laboratories, Holmdel, NJ 07733, USA,
February 1996.
[20] Svoboda T, Pajdla T, Hlavac V. Epipolar geometry
for panoramic cameras. Fifth European Conference
on Computer Vision, Freiberg, Germany, June 1998.
p. 218–32.
[21] Svoboda T, Pajdla T, Hlavac V. Central panoramic
cameras: design and geometry. Third Computer Vision
Winter Workshop, Gozd Martuljek, Slovenia, February
[22] Aggarwal M, Ahuja N. High dynamic range panoramic
imaging. Eighth IEEE International Conference on Computer
Vision, ICCV2001, vol. 1, Vancouver, Canada, 2001.
p. 2–9.
[23] Stereo photography history
D. Gledhill et al. / Computers & Graphics 27 (2003) 435–445 443
[24] Pilu M. A direct method for stereo correspondence based
on singular value decomposition. IEEE CVPR ’97, Puerto
Rico, June 1997.
[25] Tzovaras D, Grammalidis N, Strintzis MG. Disparity
field and depth map coding for multiview3D image
generation. Signal Processing: Image Communication
[26] Medioni G, Tang C, Lee M. Tensor voting: theory and
applications. In: 12eme Congres Francophone AFRIFAFIA
de Reconnaissance des Formes et Intelligence
Artificielle (RFIA), Paris, France, February 2000.
[27] Aguiar PMQ, Moura JMF. Three-dimensional modelling
from two-dimensional video. IEEE Transactions on Image
Processing, 2001;10(10):1541–51.
[28] Heckbert P. Projective mappings for image warping.
Fundamentals of Texture Mapping and Image Warping
[29] Heckbert P. Image warping and morphing. Fundamentals
of Texture Mapping and Image Warping 1999;17–21.
[30] Peleg S, Ben-Ezra M, Pritch Y. Omnistereo: panoramic
stereo imaging. IEEE Transactions on Pattern Analysis
and Machine Intelligence, 2001;23(3):279–90.
[31] Peer P, Solina F. Mosaic-based panoramic depth imaging
with a single standard camera. IEEE Workshop on
Stereo and Multi-Baseline Vision, Kkauai, Hawaii, 2001.
p. 75–84.
[32] Zhang Z. A flexible newtechnique for camera calibration.
IEEE Transactions on Pattern Analysis and Machine
Intelligence 2000;22(11):1330–4.
[33] Heikkila J. Geometric camera calibration using circular
control points. IEEE Transactions on Pattern Analysis and
Machine Intelligence, 2000;22(10):1066–77.
[34] McMillan L. Acquiring immersive virtual environments
with an uncalibrated camera. UNC-Chapel Hill Computer
Science Technical Report #95-006, University of North
Carolina, 1995.
[35] Luong QT, Faugeras OD. Self-calibration of a moving
camera from point correspondences and fundamental
matrices. International Journal of Computer Vision,
[36] Odone F, Fusiello A. Applications of 2D image registration.
Research Memorandum RM/99/15, Heriot-Watt
[37] Brown LG. A survey of image registration techniques.
ACM Computing Surveys, 1992;24(4):325–76.
[38] Zitnick CL, Kanade T. A cooperative algorithm for
stereo matching and occlusion detection. IEEE Transactions
on Pattern Analysis and Machine Intelligence,
[39] Ziou D, Tabbone S. Edge detection techniques—an
overview. Technical Report, No. 195, Dept Math &
Informatique, Universit de Sherbrooke, 1997.
[40] Bao P, Xu D. Complex wavelet-based image mosaics using
edge-preserving visual perception modelling. Computers
and Graphics 1999;23:309–21.
[41] Kim HS, Kim HC, Lee WK, Kim CH. Stitching reliability
for estimating camera focal length in panoramic image
mosaicing. 15th International Conference on Pattern
Recognition, Barcelona, Spain, 2000. p. 596–9.
[42] Bourque E, Dudek G. Automated creation of image based
virtual reality. Proceedings of the SPIE, Sensor Fusion and
Decentralised Control in Autonomous Robotic Systems,
vol. 3209, 1997. p. 292–301.
[43] Schmid C, Mohr R, Bauckhage C. Evaluation of interest
point detectors. International Journal of Computer Vision,
[44] Zoghlami I, Faugeras O, Deriche R. Using geometric
corners to build a 2D mosaic from a set of images.
Proceedings of the International Conference on Computer
Vision and Pattern Recognition, Puerto Rico, June 1997.
[45] Mikolajczyk K, Schmid C. Indexing based scale invariant
interest points. In: International Conference on Computer
Vision, Vancouver, Canada, 2001. p. 525–31.
[46] Schmid C, Mohr R. Image retrieval using local characterisation.
Proceedings of the Third International Conference
on Communicating by Image and Multimedia, Arcachon,
France, May 1996. p. 45–50.
[47] Lowe DG. Object recognition from local scale invariant
features. Proceedings of the International Conference on
Computer Vision, Corfu, September 1999.
[48] Kanatani K, Ohta N. Accuracy bounds and optimal
computation of homograph for image mosaicing
applications. The Seventh International Conference on
Computer Vision (ICCV ’99), Kerkyra, Greece, September
[49] Fusiello A. Notes on the applications of homographies in
computer vision. Research Memorandum RM/99/13,
Department of Computing and Electrical Engineering,
Heriot-Watt University, Edinburgh, UK, 1999.
[50] Mann S, Picard RW. Virtual bellows: constructing high
quality stills from video. M.I.T Media Laboratory
Perceptual Computing Section Technical Report no. 259
appears, Proceedings of the First IEEE International
Conference on Image Processing, Austin, TX, November
[51] Kourogi M, Kurata T, Hoshino J, Muraoka Y. Real-time
image mosaicing from a video sequence. Proceedings of the
ICIP ’99, vol. 4, Kobe, Japan, 1999. p. 133–7.
[52] Zhu S, Hanson AR, Schultz H, Stolle F, Riseman EM.
Stereo mosaics from a moving video camera for environmental
monitoring. First International Workshop on
Digital and Computational Video, Tampa, FL, USA,
December 10, 1999.
[53] Burt PJ, Adelson EH. A multiresolution spline with
application to image mosaics. ACM Transactions on
Graphics 1983;2(4):217–36.
[54] Onoe Y, Yamazawa K, Takemura H, Yokoya N.
Telepresence by real-time view-dependent image generation
from omnidirectional video streams. Computer Vision
and Image Understanding, 1998;71(2):153–65.
[55] Dhond UR, Aggarwal JK. Structure from stereo—
a review. IEEE Transactions on Systems, Man, and
Cybernetics 1989;19(6):1489–510.
[56] Hartley RI, Sturm P. Triangulation. Computer Vision and
Image Understanding, 1997;68(2):146–57.
[57] Tsai C, Katsaggelos AK. Dense disparity estimation with
a divide-and-conquer disparity space image technique.
IEEE Transactions on Multimedia, 1999;1(1):18–29.
[58] Jelinek D, Taylor CJ. Reconstruction of linearly parameterized
models from single images with a camera of
unknown focal length. IEEE Transactions on Pattern
Analysis and Machine Intelligence 2001;23(7):767–73.
444 D. Gledhill et al. / Computers & Graphics 27 (2003) 435–445
[59] Izquierdo E, Kruse S. Image analysis for 3D modelling,
rendering and virtual viewgeneration . Computer Vision
and Image Understanding, 1998;71(2):231–53.
[60] Lee W, Gu J, Magnenat-Thalmann N. Generating
animatable 3D virtual humans from photographs. Eurographics
[61] Seitz SM, Dyer CR. Physically valid viewsynthesis by
image interpolation. Proceedings of the Workshop on
Representations of Visual Scenes, Cambridge, MA, 1995.
[62] Debevec PE, Taylor CJ, Malik J. Modeling and rendering
architecture from photographs: a hybrid geometry and
image based approach. Proceedings of the ACM SIGGRAPH
’96, NewOrlean s, LA, 1996. p. 11–20.
[63] Oh BM, Chen M, Dorsey J, Durand F. Image-based
modeling and photo editing. SIGGRAPH, Los Angeles,
CA, 2001. p. 433–42.
[64] Aliaga DG, Carlbom I. Plenoptic stitching: a scalable
method for reconstructing 3D interactive walkthroughs.
Proceedings of the 28th Annual Conference on Computer
Graphics and Interactive Techniques, Los Angeles, CA,
August 2001. p. 443–50.
[65] Huang H, Hung Y. Panoramic stereo imaging system with
automatic disparity warping and seaming. Graphical
models and Image Processing, 1998;60(3):196–208.
[66] Pritch Y, Ben-Ezra M, Peleg S. Optics for omnistereo
imaging. In: LS Davis, editor, Foundations of Image
Understanding. Dordrecht: Kluwer Academic, 2001.
p. 447–67.
[67] Peleg S, Pritch Y, Ben-Ezra M. Cameras for stereo
panoramic imaging. CVPR ’00, Hilton Head Island,
2000. p. 208–14.
[68] Svoboda T, Pajdla T. Panoramic cameras for 3D
computation. Proceedings of the Czech Pattern Recognition
Workshop, Czech Society for Pattern Recognition,
Prague, Czech Republic, February 2000. p. 63–70.
[69] Koyasu H, Miura J, Shirai Y. Real-time omnidirectional
stereo for obstacle detection and tracking in dynamic
environments. IEEE/RSJ International Conference on
Intelligent Robots and Systems, 2001;1:31–6.
[70] Szeliski R, Shum H. Creating full viewpanoramic
image mosaics and environment maps. Computer
Graphics Proceedings, Annual Conference Series,
Proceedings of the SIGGRAPH ’97, Los Angeles, August
1997. p. 251–8.
[71] Lee K, Fung Y, Wong K, Or S, Lao T. Panoramic video
representation using mosaic image. Proceedings of the
CISST ’99, Las Vegas, USA, June 1999. p. 390–6.
[72] Sun X, Foote J, Kimber D, Manjunath BS. Panoramic
video capturing and compressed domain virtual camera
control. Proceedings of the Ninth ACM International
Conference on Multimedia, Ottawa, Canada, September
2001. p. 329–47.
[73] Shum H, Kang SB. A reviewof image-based rendering
techniques. IEEE/SPIE Visual Communications and Image
Processing (VCIP), Perth, 2000. p. 2–13.
[74] Kiyokawa K, Kurata Y, Ohno H. An optical see-through
display for mutual occlusion with a real-time stereovision
system. Computers and Graphics 2001;25:765–79.
[75] Finlayson GD, Tian GY. Colour normalisation for
colour object recognition. International Journal of
Pattern Recognition and Artificial Intelligence 1999;
D. Gledhill et al. / Computers & Graphics 27 (2003) 435–445 445

Depositing User: Sara Taylor
Date Deposited: 22 Jun 2007
Last Modified: 01 Dec 2016 17:34


Downloads per month over past year

Repository Staff Only: item control page

View Item View Item

University of Huddersfield, Queensgate, Huddersfield, HD1 3DH Copyright and Disclaimer All rights reserved ©