Computing and Library Services - delivering an inspiring information environment

Panoramic imaging - a review

Gledhill, Duke, Tian, Gui Yun, Taylor, D. and Clarke, David (2003) Panoramic imaging - a review. Computers and Graphics, 27 (3). pp. 435-445. ISSN 0097-8493

[img] PDF
Restricted to Registered users only

Download (697kB)


Panoramic imaging has important implications in robotics, computer vision and virtual reality. This paper reviews representative work in the design and development of 2D/3D panoramic image capturing systems, the advancement of auto-calibration, registration and corresponding techniques, stereo vision, 3D reconstruction and image-based rendering. The paper discusses the above work within four parts of the panoramic imaging process: capturing system, image processing for panoramic imaging, image stitching and 3D reconstruction, image-based rending and visualisation. The design and development of a panoramic system pays careful attention to the following issues: image capturing, image registration, camera calibration, feature extraction, image understanding and image stitching. The objective of this review paper is to summarise and compare some of the methods in the various stages and identify research topics and applications, which are at the forefront of this exciting and challenge field.

Item Type: Article
Additional Information: © 2003 Elsevier Science Ltd.
Uncontrolled Keywords: 3D panoramic imaging; Correspondence; Image-based rendering; 3D modelling; Stereo vision; Virtual environment
Subjects: Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Q Science > QA Mathematics > QA76 Computer software
Schools: School of Computing and Engineering
School of Computing and Engineering > High-Performance Intelligent Computing > Visualisation, Interaction and Vision
School of Computing and Engineering > Serious Games Research Group
References: [1] Rotography Ltd., [2] Helmut Dersch free software http://www.fh-furtwangen. de/Bdersch/ [3] Chen SE. QuickTime VR—an image based approach to virtual environment navigation. Proceedings of the SIGGRAPH ’95, Los Angeles, CA, 1995. p. 29–38. [4] Pixaround [5] iMove Inc. [6] Ipix Corporation [7] Park J, Inoue S. Hierarchical depth mapping from multiple cameras. Proceedings of the ICIAP ’97, vol. 1, Florence, Italy, September 1997. p. 685–92. [8] Hamden HM, Hemayed EE, Farag AA. A fast 3D object reconstruction using trinocular vision and structured light. Proceedings of the SPIE Conference, vol. 3522, San Diego, CA, November 1998. [9] Valkenburg RJ, McIror AM. Accurate 3D measurement using a structured light system, image and vision computing. [10] Nikon Cameras [11] Kodak Cameras [12] Kaidan Products html [13] MGI Webtools panorama/index.asp [14] Rees DW. Panoramic television viewing system. US Patent No. 3,505,465, April 1970. [15] Nayar SK. Omnidirectional video camera. Proceedings of the DARPA Image Understanding Workshop, New Orleans, 1997. [16] Yagi Y, Kawato S. Panoramic scene analysis with conic projection. Proceedings of the International Conference on Robots and Systems (IROS), Tsuchiura, Ibaraki, Japan, 1990. [17] Hong J. Image based homing. Proceedings of the IEEE International Conference on Robotics and Automation, Sacramento, CA, May 1991. [18] Yamazawa K, Yagi Y, Yachida M. Obstacle avoidance with omnidirectional image sensor hyperomni vision. Proceedings of the IEEE International Conference on Robotics and Automation, May 1995. p. 1062–7. [19] Nalwa V. A true omnidirectional viewer. Technical Report, Bell Laboratories, Holmdel, NJ 07733, USA, February 1996. [20] Svoboda T, Pajdla T, Hlavac V. Epipolar geometry for panoramic cameras. Fifth European Conference on Computer Vision, Freiberg, Germany, June 1998. p. 218–32. [21] Svoboda T, Pajdla T, Hlavac V. Central panoramic cameras: design and geometry. Third Computer Vision Winter Workshop, Gozd Martuljek, Slovenia, February 1998. [22] Aggarwal M, Ahuja N. High dynamic range panoramic imaging. Eighth IEEE International Conference on Computer Vision, ICCV2001, vol. 1, Vancouver, Canada, 2001. p. 2–9. [23] Stereo photography history faq/waack-ch-2.html D. Gledhill et al. / Computers & Graphics 27 (2003) 435–445 443 [24] Pilu M. A direct method for stereo correspondence based on singular value decomposition. IEEE CVPR ’97, Puerto Rico, June 1997. [25] Tzovaras D, Grammalidis N, Strintzis MG. Disparity field and depth map coding for multiview3D image generation. Signal Processing: Image Communication 1998;11:205–30. [26] Medioni G, Tang C, Lee M. Tensor voting: theory and applications. In: 12eme Congres Francophone AFRIFAFIA de Reconnaissance des Formes et Intelligence Artificielle (RFIA), Paris, France, February 2000. [27] Aguiar PMQ, Moura JMF. Three-dimensional modelling from two-dimensional video. IEEE Transactions on Image Processing, 2001;10(10):1541–51. [28] Heckbert P. Projective mappings for image warping. Fundamentals of Texture Mapping and Image Warping 1995;17–21. [29] Heckbert P. Image warping and morphing. Fundamentals of Texture Mapping and Image Warping 1999;17–21. [30] Peleg S, Ben-Ezra M, Pritch Y. Omnistereo: panoramic stereo imaging. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2001;23(3):279–90. [31] Peer P, Solina F. Mosaic-based panoramic depth imaging with a single standard camera. IEEE Workshop on Stereo and Multi-Baseline Vision, Kkauai, Hawaii, 2001. p. 75–84. [32] Zhang Z. A flexible newtechnique for camera calibration. IEEE Transactions on Pattern Analysis and Machine Intelligence 2000;22(11):1330–4. [33] Heikkila J. Geometric camera calibration using circular control points. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2000;22(10):1066–77. [34] McMillan L. Acquiring immersive virtual environments with an uncalibrated camera. UNC-Chapel Hill Computer Science Technical Report #95-006, University of North Carolina, 1995. [35] Luong QT, Faugeras OD. Self-calibration of a moving camera from point correspondences and fundamental matrices. International Journal of Computer Vision, 1997;22(3):261–89. [36] Odone F, Fusiello A. Applications of 2D image registration. Research Memorandum RM/99/15, Heriot-Watt University. [37] Brown LG. A survey of image registration techniques. ACM Computing Surveys, 1992;24(4):325–76. [38] Zitnick CL, Kanade T. A cooperative algorithm for stereo matching and occlusion detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2000;22(7):675–84. [39] Ziou D, Tabbone S. Edge detection techniques—an overview. Technical Report, No. 195, Dept Math & Informatique, Universit de Sherbrooke, 1997. [40] Bao P, Xu D. Complex wavelet-based image mosaics using edge-preserving visual perception modelling. Computers and Graphics 1999;23:309–21. [41] Kim HS, Kim HC, Lee WK, Kim CH. Stitching reliability for estimating camera focal length in panoramic image mosaicing. 15th International Conference on Pattern Recognition, Barcelona, Spain, 2000. p. 596–9. [42] Bourque E, Dudek G. Automated creation of image based virtual reality. Proceedings of the SPIE, Sensor Fusion and Decentralised Control in Autonomous Robotic Systems, vol. 3209, 1997. p. 292–301. [43] Schmid C, Mohr R, Bauckhage C. Evaluation of interest point detectors. International Journal of Computer Vision, 2000;37(2):151–72. [44] Zoghlami I, Faugeras O, Deriche R. Using geometric corners to build a 2D mosaic from a set of images. Proceedings of the International Conference on Computer Vision and Pattern Recognition, Puerto Rico, June 1997. [45] Mikolajczyk K, Schmid C. Indexing based scale invariant interest points. In: International Conference on Computer Vision, Vancouver, Canada, 2001. p. 525–31. [46] Schmid C, Mohr R. Image retrieval using local characterisation. Proceedings of the Third International Conference on Communicating by Image and Multimedia, Arcachon, France, May 1996. p. 45–50. [47] Lowe DG. Object recognition from local scale invariant features. Proceedings of the International Conference on Computer Vision, Corfu, September 1999. [48] Kanatani K, Ohta N. Accuracy bounds and optimal computation of homograph for image mosaicing applications. The Seventh International Conference on Computer Vision (ICCV ’99), Kerkyra, Greece, September 1999. [49] Fusiello A. Notes on the applications of homographies in computer vision. Research Memorandum RM/99/13, Department of Computing and Electrical Engineering, Heriot-Watt University, Edinburgh, UK, 1999. [50] Mann S, Picard RW. Virtual bellows: constructing high quality stills from video. M.I.T Media Laboratory Perceptual Computing Section Technical Report no. 259 appears, Proceedings of the First IEEE International Conference on Image Processing, Austin, TX, November 1994. [51] Kourogi M, Kurata T, Hoshino J, Muraoka Y. Real-time image mosaicing from a video sequence. Proceedings of the ICIP ’99, vol. 4, Kobe, Japan, 1999. p. 133–7. [52] Zhu S, Hanson AR, Schultz H, Stolle F, Riseman EM. Stereo mosaics from a moving video camera for environmental monitoring. First International Workshop on Digital and Computational Video, Tampa, FL, USA, December 10, 1999. [53] Burt PJ, Adelson EH. A multiresolution spline with application to image mosaics. ACM Transactions on Graphics 1983;2(4):217–36. [54] Onoe Y, Yamazawa K, Takemura H, Yokoya N. Telepresence by real-time view-dependent image generation from omnidirectional video streams. Computer Vision and Image Understanding, 1998;71(2):153–65. [55] Dhond UR, Aggarwal JK. Structure from stereo— a review. IEEE Transactions on Systems, Man, and Cybernetics 1989;19(6):1489–510. [56] Hartley RI, Sturm P. Triangulation. Computer Vision and Image Understanding, 1997;68(2):146–57. [57] Tsai C, Katsaggelos AK. Dense disparity estimation with a divide-and-conquer disparity space image technique. IEEE Transactions on Multimedia, 1999;1(1):18–29. [58] Jelinek D, Taylor CJ. Reconstruction of linearly parameterized models from single images with a camera of unknown focal length. IEEE Transactions on Pattern Analysis and Machine Intelligence 2001;23(7):767–73. 444 D. Gledhill et al. / Computers & Graphics 27 (2003) 435–445 [59] Izquierdo E, Kruse S. Image analysis for 3D modelling, rendering and virtual viewgeneration . Computer Vision and Image Understanding, 1998;71(2):231–53. [60] Lee W, Gu J, Magnenat-Thalmann N. Generating animatable 3D virtual humans from photographs. Eurographics 2000;19:1–10. [61] Seitz SM, Dyer CR. Physically valid viewsynthesis by image interpolation. Proceedings of the Workshop on Representations of Visual Scenes, Cambridge, MA, 1995. [62] Debevec PE, Taylor CJ, Malik J. Modeling and rendering architecture from photographs: a hybrid geometry and image based approach. Proceedings of the ACM SIGGRAPH ’96, NewOrlean s, LA, 1996. p. 11–20. [63] Oh BM, Chen M, Dorsey J, Durand F. Image-based modeling and photo editing. SIGGRAPH, Los Angeles, CA, 2001. p. 433–42. [64] Aliaga DG, Carlbom I. Plenoptic stitching: a scalable method for reconstructing 3D interactive walkthroughs. Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, Los Angeles, CA, August 2001. p. 443–50. [65] Huang H, Hung Y. Panoramic stereo imaging system with automatic disparity warping and seaming. Graphical models and Image Processing, 1998;60(3):196–208. [66] Pritch Y, Ben-Ezra M, Peleg S. Optics for omnistereo imaging. In: LS Davis, editor, Foundations of Image Understanding. Dordrecht: Kluwer Academic, 2001. p. 447–67. [67] Peleg S, Pritch Y, Ben-Ezra M. Cameras for stereo panoramic imaging. CVPR ’00, Hilton Head Island, 2000. p. 208–14. [68] Svoboda T, Pajdla T. Panoramic cameras for 3D computation. Proceedings of the Czech Pattern Recognition Workshop, Czech Society for Pattern Recognition, Prague, Czech Republic, February 2000. p. 63–70. [69] Koyasu H, Miura J, Shirai Y. Real-time omnidirectional stereo for obstacle detection and tracking in dynamic environments. IEEE/RSJ International Conference on Intelligent Robots and Systems, 2001;1:31–6. [70] Szeliski R, Shum H. Creating full viewpanoramic image mosaics and environment maps. Computer Graphics Proceedings, Annual Conference Series, Proceedings of the SIGGRAPH ’97, Los Angeles, August 1997. p. 251–8. [71] Lee K, Fung Y, Wong K, Or S, Lao T. Panoramic video representation using mosaic image. Proceedings of the CISST ’99, Las Vegas, USA, June 1999. p. 390–6. [72] Sun X, Foote J, Kimber D, Manjunath BS. Panoramic video capturing and compressed domain virtual camera control. Proceedings of the Ninth ACM International Conference on Multimedia, Ottawa, Canada, September 2001. p. 329–47. [73] Shum H, Kang SB. A reviewof image-based rendering techniques. IEEE/SPIE Visual Communications and Image Processing (VCIP), Perth, 2000. p. 2–13. [74] Kiyokawa K, Kurata Y, Ohno H. An optical see-through display for mutual occlusion with a real-time stereovision system. Computers and Graphics 2001;25:765–79. [75] Finlayson GD, Tian GY. Colour normalisation for colour object recognition. International Journal of Pattern Recognition and Artificial Intelligence 1999; 13(8):1271–85. D. Gledhill et al. / Computers & Graphics 27 (2003) 435–445 445
Depositing User: Sara Taylor
Date Deposited: 22 Jun 2007
Last Modified: 31 Mar 2018 15:17


Downloads per month over past year

Repository Staff Only: item control page

View Item View Item

University of Huddersfield, Queensgate, Huddersfield, HD1 3DH Copyright and Disclaimer All rights reserved ©