Computing and Library Services - delivering an inspiring information environment

Panoramic imaging - a review

Gledhill, Duke, Tian, Gui Yun, Taylor, D. and Clarke, David (2003) Panoramic imaging - a review. Computers and Graphics, 27 (3). pp. 435-445. ISSN 0097-8493

[img] PDF
Restricted to Registered users only

Download (680kB)


    Panoramic imaging has important implications in robotics, computer vision and virtual reality. This paper reviews representative work in the design and development of 2D/3D panoramic image capturing systems, the advancement of auto-calibration, registration and corresponding techniques, stereo vision, 3D reconstruction and image-based rendering. The paper discusses the above work within four parts of the panoramic imaging process: capturing system, image processing for panoramic imaging, image stitching and 3D reconstruction, image-based rending and visualisation. The design and development of a panoramic system pays careful attention to the following issues: image capturing, image registration, camera calibration, feature extraction, image understanding and image stitching. The objective of this review paper is to summarise and compare some of the methods in the various stages and identify research topics and applications, which are at the forefront of this exciting and challenge field.

    Item Type: Article
    Additional Information: © 2003 Elsevier Science Ltd.
    Uncontrolled Keywords: 3D panoramic imaging; Correspondence; Image-based rendering; 3D modelling; Stereo vision; Virtual environment
    Subjects: Q Science > QA Mathematics > QA75 Electronic computers. Computer science
    Q Science > QA Mathematics > QA76 Computer software
    Schools: School of Computing and Engineering
    School of Computing and Engineering > High-Performance Intelligent Computing > Visualisation, Interaction and Vision
    School of Computing and Engineering > Serious Games Research Group

    [1] Rotography Ltd.,
    [2] Helmut Dersch free software http://www.fh-furtwangen.
    [3] Chen SE. QuickTime VR—an image based approach to
    virtual environment navigation. Proceedings of the SIGGRAPH
    ’95, Los Angeles, CA, 1995. p. 29–38.
    [4] Pixaround
    [5] iMove Inc.
    [6] Ipix Corporation
    [7] Park J, Inoue S. Hierarchical depth mapping from multiple
    cameras. Proceedings of the ICIAP ’97, vol. 1, Florence,
    Italy, September 1997. p. 685–92.
    [8] Hamden HM, Hemayed EE, Farag AA. A fast 3D object
    reconstruction using trinocular vision and structured light.
    Proceedings of the SPIE Conference, vol. 3522, San Diego,
    CA, November 1998.
    [9] Valkenburg RJ, McIror AM. Accurate 3D measurement
    using a structured light system, image and vision computing.
    [10] Nikon Cameras
    [11] Kodak Cameras
    [12] Kaidan Products
    [13] MGI Webtools
    [14] Rees DW. Panoramic television viewing system. US Patent
    No. 3,505,465, April 1970.
    [15] Nayar SK. Omnidirectional video camera. Proceedings of
    the DARPA Image Understanding Workshop, New
    Orleans, 1997.
    [16] Yagi Y, Kawato S. Panoramic scene analysis with conic
    projection. Proceedings of the International Conference on
    Robots and Systems (IROS), Tsuchiura, Ibaraki, Japan,
    [17] Hong J. Image based homing. Proceedings of the IEEE
    International Conference on Robotics and Automation,
    Sacramento, CA, May 1991.
    [18] Yamazawa K, Yagi Y, Yachida M. Obstacle avoidance
    with omnidirectional image sensor hyperomni
    vision. Proceedings of the IEEE International Conference
    on Robotics and Automation, May 1995.
    p. 1062–7.
    [19] Nalwa V. A true omnidirectional viewer. Technical
    Report, Bell Laboratories, Holmdel, NJ 07733, USA,
    February 1996.
    [20] Svoboda T, Pajdla T, Hlavac V. Epipolar geometry
    for panoramic cameras. Fifth European Conference
    on Computer Vision, Freiberg, Germany, June 1998.
    p. 218–32.
    [21] Svoboda T, Pajdla T, Hlavac V. Central panoramic
    cameras: design and geometry. Third Computer Vision
    Winter Workshop, Gozd Martuljek, Slovenia, February
    [22] Aggarwal M, Ahuja N. High dynamic range panoramic
    imaging. Eighth IEEE International Conference on Computer
    Vision, ICCV2001, vol. 1, Vancouver, Canada, 2001.
    p. 2–9.
    [23] Stereo photography history
    D. Gledhill et al. / Computers & Graphics 27 (2003) 435–445 443
    [24] Pilu M. A direct method for stereo correspondence based
    on singular value decomposition. IEEE CVPR ’97, Puerto
    Rico, June 1997.
    [25] Tzovaras D, Grammalidis N, Strintzis MG. Disparity
    field and depth map coding for multiview3D image
    generation. Signal Processing: Image Communication
    [26] Medioni G, Tang C, Lee M. Tensor voting: theory and
    applications. In: 12eme Congres Francophone AFRIFAFIA
    de Reconnaissance des Formes et Intelligence
    Artificielle (RFIA), Paris, France, February 2000.
    [27] Aguiar PMQ, Moura JMF. Three-dimensional modelling
    from two-dimensional video. IEEE Transactions on Image
    Processing, 2001;10(10):1541–51.
    [28] Heckbert P. Projective mappings for image warping.
    Fundamentals of Texture Mapping and Image Warping
    [29] Heckbert P. Image warping and morphing. Fundamentals
    of Texture Mapping and Image Warping 1999;17–21.
    [30] Peleg S, Ben-Ezra M, Pritch Y. Omnistereo: panoramic
    stereo imaging. IEEE Transactions on Pattern Analysis
    and Machine Intelligence, 2001;23(3):279–90.
    [31] Peer P, Solina F. Mosaic-based panoramic depth imaging
    with a single standard camera. IEEE Workshop on
    Stereo and Multi-Baseline Vision, Kkauai, Hawaii, 2001.
    p. 75–84.
    [32] Zhang Z. A flexible newtechnique for camera calibration.
    IEEE Transactions on Pattern Analysis and Machine
    Intelligence 2000;22(11):1330–4.
    [33] Heikkila J. Geometric camera calibration using circular
    control points. IEEE Transactions on Pattern Analysis and
    Machine Intelligence, 2000;22(10):1066–77.
    [34] McMillan L. Acquiring immersive virtual environments
    with an uncalibrated camera. UNC-Chapel Hill Computer
    Science Technical Report #95-006, University of North
    Carolina, 1995.
    [35] Luong QT, Faugeras OD. Self-calibration of a moving
    camera from point correspondences and fundamental
    matrices. International Journal of Computer Vision,
    [36] Odone F, Fusiello A. Applications of 2D image registration.
    Research Memorandum RM/99/15, Heriot-Watt
    [37] Brown LG. A survey of image registration techniques.
    ACM Computing Surveys, 1992;24(4):325–76.
    [38] Zitnick CL, Kanade T. A cooperative algorithm for
    stereo matching and occlusion detection. IEEE Transactions
    on Pattern Analysis and Machine Intelligence,
    [39] Ziou D, Tabbone S. Edge detection techniques—an
    overview. Technical Report, No. 195, Dept Math &
    Informatique, Universit de Sherbrooke, 1997.
    [40] Bao P, Xu D. Complex wavelet-based image mosaics using
    edge-preserving visual perception modelling. Computers
    and Graphics 1999;23:309–21.
    [41] Kim HS, Kim HC, Lee WK, Kim CH. Stitching reliability
    for estimating camera focal length in panoramic image
    mosaicing. 15th International Conference on Pattern
    Recognition, Barcelona, Spain, 2000. p. 596–9.
    [42] Bourque E, Dudek G. Automated creation of image based
    virtual reality. Proceedings of the SPIE, Sensor Fusion and
    Decentralised Control in Autonomous Robotic Systems,
    vol. 3209, 1997. p. 292–301.
    [43] Schmid C, Mohr R, Bauckhage C. Evaluation of interest
    point detectors. International Journal of Computer Vision,
    [44] Zoghlami I, Faugeras O, Deriche R. Using geometric
    corners to build a 2D mosaic from a set of images.
    Proceedings of the International Conference on Computer
    Vision and Pattern Recognition, Puerto Rico, June 1997.
    [45] Mikolajczyk K, Schmid C. Indexing based scale invariant
    interest points. In: International Conference on Computer
    Vision, Vancouver, Canada, 2001. p. 525–31.
    [46] Schmid C, Mohr R. Image retrieval using local characterisation.
    Proceedings of the Third International Conference
    on Communicating by Image and Multimedia, Arcachon,
    France, May 1996. p. 45–50.
    [47] Lowe DG. Object recognition from local scale invariant
    features. Proceedings of the International Conference on
    Computer Vision, Corfu, September 1999.
    [48] Kanatani K, Ohta N. Accuracy bounds and optimal
    computation of homograph for image mosaicing
    applications. The Seventh International Conference on
    Computer Vision (ICCV ’99), Kerkyra, Greece, September
    [49] Fusiello A. Notes on the applications of homographies in
    computer vision. Research Memorandum RM/99/13,
    Department of Computing and Electrical Engineering,
    Heriot-Watt University, Edinburgh, UK, 1999.
    [50] Mann S, Picard RW. Virtual bellows: constructing high
    quality stills from video. M.I.T Media Laboratory
    Perceptual Computing Section Technical Report no. 259
    appears, Proceedings of the First IEEE International
    Conference on Image Processing, Austin, TX, November
    [51] Kourogi M, Kurata T, Hoshino J, Muraoka Y. Real-time
    image mosaicing from a video sequence. Proceedings of the
    ICIP ’99, vol. 4, Kobe, Japan, 1999. p. 133–7.
    [52] Zhu S, Hanson AR, Schultz H, Stolle F, Riseman EM.
    Stereo mosaics from a moving video camera for environmental
    monitoring. First International Workshop on
    Digital and Computational Video, Tampa, FL, USA,
    December 10, 1999.
    [53] Burt PJ, Adelson EH. A multiresolution spline with
    application to image mosaics. ACM Transactions on
    Graphics 1983;2(4):217–36.
    [54] Onoe Y, Yamazawa K, Takemura H, Yokoya N.
    Telepresence by real-time view-dependent image generation
    from omnidirectional video streams. Computer Vision
    and Image Understanding, 1998;71(2):153–65.
    [55] Dhond UR, Aggarwal JK. Structure from stereo—
    a review. IEEE Transactions on Systems, Man, and
    Cybernetics 1989;19(6):1489–510.
    [56] Hartley RI, Sturm P. Triangulation. Computer Vision and
    Image Understanding, 1997;68(2):146–57.
    [57] Tsai C, Katsaggelos AK. Dense disparity estimation with
    a divide-and-conquer disparity space image technique.
    IEEE Transactions on Multimedia, 1999;1(1):18–29.
    [58] Jelinek D, Taylor CJ. Reconstruction of linearly parameterized
    models from single images with a camera of
    unknown focal length. IEEE Transactions on Pattern
    Analysis and Machine Intelligence 2001;23(7):767–73.
    444 D. Gledhill et al. / Computers & Graphics 27 (2003) 435–445
    [59] Izquierdo E, Kruse S. Image analysis for 3D modelling,
    rendering and virtual viewgeneration . Computer Vision
    and Image Understanding, 1998;71(2):231–53.
    [60] Lee W, Gu J, Magnenat-Thalmann N. Generating
    animatable 3D virtual humans from photographs. Eurographics
    [61] Seitz SM, Dyer CR. Physically valid viewsynthesis by
    image interpolation. Proceedings of the Workshop on
    Representations of Visual Scenes, Cambridge, MA, 1995.
    [62] Debevec PE, Taylor CJ, Malik J. Modeling and rendering
    architecture from photographs: a hybrid geometry and
    image based approach. Proceedings of the ACM SIGGRAPH
    ’96, NewOrlean s, LA, 1996. p. 11–20.
    [63] Oh BM, Chen M, Dorsey J, Durand F. Image-based
    modeling and photo editing. SIGGRAPH, Los Angeles,
    CA, 2001. p. 433–42.
    [64] Aliaga DG, Carlbom I. Plenoptic stitching: a scalable
    method for reconstructing 3D interactive walkthroughs.
    Proceedings of the 28th Annual Conference on Computer
    Graphics and Interactive Techniques, Los Angeles, CA,
    August 2001. p. 443–50.
    [65] Huang H, Hung Y. Panoramic stereo imaging system with
    automatic disparity warping and seaming. Graphical
    models and Image Processing, 1998;60(3):196–208.
    [66] Pritch Y, Ben-Ezra M, Peleg S. Optics for omnistereo
    imaging. In: LS Davis, editor, Foundations of Image
    Understanding. Dordrecht: Kluwer Academic, 2001.
    p. 447–67.
    [67] Peleg S, Pritch Y, Ben-Ezra M. Cameras for stereo
    panoramic imaging. CVPR ’00, Hilton Head Island,
    2000. p. 208–14.
    [68] Svoboda T, Pajdla T. Panoramic cameras for 3D
    computation. Proceedings of the Czech Pattern Recognition
    Workshop, Czech Society for Pattern Recognition,
    Prague, Czech Republic, February 2000. p. 63–70.
    [69] Koyasu H, Miura J, Shirai Y. Real-time omnidirectional
    stereo for obstacle detection and tracking in dynamic
    environments. IEEE/RSJ International Conference on
    Intelligent Robots and Systems, 2001;1:31–6.
    [70] Szeliski R, Shum H. Creating full viewpanoramic
    image mosaics and environment maps. Computer
    Graphics Proceedings, Annual Conference Series,
    Proceedings of the SIGGRAPH ’97, Los Angeles, August
    1997. p. 251–8.
    [71] Lee K, Fung Y, Wong K, Or S, Lao T. Panoramic video
    representation using mosaic image. Proceedings of the
    CISST ’99, Las Vegas, USA, June 1999. p. 390–6.
    [72] Sun X, Foote J, Kimber D, Manjunath BS. Panoramic
    video capturing and compressed domain virtual camera
    control. Proceedings of the Ninth ACM International
    Conference on Multimedia, Ottawa, Canada, September
    2001. p. 329–47.
    [73] Shum H, Kang SB. A reviewof image-based rendering
    techniques. IEEE/SPIE Visual Communications and Image
    Processing (VCIP), Perth, 2000. p. 2–13.
    [74] Kiyokawa K, Kurata Y, Ohno H. An optical see-through
    display for mutual occlusion with a real-time stereovision
    system. Computers and Graphics 2001;25:765–79.
    [75] Finlayson GD, Tian GY. Colour normalisation for
    colour object recognition. International Journal of
    Pattern Recognition and Artificial Intelligence 1999;
    D. Gledhill et al. / Computers & Graphics 27 (2003) 435–445 445

    Depositing User: Sara Taylor
    Date Deposited: 22 Jun 2007
    Last Modified: 22 Nov 2011 10:04


    Downloads per month over past year

    Repository Staff Only: item control page

    View Item

    University of Huddersfield, Queensgate, Huddersfield, HD1 3DH Copyright and Disclaimer All rights reserved ©