|
Published Articles >> Table of Contents >> Abstract
February 2004 (Vol. 26, No. 2)
pp. 226-237
Generalized Parallel-Perspective Stereo Mosaics from Airborne Video
Zhigang Zhu, IEEE
Allen R. Hanson, IEEE
Edward M. Riseman, IEEE
Full Article Text:
   
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/TPAMI.2004.1262190
Send link to a friend
| Abstract |
|
In this paper, we present a new method for automatically and efficiently generating stereoscopic mosaics by seamless registration of images collected by a video camera mounted on an airborne platform. Using a parallel-perspective representation, a pair of geometrically registered stereo mosaics can be precisely constructed under quite general motion. A novel parallel ray interpolation for stereo mosaicing (PRISM) approach is proposed to make stereo mosaics seamless in the presence of obvious motion parallax and for rather arbitrary scenes. Parallel-perspective stereo mosaics generated with the PRISM method have better depth resolution than perspective stereo due to the adaptive baseline geometry. Moreover, unlike previous results showing that parallel-perspective stereo has a constant depth error, we conclude that the depth estimation error of stereo mosaics is in fact a linear function of the absolute depths of a scene. Experimental results on long video sequences are given.
|
 References
|
[1] J. Chai and H.-Y. Shum, Parallel Projections for Stereo Reconstruction Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR '00), pp. 493-500, 2000.
[2] R. Gupta and R. Hartley, Linear Pushbroom Cameras IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 9, pp. 963-975, Sept. 1997.
[3] H.-C. Huang and Y.-P. Hung, Panoramic Stereo Imaging System with Automatic Disparity Warping and Seaming Graphical Models and Image Processing, vol. 60, no. 3, pp. 196-208, 1998.
[4] M. Irani, P. Anandan, J. Bergen, R. Kumar, and S. Hsu, Efficient Representations of Video Sequences and Their Applications Signal Processing: Image Comm., vol. 8, no. 4, pp. 327-351, May 1996.
[5] M. Irani and P. Anandan, Video Indexing Based on Mosaic Representations IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 86, no. 5, pp. 905-921, 1998.
[6] G. Canfora and A. Cimitile, "Reverse Engineering and Intermodular Data Flow: A Theoretical Approach," Software Maintenance: Research and Practice, vol. 4, pp. 37-59, 1992.
[7] R. Kumar, P. Anandan, M. Irani, J. Bergen, and K. Hanna, “Representation of Scenes from Collections of Images,“ Proc. IEEE Workshop Representation of Visual Scenes, pp. 10-17, June 1995.
[8] R. Kumar, H. Sawhney, J. Asmuth, J. Pope, and S. Hsu, Registration of Video to Geo-Registered Imagery Proc. IAPR Int'l Conf. Pattern Recognition (ICPR '98), vol. 2, pp. 1393-1400, 1998.
[9] D.L. Milgram, Adaptive Techniques in Photo Mosaicing IEEE Trans. Computers, vol. 26, pp. 1175-1180, 1977.
[10] D.D. Morris and T. Kanade, Image-Consistent Surface Triangulation Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR '00), pp. 332-338, June 2000.
[11] M. Okutomi and T. Kanade, “A Multiple-Baseline Stereo,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 15, no. 4, pp. 353-363, Apr. 1993.
[12] S. Peleg and J. Herman, “Panoramic Mosaics by Manifold Projection,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 338-343, June 1997.
[13] S. Peleg and M. Ben-Ezra, Stereo Panorama with a Single Camera Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR '99), pp. 395-401, 1999.
[14] S. Peleg, M. Ben-Ezra, and Y. Pritch, Omnistereo: Panoramic Stereo Imaging IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 3, pp. 279-290, 2001.
[15] B. Rousso, S. Peleg, I. Finci, and A. Rav-Acha, Universal Mosaicing Using Pipe Projection Proc. IEEE Int'l Conf. Computer Vision (ICCV '98), pp. 945-952, 1998.
[16] H.S. Sawhney, "Simplifying Motion and Structure Analysis Using Planar Parallax and Image Warping," Proc. Int'l Conf. Pattern Recognition, 1994.
[17] H.S. Sawhney, R. Kumar, G. Gendel, J. Bergen, D. Dixon, and V. Paragano, VideoBrush: Experiences Consumer Video Mosaicing Proc. IEEE Workshop Applications of Computer Vision (WACV '98), pp. 56-62, Oct. 1998.
[18] H. Schultz, Terrain Reconstruction from Widely Separated Images Proc. SPIE, vol. 2486, pp. 113-123, Apr. 1995.
[19] H.-Y. Shum and L.-W. He, Rendering with Concentric Mosaics Proc. SIGGRAPH '99, pp. 299-306, Aug. 1999.
[20] H.-Y. Shum and R. Szeliski, Stereo Reconstruction from Multiperspective Panoramas Proc. IEEE Int'l Conf. Computer Vision (ICCV '99), pp. 14-21, 1999.
[21] H.-Y. Shum and R. Szeliski, Construction of Panoramic Image Mosaics with Global and Local Alignment Int'l J. Computer Vision, vol. 36, no. 2, pp. 101-130, 2000.
[22] Manual of Photogrammetry, fourth ed. C.C. Slama ed., Am. Soc. of Photogrammetry, 1980.
[23] D. Slaymaker, H. Schultz, A. Hanson, E. Riseman, C. Holmes, M. Powell, and M. Delaney, Calculating Forest Biomass with Small Format Aerial Photography, Videography and a Profiling Laser Proc. 17th Biennial Workshop Color Photography and Videography in Resource Assessment, 1999.
[24] R. Szeliski and S.B. Kang, “Direct Methods for Visual Scene Reconstruction,” Proc. Workshop Representations of Visual Scenes, 1995.
[25] J.Y. Zheng and S. Tsuji, Panoramic Representation for Route Recognition by a Mobile Robot Int'l J. Computer Vision, vol. 9, no. 1, pp. 55-76, 1992.
[26] Z. Zhu, A.R. Hanson, H. Schultz, F. Stolle, and E.M. Riseman, Stereo Mosaics from a Moving Video Camera for Environmental Monitoring Proc. First Int'l Workshop Digital and Computational Video, pp. 45-54, 1999.
[27] Z. Zhu, G. Xu, and X. Lin, Panoramic EPI Generation and Analysis of Video from a Moving Platform with Vibration Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR '99), pp. 531-537, 1999.
[28] Z. Zhu, PRISM: Parallel Ray Interpolation for Stereo Mosaics http://www-cs.engr.ccny.cuny.edu/~zhuStereoMosaic.html orhttp://www-cs.engr.ccny.cuny.edu/~zhu/StereoMosaic.htmlhttp:/ /www.cs.umass.edu/ ~zhuStereoMosaic. html, 2000.
[29] Z. Zhu, E.M. Riseman, and A.R. Hanson, Theory and Practice in Making Seamless Stereo Mosaics from Airborne Video Technical Report #01-01, Computer Science Dept., Univ. of Massachusettes-Amherst, Jan. 2001, http://www.cs.umass.edu/zhu UM-CS-2001-001.pdf .
[30] Z. Zhu, E.M. Riseman, and A.R. Hanson, "Parallel-Perspective Stereo Mosaics," Proc. Eighth IEEE Int'l Conf. Computer Vision, IEEE CS Press, vol. I, 2001, pp. 345-352.
[31] Z. Zhu, A.R. Hanson, H. Schultz, and E.M. Riseman, Generation and Error Characteristics of Parallel-Perspective Stereo Mosaics from Real Video Video Registration, M. Shah and R. Kumar, eds., Video Computing Series, Kluwer Academic, pp. 72-105, May 2003.
[32] A. Zomet, S. Peleg, and C. Arora, “Rectified Mosaicing: Mosaics without the Curl,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 459-465, June 2000.
|
 Additional Information
|
Index Terms- Mosaicing, stereo vision, visual representation, epipolar geometry, image registration, view interpolation, airborne video analysis.
Citation:
Zhigang Zhu, Allen R. Hanson, Edward M. Riseman,
"Generalized Parallel-Perspective Stereo Mosaics from Airborne Video,"
IEEE Transactions on Pattern Analysis and Machine Intelligence,
vol. 26,
no. 2,
pp. 226-237,
Feb.,
2004
|
|
RSS Feed