Abstract:Image mosaics are useful for a variety of tasks in vision and computer graphics. A particularly convenient way to generate mosaics is by `stitching' together many ordinary photographs. Existing algorithms focus on capturing static scenes. This paper presents a complete system for creating visually pleasing mosaics in the presence of moving objects. There are three primary contributions. The first component of our system is a registration method that remains unbiased by movement-the Mellin transform is extended to register images related by a projective transform. Second, an efficient method for finding a globally consistent registration of all images is developed. By solving a linear system of equations, derived from many pairwise registration matrices, we find an optimal global registration. Lastly, a new method of compositing images is presented. Blurred areas due to moving objects are avoided by segmenting the mosaic into disjoint regions and sampling pixels in each region from a single source image.
Davis, J., "Mosaics of Scenes with Moving Objects", IEEE Comp. Soc. Conf.
on Computer Vision and Pattern Recognition (CVPR98), 1998. [Postscript,
5.5MB]
[PDF 2.7MB]
|
 |
Straightforward compositing of source images can lead to blurred mosaics in regions with moving objects. [Image 102KB] |
 |
Segmenting the final mosaic into regions and drawing image samples from a single source image in each region results in a single focused image. [Image 110KB] |
 |
The initial frames from which the construction site mosaic was computed. [Quicktime 1.4MB] |
 |
Accumulated error can cause noticable artifacts when a sequence of many images is composited into a single mosaic. Images near the end of the sequence are poorly aligned with those near the beginning. [Image 100KB] |
 |
Using a global registration routine to insure that all images are mutually registered results in a much improved mosaic. [Image 73KB] |
 |
The initial frames from which the chapel facade mosaic was computed. [Quicktime 4.9MB] |
 |
A complete panorama outside of the Gates Computer Science Building. [Image 133KB] |
 |
Gates Building as a Quicktime VR file for panormaric viewing. [QTVR 180KB] |
|
The initial frames from the Gates panorama. [Quicktime 3.9MB] |
 |
A complete panorama in the Roudin sculpture garden. [Image 51KB] |
 |
Roudin Garden as a Quicktime VR file for panormaic viewing. [QTVR 87KB] |
|
The initial frames from the Roudin panorama. [Quicktime 1.2MB] |