Computer Graphics and Visualization Lab
Department of Computer Science at Purdue University

Differences

This shows you the differences between the selected revision and the current version of the page.

projects:sea_of_images 2008/09/15 15:24 projects:sea_of_images 2008/09/15 21:26 current
Line 1: Line 1:
====== Sea of Images ====== ====== Sea of Images ======
-^ Summary  ^^^^+^ **Summary** ^^^^
| **Visual simulation** of large real-world environments is one of the grand challenges of computer graphics. Applications include remote education, virtual heritage, specialist training, electronic commerce, and entertainment. In this project, we present a “Sea of Images,” an image-based approach to providing interactive and photorealistic walkthroughs of complex indoor environments. Our strategy is to obtain a dense sampling of viewpoints in a large static environment with omnidirectional images. We use a motorized cart to capture omnidirectional images every few inches on an eye-height plane throughout an environment. We then compress and store the images in a multiresolution hierarchy suitable for real-time prefetching to produce interactive walkthroughs.  Finally, we render novel images for a simulated observer viewpoint using a feature-based warping algorithm. Our system acquires and preprocesses over 15,000 images covering more than 1000 square feet of environment space with the average distance from a random point on the eye-height plane to a captured image being 1.5 inches. The average capture and processing time is 7 hours. We demonstrate photorealistic walkthroughs of real-world environments reproducing specular reflections and occlusion effects while rendering 20-30 frames per second.  |||| | **Visual simulation** of large real-world environments is one of the grand challenges of computer graphics. Applications include remote education, virtual heritage, specialist training, electronic commerce, and entertainment. In this project, we present a “Sea of Images,” an image-based approach to providing interactive and photorealistic walkthroughs of complex indoor environments. Our strategy is to obtain a dense sampling of viewpoints in a large static environment with omnidirectional images. We use a motorized cart to capture omnidirectional images every few inches on an eye-height plane throughout an environment. We then compress and store the images in a multiresolution hierarchy suitable for real-time prefetching to produce interactive walkthroughs.  Finally, we render novel images for a simulated observer viewpoint using a feature-based warping algorithm. Our system acquires and preprocesses over 15,000 images covering more than 1000 square feet of environment space with the average distance from a random point on the eye-height plane to a captured image being 1.5 inches. The average capture and processing time is 7 hours. We demonstrate photorealistic walkthroughs of real-world environments reproducing specular reflections and occlusion effects while rendering 20-30 frames per second.  ||||
| {{:wiki:projects:sea_of_images:omnicamera.jpg?200|}} \\ Omnidirectional camera used by our system | {{:wiki:projects:sea_of_images:acq-robot.jpg?200|}} \\ Mobile robot used for acquiring sea of images | {{:wiki:projects:sea_of_images:fiducials.jpg?300|}} \\ Fiducials and example planning system used to obtain images with a guaranteed pose accuracy || | {{:wiki:projects:sea_of_images:omnicamera.jpg?200|}} \\ Omnidirectional camera used by our system | {{:wiki:projects:sea_of_images:acq-robot.jpg?200|}} \\ Mobile robot used for acquiring sea of images | {{:wiki:projects:sea_of_images:fiducials.jpg?300|}} \\ Fiducials and example planning system used to obtain images with a guaranteed pose accuracy ||
Line 11: Line 11:
| {{:wiki:projects:sea_of_images:comp1.jpg?400|}} {{:wiki:projects:sea_of_images:comp2.jpg?400|}} \\ **Captured vs. Reconstructed Comparison.** (left) A captured omnidirectional image. (right) A reconstructed omnidirectional image for a novel viewpoint that is as far as possible from the surrounding images. |||| | {{:wiki:projects:sea_of_images:comp1.jpg?400|}} {{:wiki:projects:sea_of_images:comp2.jpg?400|}} \\ **Captured vs. Reconstructed Comparison.** (left) A captured omnidirectional image. (right) A reconstructed omnidirectional image for a novel viewpoint that is as far as possible from the surrounding images. ||||
-^ Publications ^+^ **Publications**  ^
| <HTML><script language="JavaScript" src="http://wiki.cs.purdue.edu/cgvlab/pubs/publication_js.php?project=24"></script></HTML>  | | <HTML><script language="JavaScript" src="http://wiki.cs.purdue.edu/cgvlab/pubs/publication_js.php?project=24"></script></HTML>  |
-^ People ^+^ **People**  ^
| <HTML><script language="JavaScript" src="http://wiki.cs.purdue.edu/cgvlab/pubs/people_js.php?project=24"></script></HTML>  | | <HTML><script language="JavaScript" src="http://wiki.cs.purdue.edu/cgvlab/pubs/people_js.php?project=24"></script></HTML>  |
 +
 +
 

projects/sea_of_images.txt · Last modified: 2008/09/15 21:26 by rosenpa
  [Main Page]   [Projects]   [Publications]   [People]   [Courses]   [Talks]