Sample Image

Content-Adaptive User-Controllable Capture and Display

Overview: We have seen a tremendous advancement in the past decade by which very soon we will find cameras and projectors embedded in handheld devices like mobile phones and digital cameras. Most mobile devices nowadays are equipped with cameras. With the current advent of pico projectors, projection-enabled mobile devices are also getting popular. The first pico projector phone went on sale last winter and is available in Korea. Manufactured by Samsung it was show cased at CES in January 2009. In December 2009, AT&T introduced the LG eXpo phone which has a pico projector attachment. Rumor has it that Apple is not far behind with possible offerings in iPhone 5. Nikon is embedding pico projectors in other hand-held devices like digital cameras. With this trend, very soon users would seek greater control over the resources available in a display or a camera. Such resources include color resolution, spatial resolution, spectral resolution and so on. For example, they would want to target resolution at the most important object in the scene during capture or display. Or, they would want to change the spectral sensitivity of the primaries based on the scene illumination condition – e.g. CMY for dark scenes, RGB for bright scenes and 6-primary for colorful scenes. Thus, we envision content-adaptive user-controllable capture and display devices to be increasingly popular in the future. Already, we have started to see some work in this direction including the first multi-modal camera built at our lab in UCI that offers adaptive spectral sensitivity for optimal signal-to-noise ratio (SNR). There are also recent work on content-adaptive parallax-barrier displays. These allow users much greater user control over the device and hence are much more flexible than before.

Publications:

Switchable Primaries Using Shiftable Layers of Color Filter Arrays
Behzad Sajadi, Aditi Majumder, Kazuhiro Hiwada, Ramesh Raskar, Atsuto Maki.
ACM Siggraph (ToG), 2011
web page paper video
Geometric Stitching for Real-Time Panoramic Image Generation Using Texture Maps
Aditi Majumder, M. Gopi, Brent W. Seales, Henry Fuchs
ACM Multimedia, 1999
paper

Project Members: Aditi Majumder, M. Gopi, Behzad Sajadi

Funding: