NEWS /

Indian Students in US Pioneer Photo Embedding in Videos

22 Nov, 2008, 3:46 pm IST | IANS |

Two Indian students in the US are among a group of researchers who have developed ZunaVision, a technology that allows you to view a video and change a still photo inside it.

The Stanford University researchers, computer science graduate students Ashutosh Saxena and Siddharth Batra, and assistant professor Andrew Ng, say the technology will have many uses, Science Daily reported.

For instance, suppose a favorite video of a birthday party is marred by a small, troubling detail - in it is a photograph of your ex-wife. ZunaVision will allow you to "take down" the photo - and replace it with your current wife's photo.

The researchers said the software can place an image on almost any plane surface in a video - it can even insert a video inside a video.

This, for instance, opens up the possibility of your singing karaoke side-by-side with your favorite singer. Or livening up those dull vacation videos.

The researchers said that anyone with a video camera might now earn some spending money by agreeing to have unobtrusive corporate logos placed inside their videos before they are posted online.

The person who shot the video, and the company handling the business arrangements, would be paid per view, in a fashion analogous to Google AdSense, which pays websites to run small ads.

The embedding technology is driven by an algorithm that first analyses the video, with special attention paid to the section of the scene where the new image will be placed.

The color, texture and lighting of the new image are subtly altered to blend in with the surroundings. Shadows seen in the original video will be seen in the added image as well. The result is a photo or video that appears to be an integral part of the original scene, rather than a sticker pasted artificially on the video.

The algorithm ("3D Surface Tracker Technology") used to produce these realistic results is also capable of dealing with what researchers call "occluding objects" in the video - a guest walking in front of the newly hung photo.

It achieves this by first building a model, pixel by pixel, of the area of interest in the video.

"If the lighting begins to change with the motion of the video or the sun or the shadows, we keep a belief of what it will look like in the next frame. This is how we track with very high sub-pixel accuracy," Batra said.

"It's as if the embedded image makes an educated guess of where the wall is going next, and hurries to keep up."

Other technologies can perform these tricks - witness the spectacular special effects in movies and the virtual first-down lines on televised football games - but the Stanford researchers say the existing systems are expensive, time consuming and require considerable expertise.

Some of the recent Stanford work grew out of an earlier project, Make3D, a website that converts a single still photograph into a brief 3D video. It works by finding planes in the photo and computing their distance from the camera, relative to each other.

"That means, given a single image, our algorithm can figure out which parts are in the front and which parts are in the background," said Saxena. "Now we have extended this technology to videos."
RELATED STORIES

Protests erupt across Europe against web piracy treaty

Protests erupt across Europe against web piracy treaty

Tens of thousands of protesters took part in rallies across Europe on Saturday against an international anti-piracy agreement they fear will curb their freedom

Google is getting new test labs and 'Experience Center' at Googleplex

U.S government agency replaces BlackBerry with iPhone

SwaggSec hacks Foxconn, uses unpatched IE

Intex launches new 3D dual SIM touch phone, the Avatar

Yahoo! India adds Bengali to its local language base

Sony flashes MDR-EX42 Swarovski Zirconia in-ear headphones

 

Photos

Mugen Power Galaxy Note Battery Pack

Mugen Power Galaxy Note Battery Pack

30 Jan, 2012, 12:52 PM

3.1

Samsung Galaxy Tab 620

Samsung Galaxy Tab 620

25 Jan, 2012, 01:29 PM

3.1

LG Optimus Black P970

LG Optimus Black P970

24 Jan, 2012, 06:11 PM

3.9

MORE PHOTOS

Leaked Images, Availability, Pricing,
Specs, Pre-order

OPINIONS

Ivor Soans

How time flies. A few weeks ago the BlackBerry world was mad at RIM for a massive 3-day outage. Now,...

MORE OPINIONS

features

Market Watch: Tablets (Feb 2012)

Market Watch: Tablets (Feb 2012)

Tablets have been making rounds for a while now, but it wasn’t until a...

By Roydon Cerejo , Rajesh D'souza

Resident Evil: Operation Raccoon City Interview

Resident Evil: Operation Raccoon City Interview

We sit down and talk to producer Mike Jones who assures us that fans have...

By Avinash Bali

Top smartphones under Rs. 15,000

Top smartphones under Rs. 15,000

The 15K budget has been a sweet deal for those not wanting to spend extra...

By Karan Shah

MORE FEATURES

626 views

926 views

577 views

MORE WALLPAPERS

How To: Install ICS on your Galaxy S

How To: Install ICS on your Galaxy S

10 Feb, 2012, 05:23 AM

On video: MSI WindPad Enjoy 10

On video: MSI WindPad Enjoy 10

09 Feb, 2012, 04:50 AM

On Video: Mercury mTab Neo

On Video: Mercury mTab Neo

08 Feb, 2012, 10:18 AM

2.8

MORE VIDEOS

Close

More from this Author

Android Roars Past iPhone in US