Researchers from the University of Washington’s Graphics and Imaging Laboratory are developing video enhancement software which utilizes data from related still images. Currently only for use with ‘still-life’ scenes, the process incorporates information from higher resolution photos and automatically maps it to the corresponding areas of the video in need of improvement – increasing resolution, dynamic range, ligthing, and even masking specified areas.
Unlike traditional visual effects software (e.g., After Effects, Shake, Boujou, etc), the system is completely automatic and no manual labor is required from the user. The major limitation of the work is that it can currently handle only videos of static scenes (i.e., videos shot with a moving camera but containing no moving objects in the scene). Efforts are being made to lift this restriction in future work.
Pretty amazing results, especially if the software works as effortlessly as described. Unfortunately rendering times currently required are even more impressive – taking a Linux server farm 5 minutes to churn out a single frame! Developers say this will improve after forthcoming optimizations.
– Using Photographs to Enhance Videos of a Static Scene [via Gizmodo]
4 thoughts on “Photographically enhanced video”
Comments are closed.
ADVERTISEMENT
Join Make: Community Today
That is simply freaking AMAZING. Where do I sign??
/builds a server farm solely for this purpose.
I saw this paper a while back. It’s simply amazing…I can think of so many applications (using current SD footage as source tracking data and using photos to generate better up-res’d footage, and I simply love their motion stabilization).
Microsoft’s image labs recently put something out as well:
http://research.microsoft.com/unwrap/
Basically, it ‘unwraps’ a 3D texture from a subject in a scene, allowing you to easily make changes to video, such as adding a beard, glasses, removing a logo, etc.