Three dimensional video tracking has been around for a while but it is generally restricted to high end packages. If you have ever wanted to tag data onto video objects, analyse traffic flows and pedestrian paths or augment scenes then the video below brings it a step closer to consumer level:
Interactive Video Object Manipulation from Dan Goldman on Vimeo.
For more information take a look at the following publications:
Goldman, D. B, Gonterman, C., Curless, B., Salesin, D., and Seitz, S. M. 2008. Video object annotation, navigation, and composition. In UIST '08: Proceedings of the 21st annual ACM symposuim on User Interface Software and Technology, 3–12.
Goldman, Daniel R. 2007. A framework for video annotation, visualization, and interaction, PhD Thesis, University of Washington.Goldman, D. B., Curless, B., Seitz, S. M., and Salesin, D. H. 2006. Schematic storyboarding for video visualization and editing. ACM Transactions on Graphics (Proc. SIGGRAPH), 25(3), 862–871.