Realtime video tracking with a pan-tilt camera

Arduino Photography & Video
Realtime video tracking with a pan-tilt camera
tracking_overview.jpg

UMass Amherst hardware hackers Blake Foster, Rui Wang, and Erik Learned-Miller built this articulated realtime tracking rig using a GPU, Arduino, and FPV Pan-Tilt camera. [Thanks, Rui!]

The human eye is amazingly adept at tracking moving objects. The process is so natural to humans that it happens without any conscious effort. While this remarkable ability depends in part on the human brain’s immense processing power, the fast response of the extraocular muscles and the eyeball’s light weight are also vital. Even a small point and shoot camera mounted on a servo is typically too heavy and slow to move with the agility of the human eye. How, then, can we give a computer the ability to track movement quickly and responsively?

Thanks to recent progress in camera miniaturization, small, easily manipulable cameras are now readily available. In this project, we use a first person view (FPV) camera intended for use on model airplanes. The camera is mounted on servo motors which can aim the camera with two degrees of freedom. The entire assembly weighs only 32 grams, only slightly more than a typical human eyeball. Coupled with a GPU-based tracking algorithm, the FPV camera allows the computer to robustly track a wide array of patterns and objects with excellent speed and stability.

What will the next generation of Make: look like? We’re inviting you to shape the future by investing in Make:. By becoming an investor, you help decide what’s next. The future of Make: is in your hands. Learn More.

Tagged

I make cool stuff and write about other people making cool stuff on makezine.com. If you have something you think I should see, send me a tip.

View more articles by Adam Flaherty
Discuss this article with the rest of the community on our Discord server!

ADVERTISEMENT

Escape to an island of imagination + innovation as Maker Faire Bay Area returns for its 16th iteration!

Prices Increase in....

Days
Hours
Minutes
Seconds
FEEDBACK