Wearable metadata

Computers & Mobile Craft & Design Fun & Games Technology
Wearable metadata

Patty Maes of the Fluid Interfaces Group at the MIT Media Lab introduces what may be the must have gadget in the not so far future.

The SixthSense prototype is comprised of a pocket projector, a mirror and a camera. The hardware components are coupled in a pendant like mobile wearable device. Both the projector and the camera are connected to the mobile computing device in the user’s pocket. The projector projects visual information enabling surfaces, walls and physical objects around us to be used as interfaces; while the camera recognizes and tracks user’s hand gestures and physical objects using computer-vision based techniques. The software program processes the video stream data captured by the camera and tracks the locations of the colored markers (visual tracking fiducials) at the tip of the user’s fingers using simple computer-vision techniques. The movements and arrangements of these fiducials are interpreted into gestures that act as interaction instructions for the projected application interfaces. The maximum number of tracked fingers is only constrained by the number of unique fiducials, thus SixthSense also supports multi-touch and multi-user interaction.


Thanks Lyle and Susan.

Want to give this system a try? She says it can be made from off the shelf parts for just $350. Post up your ideas in the comments, and show us your stuff in the MAKE Flickr pool.

14 thoughts on “Wearable metadata

  1. Wifigod says:

    I really hope they release the software for this under an open source license. This platform would benefit greatly if everybody was allowed to contribute. If not, I think an alternative open source project would definitely be created and end up surpassing the usability of the MIT version.

    1. Anonymous says:

      a few years after the internet became popular, everyone’s got a website

      a few years after this goes live, everyone’s going to have data tags on their products so people’s gadgets can pull up information about it

      wonder what people will call it… Teds?, (Let my Ted look that up) hehe

  2. Silverman says:

    We need more videos where the graduate student gets a standing ovation at his advisor’s presentation.

  3. Monica N says:

    This would probably be better if they found a way to not have to use a phone. It would make it cheaper and the system would be able to stand alone.

  4. ted says:

    wow… with my name being Ted and all, this looks cool (and a bit scary all at the same time.

  5. Mark L says:

    So, let’s open up the discussion again: Does technology like this make us smarter or dumber?

Comments are closed.

Discuss this article with the rest of the community on our Discord server!

Making things is the best way to learn about our world.

View more articles by Chris Connors