Overclock.net banner

[guru3d] Would You Like To Have A Sixth Sense?

1967 Views 20 Replies 20 Participants Last post by  Lyshk0
Would You Like To Have A Sixth Sense?
By Thorsten Finck, March 12, 2009 - 7:07 PM

How about getting a sixth sense? Impossible, you say? Well, maybe not, if you're getting some help from MIT Media Lab's new Fluid Interfaces Group. SixthSense is the name of a device Pattie Maes, associate professor in MIT's Program in Media Arts and Sciences and founder of the Fluid Interfaces Group, presented at this year's TED, an annual conference that brings together the world's most fascinating thinkers and doers. Pranav Mistry, Research Assistant and PhD candidate at the MIT Media Lab, is the "brain" behind SixthSense, who actually designed and implemented the whole system.

Take a cellphone, a pocket projector, a mirror and a camera. Put everything together so that you can wear it like a pendant around your neck, and you're almost there. Now, use the cellphone to connect you to the information avaliable online. Et voila. You just created a wearable gestural interface that lets you use natural hand gestures to interact with that information - your SixthSense.

Here is how it actually works: "The projector projects visual information enabling surfaces, walls and physical objects around us to be used as interfaces; while the camera recognizes and tracks user's hand gestures and physical objects using computer-vision based techniques. The software program processes the video stream data captured by the camera and tracks the locations of the colored markers (visual tracking fiducials) at the tip of the user’s fingers using simple computer-vision techniques. The movements and arrangements of these fiducials are interpreted into gestures that act as interaction instructions for the projected application interfaces. The maximum number of tracked fingers is only constrained by the number of unique fiducials, thus SixthSense also supports multi-touch and multi-user interaction."

Some, already working, applications for which you could use the SixthSense are: "The map application lets the user navigate a map displayed on a nearby surface using hand gestures, similar to gestures supported by Multi-Touch based systems, letting the user zoom in, zoom out or pan using intuitive hand movements. The drawing application lets the user draw on any surface by tracking the fingertip movements of the user’s index finger. SixthSense also recognizes user’s freehand gestures (postures). For example, the SixthSense system implements a gestural camera that takes photos of the scene the user is looking at by detecting the ‘framing’ gesture. (...) The SixthSense system also augments physical objects the user is interacting with by projecting more information about these objects projected on them. For example, a newspaper can show live video news or dynamic information can be provided on a regular piece of paper. The gesture of drawing a circle on the user’s wrist projects an analog watch."

Another amazing thing is that the current prototype system costs approximate $350 to build.
Now you can avoid that using cell phone while driving fine by using sign language.

This seems to me like one of those gateway technologies that will lead to great things to come. Good work MIT.
See less See more
  • Rep+
Reactions: 1
1 - 20 of 21 Posts

Originally Posted by dharmaBum View Post
It's important to keep in mind, computers do one thing exceptionally well - exactly what we tell them to do (to the chagrin of many an unclear programmer). That they may do that fast isn't all too impressive on its own. The equation itself is just consistent gibberish, the thought behind it is what is inspiring.
cool stuff.
See less See more
So you can interact with the internet by using your fingers on any surface? Is that what I'm seeing? That's pretty gol dang cools.
woww interesting concept
figures its from MIT
See less See more
I don't know... I am not feeling it. I would have to try it out myself, and then I am pretty sure I wouldn't like it on an everyday bases, and go back to my mouse and keyboard.
I guess for those who see dead people, this would be a seventh sense.
Scientists at MIT reach new heights of nerdiness
Next weeks article:


Scientist at MIT make happy time with motherboard... Experiments with new human input devices!

This is a highlight movie from TED:


It is insanely impressive.


This demo -- from Pattie Maes' lab at MIT, spearheaded by Pranav Mistry -- was the buzz of TED. It's a wearable device with a projector that paves the way for profound interaction with our environment. Imagine "Minority Report" and then some.

Turns out he was dead the whole time...

That is pretty freaking cool, though. Imagine FPS games where you are literally immersed. Enter a white room and project the game in front, back, all around. Too damn cool.
I don't think this will catch on till they can put the projection in a contact lens or something more discrete
Umm. Repost...

Please merge with the original thread!
New source same article subject!
as per posted repost rules!
[Edit] (nice video BTW)
See less See more
that is sooooooo freaking cool! i love the way that it works. its a bit big for mass production but im sure that they will sort somthing out and make it smaller.

the finger bit is a bit wierd but i guess that its neccesary for the product to work. i cant wait for the main stream product to hit the shelves.
At the beginning the tension was building up and I was getting goosebumps, but then she started talking about toilet paper...
I'm sorry but I don't know if this will catch on entirely. No tactile response is the biggest problem for me. I don't wanna push buttons that don't exist. Also that is information overload for the most part. I purchase based on price for the most part. Big purchases are what I research and those require MUCH more research than what I'd like to do while standing there. As for info on PEOPLE??? Heck no. I'd rather find out by asking someone about them... preferably the person I'm talking to!

BUUUUT! This technology will have its place I'm sure of it. And it is quite innovative. My hat is off to them for developing it.
See less See more
Thats frickin cool.

Next will be cyberbrains, I tells you. Like the ones in Ghost In The Shell
See less See more
Not practical enough, not enough data on every item.

No thanks.

Originally Posted by justarealguy
View Post

Not practical enough, not enough data on every item.

No thanks.

But there could easily be.

I think this is a good idea, especially with wireless internet becoming this mainstream - 7.2 mbit on HSDPA right now. Most likely 20 mbit wireless within the next 2 years, and also with a much lower ping. 100ms on HSDPA is not unrealistic, and most likely we'll have new technologies that allow us to go even lower (or by just simply putting antennas closer. 2 ms on standard wireless at 5 meters).

The big limiter in this is the projection, and the camera. You need pretty ideal lightning conditions for the camera to actually work.
See less See more
1 - 20 of 21 Posts
This is an older thread, you may not receive a response, and could be reviving an old thread. Please consider creating a new thread.