|
Hardware
Hardware description of SixthSense.
Create your own SixthSense DeviceSo you want to make your own SixthSense Device. Now what? ComponentsCameraThe camera is the key input device of the SixthSense system. The camera acts as a digital eye of the system. It basically captures the scene the user is looking at. The video stream captured by the camera is passed to mobile computing device which does the appropriate computer vision computation. The major functions of the camera can be listed as:
Suggested Product: Logitech QuickCam Pro for notebooks ProjectorThe projector is the key output device of the SixthSense system. The projector visually augments surfaces, walls and physical objects the user is interacting with by projecting digital information and graphical user interfaces. The mobile computing device provides the projector with the content to be projected. The projector unit used in prototype runs on a rechargeable battery. The major functions of the projector can be listed as:
Suggested Products: You can buy either laser (AAXA, Microvision) or L.E.D (3M MPro110) projectors. MirrorThe mirror reflects the projection coming out from the projector and thus helps in projecting onto the desired locations on walls or surfaces. The user manually can change the tilt of the mirror to change the location of the projection. For example in application where the user wants the projection to go on the ground instead of the surface in front, he can change the tilt of the mirror to change the projection. Thus, the mirror in the SixthSense helps in overcoming the limitation of the limited projection space of the projector. Suggested Product: Any 1”X1” first surface mirror MicrophoneThe microphone is an optional component of the SixthSense. It is required when using a paper as a computing interface. When the user wants to use a sheet of paper as an interactive surface, he or she clips the microphone to the paper. The microphone attached this way captures the sound signals of user’s touching the paper. This data is passed to computing device for processing. Later, combined with the tracking information about user’s finger, the system is able to identify precise touch events on the paper. Here, the sound signal captured by the microphone provides time information whereas the camera performs tracking. The applications enabled by this technique are explained earlier. Suggested Product: Microphone of Logitech QuickCam pro for notebooks Mobile computing deviceThe SixthSense system uses a mobile computing device in user’s pocket as the processing device. The software program enabling all the features of the system runs on this computing device. This device can be a mobile phone or a small laptop computer. The camera, the projector and the microphone are connected to this device using wired or wireless connection. The detail of the software program that runs on this device is provided in next section. The mobile computing device is also connected to the Internet via 3G network or wireless connection. Suggested Product: Any Windows computer For a more detailed list of resources, along with prices check Links / Resources
Now that you have all these pieces, you need a way to combine them. We recommend using Lego strips to form the base. The projector, camera, and mirror assembly can be directly put onto this base. You can also use Velcro to combine the products.
|
you have described all about the hardware configuration but didn't mention how these devices connected with each other and how it works..?
The connections seem reasonably obvious to me: the USB camera is plugged into the computer's USB port. The microphone is plugged into the computer's microphone jack; or if it communicates with the computer via USB, it's probably already plugged in together with the USB camera.
The projector is plugged into the VGA port and projects downward toward the user's feet. The mirror is placed just below the projector, reflecting the image onto objects in front of the user. This is mostly for convenience so you won't have a long projetor sticking out in front of you. The camera points forward.
The rest is a job for the software.
but on what platform it works.....how the code is written???????
The text states that the prototype is running on a Microsoft Windows computer. According to the software pages, the code is written in C/C++ and will be available (hopefully) shortly.
can you attach some instruction on how to use the hardware and software :P
will you market it? please do ;-)
how does it connects
Hey, im really interested in this device but through these instructions i cant seem to find a clear way to run and connect all the components of the device CAN SOMEONE PLEASE ANSWER BACK WITH SOME THOROUGH ANSWERS TO THIS QUESTION .... ANYONE.
Nevermind ^ i got how to connect it all ... but how do u run it???
Whats the point of the color markers and then lego strips??
Hi there mate, when will the OpenSource? Code be available to download? please let us know, its a very interesting project you got there! congrats and thanks for sharing.
i cant understand what those color markers are.......?? what is it made up of.......??? what is its specialty.......??? why do we need to use color markers instead of our fingers.....??? what is the diff if we use our finger or a color marker.....???
please reply soon to my email id : n.neelesh.ganan@gmail.com
i am doing a documentation on it in my college. so i need ur response sooooooooonnnnn
@shababa...@gmail.com , @ neelesh...@yahoo.co.in : Color markers are at the tip of the user’s fingers .Marking the user’s fingers with red, yellow, green, and blue tape helps the webcam recognize gestures. The movements and arrangements of these makers are interpreted into gestures that act as interaction instructions for the projected application interfaces.
i want a clear concept to make it upon please tel me
It would also help u could make video on YouTube? on step be step instructions on how to make it.
From where should the software be downloaded for this???? Plz reply as soon as possible cuz i've already made that thing but just want to know what to do next??? Tnx in advance
HOW TO RUN THIS
First, you'll need to understand C++. Get a book and learn some C++ and get a few basic programs running. Then you'll have a good idea how to put the software together with the hardware. It's open source, not an 49p "App".
Yes the only way to get this to work is if you have knowledge of c++ or c# (you well need to fully understand the programming languages)
is there a step by step tutorial on how to make it. Dude I'll pay for it if its a dvd. if its youtube its better.
Does we need to use windows mobile phone compulsory? or any mobile phone is sufficiant? please specify.thank you.
i want to know that it is important to buy hardware from only these links . but not from other source, company or other market, which will be more economical and easy. rather than that thing pls tell us the configuration of these hardwares..pls tell me i m dieing to make this project.
tell me,how can a camera scan our motion...
hey can you plz just let me know one thing...what have you used as a MOBILE COMPUTING DEVICE??? a laptop?? bt where should we keep it while using the SIXTH SENSE??? and how are we going to manage with the bulkness, battery and other issues of the laptop?? please reply
Truly remarkabel project you have going on here. Congratulation. I will start to learn C++ asap now :-) Thanks for this opportunity and inspiring technology. Hope to see more from you.
Thanx
Can somebody please post the steps or video on "How to connect all required hardware components ?" please!.
Hey people, watch this video from Ted Talks on Sixth Sense. It should answer a few of your questions. http://www.ted.com/talks/lang/eng/pranav_mistry_the_thrilling_potential_of_sixthsense_technology.html
I have been looking into cheap, portable Windows 7 tablet machines, I found a few on EBay that seem to have the power and the USB.
This one is only 330 + shipping. http://www.ebay.com/itm/New-9-7-Windows-7-Intel-N455-1-66GHz-2GB-32GB-WIFI-Camera-Laptop-Tablet-PC-N97-/260871930722?pt=US_Tablets&hash=item3cbd2dc362
What are the minimum hardware specifications to get this to run? Does it use any windows specific libraries, or could it be reconfigured to run on linux?
great invention. how to download it?
thanks for such an invention.
Hi Pranav..........
Your Product is very amazing ya....i really proud of u...Thanks and ALL THE BEST TO NEW THINGS
This product is a creation !! Pranav, could you please let us know how to connect these devices to each other.
Thank you !!
Warmest Regards, Soumya Prakash Parhi
Hi Pranav,
There is one suggestion on the camera & Projector part as far as the hardware is concerned can we use any mobile phones hardware i.e. like their cam & Projector for the project by hacking them by any means like I found 2 cell phones (Spice M-9000 & Intex V.Show Mini Theatre (IN 8809) ) which are compact enough and low cost too. So please suggest how can we use these device for the project as it meets all the hardware requirements suggested by you but how can we use the software code for the same or can we have new set of code for them.
Thanks & Regards, Prakash J Chandan
This is it guys
Hi Pranav,
What would be the total estimated cost of the project
sorry,
I got the estimated cost...
thanks
sunil
hey now that Aakash tablet has been launched, i feel u should make 6th sense compatible with that
thanks so much for sharing, though i still have no idea how to connect it to the main device and should the device just be the phone or laptop as it is. ^^
HI PRANAV,
there is no sourcecode http://code.google.com/p/sixthsense/source/checkout
Hi pranav, your technology is really on everyonez mind....
even on my mind... m working on this in my college... need to submit sixth sense as a project... but really need help for the connection thing... i wish u or ur team members will help me....
id-mukul_wadhwa1011@yahoo.co.in
Innovation is the key to research ... and you showed it ... I wonder how second life researchers will react to this ...
hi,
Where can you buy this whole set
Just assemble all this stuff and sell it
Just assemble all this stuff and sell it
good stuff.
the kinect cammra on the xbox 360 is just what this projet needs its way better at tracking stuff, like your fingers so you dont have to wear those caps on your fingers hears a short vid of what i am talking about.
http://youtu.be/-yxRTn3fj1g
Meanwhile, please buy ALL the devices from Amazon (I guess he's not an affiliate)
hatzz off 2 u pranav sir....i wud like to c it get implemented n assesibl to d physically disabld ppl of this world..gr8 job sir...i am lukin forwrd 4 dis open source sharin 2 build one for myself too..
My Suggesstion: If this has been completely done using Free Open source softwares and programming lanugages like c / C++ / python etc. there is no software cost involved... when this project is let open source.. then why not it should be done using open source tools. because Linux users like me would not use dll files or microsoft visual studio to achieve this. If i could know under what license this has been released, Me and my team would port this technology completely using open source technologies and generic language which supports every operating system and not proprietary like C#.Thanks for letting the codes Open source.
software up for download fellow enthusiasts....hope we make it right...
have no idea,want to own one of myself.
I am trying to connect via my ipod touch, but I can only view videos? I am using composite cables from my ipod to a P1 Jr aaxa projector. How do I get it to mirror safari, etc? Thanks. Everest
Pranav,
Copying a zip file and putting out does not make your code 'open source'. Open source is all about community. Why can't can't "develop" the code in "open" ? Why don't you use the source control? Why c# was chosen?
@Sagarun Thanks for your comment. Yes, we agree. All these is coming. We are working on it. Want to help in it?
what to do to help? i wann use it for my new mobile htc :) and can you describe or add some more examples of projectors and mirror holders and webcams, cause i think this should work with almost every hardware thats based on windows (C,C++,C#) or can connect to these devices :P
@Pranav : Hey bro you did a tremendous job n thanks for sharing the software. I am able to run the apps successfully. But can it do the paper editing stuffs that you did using microphone and AR technology ...?
@coolrk : can you please tell us how to configure the software?
@annu1:
1.First of all you need Visual Studios and direct x installed.... (I am using Visual studios ultimate 2010)...
2.Then u need to copy the files from wuw_v0.1.zip to any location on your computer.
3.Click on WUW01.sln (which is present in the folder "CODE") then click on F5 to debug it.
4.If you debug it successfully...a black screen appears with a little square box on the right just hover your mouse around it and you will find some options like Camera,Tokens,Apps...(Internet connection is required )
5.Click on Tokens,(This is where you need to add your markers)
6.Then click on new marker,you will find that the screen starts blinking and after 4 secs it stops with a still picture.Now add the colour markers.(You need Four markers)
7.After adding,square boxes appears to move on your four colour markers ,then save those four markers.
8.And now test different apps like draw,Jeff Han,etc
@coolrk.15 Thanks. We will upload the instructions and new versions that support those features soon.
How did you remove the mic from the camera?
@Pranav : Ok... thanks again and Happy new year 2012.
all indians are proud of you sir.our english mam in our college has shown your video and inspired us. please aceept our wishe to you from 'SHRI VISHNU ENGINERING COLLEGE FOR WOMEN'.wish u a happy new year 2012.we have assistive technology lab in our college to help the disable.we want to make your project at basic level in our college.the basic level means "by using four sensors of mouse u made the device which can wear to our hand",that we want to make simply.can u please provide any information about this?(because in video we are unable to understand)
no need to do so much of visual basic debugging etc...... just go to the property of "\code\WUW01\bin\Debug\WUW01.exe" and change the compatibility to windows 98 and it will run fine without visual basic and all the long-cut process
would it be possible for some one to make a video or a sheet with the complete directions on how to make this device? thank you to anyone who does
@payam :oh ya it works .Are you able to run the apps like the Newspaper,Mail and Menu ?? I am facing problems with those apps...
@khalid:
I have made the tutorial
Go to http://sixthsensewuw.blogspot.com/2012/01/how-to-configure-software-and-add.html
Hope it helps
Thanks Pranav for the Code. Wish you a Happy & Prosperous New Year. I did manage to test it under OS Windows 7 Profession 32bit but it keeps crashing when I try to test it under Windows 7 64bit. Any suggestions are high appreciated. Thanks once again and keep it up.
Well Done!!!
@charles: on Windows 7 64bit u have to solve the problem like me or marconi on the Software page here :D
Can anybody make tut for assembling hardware ?
very ... good!
very good!
Pranav,
This is most incredible project I've seen. I've just finished my advanced course in C++ so it's pretty exciting for me to find out a lot of it is written in C++/C#. I sincerely hope this continues to grow. I'll be looking into building my own and contributing soon.
Hi, am akash from cochin, india. am working on beagle board for my BTech. project. can we cross compile this code and make it run in an arm platform. can we run it in linux ( angstome) hoping to get a reply :)
hey, if u wanna earn money like google or facebook without any cost, click here: http://signup.wazzub.info/?lrRef=iiq4W its easy, only refer other people, e.g. your family members or friends. its totally free, but in beta phase now.. have fun and earn referrals/money waiting for the final release of sixthsense project ;)
@akash : m also developing under BeagleBone? with android OS
hi friends,
New Nikon Coolpix S1200pj Projector Digital Camera + Accessories, on ebay which is very much similar/cost effective for hardware required for us...................please see product and specification..................please tell me will it work as sixth sense device.http://www.ebay.in/itm/New-Nikon-Coolpix-S1200pj-Projector-Digital-Camera-Accessories-/230732659762?pt=LH_DefaultDomain_203&hash=item35b8bcfc32
hi, I am Harsh Patel and I am a High School Student at James B. Conant High School at Hoffmen Estates Il, and I don't have a lot of Exprience with C++, i was wondering if you had a biggner invention I can use to get fimiliar with this amazing technology.
Is there a small Sixth Sense device --> just a Camera + earphones + system == Expected to click picture of the person, scan the photo thru the database and "say" or 'speakout' the name of the person and optionally other details of the person? There are Android mobile apps for same. However, picture taking may not be liked by many. When the picture is taken using Sixth Sense device, the person will not know about it.
is there any problem in using colour markers which have the same colour of the background ? will it distinguish the marker from the background ? and what type image processing is used ?
@renittoj: I had the same problem..the camera recognizes all things that have the same colour of the colour markers. the software is not develoved that based yet.. we have to wait..may he find other solutions :D
@taylorwh make sure u have the right pack
http://download.microsoft.com/download/1/7/1/1718CCC4-6315-4D8E-9543-8E28A4E18C4C/dxwebsetup.exe
this will install all the frameworks - worked for me
hey can any one help me out that how can i implement this technology in java?? java have some reserved class for matlab,but i didnt know how i connect java with matlab and these devices. help me plzzzz
I am willing to pay someone $500 to build this or me. Please respond ASAP. Thank ou,
I want to make a ppt on this topic can anyone give the information required for making a ppt thankyou
Is any code written to the project and pls send me video or step by step procedure how to make a project by my own.Reply soon.....plz
We should most def get this ported to Java.
what is the code
what is the code used for
the fundametal problem with the implementation is speed....mobile processing is very slow...it has to be a laptop computer for good speed processor,,,can anybody explain me how hand gesture worked with colored marking
Someone can explain, if he had the solution, how you can connect the hardware to make a necklace like @pranav had.
need Explain ...
I am also interested in this device.But still in doubt:"How it will appear the textual data(not images) reflected by the single mirror?" pls explain.
Noordall... I jsut looked at the picture on the website. It looks like he just taped everything to a wooden ruler and attached a necklace to it. Take a look at the pics and it will become really clear to you.
How can I find a mobile computing device using windows at a reasonable cost in india?
can any one plz clearly explain abt d reqrmnts f ds project n easily available hardwares in market.. n how to asemble ,etc.......
Why not use wireless USB Hub to connect the devices? As we don't need to bring the computer device all the time.
hello, im sorry if this got answered already but i wasn't able to find any info about it.
the software can be run on a windows phone OS?
Hello everyone, can someone please let me know if this projector with inbuilt camera would work? I was about to order my hardware and I saw this product, if it works with this project then it will make life so much easier. http://www.projectorshop24.co.uk/aiptek-projector/aiptek-pocket-cinema-z20/
please let me know as soon as possible.
Excellent!!
Nice projector BUT my guess is that the Aiptek-pocket-cinema-z20 will NOT work for the WUW because the device will only project the pictures and movies from it's own SD card and will not send out the "data" to a PC with the WUW software and then back to the projector. You can only send "data" to the projector.
I have a pico laser projector with 15 ANSI Lumens too and I think it's way to dark for outside use...
Thank you for the reply. Much appreciate it. Thanks.
It depends on if the hdmi connector can be used as a input, if so, what ever you are using as your computing platfrom will be displayed by the projector.
hi sir,i m dng seminar on this so please ans my qn as soon as possible plz.cant we use our hand instead of colour marker? how is software work? how software and hardware connected? plz mail me ans soooooooooooooooooooon
What about Apple. I have a MacBook? Pro. Would that work? You also said a mobile phone would work, and I have an iPhone. Would that work, and if so how would I connect everything to the iPhone (plus running the program). Anything will help.
Thanks,
Ben
Check this.
http://www.techexperiments.in/2012/03/complete-guide-of-making-sixthsense.html
Friends, You can now download RHLcamMouse Source Code from : http://www.rohildev.com
This is the most amazing invention by an Indian - second only to the invention of the "zero". Pranav, you should be so proud of yourself. You have made all Indians proud.
so would a windows tablet work for this or what about a android tablet
When is the mobile version of this software going to come out because it is really inconvenient to use the laptop as the mobile computing device.
if i took the camera out of an iPhone would there be a way to program everything to work with it?