|
Software
Information on setting up the software for SixthSense.
How to run the Software Component of SixthSenseThe prototype system runs on windows platform and majority of the code is written in C++ and C#. We will be uploading newer versions as it is being developed; this will also include a mobile version. NOTE: We are moving the new code to Git this week. Meanwhile you can download it at the link below. WUW v0.1 betaDownloador you can download latest release tag from: github Instructions for running WUW_v0.1WUW_v0.1 is the beta version of SixthSense code (WUW stands for Wear Ur World, a former name of the project). This version runs on Windows. Make sure you have Visual Studio and Direct X installed. Extract and copy the files from wuw_v0.1.zip to any location on your computer. Open WUW01.sln (which is present in the folder "CODE") then click on F5 to debug it. If you debug it successfully, a black screen appears with a little square box on the right just hover your mouse around it and you will find Option tabs such as Camera, Tokens and Apps. Camera: you can choose which camera to use and configure the camera settings here. You may need to mirror the camera here using the camera settings. It is also recommended to use fixed/manual white balance and exposure such that the camera image is stable and light independent. Tokens: This version of code uses colored fingertips as markers. One need 4 different colors in order to run most of the Apps. We recommend to use Red, Yellow, Blue and Green (or colors that are different enough). We have also noticed that the matt colored tape/objects works better as they have less reflective changes. When you click on ‘Add Markers’, the screen starts blinking and after 4-5 secs it stops with a still picture so that you can add those markers on your hand as new markers. You can simply drag-select the colored marker on the screen by mouse cursor. Once you have all four markers (O, P, M, and N) added the software will start tracking the four markers. You can set the thresholds to better the tracking. You can save those markers and can reuse in subsequent executions, or can add new markers every time. Apps: there are three ways to launch any application. Apps tab can let you choose the apps you want to load and run. One can also load apps from ‘Menu’. ‘Menu’ is triggered using Namaste gesture. Once on Menu screen you can choose the App by hand-click (Hand Click gesture works by moving the O marker and hiding P marker. (Some of the Apps require some particular settings. There are also several types of gestures that are supported as of now. Details on Applications and Gestures will be added soon here.) Contribute |
I am very much interested about your sixth sense device. I have watched all possible videos and read out all the articles about it. I have also carefully read about the hardware components which is required and I will be very glad if I should be informed about the softwares included in it. I'll want also to work on this project as I am doing SOFTWARE ENGINEERING and I like to make programs in C.
can you make a documentation on the project?? thx
Really looking forward to the uploading moment... :)
Greetings, Alonso.
How much time it takes for software available for download . can't wait now !!!!!!!!1
I'm so excited. I have been waiting almost two years for this moment. Thank you so much for everything you have done. Please let me know if there is anyway I can help.
I think being able to leverage this technology on mobile phones would be key. I have both an old Windows Mobile 6 phone and a Palm Pre which are still perfectly good and would, I think, be great to use for this type of project. I know that previous-generation Android devices are readily available, and that is another great platform. We need to utilize the "hacking" community to port the source (when it eventually comes out) to multiple mobile phone platforms so this technology can be utilized by the masses and begin to evolve.
Hi all,
I did my own sixth sense prototype from scratch! check that: http://www.youtube.com/watch?v=pGFP9XhA99Q
I have been waiting for this for a long time, I am so glad it is finally coming. I will receive my first salary from work soon and the first thing I want to do is build one of this. Thank you
I just dont get it. Why would someone want to give this project for free
@Dedam: lol exactly my thoughts ..
In my opinion 2 reasons:
1.- Too early to sell it. This tech is not fully developed and it's too way complicated for big audience. If anyone of us finds a good idea or a good concept or an interesting improvement, maybe selling is an option. But as far as I see, DIY and open source is much more exciting.
2.- This MIT guy... He's awesome or just crazy. Or both things altogether :)
It's up to us to make something good with it. Thrilling. Open source rules, ladies and gentlemen.
Greetings, Alonso.
hi all.how can we get the software? or i have to make it myself? thank for your comments.
Is there a upload somewhere else available?
Will a apple iPod work (4g)
what kind of software is necessary to connect the hardware to allow them to work together?
pranav you are brilliant i cant wait till you post it so i can make my own. this really is the best thing since sliced bread.
The software and products will be ready when they will be ready.
The real breakthrough is in the altering of existing worldviews around technology and human behavior.
Question we must ask ourselves - how do such breakthroughs and possibilities impact your worldview today? How can you use this access to invent new possibilities now?
Fascinating redesign of human thinking and behavior. Thank you, Pranav.
Wow I have been waiting nearly 2 years for this day to come. I am looking forward to making a Kit of my own and using the sixth sense technology daily.
I got to know this about 5 minutes ago and I think I'm in right time, I hope the software come soon. If this work like on the videos it will be awesome!!!!
is it possibile to buy it fully installed insted of having to put it together manuly and with the software?
and at what cost?
no it is still under development, so you have to make it yourself, though he has said many times it will cost aprox $350 to build
common tell abt the software pleaseeeeeeee. we are anxious for it. friends if one of you get the software please tell me .
wow !!! i am really amazed... nice calculation nd prediction..great!!!!
I appreciate the scale of this project. Pranev is indeed a true genius. I'm moving to Ireland soon and the first thing I want to do is to build myself a prototype. I am pretty anxious abt the software and cant wait for it. There are so many applications for this project it's mind boggling!!! I also look forward to lending a hand to this project. I'll keep watching. Thank U Pranev.
cant wait for the software to come out...and the step by step tutorial so i can build myself one....im a first year mechatronics in It sligo ireland and eager to show off this magnificent device.....and im looking forward for more awesome stuff fro you pranav.....best of luck and more power....
i am interested in the project
it's amazing
cant wait for the software to come out...and the step by step tutorial so i can build myself one....im a first year mechatronics in It sligo ireland and eager to show off this magnificent device.....and im looking forward for more awesome stuff fro you pranav.....best of luck and more power....
I would love an update to this, it would be awesome to start exploring the possibilities!
I have been waiting for this for 2 years!! So excited!
you have no idea how long i have been waiting to get this, please upload it soon, its so awesome i must have
First thank you for the good work you are doing one day your work will change the world!!!
I am a computer tech working in skokie right now. I am so extremely excited to see this devise work in side a school just now I have had a teacher ask me if there was a simple way to record her kids, in the middle of class. My suggestion of using a lap top is not going to work, we need this please if there is anyway we can have a copy of your software I will provide all the hardware necessary and if need be I am more then willing to sign any legal stuff.
Please Please Please let me build one soon for my kids I know they will love it.
-Josh the Tech
Congrats Sir, I am eagerly waiting for your software update. Can you tell me the date when you are going to upload. Thanks
I've been waiting for it for a long time.
plz send the software program quickly...........thanks
Guys, any plans to update the software code? I would be happy if it is a "not so working copy" even if that is what is available!
please add the software soon
Hi, check out the prototype that I build from scratch... http://www.youtube.com/watch?v=mHOW70Oa8o8&feature=related
PLEASE PRANAv.....give us the software.....it will be a very noble deed to release on opensource....much greater satisfaction in helping the masses..
awesome job
Great Stuff man, I am very much interested to work here in India on the same, Can you please provide any SW related details, documentation to explore more. Nilekh
I've been waiting for it for a long time. Plz add the software soon...any way awesome job
Since this will be available on windows platform, how about other platforms? I am willing to invest my time into having the same software run on a Mac OS X platform
Thank you for keeping this project open source, I look foward to building my own Sixthsense device asap. Will Sixthsense be able to run on android?
im learning C++ and C# just to build this. im so excited for this
Awesome work Pranav. Am waiting for the Open Source part of the Software.. ;)
Incredible work, i´m very excited about this proyect and hoping to take a look into it.
Fernando
This is amazing, I got interested in this project when I saw a video about it this year, I really want to see this source, and see this proyect working in real life!
Eduardo
sir, when the software will be uploaded, plz give it soon to us, we are waiting
I saw this on PopSci? a year or two ago, and became instantly enamoured. It's going to be difficult for me to do this, I think, because I'm just a high school graduate with little inner computer knowledge, and I have but an Android smartphone, not a Windows labtop, to use. I suppose this means that I must use the wait to learn more about computer language, and about translating programs into phone apps. Although, of course, I'd be excited if some of the more experienced user do it first, which I'm sure they will.
This has been bothering me, however: you other users, please stop nagging for a release of software. I doubt the genius that we call Minstry Pranav isn't going to forget to post it up here. I mean, this is kind of important to the whole operation: providing the software for the betas. If he hasn't posted the software yet, then it obviously isn't ready, and pressuring him, stressing him even more out than he undoubtably is, isn't going to make it come out faster. He's probably working out the bugs, so that it can function well enough that he can receive feedback about specific problems, rather than receiving flack about how it sucks. If not that, he's holding back for something else, which is probably just as important. If you've waited two years, you can wait a little longer. If you haven't waited that long, keep in mind that others have waited even longer.
That said, I'm tintillated with excitement. I told my old Multimedia teacher, who's always looking for the newest, useful, unique and intruging software and technologies to inspire both her students and herself, and we are both looking forward to it, when you finish. In the meantime, as I said, I plan on studying, in order to prepare myself for this brilliant endeaver.
-Andrea, a know-nothing high school graduate
plz send the software program quickly...........thanks
am really intersetd in this ... so i took my s7 seminar on it and i 'd like to my main project on it
what o you guys say that instead of smartphone use a pc and transmitter and getting a remote accessing so as i can use my pc anywhere and the benefet s sped cause the processor is dual core and its at home o.....
This project is cool and very interesting
Thanks for your contribution to technology,
Regards from Perú,
relese that software as quick as possible, please ;]
brilliant project regards from Poland
i have waited for a long time ,your work is wonderful and i will keep on concentrated on it~
Hi, like many commenting here have been waiting to see more of the wonderful, evolutionary SixthSense? Project, however I came across this article from 18/10/11 on the OnePerCentTurn? website called "Turn Anything, Even Your Clothes, Into a Touch Screen and it seems that Microsoft are going to put out a similar ideas soon, they at prototype stage too.. Would be cool to see this out first and the big guys left behind for a change. :-) Either way look forward to when the software is released.
Looking forward to the release of the software. This looks like an awesome project.
Checking this page every day waiting for the best invention EVER! & soon after phones should be powerful enough to run this =D
Come on! I've been waiting 2 years and still no software released. Can you at least bring out an unpolished version to try out.
>>Comment by agni.ila...@gmail.com, Yesterday (31 hours ago)
>>Come on! I've been waiting 2 years and still no software released. Can you at least bring out an >>unpolished version to try out.
That is what they are working on right now. This is new technology, still in the formative stages. Be patient.
Have you tried integrating with the Kinect device? Since it is relatively cheap, you can pull out the cameras, you get 3d and infrared. I have worked with WPF and Kinect, and seen others who have gotten the fingers to show instead of the hands. Thank you so much for putting out a the libraries that you have. As a C# developer, I was highly surprised (and then motivated) to find that you have put this on windows. Thank you, this will change how we interact with each other and the disabled.
Can't wait to give this a try! It's going to spread like wildfire once people see what it can do. Thanks for making it open source!
hoax?
I was very much intrested about this 6th sense technology and as a student of 2nd year can do my project on this technology ? and can i develop this in android version? could u help me for this Questios?plz
Great idea, creators! I think that the longer they wait to release it, the better it will be!!! As soon as the code comes out, I will explore making my own. Good Luck!
This project is very impressive.
Check out the TED talk here if you haven't seen it yet: http://www.youtube.com/watch?v=ZqV3mpok22w&feature=related
I have been waitin 2 years for this to come out. Please someone let me know what is goin on with it. Is it me that can't find it or is it everybody?
When will the software be released as an OSS?
The project is very impressive
I will impressively wait for your source code written in c++, your system is very interesting. thx
I'm sorry, where is the source?
where can i download ? and how can i download ?
Release that shit. You're only going to go far if you release the idea to more people. Google, Apple and Microsoft could crush you in both product and software development in a couple months. You have to let more eyes, hearts, minds and fingers into this project, because it needs more man-hours to make it defensible against the software/product giants' whims.
when will it be up, maybe later this year
Its feels like forever the wait, been 2 years. Is the software out yet, or the prototype atleast and where can i find it? because im sure i must have missed the released date by now or something. Too much excitement, Pls can anyone just let me know, would REALLY appreciate it :)
I'm done waiting, why don't you just; 1. Release the software as open source, OR 2. Admit that this is a hoax and will not be released. Really, this is ridiculous, it shouldn't take this long to release some code, it's been 2 years.
Eagerly waiting for the software and configuration details so that I can make one and test it.
Thanks, Soumya Prakash Parhi
Pranav I have been waiting eagerly for this moment. When do u think the software will upload? Please tell me. Thank you so much for all it.
Yeah,Pranav,when we can get the software code? Much obliged~
hi,Pranav, it is excited to see this device. I will wait for the code and i have a question:could any mobile computing device run this software?
hey now that Aakash tablet has been launched, i feel u should make 6th sense compatible with that
Hello Pranav Mistry, I was wondering, as many others, how soon will the software code be uploaded onto the site? Thank you very very much
this is just awesome piece of technology, i almost read articles and watched all the video related... i kinda feel that the applications of this product can be endless but please reveal the rest of them too.....
I saw this video in 2009, and I am anxiously awaiting the software. when will it come out?! Please release it fast.
oh please release the software soon
Please release it soon....cannot wait to see...
I would have to add my voice, would be great to have something!
how to setup hardware ?
I don't see any code to download. When is it going to be released? What is the best device to use? OQO makes some cool ones. Thanks
Well, worth of waiting... Or challenging to do by ourselves :)
Hi Pranav
Thanks Prakash J Chandan
Where are the codes? Me and my uncle have been waiting for 4 months, and still nothing. Are you going to post the codes?
is this thing still open?
How long will it take just upload it soon!!
Please upload this! I even emailed you!
use of basic programming language in amking this future technology is the biggest achievement in this invention. waiting for codes .
from, AKHIL MEVADA Ahmedabad
Why are you using C#? You should go for Scala to achieve parallelism. <a href=www.chankeypathak.com>Chankey</a>
interesting to see...
I really want to take part in this. I hope the code gets released soon.
Give the guy a break!! If he releases too soon then you will be on his back insisting he fixes bugs for you. If you want to help then document what you have already achieved and make it available to others
I just saw this and I can't wait to try it on a number of applications. This is a huge breakthrough in user/computer interface!
Great idea and a brilliant innovation. Can't wait to check out the source code and play around with it. Thanks Pranav for bringing the virtual world of information to reality :). Hats off to you :D --- Saurabh
It's like giving candy to a boy, soon..
I check this page every single day, one day its going to go up and this page is going to explode...only a matter of time! Can't wait!
I downloaded the software, thank you very much!
How to use it ?? ( for noobs )
Thanks a lot for the release ! I spent a long time waiting for it ! Launching my tests now but will there be any chance to run it under non windows OS ? Merry xmas & happy new year.
Maybe you release the Beta Code v0.1 as a gift for Christmas to us,TKS. Wonderful!Thank You!
Thanks so much for this the device looks wonderful. The software is the last missin piece I have no clue how to get it to work, But just releasing it in this manner is such a gesture.
It would be nice to see how other people are getting along.
Merry Christmas to you.
Thanks you very much pranav brother..you did a tremendous job...thanks a lot for giving this project as an open source <3 wonderful idea...
adv happy newyear to all
Finally! This is awesome Pranav, thank you very muchos. Now the only problem is that I have no idea of informatics. If anyone out there could help in any way...
Would certainly appreciate it if you had a tutorial on how to use the source code for noobs. I've downloaded it, been waiting for a horribly long time for it, but now that its out, I have no clue as to what to do with it. Any Suggestions?? Anyone??
Have been checking every day for this, extremely happy about the download being available. I'm downloading directx right now as im assuming that it is required, I will let you guys know how it turns out. :)
Thank you for being a man of your word! It did take awhile but you did it! So many in your shoes even at MIT have done similar things but never released the code and now that tech is obsolete. I would love to see a basic keyboard and mouse set we can use unless I am missing something. Has anyone compiled any binaries yet? So excited about this! I have been looking for a usable start for years I want to do my work and not have to sit!
Thank you for helping our world!
Thanks!!! This is going to be on my 2012 to do list!!!!
Everyone of us trusted you. We all know this can never be a coarse. I think it worth thousands of hours' wait. Thank you so much.
I really need some advice on how to run this software, I do not own visual studio and most likely never will. Is it required? i swear i have opened every file in the package. HOW DO I RUN THE DANG THING
OK got it running, COOL!
this is what i did: install visual studio C# 2010 (http://www.microsoft.com/visualstudio/en-us/products/2010-editions/visual-csharp-express) install directX SDK (http://www.microsoft.com/download/en/details.aspx?id=10084&hash=IYXPCllHASPeSu7Cq6oC0AIsuXpRXBWfM1v%2fX3Wf0Jkiv1VUmgCNNbhsjCrRHuUWxBi4E4GeO5OEqIa2T%2fQ8HA%3d%3d) download the code and extract it open the solution in visualstudio 2010 C# edition in the solution configuration manager define a new platform (x86) and set is as platform for debuging try to do a full build (this will fail because of missing dlls). this will create a folder x86 in [code\WUW01\bin] copy all dll files from [code\WUW01\bin\debug] to [code\WUW01\bin\x86] these files: DirectShowLib-2005.dll FluidKit.dll NyARToolkitCS.dll NyARToolkitCS.sandbox.dll NyARToolkitCSUtils.dll TouchlessLib.dll VEarthControl.dll WeatherReaderMVC.dll WebCamLib.dll WPFControl_Album02.dll WPFControl_Clock01.dll WPFControl_Menu02.dll WPFControl_Weather01.dll now back in visual studio remove all the references to the following dlls FluidKit.dll NyARToolkitCS.dll NyARToolkitCS.sandbox.dll NyARToolkitCSUtils.dll TouchlessLib?.dll VEarthControl.dll WeatherReaderMVC.dll WPFControl_Album02.dll WPFControl_Clock01.dll WPFControl_Menu02.dll WPFControl_Weather01.dll then click on add reference and browse to the x86 folder and add select the following dlls and add them: FluidKit.dll NyARToolkitCS.dll NyARToolkitCS.sandbox.dll NyARToolkitCSUtils.dll TouchlessLib?.dll VEarthControl.dll WeatherReaderMVC.dll WPFControl_Album02.dll WPFControl_Clock01.dll WPFControl_Menu02.dll WPFControl_Weather01.dll rebuild the solution and you will only receive warnings. now create the follwing folder: [code\WUW01\bin\x86\Debug\Gestures] [code\WUW01\bin\x86\Debug\Inkings] [code\WUW01\bin\x86\Debug\pics] [code\WUW01\bin\x86\Debug\temp] copy the xml files from code\WUW01\bin\Debug\Gestures to code\WUW01\bin\x86\Debug\Gestures copy the DirectShowLib??-2005.dll and WebCamLib??.dll from code\WUW01\bin\Debug\ to code\WUW01\bin\x86\Debug\ push the debug button and the app will start you will get an null reference error in WUW_Paint but you can click continue F5 the app will start with the camrea on and with the config screen, you need to press the new marker button the screen will flicker and will frezze after 4 secs or so. put you markers in front of the camera within those four secs and when the camera freezes with the mouse mark your markers (click hold mouse down and draw a circle) mark all four and then click the SAVE M button so you can load them next time the markers will be tracked you will seee squares on the screen if you hover with the mouse over the square on the top right , the config screen wil hide or show if you click view in the camera tab in the config screen you will get a window showing the guestures loaded, have not got them working yet.
Remarks
i guess you need the .pat files for the AR stuff, but have not got this working yet find out why error exists in WUW_Paint my camrea is a default one from the HP elitebook 8540p laptop, works fine.
good luck! please lets keep all writing and informing each other . so I'm off to find me a projector...and to make myself some fancy colored markers...
crap...i hate the wiki markup syntax
Awesome i'm installing visual c# right now, i have already built the hardware but it is a little different as i have a bigger projector. Have not tryed it yet hope it works :P
@marconijmeijer can you make a video on it? thanks in advance
Thank you very much for the code release Pranav!
I still have problems with running your software but it is working partially. :) I think you will implement more of your ideas in future releases.
In the Hardware section user "payam.1.." wrote: "\code\WUW01\bin\Debug\WUW01.exe"
You can use that WUW01.exe WITHOUT the installation of Visual Studio and DirectX SDK (like marconijmeijer has figured out). Thanks for that helpful startup tutorial. I have tried that on my 2nd PC (Win7 32bit) and it worked but it's overkill because you don't need that. The WUW01.exe is all you need. I did not switch it to any compatibility mode.
The problem on my other PC (also Win7 32bit): I will only get the startup screen. The square "mouse over" field on the top right corner is NOT on the screen!!
At first there is NO video output on the screen. When you are able to hit the small square you will get to the menu where you can add your colored markers and then you will see the camera video screen.
The red O, M, P, N (left top corner) are the markers that will move after you have set them correct in the config screen.
Here is a screenshot:
On one PC I can see and activate the square button (top right) and on the other it looks like in the screenshot. I can only get to the menu with drawing an "e" with my mouse on the left bottom corner with the blue dots.
Problems on both PCs:
-Main problem is the black box that sits there and covers most of the screen and even the video output screen. How to remove that please?
-The markers will not save correctly. The programm will crash if you want to LOAD the markers.
-The keyboard input not working correctly. Every key I press results in a box: INPUT2 - "key that I had pressed" and the OK button.
But I would like to use the keyboard shortcuts like stated in the documentation.txt
I have seen that all lines for the shortcuts are commented out with // in the WUW.cs main file. But even if I remove the // on each line and saved it it's not working.
I hope you Pranav or someone here can solve the small problems. I think the best for all users would be a video tutorial on how to use the WUW01.exe and all it's functions.
Thank you very much.
વાહ પ્રણવભાઈ વાહ.... ખૂબ જ સરસ... SixSense?નું ડેવલોપીંગ અમારી સાથે શેર કરવા માટે ખૂબ-ખૂબ આભાર....
@Outatim :
I guess the Blackbox is actually the newspaper application and its not even working properly....
I have made a video to remove it.
Go to http://sixthsensewuw.blogspot.com/2012/01/how-to-remove-black-box.html
I got an error on Debugging -.- it says sth about "System.BadImageFormatException?" its not an 32bit application or sth. like that :( what to do to run it successfully?? please help..
here the text:
System.BadImageFormatException? wurde nicht behandelt.
@casher : Are you using a 64 bit OS ?? And which version of Visual Studios is installed ??
The exception is caused by a 64-bit process trying to load a DLL that was built for 32-bit. @Casher:
Or the other way around, a 32-bit process cannot load a 64-bit DLL.It could only go wrong if you changed the Platform target setting in your C# class library project. From x86 or AnyCPU to x64.
(If you are using MS Visual Studios 10) Go to the build option-----> Configuration manager -------> and change the platform to Any CPU
I hope it works....
Excellent and fascinating project. Just downloaded the source. Any chance anyone will post the various builds you have completed?
@coolrk: sry, but it didnt solve the problem on my Ultimate version of Visual Studio 2010. The setting with Any CPU was already made, and i changed to every other platform and it didnt work either. Whats IntelliTrace?-Debugging?? it says, its only available on x86 platforms?! :D heres a picture of the configuration manager (im german):
and when i click on the green debug arrow then visual shows this message:
on my 64-bit this doesnt run yet :(( what should i do?? please help me :P
shall i do the stuff marconi did? with copying dll files and so on?
yees, it works now on my 64-bit PC!! (I hope :D ) i did the first few steps marconi did: 1. defined a new x86 platform and debugged (and get the same error as before :D ) <- (I dont know if you have to do this debugging step, maybe to set some settings or sth) 2. copied the whole Debug folder from [code\WUW01\bin\debug] to [code\WUW01\bin\x86] 3. back in visual studio 2010 ultimate then i went right to the bar and deleted the FluidKit?.dll file (because there was a warning for many .dll files) and created a new reference for that file with the new folder [code\WUW01\bin\x86]. And then all other .dll files with errors were made correctly to the right folder. Now the little exclamation mark are away :D I hope this will stay! It works :D thx marconi
@casher : Oh I'm glad that you finally did it...
Iam trying to get the gestures like clock to work...How to remove the blackbox ? ..Unable to right click on it as coolrk mentioned Just got a pico projector ..need to try with it.
@rock2047: show pics how you wanted to remove blackbox like coolrk. which version of visual studio do you have? what color markers do you use? can you show me the link for pico projector.. thx and try the way coolrk says in his video another time.
Iam using VS 2010 express edition. Red,Blue,Yellow,Green markers.... I got a iGO 2020 pico projector for $140...Tried to connect it to my computer but unable to find the right cable/adapter. Unable to right click on the blackbox to send it back..Nothing happens when i right click.
Hello! I managed to get the software running on debug using my pc. I am having a little trouble with input. When I recognize my markers and save them I cannot figure which one is the mouse (because they are all over the place; sporadic) and how to use them to select etc. I was wondering if you could help me with better recognizing markers and controlling them and how to use them to navigate the program (how to click). Is this even possible considering that I am not using the projector? Right now my computer screen is output. Could my lack of control with the camera input have to do with the mirror effect?
@rock2047: did you move to the 'form' of wuw in visual studio? You have to to edit the black box!
@casher: Thank you..Removed the blackbox in VS..working fine
this works great job hope you update the beta
Windows Only? Why not use some more portable platform or toolkits?
We are in the process to GIT. Thank you all for your support.
i have run this project and i too getting this "black screen" which is overlapping with the video. what i have done is ,just adjusted the size of the "pictureBox1" control in "Microsoft Visual Studio" which is overlapped with the "pictureBoxDisplay" control.After this correction i am able to see the picture with out that black box appearing on the picture.
"Loader lock was detected " what should i do ??? in VB i am getting this message while debugging i want to remove the black box
Yes I removed the black box.I want to know if you can navigate the program on your computer without a projector.
-This is what Pranav said. If anyone has found out a way to make this work (and is doing tutorials) could they consider posting a video? I find it an accuracy problem. The camera always picks up on random stuff behind me etc.
wuw01.exe not found
how to use it on mobile? ?
Got it working. Yet to create the markers and use the application. :)
It works partially well :) :)
could any one tell me how to add the markers
is the projector neccessary to test this application and i also want to know how to add markers
projector not neccessaty to run/test application. and see above how to add markers:
" Tokens: This version of code uses colored fingertips as markers. One need 4 different colors in order to run most of the Apps. We recommend to use Red, Yellow, Blue and Green (or colors that are different enough). We have also noticed that the matt colored tape/objects works better as they have less reflective changes. When you click on ‘Add Markers’, the screen starts blinking and after 4-5 secs it stops with a still picture so that you can add those markers on your hand as new markers. You can simply drag-select the colored marker on the screen by mouse cursor. Once you have all four markers (O, P, M, and N) added the software will start tracking the four markers. You can set the thresholds to better the tracking. You can save those markers and can reuse in subsequent executions, or can add new markers every time. "
I'm running Windows7(64bit) and Visual Studio 2010 Professional. When I debug the program, I get the following error. Please help me on what to do?
"An unhandled exception of type 'System.IO.FileNotFoundException?' occurred in Microsoft.VisualStudio?.HostingProcess?.Utilities.dll
Additional information: Could not load file or assembly 'Microsoft.DirectX, Version=1.0.2902.0, Culture=neutral, PublicKeyToken?=31bf3856ad364e35' or one of its dependencies. The system cannot find the file specified"
The application doesn't work well in 64 bit. Use x86 configuration to debug.
@sambruc:
read previous comments!! I had the same prob and solved it like marconij explained.
Hello,
If you could integrate a system like this: http://mi.eng.cam.ac.uk/~qp202/my_papers/BMVC09/ and like this https://vix.tv/ and tie it into what you have you can make the software recognize your hands and track their gestures. This would remove the need for the color markers on your fingertips and just use the gestures itself to command actions.
@myzenh: sounds and looks cool :D this would be a good addon feature :P if u can code than you can do it ;)
but let Pranav first finish the project or sth. He has a lot of stress at the moment.
what is GIT and how does it differ from C++ and C#
is the github version 0.1 newer than the first one??
cannot find webcam...why? i have connected a camera!
I have a webcam just no projector. I'll probably end up testing this in a few more months from now. it's still to early for me..
Thanks to the helpful posts by marconij and raj.bol, i've got the project runnng under VC debugger. Still trying to figure out how to use the apps - seems like a number of freezes and it lags in displaying the work area after markers are initialized. Also get a crash (as reported by someone else) when trying to reload markers... still its a start...Using a vaio laptop with built in cam for now...
I cant open anything from WUW_v0.1. For some reason it says the files cant be found. it keeps taking me here. http://shell.windows.com/fileassoc/0409/xml/redir.asp?EXT=sln. any help would be nice.
I runned the program in visual studio and it worked! But a black square shaped screen is appearing infront of the running program and i can see half of the running program....... plz give any fixes or solutions...
Black box solution: http://sixthsensewuw.blogspot.com/2012/01/how-to-remove-black-box.html
Hey its working Awesome without projector also......just the 3d app is not stopping....it is still visible after clicking stop 3d......
@ Martysma...@yahoo.com you don't have visual basic installed
oh ok
hi guys when i debug the application in vs 2008 ...im getting an error message "WUW was unable to find to find a webcam.Please make sure that a camera is connected and installed"....im running this aplication on my lenovo laptop which has a inbulit but im not understanding why im getting this error plzz help ....thanx in advance
WoW!!!! Very good Pranav... Maja padi gai..... Gujarati ma....
all the best to Code users.... waiting for something new out of this....
Ramesh Gadhvi
Bhai Bhai Aa To Chaakaa jevu Che.. Jalsa che anaa to havey
Splendid work boss!!! thank you for the magic!!!
Great work... I could work with Test and Paint ... Map failed to open the localhost page... and marker movements were bit sluggish... In my case...it fails at Mail.control maybe because my outlook is not configured WORKAROUND : Open Outlook and then Debug... no errors no warnings... Take a pic fails for gallery storage...GDI+ failure...is it because path of storage has no folders as mentioned in the code I just want to check whether other users who were successful had same experience or did I went wrong somewhere... But I must say for my first try...it worked beyond my expectations Will update...if I reach my next stage...
Hats Off to the Creator!!!
hai sir, (anilmaurya02@gmail.com) i anil kumar maurya wish u for your innovation. my sir giving me to make a project on technology. i thanks to u becau. it help me me my project better from other than. i have seen your technology sixth sense. my sir is giving me appreciation for making such project on such this type of technology which my sir with my friend can't imaging that i make such type of project.THANKS SIR THIS WILL HELP ME AT A LOT....i maked a ppt on "sixth sense technology" with my group team AHSSMFP. IT IS A WOUNDER FULL TECHNOLOGY......!!!!!!!!!!!!!
followed marconij...@gmail.com instructions.. get this error: Cannot create instance of 'WeatherReaderUI' defined in assembly 'WeatherReaderMVC, Version=1.0.0.0, Culture=neutral, PublicKeyToken?=null'. Exception has been thrown by the target of an invocation. Error at object 'viewbox1' in markup file 'WPFControl_Weather01;component/usercontrol1.xaml' Line 12 Position 14. What am i doing wrong?
Much obliged!Pranav Mistry! you are hero!
Thanks for the detailled instructions given by marconij. Working good in 64bits!!
I keep getting this whenever I click debug: BadImageFormatException? was unhandled is not a valid Win32 application. (Exception from HRESULT: 0x800700C1) How do I fix this?
i used the github working better than first one, all the application are also working well. need more upgrade which is user friendly, and which looks good
I am Trying to implement it
I installed VS 2010 then i did what marconij has told . I havent' connected anything so far to my computer . Its giving error on debugging ... The type 'System.Windows.Markup.IComponentConnector' is defined in an assembly that is not referenced. You must add a reference to assembly 'System.Xaml, Version = 4.0.0.0, Culture = neutral, Public Key Token = b77a56c934e089'. --- File WUW.cs
I added the reference to System.Xaml and now it says File Load Exception ... any helps
I'm having the same problem as you, abhinava. I cannot find any solutions to this problem.
I saw this last night and went ahead and bought the required and recommended hardware for this project. I am very much thrilled about this and hope to be working with anyone that is on this project to further its development.
Thanks for all your work, and for makeing this opened for everyone of us who wants to build it!
I got the wuw01.exe to work. I did have an error with WpfUserControl_Mail01? not accepting the null object, so I took out the instance = new WpfUserControl_Mail01? out of the equation and it compiled the wuw01 without any problems.
Now to get colored tape and get the markers set.
I have an idea. Instead of using colored annoying rings, we can use Kinect technology.. Kinect is a motion sensing input device by Microsoft for the Xbox 360 video game console. And I think we can use it for tracking fingers without those rings. We can use the SDKs provided by Microsoft for Kinect. I just got this idea 2 min. ago.. And I didn't tried it so don't get angry if didn't work out..
Does anyone know when this will be Open Sourced? I'd love to use this in conjunction with a Raspberry Pi, but being ARM it won't run Windows...
Hello, I want to know if someone can modified the NewsPapers? software. I want to access to an other "website".
I have setup a google hangout so we can talk and share ideas. https://plus.google.com/hangouts/extras/talk.google.com/sixth%2520sense%2520technology?authuser=0&hl=en&eid=
come on update this thing...... its not been updated since jan 13th
hello, i am doing computer engineering and m in F.E..
1>i found that i can use this WUW app i.e. mouse for other app on my pc by just minimizing V.B. window, but i cannot access my 100% Window can any1 tell me how to increase or set its area as per my screen resolution. and also 2>images taken by WUW contains my hand also so how to remove it. 3> i have to change name of address of image from source(program) or target(my directory)before taking image other wise it will generate an error. it dose not display 'all images at a time' taken from WUW in its preview mode. that's all other wise all functions are best.a big salute for pranav mistry .............facebbook was offering him 2billion $ and a proprietorship of 5% shares of facebook but instead he choosed to open source this project..........thts what a true technical entrepreneur does :)
hi guys when i tried to open the project using "WUW01.exe", nothing opened at all. when i opened the project using visual studio 2010 then pressed F5, nothing appeared although "WUW01.exe" in processes in task manager consumes 70% of CPU what to do to fix this situation ?
Thanks in advance
Yes!!! Got it working!!! Thanks to marconij...@gmail.com for the super useful step by step guide and to Pranav for creative genius!!!
@ahmed.el...@gmail.com we encountered the same problem. I had a feeling it was because I renamed some folders in the project. So I just deleted what I had done and restarted, being careful to not change much.
We also encountered an error with the following lines:
WPFControl_weather01.usercontrol1 control weather = new WPFcontrol_weather01.usercontrol();
I should state that I am a terrible coder and was unable to solve the error above. Commenting out the whole line does not work, but commenting out the part after and including "=" worked.
We made our markers using Word and a printer, and the system tracks them! Yellow was tracked best. I accidentally started opening applications while testing this out, which was cool.
I have also bought the projector and will assemble the mirror set-up this evening.
Thanks again!!!
Raj P and Marc K
why no one wants to upload a tutorial video about this? Is it because we're not supposed to? Did they make it illegal to do so for this project? because instead of explaining all this like that, why not just show it? Because this is ridiculous!!! It's the first time something as huge as this has no youtube tutorial...O well...
http://code.google.com/p/sixthsense/wiki/Tutorial ---> here z the tutorial.
@rajbpate...@gmail.com thank you
I have another error. when i tried to open the project using "WUW01.exe", nothing opened at all.when i opened the project using visual studio 2010 then pressed F5, that error appeared "The file 'C:\Users\pranav\Documents\Visual Studio 2008\Projects\WindowsFormsMail01reverse?\WpfUserControl_Mail01?\UserControl1?.xaml.cs' does not exist." ?
Thanks in advance
same thing im getting like sirismai
can some one give me a link to the latest version of wuw and wer do i find gallery application
Hi to every one I have downloaded the OS software and am looking to find the Google hangout for this so I can join the discussion does anyone have a link to it please I have searched but not finding it I am very interested and am going to build my own device. All seems to be working good so far Thanks to Pranav Mistry you Sir are a genius. And the up most respect for keeping this in the OS community, I admire your vision
I had some trouble with this line:
kept getting a null reference error..so I commented the line (put "//" at the beginning of the line) => => //WpfUserControl_Mail01?.UserControl1? Control_mail = new WpfUserControl_Mail01?.UserControl1?();
after which I added a new line before this one , so it would look like this => => WpfUserControl_Mail01?.UserControl1? Control_mail;
Friends, RHLcamMouse Source code is available for download from : http://www.rohildev.com
the previous code without the question marks and the lines under them...
64-bit Machines need to go into Project->Properties->Build->Platform target->x86 and it will build and run. I am testing it now.
I am wondering... So this only works on Windows capable devices, like for instance, Windows computers(as dumb as that sounds, to be carrying around a laptop for your SixthSense?), or the Windows Phone. Is that correct? If so, I wonder if they will work on an iOS version eventually.
I got this error, Any tips?
COMException was unhandled Retrieving the COM class factory for component with CLSID {0006F03A-0000-0000-C000-000000000046} failed due to the following error: 80040154.
on this line WpfUserControl_Mail01?.UserControl1? Control_mail = new WpfUserControl_Mail01?.UserControl1?();
Hi all - any plans for Linux support? I'm really excited about this, been interested in augmented reality and such for years, but I can't get the software to work even with WINE and I can't find any guides online.