Below you can find some of the OpenTouch testing demo videos I made sometime ago. The QuickTime movies have good quality but some of them have low fps, because of my screen capturing software (that will change in future). Enjoy the videos and let me know what you think.

OpenTouch – FTIR Blob Detection algorithm test
http://opentouch.info/tmp/OpenTouchFTIR.mov

OpenTouch – Blob Detection using ffmpeg for video input
http://opentouch.info/tmp/ffmpegBlobDetection.mov

OpenTouch – Simple OSC sender and Processing app
http://opentouch.info/tmp/OpenTouchSimpleOSC.mov

OpenTouch – TUIO sender and Processing drawing app
http://opentouch.info/tmp/OpenTouchTUIO.mov

OpenTouch – Quartz Composer Particle System using TUIO cursor custom patch
http://opentouch.info/tmp/OpenTouchParticleSystemQC.mov

OpenTouch – Quartz Composer Explosion using TUIO cursor custom patch
http://opentouch.info/tmp/OpenTouchExplosionQC.mov

OpenTouch – some of the demo videos combined together (low quality video at YouTube)

I managed to merge portVideo library (newest version from reactable 1.3 and portVideo 0.3). I added directory structure and merged portVideo source code to SVN.

Here is a portVideo example compilation on Linux , Mac OS X (Tiger & Leopard) and Windows XP:

How to for Linux users (Ubuntu 7.04)

1. Install necessary libraries
   

   sudo apt-get install libsdl1.2-dev libsdl1.2debian
   sudo apt-get install libraw1394-8 libraw1394-dev
   sudo apt-get install libdc1394-13 libdc1394-dev

2. Build example using make from linux directory.
3. Run portVideoSDL output file.

How to for Mac OS X users

1. Download SDL framework (SDL Runtime library for Mac OS X) from SDL web page.
2. Put SDL.framework in /Library/Frameworks or in ~/Library/Frameworks.
3. Open Xcode Project from macosx directory.
4. Build and go.

How to for Windows users

1. SDL is already provided as lib.
2. All you have to do is compile portVideo using Visual Studio 2003 or 2005 project from win32 directory.

Happy compiling :-)

Let’s start with some project links:

• OpenTouch project web page at Google Project Hosting,
• Source code will be placed at SVN on Google Hosting Project,
• Official webpage will be at OpenTouch.info (page is still underconstruction)

Big thanks to Christian Moore aka nui for domain and access to this page.

OpenTouch framework suppose to be a cross-platform one and everybody knows that cross-plaform programming is more complicated then one-platform programming. So together with my mentor (Bertrand Cachet) and WinLibre mentoring organization leader Pierre-Jean Coudert we had to choose the best programming language in which OpenTouch should be written. There were two choices: C++ or Java. I have to say that I have experience with C++, Java and Obj-C and after my attend at WWDC I wanted to use Obj-C, but that would stop me from doing a cross-platform solution. So taking all the advantages and disadvantages of Java & C++ we decided to use C++ as more common and universal language. OpenTouch is based on image processing and I think that for this kind of tasks C++ is much more efficient with better performance which is a big plus.

But of course there is one problem I either have to find a good cross-platform capture library that will allow me to do processing of the images from my camera or I have to develop one by myself. After a quick research in this area I found that guys from reactable that wrote reactivision have developed a library called portVideo which does what I want. It actually is a C++ cross-platform capture library. The version on portVideo is pretty old I have to compare it with the version that is used in the newest version of reactivision and based on that I will download the newest version and compile it on 4 different platforms (Mac OS X Tiget & Leopard, Windows XP and Ubuntu 7.04). When I get a working version of capture library I will move to blob detection implementation.

BlobDetection Java library cannot be used anymore so I have to either port it to C++ which should not be a problem concerning that both languages are OOP. I can also implement algorithm described in paper: “A Linear-Time Component-Labeling Algorithm Using Contour Tracing Technique“.

From the other side using OSC protocol to communicate between OpenTouch and application on top of it as described in my proposal allow us to use almost any language including Obj-C and all the new features of Mac OS X Leopard. That works for me :-)

Final decisions:

• OpenTouch will be developed in C++,
• Capture library will be based on portVideo and reactivision software,
• Demo application might be written in any language including Obj-C and all the Leopard techno like Core Animation, Quartz Composer with OSC support etc,
• Blob tracking algorithm will be ported to C++ from BlobDetection Java library or implemented from scratch based on paper I mentioned before.

When I started to work on my multitouch screen I’ve been using cheap Logitech Quickcam Messenger webcam and I knew that one day I have to buy new one for better quality and performance.

There were 3 candidates :

• SPC900NC Philips – pretty expensive USB camera with really good quality, seems to work on Mac OS X with Macam drivers,
• FireFly MV Point Grey Research – firewire camera, really good one but also really expensive, should work on every platform
• Fire-I Unibrain Camera – firewire camera, good quality, not as expensive as Firefly, support for all three platforms (Windows, Linux, Mac OS X), easy to change lens

I decided to order Fire-I. It should arrive in couple days. So I will let you know how it works soon. When camera will arrive I will hack the lens to cut off all the visible light and capture only IR.

Right now my Logitech Quickcam Messenger works with Macam drivers on Mac OS X without any problems.

That’s all for now :-)

Starting from today I will be posting progress reports of my Google Summer of Code project: OpenTouch on my blog. This will be the best way to inform community what I’m actually working on and to inform my mentor (Bertrand Cachet) about my progress and any problems I have to face. Stay tuned for the first report.

While being at WWDC I took a Monday off just after Keynote and drove to Googleplex in Mountain View. I had a pleasure to visit Google and meet with Leslie Hawthorn Project Manager for Google Summer of Code :-) I had a really great time there. Thank You for that opportunity. After a tour and lunch I had a Tech Talk: Introduction to MacLibre and OpenTouch. Projects I was talking about are both my Google Summer of Code projects: MacLibre GSoC 2006 & OpenTouch GSoC 2007. After tech talk I was interviewed by Leslie for Google Summer of Code podcast :-) Here are some photos that I took at Googleplex :-)

Post about my Tech Talk and Podcast Interview at Google Summer of Code blog

My Tech Talk: Introduction to MacLibre and OpenTouch at Google Video

Direct link to podcast interview in mp3 format

My presentation in pdf format at Google Summer of Code discuss group