CompizTomato: the FCI revolution

Monday 14 July, 2008 at 6:21:52 pm
filed under graphics, projects, software

Some firm produce, a good webcam and a new era of Fruit-Computer interaction.

A few days ago I was looking for a v4l2 wrapper and stumbled across OpenCV. I’ve been hooked ever since. It’s an open computer vision library that provides a simple interface to a lot of sophisticated image processing.

As a little test of the system I hacked the sample blob tracking application to send signals to Compiz over DBus when the tracked object moves to the side of the screen. The tracking can be a little flaky so I needed a brightly colored object that would stand out against the background. We happened to have some tomatoes lying around in the kitchen, and thus was born CompizTomato.

As you can see from the video, the recognition is not perfect but certainly seems to get the job done. I can use it with only slightly diminished accuracy while sitting right in front of my computer against a busy background. Further testing has also revealed that I can also track my head and wobble from side to side, but it’s not quite as fun and considerably harder on the neck.

Without further adieu, the video:

http://www.youtube.com/watch?v=cD9ZMjy_rkE

9 comments

RSS / trackback

respond

  1. David Granberg

    on Tuesday 15 July, 2008 at 3:58:00 am

    BRAVO

  2. Chase McVeigh-Walker

    on Tuesday 15 July, 2008 at 12:21:24 pm

    Jacob, this was really interesting. thank you for showing me this.

    -Chase McVeigh-Walker

  3. Lauren Alpert

    on Tuesday 15 July, 2008 at 5:30:00 pm

    nice. now onto the minority report gloves, eh?

  4. Jacob Andreas

    on Tuesday 15 July, 2008 at 9:55:00 pm

    That's tonight's project.

  5. Claire Andreas

    on Wednesday 16 July, 2008 at 5:44:00 am

    oh god.

  6. TAylor Nelson

    on Tuesday 29 July, 2008 at 7:15:06 pm

    MArvelous jacob

  7. Taylor

    on Thursday 07 August, 2008 at 2:32:42 am

    http://img160.imageshack.us/img160/7844/screenshot4mi3.png
    compiz-fusion.org

  8. Jacob

    on Thursday 07 August, 2008 at 8:53:37 am

    Just because you can doesn’t mean you should, Taylor.

  9. Trackbacks

    on Wednesday 03 December, 2008 at 10:54:25 pm