Sign in with
Sign up | Sign in

Kinect Used As 3D Video Capture Tool

By - Source: Tom's Hardware US | B 8 comments

It's one of the first Linux-based Kinect applications.

While Xbox 360 gamers smack each other around playing games with the Microsoft Kinect, the PC sector has seen quite a bit of Kinect-related activity by way of drivers and apps. Just recently a set of open-source drivers for Linux became available, the result of a $3000 bounty supplied by an Adafruit Industries contest.

However the latest "hack" arrives by way of UC Davis visualization researcher Oliver Kreylos in a tool that captures the Kinect's infrared and color cameras, mapping the photographic aspect onto the "depth" video stream.

"[It's] based on the reverse engineering work of Hector Martin (marcan42 on twitter and YouTube)," he explained. "I didn't use any of his code, but the 'magic incantations' that need to be sent to the Kinect to enable the cameras and start streaming. Those incantations were essential, because I don't own an Xbox myself, so I couldn't snoop its USB protocol. The 3D reconstruction code is entirely written from scratch in C++, using my own Vrui VR toolkit for 3D rendering management and interaction."

The resulting application generates a wild image that almost projects Kreylos forward while providing a scribbled, outline appearance as seen in the old 1985 A-HA video, Take On Me. As seen in the video below, the app really gets interesting when Kreylos begins to manipulate the entire view while he's talking, rotating the image until you can see the other side of his otherwise flat appearance. Nope, no brains and guts, just a reverse "texture."

It wouldn't be surprising to see Kreylos or other developers purchase additional Kinect devices and incorporate them into similar apps. In this case, three additional views could provide front, back, and another side view, allowing him to create a more 3D-like image. Then again, that's another $450. Would it be worth it?

Oliver Kreylos Kinect Hack

Display all 8 comments.
This thread is closed for comments
  • 4 Hide
    razor512 , November 18, 2010 12:44 AM
    Now they just need to refine it and make a app that will allow it to display the image on 3D HDTV's and make it real time.

    imagine skype 3D
  • 0 Hide
    ricardok , November 18, 2010 1:19 AM
    I guess you guys should go here:
  • 0 Hide
    dEAne , November 18, 2010 4:30 AM
    Thanks for this - I have something else in my mind, you give me an idea.
  • 0 Hide
    TheWhiteRose000 , November 18, 2010 8:43 AM
  • 0 Hide
    makingoneup , November 18, 2010 9:20 AM
  • 1 Hide
    zak_mckraken , November 18, 2010 3:59 PM
    dEAneThanks for this - I have something else in my mind, you give me an idea.

  • 0 Hide
    eddieroolz , November 18, 2010 6:20 PM
    Kinect is definitely proving to be a success.
  • 0 Hide
    volky , November 18, 2010 6:36 PM
    If he had four of em, just imagine what he could do lol