Sign in with
Sign up | Sign in

VIDEO: Skyrim PC Hacked to Work With Microsoft Kinect

By - Source: Geeky Gadgets | B 26 comments

A YouTube member reveals a hack that allows him to use Kinect to control his character in Bethesda's just-released Skyrim.

It was bound to happen eventually: someone has managed to get Microsoft's Kinect motion-sensing device to work within the PC version of Bethesda's The Elder Scrolls V: Skyrim. The hack was developed by YouTube user KinectFAAST and uses both motion detection and voice commands to get the job done.

"The gestures are simple and intuitive, yet allow for gameplay depth never before seen with the Kinect," KinectFAAST writes. "Simply swing your right arm forward, up, left, or right, and your character will hack with his sword. Or, if you have a spell in your right arm, simply raise your hand or push it forward to cast. Use your left arm to control your character’s view; if you have something equipped like a spell or shield, you left arm will control that as well."

KinectFAAST explains that the gesture control is handled by the Kinect using a middleware program called FAAST that operates using the OpenNI framework and converts user movements into keystrokes. The OpenNI framework doesn't actually support voice control, so he used a program called VAC (Voice Activated Commands) which allows the user to pair spoken words with keystrokes.

"Trying to avoid any type of controller, wires, or anything that might impede movement, I have used a RazorFish Bluetooth headset to send voice commands to VAC," he said. "This device was relatively inexpensive, and probably accounts for some of the gameplay moments where a command is unrecognized."

A video demonstration can be seen below, but it doesn't showcase a number of voice-related features like using "Left hand" and "Right hand" commands, saying "Journal," saying "Hello" and more.

Skyrim Kinect

Display 26 Comments.
This thread is closed for comments
Top Comments
  • 13 Hide
    RazorBurn , December 7, 2011 7:54 AM
    Im Fat.. And I really need that..
  • 12 Hide
    Swolern , December 7, 2011 6:17 AM
    Awesome, always looking for some new ways to game to keep it fresh and interesting. The recognition technology needs to get better though.
  • 12 Hide
    jazn1337 , December 7, 2011 7:03 AM
    But why can't I just yell Dragon Shouts at Kinect? That's the only real feature you need.
Other Comments
  • 12 Hide
    Swolern , December 7, 2011 6:17 AM
    Awesome, always looking for some new ways to game to keep it fresh and interesting. The recognition technology needs to get better though.
  • 6 Hide
    mrpijey , December 7, 2011 6:40 AM
    Interesting stuff but nothing more than a mere proof of concept. As theconsolegamer mentioned, standing there waving around there like a jacked up moron isn't how I want to experience a game. The only way I can see a true full body experience working within a game is when we can hookup electrodes to our brain or put on a helmet and play the game in a virtual reality environment without the need to stand in front of the TV and smash everything around us because we're jumping up and down like lunatics to move the character forward.

    I've tried Kinect and I can't see anything fun with it except for the occasional family/drunken party Guitar Hero-kind-of game session. For games like Skyrim and alikes this would never work in the long run.
  • 12 Hide
    jazn1337 , December 7, 2011 7:03 AM
    But why can't I just yell Dragon Shouts at Kinect? That's the only real feature you need.
  • 9 Hide
    clonazepam , December 7, 2011 7:26 AM
    lol Im waaay too lazy to ever get into this... I like the idea of just cherry picking that one feature of voice-activated commands. That thought immediately brings me back to the horrid experience I had trying to make use of Windows 7 voice commands. You can only say "start listening" so many times before the microphone and its wire are hanging from the power lines outside.
  • 9 Hide
    darkchazz , December 7, 2011 7:53 AM
    God I love modders :) 
  • 13 Hide
    RazorBurn , December 7, 2011 7:54 AM
    Im Fat.. And I really need that..
  • 5 Hide
    CaedenV , December 7, 2011 9:30 AM
    I would much rather see what could be done with 2 PS Move controllers. Assign buttons on one for your forward, back, strafe left and strafe right, and assign interface buttons on the other. There would be less lag, more natural movement for the player, and less worrying the neighbors by repeatedly shouting things like 'shield' 'sward' 'fire' and other things that will make them think you are about to massacre the whole building.
    I am all for motion control... just let me have the option to sit down, and not have to talk.
  • 0 Hide
    kryojenix , December 7, 2011 11:07 AM
    AWESOME! Me Want!!
  • 10 Hide
    beardguy , December 7, 2011 11:34 AM
    Now do that for the next 200 hours of game play, guy would be ripped :) 

    "Where do you work out?" ...

    "In Skyrim, it's only for the Dragon Born though"
  • 0 Hide
    jimmy-bee , December 7, 2011 12:11 PM
    Thats nice but hows about getting SkyRims numerous PC bugs patched, listing Bethesda. Abruptly quitting/crashing to the desktop sucks as do the shaders going haywire after a while forcing a game restart to fix. I knew I should have waited longer to buy it.
  • 1 Hide
    Houndsteeth , December 7, 2011 12:29 PM
    Bethesda...awesome games, just wait six months for them to work out the bugs.
  • 0 Hide
    JasonAkkerman , December 7, 2011 12:53 PM
    Lightning bolt! Lightning bolt! Lightning bolt!
  • 5 Hide
    fulle , December 7, 2011 1:44 PM
    jimmy-beeThats nice but hows about getting SkyRims numerous PC bugs patched, listing Bethesda. Abruptly quitting/crashing to the desktop sucks as do the shaders going haywire after a while forcing a game restart to fix. I knew I should have waited longer to buy it.


    The problem is that the game only utilizes 2GB of RAM by default. Download a large address aware mod, like 4GB Skyrim.

    http://www.skyrimnexus.com/downloads/file.php?id=1013
  • 0 Hide
    beardguy , December 7, 2011 2:09 PM
    fulleThe problem is that the game only utilizes 2GB of RAM by default. Download a large address aware mod, like 4GB Skyrim.http://www.skyrimnexus.com/downloads/file.php?id=1013


    I don't think the bugs/crashes have anything to do with this, do they?

    I've been having issues myself with random crashes to the desktop. Also, I get this weird flickering effect ... every time it flickers to a white screen for only a split second I hear the water sound effect like I'm in the water or something. Pretty strange. I hope they fix all the bugs soon.
  • 3 Hide
    fulle , December 7, 2011 2:32 PM
    beardguyI don't think the bugs/crashes have anything to do with this, do they? I've been having issues myself with random crashes to the desktop. Also, I get this weird flickering effect ... every time it flickers to a white screen for only a split second I hear the water sound effect like I'm in the water or something. Pretty strange. I hope they fix all the bugs soon.


    It has a LOT to do with crash to desktop issues, and loss of texture problems, like the person I quoted described... so yes, I think my proposed fix would work for him.

    As for your issue... well, we should be discussing this sort of thing in the forums. Most of the Skyrim issues are fixable. I had many problems myself, but got the vast majority of it sorted out the night I bought the game, by just doing some searching around for about a half hour.

    Updating video drivers, applying the 4GB mod I linked, and changing your sound audio quality to 41K, resolves the vast majority of Skyrim technical issues. And then it's just little things, like NPCs clipping through walls and crap, which isn't as game breaking. The comments section isn't the best place for talking about specific fixes though.
  • 0 Hide
    alidan , December 7, 2011 3:30 PM
    equipping new weapons is frustrating for me, because right hand usually locks to one weapon and than its a pain in the ... to fix it. i can see voice commands being a very good tool, in the way of not pausing the game.

    but the video shows why kinect has better applications outside of game than inside.

    i would love to see move, that could be a bit interesting, but a full mod of combat would be unnecessary, but in my eyes could be the best mod ever if done right. need to unlock character movement, and have free motion of the sword and bow, swing as many times as you can, get rid of stamania as its tied to if you can do a full swing. weapon parrys, and probably a slow time down option for fighting bow users, like 1 second long, and you move your sword to parry it.

    but than again i have high hopes for motion games, and it will never happen, because motion games are content with family orientated game play,
  • 3 Hide
    nezzymighty , December 7, 2011 3:35 PM
    RazorBurnIm Fat.. And I really need that..


    That's a hillarious statement and I'm there too.... we would need kinect to measure our feet in motion... how fast or slow paced we run on a spot... then we'll really loose weight quick... Imagine if you dedicated as much time to working out as playing the game... as time passes as you level your character, you'll probably feel like you've levelled too...
  • 1 Hide
    mb2bm55 , December 7, 2011 3:55 PM
    If you played it with weights in hand it would probably be an effective workout
Display more comments