Sign in with
Sign up | Sign in

Microsoft Surface Used as a Big Games Controller

By - Source: Tom's Hardware US | B 35 comments

Hands-on gaming.

Touchscreen gaming, like it or not, is soon going to be huge. Some would say that gaming on touchscreens is already big and here, and not in the way of the Nintendo DS, but the iPod touch, iPhone and all the Android phones that rely entirely on the touch screen for input.

What, then, will become of the control interfaces for more hardware games that require a controller or mouse and keyboard? Nobody knows yet, but University of Massachusetts Lowell Robotics Lab student Eric McCann seems to have an early idea of what it could be like.

Using Microsoft's experimental Surface table experiment, McCann hacked together a controller interface that uses both hands on the screen to control Microsoft Flight Simulator as well as Valve Software's Portal.

While it's not a perfect solution since your hands are still covering screen real estate, it's still a fascinating exercise that could point to how we someday may play hardcore games.

Check out the video demo below:

Microsoft Surface Used as a Big Games Controller

(via Kotaku.)

Ask a Category Expert

Create a new thread in the News comments forum about this subject

Example: Notebook, Android, SSD hard drive

This thread is closed for comments
Top Comments
  • 11 Hide
    TheStealthyOne , September 16, 2010 1:15 PM
    I dunno if I like this; leaving a tangible interface doesn't sound ideal :/ 
Other Comments
  • 7 Hide
    thorkle , September 16, 2010 1:15 PM
    This seems applicable for flight simulator, but portal looked very strange with those controls. I think it would be best if there were more specific control schemes for various games.
  • 11 Hide
    TheStealthyOne , September 16, 2010 1:15 PM
    I dunno if I like this; leaving a tangible interface doesn't sound ideal :/ 
  • Display all 35 comments.
  • 4 Hide
    willgart , September 16, 2010 1:18 PM
    interesting... not sure if its really useful as your hands will hide part of the screen all the time. and appear to not be comfortable in a horizontal position. certainly more powerful in a vertical one.

    maybe another touchscreen at the bottom of the device (like a keyboard in a laptop) will be better.
    In fact 2 touchscreens... then you can play with somebody else in front of you while sit on a comfortable chair (and you share the surface between the 2 users).
    Will be incredible for a wargame, you can have a touchscreen with some information in front of you and you can type commands here, and you can point the map on the surface itself to move the units...

    The idea of having a touchscreen instead of a keyboard could be really great, no more keyboard shortcuts but real dynamic icons, like an RPG game where you have your shortcut bar with your actions, these actions can be displayed on the "virtual keyboard" as well as life, stamina etc...
    (I think some next gen laptop will be like this)

    But I like the controller on the screen, appear to be really dynamic.
    is it working on a tabletpc ?
  • 1 Hide
    tu_illegalamigo , September 16, 2010 1:25 PM
    I dont like it, at least not yet. I will cling to my sticks and buttons for a bit longer. I wonder how responsive it is, and perhaps how comfortable as well.
  • 3 Hide
    Specter0420 , September 16, 2010 1:32 PM
    This would be awesome for a game like DCS: Black Shark with its clickable cockpit buttons! Just imagine looking around with your trackir, flying with a joystick, and reaching up and pressing the buttons/flipping the switches in the cockpit, total immersion! Then again a normal touchscreen would do just fine as well.
  • 2 Hide
    SoiledBottom , September 16, 2010 1:33 PM
    + 1 to The crystal Method
  • 7 Hide
    kelemvor4 , September 16, 2010 1:53 PM
    Controllers aren't going anywhere; at least not as a result of touch screens. Hell, keyboard and mouse circa 1980's is still the king for controlling most games.

    Sure if you want to play farmville or pong, touch screen is good enough, but that won't hold true for "real" games.
  • 4 Hide
    ares1214 , September 16, 2010 2:04 PM
    This plus the table thing they have should be interesting. Unless it gets beat to the punch by the iCoffee Table and the iHave My Hands on Said Coffee Table...
  • 1 Hide
    troger5troger5 , September 16, 2010 2:06 PM
    I see it being good for menu's, view screens, turning on ecm jamming in a flight game etc, but the point of a similator is to simulate and having a ch throttle and flight stick or a stearing wheel / foot pedal etc can never be replaced by touch. I can see having something that sits like at an angle above your keyboard and below your monitor for switching settings, viewing maps , etc would be great without having to switch to these screens and then finding your button to push... Starcraft / warcraft II type games would be interesting........just my thought
  • 2 Hide
    eyemaster , September 16, 2010 2:41 PM
    They keep trying to have touch screens and games put together. Unless you create a different game than what exists today, it's not going to merge properly. When you plan a first person shooter, you need a controler of some kind, to mimic real life. If you plan a RTS, then you need some kind of mouse, touch screen sounds good but your arms will get tired and you will miss visual cues as you'd have both hands over the screen managing things.

    I guess I lack the imagination necessary to see where a touch screen is useful for gaming.
  • 0 Hide
    theoutbound , September 16, 2010 3:17 PM
    I think this would be a very situational controller. For RTS games, this would be the holy grail of controllers. For FPS games, RPGs or pretty much anything else, I would take a mouse and keyboard over it any day.
  • 1 Hide
    madass , September 16, 2010 3:53 PM
    Until and unless people start playing games "in our heads" Johny Quest style, the mouse and keyboard is here to stay.
  • 0 Hide
    Stifle , September 16, 2010 4:08 PM
    Sounds like fun, but ill still evacuate more heads with my keyboard and mouse.
  • 0 Hide
    jgiron , September 16, 2010 4:16 PM
    I can see this being useful for an RTS, but not other game types.
  • 0 Hide
    sailfish , September 16, 2010 4:50 PM
    While it's an interesting concept, it looks like it impedes game play more than advances it. A mouse+keyboard is much more efficient and less distracting.
  • 0 Hide
    pocketdrummer , September 16, 2010 4:58 PM
    Though useful for some things (hitting the buttons in the cockpit, flipping switches), it's terrible for others (FPS games need total precision).

    Touch is great, but motion is the future. Both still have a LONG way to go before they are ideal.
  • 0 Hide
    g00fysmiley , September 16, 2010 5:08 PM
    I can see MMO gaming on a ouchscreen would be useful, select target and acess to more movs than a specialty mouse or keyboard can allow.. less clicking means better mmo players

    note I'm saying for the mouse only you'de still move most efficiently with keyboard controls and hot keys
  • 1 Hide
    dstigue , September 16, 2010 5:16 PM
    This needs a second input device like Nintendo DS. It's not a new concept!!
  • 0 Hide
    azcoyote , September 16, 2010 6:22 PM
    Just imagine playing Axis and Allies on one of these....
  • 0 Hide
    vloomz , September 16, 2010 6:23 PM
    not a perfect solution since your hands are still covering screen real estate

    why not use mouse and keyboard??
Display more comments