Sign in with
Sign up | Sign in

Experiencing Projected AR

CastAR: The Augmented And Virtual Reality Triple-Threat
By

Again, castAR is one of those products that you really have to experience in-person to fully appreciate. But now that we’ve explained how the glasses work, we’ll try to give you an impression of what it's like to use them. Technical Illusions let us try out the new HD prototype, which projects a 720p image out into the world. Even in this early stage of development, the castAR glasses are very light and comfortable to wear.

Angy Bots screenshot (not running on CastAR)Angy Bots screenshot (not running on CastAR)

The first demo we were shown was a third-person shooter called Angry Bots, a sample project made with the Unity Engine, and an example of how easy it is to get Unity games running in castAR. While field of view issues affected the demo's ability to draw us in, it was still a good example of how existing games can be adapted to castAR. Technical Illusions also added that the horizontal field of view will be much better on the final product.

Next, we were shown what Rick called the company's “non-infringing Star Wars-like chess scene”. Although the demo wasn't interactive, it served as a much better indicator of what castAR can do. You see a 3D chess board with animated pieces projected onto it, and when you move around, toward, or away from the board, your view shifts as if the pieces are there in front of you. It’s believable enough that you feel tempted to reach out and pick up one of the characters, which of course you can't. With the integration of gesture recognition through Kinext, though, you will be able to in the future. This is the demo that impressed me most. It was the first time I've used an AR system able to draw my mind in and make the content out in front of me believeable.

CastAR 3D Chess Test Footage

The third demo was similarly a non-interactive scene. But instead of a chess board, it was an RPG-style dungeon filled with armored skeletons. Again, it looked impressively real. You could lean in very close to the skeletons to see their detail work. Regardless of angle, they always appeared right where they were expected.

Granted, all of this depends on the retro-reflective surface, so the immersion factor is influenced heavily by the size of the surface available to you. We asked if it's possible to surround yourself with the material, creating a 360-degree experience and were told yes, it should be, so long as you have enough head-tracking markers.

Testing Multi-User CastAR (via Technical Illusions)Testing Multi-User CastAR (via Technical Illusions)

The last demo showed how castAR may be used for more than gaming. It was a simple non-interactive virtual desktop that Rick threw together, with different windows appearing in front of you on different planes.

Display all 13 comments.
This thread is closed for comments
  • 2 Hide
    blackmagnum , February 27, 2014 3:07 AM
    Someone's been trigger happy with the hot-glue gun.
  • 2 Hide
    Quarkzquarkz , February 27, 2014 7:50 AM
    Wait, so will this be better than Oculus Rift? I'm really curious now.
  • 3 Hide
    CaedenV , February 27, 2014 7:53 AM
    This is pretty neat!Back when I was a kid in the '90s my dad use to work for a company that made 3D scanners, and I had the opportunity to follow him one day to go repair a scanner at a college. While there the college students kept me entertained with a system kind of similar to this. It was based on a stereoscopic rear-projection screen, and a set of head tracking polarized glasses. It was pretty cool, and I have been very supprised that we have not seen much like it until now.The other cool thing was that rather than a big funky wand, you basically had 2 handheld devices with buttons under each finger in order to interact with the enviornment. One button would allow you to grab and move an object, another would allow you to rotate, others would bring up context menus, or 'in game' options. It was all really neat.Anywho, the big thing that it was missing (other than good graphics... it was the '90s after all) was the ability to have a multiple users. With multiple users interacting on the same playing field like this new AR can do, it makes for some much more interesting gameplay.I really hope that things like VR and AR are able to take off. When I was a kid I was promised that I could go live in space, and that we would have holodecks available... so far we are 0 for 2, but I would be pretty happy if we could get one or the other off the ground.
  • 3 Hide
    CaedenV , February 27, 2014 8:04 AM
    Quote:
    Wait, so will this be better than Oculus Rift? I'm really curious now.


    Certainly not 'better' in the way of quality. The nice thing about Oculus Rift is that you have a much more controlled enviornment, and are able to surround yourself with a virtural world while blocking out reality. This system is meant to open up more social or alternative styles of gameplay. Much more flexible in what it can do... but it will necessarily always have drawbacks because the environment is less controlled. Ambient light can wash out your characters, resolution on projectors vs a screen are always going to suffer more from things like the screen door effect, and it is much more difficult to cram 2 high resolution projectors in the same space as a single high res monitor.

    So it is one of those things where you win some and you loose some. I think the Oculus Rift will have much more of a following for hard core gamers, and even myself as a moderate gamer. But the Rift will always suffer in the popular market because (as is the great secret of Nintendo) people, especially kids (or parents of those kids), enjoy more social games. Things that block reality out have a very difficult time gaining traction. But something like this AR would offer more social interaction. Essentially high tech board and card games, or some sort of choose your own adventure games. I could just imagine something like Warhammer, or D&D being played like this where you can throw down a card or a token and have a 3D character on the field of battle. Or better yet, combine UI hardware like this with a content creator like Project Spark in a school setting to engage students in cooperative programming and game environments!

    At any rate, you loose out on quality, but you have the potential to gain in other ways which could be much more interesting than the Rift. Very different devices aimed at very different uses and markets.
  • 5 Hide
    Omid_m_19 , February 27, 2014 8:20 AM
    Beside D&D and board games that have been mentioned in the article,and I add TCG(Trading card games,like Yu-gi oh and infinity wars),I think other things too will be much fun.For example,by adding kinect,you can play a fighting game,seeing your opponent in front of you,and with kinect monitoring your body actions,you hit or block AI fighter,like real fights.I think it would be very useful in learning martial arts.
  • 1 Hide
    Omid_m_19 , February 27, 2014 8:33 AM
    Beside D&D and board games that have been mentioned in the article,and I add TCG(Trading card games,like Yu-gi oh and infinity wars),I think other things too will be much fun.For example,by adding kinect,you can play a fighting game,seeing your opponent in front of you,and with kinect monitoring your body actions,you hit or block AI fighter,like real fights.I think it would be very useful in learning martial arts.
  • 1 Hide
    rsktek , February 27, 2014 10:51 AM
    Wondered how long it would take Tom's to mention this tech gear.
  • -1 Hide
    tristangl , February 27, 2014 10:51 AM
    Off topic and no one will care butI find that dev girl very cute hehe
  • -1 Hide
    tristangl , February 27, 2014 11:31 AM
    Off topic and no one will care butI find that dev girl very cute hehe
  • 2 Hide
    tristangl , February 27, 2014 11:33 AM
    darn I forgot that you CANNOT hit refresh on Toms pageGuys at Tom... can you fix that stupid bug where it double post your comment if you ever hit F5 once you post somethingShould be already fixed... I mean you are a a tech website are you not??!!?
  • 0 Hide
    Murissokah , February 27, 2014 12:54 PM
    "Although the pair no longer worked at Value..."That is one weird typo.
  • 1 Hide
    floobadedoo , February 28, 2014 9:29 AM
    Comparing Cast AR to the Oculus Rift is interesting. The OR is regarded as having an advantage when full immersion is desired. The wide FOV and low latency of the OR work well together to reduce motion-induced nausea which has been one of the biggest impediments to widely adopted VR. Eye fatigue is likely to still be a problem with the Rift, however. I've experienced wide FOV VR with several hours of use with a Sensics system an it is a remarkably cool experience. However, full visual immersion still has some drawbacks in the user-interface and this can disrupt immersion or leads to a limited experience. Without very accurate hand/finger tracking, controls are best limited to a "HOTAS" (or HOMAK--Hands-On-Mouse-And-Keyboard) mentality. This creates a burden for the application designer, needing to create an abstraction of the control or environment that maps to the HOMAK/HOTAS input devices. A poor abstraction can be trivially accomplished, but a good controls abstraction requires some serious savvy. A Kinect type interface can simplify some of this in certain situations, but overall, the user is left grasping at air once the hands come off the main controls. And walking about with another player also in VR? Please empty the room of all obstacles and invest in some good body tracking software.What CastAR offers is a greatly simplified interface considerations with AR objects (and players!) that can match our real-world expectations. Need to move an AR game piece? Reach out, pick it up and place it where you want it. Need to flip some switches? Slide levers? Thump on a faulty needle gauge? Reach out and do it. Need to move from the pilot cockpit seat to the back-facing gunner's seat? Get up, turn around, walk to the other seat and sit down. Need to touch other players for some reason? Reach over and touch them. (Yeah, what games are there that have you touch another real-life player? None, yet, but if someone wants to develop one, CastAR is the obvious choice over any fully immersive HMD.)CastAR technology may beg us to redecorate our rooms with grey shiny cloth, but it won't ask us to rip ourselves out of the immersive environment just to find the mouse that fell on the floor, or to check on the odd sound that might be the cat coughing up a hairball, or because we've got an eye-fatigue induced migraine after 45 minutes of gaming. What CastAR is offering is something far beyond the simple and very limited world of HMD-based VR. It is offering to replace a great deal of user-interface mojo with naturally intuitive interactions. Immersion isn't just about visuals, it is about meeting a user's intuitive expectations instead of having to remember which keystroke accomplishes which simple actions. VR HMDs are to visuals what surround sound is to mono. But the applications CastAR has the potential to offer can break down the fourth wall and create accessibility to users far beyond immersive VR. CastAR will allow us to integrate the real world into our games, not as an intrusion on immersion, but as an augmentation to the game environment. (See what I did there?) Any software developers aiming strictly at VR are being short-sighted in the extreme.
  • 0 Hide
    wtfxxxgp , March 6, 2014 4:55 AM
    I think there are merits to both types of technology but I agree with another comment that this tech is going to follow a similar success story as Wii - it appeals more directly and immediately to the younger market. I think it could end up being very successful if implemented properly - think about having an entire room outfitted to take advantage of this for team-based games like LOL for example. It could be very interesting indeed. The future looks exciting!