IDF 2010, Research Day: Context-Aware Computing

Is This The Future?

The chart shows different sensors extracting different types of data, how they might be classed and what might be inferred from the data. Note that it’s not just about the sensors. How the sensors are used and what the user is doing with other applications (“soft sensing”) also becomes part of the user’s data stream, and these are fused together by something Nachman called the “Activity Fusion Algorithm.”

If you want the systems in your life to really be smarter about what you do, and make recommendations or give you useful information, then you’ll want all of the sensors in all of your systems (portable or not) to aggregate that data. The inference engine can then be much smarter about what predictions it makes about what you’ll do or like. If that sounds creepy, it could be. But if it’s done right, it could be a huge productivity enhancer.

Now comes the tricky part. All of this data collection and aggregation requires tremendous compute and storage capability. It also implies that some of this data is either stored in the cloud, on distant servers, or passed through systems on the Internet. So, users need granular control over what data is collected and where it’s stored.

All of this is still in very early stages of development. For example, if you want to have sensors up and running 24x7, the power draw needs to be extremely low, and you need the ability to quickly and easily recharge. Anyone who’s used a GPS radio on a smartphone can understand how challenging this might be for certain classes of sensors.

Of course, the biggest question is social: will people really want it? Different users might have different feelings about being monitored constantly. Just look at the controversy surrounding the recent launch of Facebook Places.

In the end, context-aware computing will likely become prevalent a decade or so from now. However, it’s really difficult to predict what form it will take and how it will be actually be implemented and used. That’s the nature of research: what shows up in the lab today may affect what products we see a decade later, but predicting what those will be is a much harder nut to crack.

  • Maybe, at 29, I'm already the old guy that thinks new-fangled technology is evil, but I absolutely do not want this.

    Almost every infuriatingly negative experience I've had with technology was the result of some developer trying so hard to make my computer do what I want for me (or take advantage of some cool new technology), I had to fight to make it do what I actually wanted it to do (I'm looking right at you Microsoft). It gets even worse when tech developers implement stuff "because they think it's cool" instead of "because people actually want it" (clippy anyone?)... or I suddenly can't do a simple help search for something like "where's the button to do X" because a software developer decided it would be a great idea to have ALL of their help documentation online, but never contemplated the idea that somebody might use their software on a private network that doesn't have internet access (or in a hotel room that charges 12.95 for internet access, or in an airport with no wi-fi, etc).
    Reply
  • randomizer
    "So, users need granular control over what data is collected and where it’s stored."

    Users don't want granular control. That's why they whine about Facebook privacy settings. Users want "me," "my friends" and "everyone" privacy settings. Heaven forbid they have so much choice that it makes them think for more than a fraction of a second. This is the 21st century, choice is old-fashioned. These days automation is key. If a program doesn't do everything then it isn't good enough. Gone are the days when people had a program that they expected to do one thing well. Now programs must do everything, poorly.
    Reply
  • executor2
    @anon dude "I'm looking right at you Microsoft" , I don't get you Sir , because Windows evolved from better to best , quick search programs in the start menu ,memory caching to speed applications to "instant" opening , reliable updates of windows and it`s drives , a very big (extreme) database of drives for hardware.

    "where's the button to do X" Sir I never had to search for a button in my life in Windows , the interface is intuitive that means you have to use your brain to understand it .

    "a private network that doesn't have internet access" well if you travel allot you must have a wireless laptop hooked to your phone , I am wrong ?

    All those problems are directly connected to your inability to adapt to change , try figuring out the solutions not blame problem , best regards.
    Reply
  • amnotanoobie
    Almost every infuriatingly negative experience I've had with technology was the result of some developer trying so hard to make my computer do what I want for me (or take advantage of some cool new technology), I had to fight to make it do what I actually wanted it to do (I'm looking right at you Microsoft). It gets even worse when tech developers implement stuff "because they think it's cool" instead of "because people actually want it" (clippy anyone?)...

    We could agree that not everything that MS implements turns into a goldmine. What we have is MS trying to explore what "could" possibly work or what people would possibly want. SuperFetch for example was initially hell for Vista, but after refinement in Win7 most people probably couldn't do without the speed boost of launching applications.

    or I suddenly can't do a simple help search for something like "where's the button to do X" because a software developer decided it would be a great idea to have ALL of their help documentation online, but never contemplated the idea that somebody might use their software on a private network ...

    Not all software makers are like this, though some are. Microsoft usually has an offline help available unless of course if you don't include it in the installation. MS is probably one of the biggest companies who research items about usability and how people interact with computers.

    9501559 said:
    Now programs must do everything, poorly.

    It sometimes is how some software makers try to rush and add new features just to get ahead of other companies. Sometimes it pays off, sometimes it doesn't (e.g. Vista).
    Reply
  • randomizer
    executor2All those problems are directly connected to your inability to adapt to changeOr maybe it's due to his lack of desire to adapt to how Windows wants him to do things. Is it beyond reason that a person would want their software to do what they want it to do, and how they want it to do it? I generally don't mind using Windows, as it has some nice features that make using it convenient (and some that make it downright infuriating).

    Maybe you don't like having control of your system. I suppose if not wanting to give up control and not liking the idea of hiding system configuration behind more and more levels of abstraction (and deeper and deeper menus) is what you call "inability to adapt to change", then yes, some of us have a problem and would prefer things to be simple again.
    Reply
  • randomizer
    amnotanoobieSuperFetch for example was initially hell for Vista, but after refinement in Win7 most people probably couldn't do without the speed boost of launching applications.I'd prefer it if applications launched quickly without aggressive prefetching. But I'd have to use another OS for that. Or I could get an SSD since that makes far more difference than Superfetch.

    amnotanoobieIt sometimes is how some software makers try to rush and add new features just to get ahead of other companies. Sometimes it pays off, sometimes it doesn't (e.g. Vista).Just look at AVG. Up to AVG 7.5 I was able to use it, but once AVG 8 came out the program became a free version of Norton. Bloated, slow, packed with useless features...

    Then one day Microsoft opened up a dusty chest in their Redmond attic and discovered long-forgotten writings containing Ockham's Razor. Thus Microsoft Security Essentials was born.
    Reply
  • rwmunchkin12788
    Well this turned into some heated debate pretty darn quickly. Anyway, back on topic.

    I think both anon dude and randomizer have perfectly valid points for two very different groups of people. The everyday user has nowhere near the technological know-how that even tomshardware.com newbies have, and a plethora of controls to do anything the person wanted would only make them confused.

    What's frustrating anon dude is the obvious response to make everything easier to the point of losing that lack of control. I remember people griping back when Windows XP had the new format for the control panel and start menu. Heck, even as a young teenager it frustrated me until I figured out that you can switch everything back.

    Us tech savvy people want our choices, our options, our features, all to be customizable and tunable to the nth degree, while the everyday user just wants point and click (or not even).

    I think that context-aware computing, if done well, can allow for both ends of the spectrum. Experienced users would love to be able to choose what things get automated and have infinite control over how it does that, while everyday users would love to just plug it in and instantly see it work without having to pick or choose any options.
    Reply
  • luke904
    anon dudeMaybe, at 29, I'm already the old guy that thinks new-fangled technology is evil, but I absolutely do not want this.Almost every infuriatingly negative experience I've had with technology was the result of some developer trying so hard to make my computer do what I want for me (or take advantage of some cool new technology), I had to fight to make it do what I actually wanted it to do (I'm looking right at you Microsoft). It gets even worse when tech developers implement stuff "because they think it's cool" instead of "because people actually want it" (clippy anyone?)... or I suddenly can't do a simple help search for something like "where's the button to do X" because a software developer decided it would be a great idea to have ALL of their help documentation online, but never contemplated the idea that somebody might use their software on a private network that doesn't have internet access (or in a hotel room that charges 12.95 for internet access, or in an airport with no wi-fi, etc).

    I'm 16 and I agree
    Reply
  • luke904
    executor2@anon dude "I'm looking right at you Microsoft" , I don't get you Sir , because Windows evolved from better to best , quick search programs in the start menu ,memory caching to speed applications to "instant" opening , reliable updates of windows and it`s drives , a very big (extreme) database of drives for hardware."where's the button to do X" Sir I never had to search for a button in my life in Windows , the interface is intuitive that means you have to use your brain to understand it . "a private network that doesn't have internet access" well if you travel allot you must have a wireless laptop hooked to your phone , I am wrong ?All those problems are directly connected to your inability to adapt to change , try figuring out the solutions not blame problem , best regards.

    windows makes too many decisions for you, its annoying.. they are wrong 90% o the time and even if they were the right ones it would hardly save me any time


    I'm not happy with any operating system, not windows, not mac, not even linux


    Reply
  • smile9999
    how about no thank you
    Reply