Sign in with
Sign up | Sign in

Stream Computing

Eight Computing Advancements At IBM Research
By
Stream Computing

Stream computing is one of the most interesting projects at IBM Research because it could have a major impact on all facets of computing. In traditional information analysis, you feed a data set into an application, which performs the analysis and then provides the results. To perform additional analysis, you change the data and re-start the test. With stream computing, the data keeps feeding to the application constantly, and the analysis continues in real-time. From a consumer standpoint, this would be akin to taking photographs with a camera, feeding them into Photoshop continually, adjusting pixels for color quality, and changing the images and improving them as you snap each new image--except that, you could keep snapping the same photo at different times of the day and with different settings, and Photoshop would provide the best possible image using automated filters and effects.

The problem that stream computing addresses is that, in the time it takes to run a query using a given data set, especially if you have scheduled time on a supercomputer for the test, the original data may have changed. This means scientists are dealing with out-of-date information.

“What's unique about IBM's stream computing software is that it utilizes a new streaming architecture and breakthrough mathematical algorithms to create a forward-looking analysis of data from any source, narrowing down what people are looking for and continuously refining the answer as additional data is made available,” says Nagui Halim, the chief scientist for stream computing at IBM. “The stream computing software has the ability to assemble applications on the fly based on the inquiry it is trying to solve, using a new software architecture that pulls in the components it needs, when they are needed, that are best at handling a specific task,” adds Halim. “Millions of pieces of data from multiple sources are streaming into systems that are not capable of processing the data fast enough. We constructed a computing system built for perpetual analytics that analyzes information as it happens, which has very powerful applications in financial services, government, astronomy, traffic control, healthcare and many other scientific and business areas. This is computing at the speed of life.”

See more See less
Ask a Category Expert

Create a new thread in the Photo reports comments forum about this subject

Example: Notebook, Android, SSD hard drive

Display all 20 comments.
This thread is closed for comments
  • 1 Hide
    cyberkuberiah , November 27, 2009 5:48 AM
    yeah , ibm has one of the largest patent portfolio .
  • 0 Hide
    neiroatopelcc , November 27, 2009 6:02 AM
    I wonder if mote runner could solve the problem siemens has with its cts systems! (ie they don't work anywhere near as good as they do in theory, because they employ a million different sensors and need different staffing depending on the hardware - and at siemens there's no such word as teamwork)
  • 0 Hide
    nonxcarbonx , November 27, 2009 6:21 AM
    no supercomputing elements?
  • 1 Hide
    donaldduck , November 27, 2009 6:51 AM
    And they still cannot make a decent email client :p 
  • -3 Hide
    powerbaselx , November 27, 2009 7:07 AM
    Also it's a pitty IBM couldn't convince Apple to keep PowerPC laptops (even moving to Intel Macbooks at the sametime), and also for not bring back a new version of OS/2 operating system in the same line of MacOS.
    For the ones that remember the old OS/2 Warp it was a great operating system very stable with excelent multitasking capabilities.
  • 4 Hide
    void_pointer , November 27, 2009 7:58 AM
    Quote:
    [Page 1] In many ways, IBM transitioned from bring a mere PC manufacturer to a think tank that creates ideas [sic]


    IBM? A mere PC manufacturer? OMG! That is mind-shatteringly terrible -- 30 seconds of research would have told you that your understanding of IBM's history is hopelessly and ineptly inaccurate!

    Poor.
    Seriously poor.
  • -3 Hide
    neiroatopelcc , November 27, 2009 8:23 AM
    powerbaselxAlso it's a pitty IBM couldn't convince Apple to keep PowerPC laptops (even moving to Intel Macbooks at the sametime), and also for not bring back a new version of OS/2 operating system in the same line of MacOS.For the ones that remember the old OS/2 Warp it was a great operating system very stable with excelent multitasking capabilities.

    was it? I remember we bought it simply because it was cheaper to buy the os and format the floppies than buy floppies individually!
  • -2 Hide
    Anonymous , November 27, 2009 12:33 PM
    IBM acronym I Blame Microsoft ;) 
  • 4 Hide
    njalterio , November 27, 2009 1:45 PM
    Quote:
    In many ways, IBM transitioned from bring a mere PC manufacturer...


    Nope. Not reading any further!
  • -3 Hide
    Anonymous , November 27, 2009 4:02 PM
    The move to multi-core is not driven by lithographic limitations but instead by device leakage/Power/thermal envelope putting a limitation on maximum clock frequency. Jobs can only be executed faster now if they can be distributed over many cores. Lithography is enabling multi-cores: 2 cores per chip 2 years ago, now 6 and soon 8 cores per chip.
  • -3 Hide
    avg-joe , November 28, 2009 3:43 PM
    wicked_vinny wrote: IBM acronym I Blame Microsoft ;) 

    Nah. IBM these days stands for "India-Based Manpower".
  • -3 Hide
    Anonymous , November 28, 2009 4:25 PM
    One Mainframe To Rule Them All-IBM and Verichip- The Human Microchipping Agenda

    http://www.youtube.com/watch?v=mF1h_FaQOq4&feature=player_embedded#
  • -1 Hide
    AtuBrian , November 28, 2009 4:37 PM
    interesting
  • -1 Hide
    bayouboy , November 28, 2009 6:13 PM
    checkitoutnowOne Mainframe To Rule Them All-IBM and Verichip- The Human Microchipping Agendahttp://www.youtube.com/watch?v=mF1 [...] _embedded#

    LOL, conspiracy theories. Be careful IBM knows where you live, and even your dreams. Tin foil helps.
  • 0 Hide
    skine , November 28, 2009 8:37 PM
    Dear IBM,

    Please come back home.

    -Person living in Binghamton.
  • 0 Hide
    back_by_demand , November 28, 2009 9:26 PM
    I think IBM have the right attitude, this isnt a list of consumer products, not yet anyway.
    Billions are being spent on research where the ultimate aim is... discovery!!!
    Some of these ideas may have serious commercial applications, some may not, but all of them are amazing. Working in IBM's R&D division must be like "Eureka" but without all the sci-fi adventures.
    All this is paid for with boring corporate ebusiness stuff, etc, etc.

    I can imagine it like a stuffy accountancy company ploughing it's profits into going snowboarding at weekends
  • 1 Hide
    kelfen , November 29, 2009 2:11 AM
    The vampire that never dies! IBM!
  • -2 Hide
    mlopinto2k1 , November 29, 2009 7:02 AM
    IBM - Internatioal Business Machines.. *cough*

    http://professionalmike.com
  • -1 Hide
    mlopinto2k1 , November 29, 2009 2:37 PM
    powerbaselxAlso it's a pitty IBM couldn't convince Apple to keep PowerPC laptops (even moving to Intel Macbooks at the sametime), and also for not bring back a new version of OS/2 operating system in the same line of MacOS.For the ones that remember the old OS/2 Warp it was a great operating system very stable with excelent multitasking capabilities.
    My friend works for IBM in Fishkill and HATES WARP.
  • 0 Hide
    chris62 , November 30, 2009 12:13 PM
    http://www.ddj.com/architect/212900103

    Until a few years ago, the processor hardware community translated Moore's Law of transistor density directly into single-threaded performance gains as a result of increasing clock frequencies. Lately, this translation has been hampered by the effects of clock frequency on power consumption and heat generation. The new reality is that per-thread performance is essentially static, and an increase in performance is delivered by an increase in the number of available processor cores per socket.