95% of generative AI implementations in enterprise 'have no measurable impact on P&L', says MIT — flawed integration cited as why AI projects underperform

AI illustration
(Image credit: Getty / Jonathan Kitchen)

Many companies are rushing to implement various AI tools into their operation, but most of these pilot programs fail, according to an MIT study. Fortune reported that 95% do not hit their target performance, not because the AI models weren’t working as intended, but because generic AI tools, like ChatGPT, do not adapt to the workflows that have already been established in the corporate environment.

As per the report, the study's findings purportedly demonstrate that only "about 5% of AI pilot programs achieve rapid revenue acceleration." It says "the vast majority stall," and deliver "little to no measurable impact" on profit and loss. The findings are based on 150 interviews, a survey of 350 employees, and an analysis of 300 public deployments of AI.

Latest Videos FromTom's Hardware
Jowi Morales
Contributing Writer

Jowi Morales is a tech enthusiast with years of experience working in the industry. He’s been writing with several tech publications since 2021, where he’s been interested in tech hardware and consumer electronics.

  • -Fran-
    Exec: "Look everyone! This great new invention is called a Hammer. We need to start using it in our processes to increase productivity!"
    Employees: "Sir... We bake cakes..."

    Regards.
    Reply
  • George³
    "AI" didn't exist. They implemented bad trained with trash data from internet models. That's all my friends.
    Reply
  • Notton
    "Look, if people don't buy into AI, this bubble is going to burst and it's going to crash the market!" -some exec

    IDK about other people, but ads selling AI products have taken over scam ads.
    So I'm just going to assume AI is also a scam at worst, ponzi scheme at best.
    Reply
  • Alex/AT
    Let me guess. These "5% of AI pilot programs" are coming from/on "AI" developers themselves and related hardware/software vendors?
    Reply
  • edzieba
    I'm surprised even 5% haven't failed, though I guess that's "haven't failed yet". LLMs have little no no practical utility, and areas where big MLNNs do have utility (e.g. image processing) they had already been in use for years before the "deep learning" boom rebranded MLNNs to make them seem a shiny new idea.
    Reply
  • SomeoneElse23
    I used ChatGPT the other day to create some very useful code.

    That said, ChatGPT is a dumb as a rock. The first two iterations wouldn't even compile. The third iteration had routines in it that were never called.

    After very explicit direction and tweaking, and a number of more iterations, I did end up with very useful code, faster than I could have made it.

    I found the process very enlightening. There's nothing intelligent about "AI". It does precisely what you say.

    Only with intelligence guiding it was I able to be more productive than I would have been otherwise.
    Reply
  • palladin9479
    Alex/AT said:
    Let me guess. These "5% of AI pilot programs" are coming from/on "AI" developers themselves and related hardware/software vendors?

    "AI" is just super good pattern recognition. It works best in environments where it's given a ton of data, then instructed to find patterns and act on them.
    Reply
  • ravewulf
    Even if we assume AI can or will be able to fill entry-level jobs, that's still bad for the industry as it chokes off the future talent pool for higher-level positions.
    Reply
  • fiyz
    -Fran- said:
    Exec: "Look everyone! This great new invention is called a Hammer. We need to start using it in our processes to increase productivity!"
    Employees: "Sir... We bake cakes..."

    Regards.
    You sir, lack creative imagination. Do you not bake meat pies? Let me introduce you to what I also call, the meat tenderizer.
    Reply