Startup trains AI models with gaming GPU setup under $100K

GPU
(Image credit: Shutterstock)

The heart of a good AI system is a well-trained model. This requires a great deal of resources and power which can end up costly for investors and everyone else involved. One startup is shaking things up a bit by training its model using more affordable hardware. Fastino is reportedly using less than $100,000 (USD) worth of gaming graphics cards to handle its training needs. This stands out against more commercial operations like Elon Musk's giant xAI, which has seriously intense power requirements.

TechCrunch first reported on Fastino and its use of low-end gaming chips.

According to Fastino, this was accomplished by developing architecture for their AI model that is "task-specific" and designed to function on a smaller scale. This change has made for a faster model that has a noticeable degree of accuracy. The best part, however, is the cost effective benefits of training their system on cheap gaming hardware.

Ash Hill
Contributing Writer

Ash Hill is a contributing writer for Tom's Hardware with a wealth of experience in the hobby electronics, 3D printing and PCs. She manages the Pi projects of the month and much of our daily Raspberry Pi reporting while also finding the best coupons and deals on all tech.

  • Notton
    While I don't care if they snap up all the manufactured e-waste that are the 8GB cards, it'll send the wrong message to Nvidia and AMD that those are popular cards.
    And if they snap up all the 16GB~24GB cards, well then it's war.
    Reply
  • DS426
    Notton said:
    While I don't care if they snap up all the manufactured e-waste that are the 8GB cards, it'll send the wrong message to Nvidia and AMD that those are popular cards.
    And if they snap up all the 16GB~24GB cards, well then it's war.
    It'd be great to actually see all those old 8 - 12 GB mining cards repurposed for something like this. As you said though, if they create too big of a hole and therefore vacuum in the used card mining, both new and used just get pushed up on price and lower on availability, which we REALLY don't need right now.

    It's already a PC gamers vs. AI everything war... just hoping to see Intel and Samsung get back into the game in such a way to make gaming GPU's both advancing, affordable, and available.
    Reply
  • aberkae
    DS426 said:
    It'd be great to actually see all those old 8 - 12 GB mining cards repurposed for something like this. As you said though, if they create too big of a hole and therefore vacuum in the used card mining, both new and used just get pushed up on price and lower on availability, which we REALLY don't need right now.

    It's already a PC gamers vs. AI everything war... just hoping to see Intel and Samsung get back into the game in such a way to make gaming GPU's both advancing, affordable, and available.
    Yeah this reminds me of the crypto mining boom but on roids! Ai is hogging up significant resources in energy and allocation. Ai token mining is like crypto mining without the negative public stigma yet imo.
    The silver lining comes in talks of arm and Nvidia/cpus in becoming market share dominant vs everything x86. Intel is desperate for a 1 to 2 attempts on a win before it becomes bankrupt imo if not sooner. As well as AMD defending it's position powerful and efficient apus. The market is also converging not only in ai but the game handheld sector is becoming a hot commodity by the minute.
    Reply