Chinese AI outfits smuggling suitcases full of hard drives to evade U.S. chip restrictions — training AI models in Malaysia using rented servers

Hard Drives
(Image credit: Shutterstock)

Chinese AI companies are reportedly smuggling hard drives to Malaysia in order to train their AI models without technically breaking the export controls that the U.S. has placed on advanced Nvidia chips heading into China. According to the Wall Street Journal, four Chinese tech workers flew in from Beijing to Kuala Lumpur, each one carrying 15 hard drives with 80 TBs worth of data each for training an AI model.

This was a meticulously planned operation and took several months of preparation. Sources say that the engineers chose to fly in the data on hard drives, because it would take a lot of time to transfer the data online without attracting attention. They then divvied up the hard drives between four passengers to avoid raising alarm bells with Malaysian customs and immigration officers. The Chinese personnel then proceeded to a Malaysian data center, where their company rented 300 Nvidia AI servers to process the data and build the AI model.

The involved companies also made some legal moves to muddy the waters. The Chinese AI company had previously used the same process to train its model using the Malaysian data center, with its Singapore-registered subsidiary signing the rent agreement. But with Singapore clamping down on AI tech exports, the Malaysian company asked its Chinese client to register locally and avoid scrutiny.

Setting up a local operation and manually bringing in the data on hard drives makes training more complicated than doing it in China. However, the U.S.’s bans are making it harder for companies to import the advanced hardware they require for AI training. Despite Nvidia’s claims that “there is no evidence of chip diversion”, there is a healthy black market in China for smuggled Nvidia chips, and they’re able to get them through subsidiaries and other companies based in nearby countries.

Still, doing this requires a lot of money, especially as the increased risk means suppliers likely put a premium on the servers they sell. It has also reportedly become more difficult recently because of the pressure that the White House has been putting on these countries. So, instead of importing the hardware, the next best option for some of these Chinese companies is to export the data instead.

Moves like this show how difficult it is for the U.S. to enforce the export bans that it has put on these powerful chips. More than that, the U.S. Senate has found out that the Commerce Department is woefully underfunded and has been ineffective at enforcing these controls. Although it seems that Washington’s sanctions are slowly starting to take effect with increased enforcement, the fact that Chinese companies take these steps to circumvent AI chip bans shows that the White House has got its work cut out for itself.

Follow Tom's Hardware on Google News to get our up-to-date news, analysis, and reviews in your feeds. Make sure to click the Follow button.

Jowi Morales
Contributing Writer

Jowi Morales is a tech enthusiast with years of experience working in the industry. He’s been writing with several tech publications since 2021, where he’s been interested in tech hardware and consumer electronics.

  • pug_s
    I think there's easier to send data without smuggling hard drives. maybe backup tapes? Maybe it is easier for Chinese companies to set up some standalone data lines and send data online.
    Reply
  • Notton
    How fast is the internet connection between China and Malaysia?
    If it's 100GB/s, 4.8PB would take 14~19hrs, at which point it's probably faster flying over there with a bunch of HDDs.
    Reply
  • tamalero
    Notton said:
    How fast is the internet connection between China and Malaysia?
    If it's 100GB/s, 4.8PB would take 14~19hrs, at which point it's probably faster flying over there with a bunch of HDDs.
    as the news report mentions.. its not the speed.
    Its about "being find out" and blocked.
    Faster would means will get them blocked quickly I guess...
    Reply
  • althuser
    I wish China every success! They are developing their own AI against all the odds.
    Reply
  • circadia
    althuser said:
    I wish China every success! They are developing their own AI against all the odds.
    hmm, I wonder why your account is so new? and I wonder why all of your posts are pro-China messages? also, why do all of them somehow have at least one spelling/grammatical error?

    more seriously, though, you really think China is not as shady as the US?
    Reply
  • Misgar
    "the U.S. Senate has found out that the Commerce Department is woefully underfunded and has been ineffective at enforcing these controls."
    https://nymag.com/intelligencer/article/doge-elon-musk-what-federal-agencies-access-lawsuits.html
    "At least one DOGE agent has been to the Commerce Department’s Maryland headquarters, where they requested and gained access to the agency’s IT systems in what they apparently said was an effort to root out government DEI efforts. This included accessing NOAA data."
    Maybe recent cuts have affected the Commerce Department's overseas operations.

    pug_s said:
    maybe backup tapes?
    I'm not sure about easier. LTO-9 will store 18TB and LTO-10 will store 30TB (or up to 75TB if the data is highly compressible). You'd need a suitable tape drive at the other end.

    LTO-9 has a native transfer rate of 400MB/s for uncompressed data.

    The report says 4.8PB of data was transferred.

    Using a single LTO-9 drive, it would take 3,579 hours or 149 days to extract the data.

    Perhaps hard disks weren't such a bad idea after all.
    Reply
  • Hooda Thunkett
    Misgar said:
    "the U.S. Senate has found out that the Commerce Department is woefully underfunded and has been ineffective at enforcing these controls."
    https://nymag.com/intelligencer/article/doge-elon-musk-what-federal-agencies-access-lawsuits.html
    "At least one DOGE agent has been to the Commerce Department’s Maryland headquarters, where they requested and gained access to the agency’s IT systems in what they apparently said was an effort to root out government DEI efforts. This included accessing NOAA data."
    Maybe recent cuts have affected the Commerce Department's overseas operations.


    I'm not sure about easier. LTO-9 will store 18TB and LTO-10 will store 30TB (or up to 75TB if the data is highly compressible). You'd need a suitable tape drive at the other end.

    LTO-9 has a native transfer rate of 400MB/s for uncompressed data.

    The report says 4.8PB of data was transferred.

    Using a single LTO-9 drive, it would take 3,579 hours or 149 days to extract the data.

    Perhaps hard disks weren't such a bad idea after all.
    Whaaaat??!? The Commerce Department isn't doing their job??!? Cut their budget more! Cut it again! The budget cuts will continue until performance improves!
    /s
    Reply
  • spongiemaster
    Misgar said:
    "the U.S. Senate has found out that the Commerce Department is woefully underfunded and has been ineffective at enforcing these controls."
    https://nymag.com/intelligencer/article/doge-elon-musk-what-federal-agencies-access-lawsuits.html
    "At least one DOGE agent has been to the Commerce Department’s Maryland headquarters, where they requested and gained access to the agency’s IT systems in what they apparently said was an effort to root out government DEI efforts. This included accessing NOAA data."
    Maybe recent cuts have affected the Commerce Department's overseas operations.


    I'm not sure about easier. LTO-9 will store 18TB and LTO-10 will store 30TB (or up to 75TB if the data is highly compressible). You'd need a suitable tape drive at the other end.

    LTO-9 has a native transfer rate of 400MB/s for uncompressed data.

    The report says 4.8PB of data was transferred.

    Using a single LTO-9 drive, it would take 3,579 hours or 149 days to extract the data.

    Perhaps hard disks weren't such a bad idea after all.
    The article indicated they were using 80TB drives. There are no 80TB hard drives. Those have to be enterprise SSD's which would significantly speed up the data transfer rates. At a pretty standard 250MB/s for mechanical drives, it would still take almost 4 days to fill a drive. Tape drives would actually be faster than hard drives.

    https://shop.sandisk.com/products/ssd/internal-ssd/ultrastar-dc-sn655-nvme-ssd?sku=0TS2458
    These top out at 60TB, but there are companies selling 100TB+ drives. At 4300MB/s, you're looking at about 5 hours to fill an 80TB drive, which isn't too bad. SSD's will also be significantly lighter and more robust than lugging around 15 mechanical drives in a suitcase.
    Reply
  • Misgar
    spongiemaster said:
    There are no 80TB hard drives.
    Yes, I wondered about that discrepancy too, but assumed it was a typo in the article.

    Perhaps something got changed by AI translation from a Malay language article into English.

    After all, there's practically no difference between a spinning hard disk and a Enterprise class SSD, is there???
    Reply
  • fiyz
    pug_s said:
    I think there's easier to send data without smuggling hard drives. maybe backup tapes? Maybe it is easier for Chinese companies to set up some standalone data lines and send data online.
    I'm guessing they're more worried about Chinese competitors stealing their invested GPU time?
    Reply