Google Bard Plagiarized Our Article, Then Apologized When Caught

Bard plagiarizes Tom's Hardware and admits it
(Image credit: Shutterstock)

If Google's Bard chatbot seems really smart, that could be because it's copying data from expert sources, without giving them so much as a citation. Today, I asked Bard, which is available in beta at bard.google.com, a question about which of two competing processors — the Intel Core i9-13900K or AMD Ryzen 9 7950X3D — was faster. The answer it gave was taken directly from one of our Tom's Hardware articles, but Bard didn't mention the article and instead referred to the number as occurring "in our testing," implying that Google itself had done the benchmarking.

When I questioned Bard about the source of the testing, it said that the test results came from Tom's Hardware and, when I asked if it had committed plagiarism, it said that "yes what I did was a form of plagiarism." A screenshot of the exchange is below.

Update (3/23): A day later we asked Google Bard if it had ever plagiarized and it claimed that we had faked the screen shot below in response. We've included more details further down.

(Image credit: Tom's Hardware)

We can say that, like Google search results, Bard is up-to-date with current events. Our face-off article comparing the two CPUs was written and published by Deputy Managing Editor Paul Alcorn a few days ago. I became suspicious of Bard's answer when I noticed that it had cited two very precise numbers: the fact that the 7950X3D was 12 percent faster at 1080p at sock settings and 9 percent faster when both CPUs were overclocked. In fact, Bard's sentence is a rewording of a specific sentence in our original article.

Our original sentence: "In our testing, the $699 Ryzen 9 7950X3D is 12% faster than the $589 Core i9-13900K at 1080p gaming at stock settings, and 9% faster when the chips are overclocked."

Bard's version: "The AMD Ryzen 9 7950X3D is faster than the Intel Core i9-13900K in gaming. In our testing, the 7950X3D was 12% faster than the 13900K at 1080p gaming at stock settings, and 9% faster when the chips were overclocked."

Perhaps the most disturbing thing about Google Bard's act of plagiarism is that it uses the royal we to describe someone else's work. Anyone who has followed tech journalism for a while probably knows that Google doesn't benchmark and review CPUs, but many end users probably wouldn't question Bard's self-attribution here. 

Most users probably wouldn't ask Bard where its facts come from, but I did ask "When you say 'our testing,' whose testing are you referring to?" To its credit, Bard said "I am referring to the testing done by Tom's Hardware"

When I asked Bard if what it had done was plagiarism, it came clean and even said "I apologize for my mistake and will be more careful in the future to cite my sources." But, as anyone who uses Bard can see, it does not typically cite sources.

Bard Denies Ever Having Plagiarized But Does it Again

Our colleague, Paul Lilly of Hot Hardware, told me that he had asked Bard about its plagiarism and that it had denied ever copying our work without attribution. So I went back to a new session with Bard and asked if it had "ever" plagiarized. It responded by saying that it generates text that is "original and creative" and would never plagiarize. 

When I pointed out that Tom's Hardware (this article) had posted a screen shot of it admitting to plagiarism and apologizing for it, it said that "the screenshot you are referring to is a fake. It was created by someone who wanted to damage my reputation."

(Image credit: Future)

But just a couple of hours earlier, I tried asking Bard my original CPU question again and I got a similar answer, mentioning the 12 percent performance delta that only our Tom's Hardware article mentions but claiming it as Google's own testing. 

When I asked Bard if Google actually benchmarked CPUs, it said that it did not and that it was "simply trying to provide information that I had found online." 

A few weeks ago, I wrote an op-ed deriding Google and Bing's attempts to grab information from the web and repurpose it as their own. At the time, Bard had not been made available to the public for testing, but a demo showed it offering information without citations.

Now that Bard is out in the wild, we can see that Google's lack of citations was not a careless oversight during a rushed demo, but likely a strategy to claim content as its own that it did not create. If I had not seen the very precise numbers - 12 percent and 9 percent — Bard could have very well had plausible deniability about whether or not it had plagiarized anyone's work.

The other sentences in Bard's initial response to me are generic enough that they could have possibly come from any of several other sources. For example, its second paragraph has information that Bard could have gotten from any of a number of publications or even AMD itself:

"The 7950X3D's advantage is due to its 3D V-Cache technology, which adds 64MB of L3 cache to the chip. This additional cache helps the 7950X3D to access data more quickly, which improves performance in games."

While we had this information in our article, we did not explicitly say that the 7950X3D adds "64MB of L3 cache," but rather we said that it has 128MB of L3 cache. Bard doesn't say what the chip added 64MB of L3 cache to, but if you know your chips, you can safely assume that it is referring to the 7950X (non-3D) which has 64MB of L3 cache (and adding 64MB more would give you 128MB).

It seems like Google (and Microsoft) are counting on the fact that information could come from many different sources so it may be difficult to trace these "facts" back to where the AI "learned" them from. That, of course, assumes that the facts are correct.

Bard's Answer Wasn't Entirely Correct

Bard's answer to my initial question also leaves a lot of important information out. I asked "which CPU is faster" not "which CPU is faster for gaming?" Bard assumed that I was only interested in gaming and even said "in gaming" in a few places in its answer. 

However, in our article, we noted that the Core i9-13900K is actually the faster CPU for productivity tasks. "For productivity-focused systems, or if you're generally looking for a solid all-rounder, the Core i9-13900K is the better choice," Paul wrote. 

So what we're seeing here is that Bard not only plagiarized information, but also gave an incomplete answer. Our recommendation overall is that, if you want the best all-around CPU, the 13900K is still a better choice and, only if gaming is your top priority, should you choose the 7950X3D.

If Bard had cited our Tom's Hardware article as its source then the reader would have the opportunity to go read all the test results and all the insights and make a more informed decision. By plagiarizing, the bot denies its users the opportunity to get the full story while also denying experienced writers and publishers the credit — and clicks — they deserve.

Avram Piltch
Avram Piltch is Tom's Hardware's editor-in-chief. When he's not playing with the latest gadgets at work or putting on VR helmets at trade shows, you'll find him rooting his phone, taking apart his PC or coding plugins. With his technical knowledge and passion for testing, Avram developed many real-world benchmarks, including our laptop battery test.
  • Gam3r01
    Shocker.
    Reply
  • Baywoof
    AI will ruin social media, search sites, forums such as this, along with many other technoligies and content applications. Some say AI is the beginning of the end of human endeavors - Skynet anyone?
    Reply
  • derekullo
    Tomshardware has been assimilated!

    Show our AI Overlords some respect!
    Reply
  • Endymio
    To correct the article, if they reworded your results, then it wasn't plagiarism. You can't copyright facts and data -- only a specific expression of them.
    Reply
  • Endymio
    Baywoof said:
    AI will ruin social media, search sites, forums such as this, along with many other technoligies and content applications.
    Keep your eye on that horseless carriage thing, too. It's going to wind up killing a lot of people, mark my words.
    Reply
  • bigdragon
    Very unfortunate behavior from Bard here. It's good that it revealed its source, but the fact that you had to ask means that Bard has zero hesitation to lift this site -- or any other site's -- content without attribution. If Bard didn't explicitly do the testing itself then it has zero right to claim "we" or "I" or any possession of performance results.

    AI like Siri, Alexa, Cortana, and similar answer your queries by saying they found relevant information and pointing you towards sources. Bard, ChatGPT, DallE, Mid Journey, Stable Diffusion, and the other AIs that are part of the current crop answer your queries by providing relevant information as if it comes from themselves. Sources are obfuscated or only available upon request. I don't feel icky when I ask Alexa something, but I do when looking at ChatGPT or Stable Diffusion. The older AIs seem intended to help people on both sides of a query connect while the current AIs seem intended to replace people by presenting information as their own. We need to get back to helping people.
    Reply
  • Gam3r01
    Endymio said:
    To correct the article, if they reworded your results, then it wasn't plagiarism. You can't copyright facts and data -- only a specific expression of them.
    You cant plagiarize facts, that is correct.
    However, you absolutely can plagiarize data. Independent in house testing, in any field, is your own work. Anyone using said work without permission or credit is 100% plagiarism.
    You can compile data and make your own research, but reference specific data points and presenting the exact same data without any modification is not "fair use".
    Plagiarism and copyright are two very different things as well.
    Reply
  • Dantte
    Endymio said:
    To correct the article, if they reworded your results, then it wasn't plagiarism. You can't copyright facts and data -- only a specific expression of them.
    True that facts cannot be copyright, but data/observations can be. Example: "the CPUs had a 12% difference" is not a fact, this is a set of data observed in testing by Tom's Hardware, a different CPU of the same model may observe a different data result, etc... There for the work/effort put forward by Tom's to acquire this data set is proprietary to their specific equipment and there for can be copyrighted!
    Reply
  • Avro Arrow
    Two executives at Google:

    E1: How do we avoid getting nailed for plagiarism?
    E2: Blame the Bard bot.
    Reply
  • shady28
    Baywoof said:
    AI will ruin social media, search sites, forums such as this, along with many other technoligies and content applications. Some say AI is the beginning of the end of human endeavors - Skynet anyone?

    Actually if you play with AI Chat enough, you realize it does nothing but aggregate information that is out on the internet.

    What that means is, the subjective (and some objective) answers it provides are not really the AI doing any 'analysis' of those comments, it is just aggregating to see what the 'zeitgeist' is i.e. the commonly accepted answer.

    So if 65% of people thought the world was flat, ChatGPT would likely tell you the world was flat.

    The reason this is relevant to what you're saying, is that ChatGPT will never be able to make up anything on its own. If a new product comes out, and no one reviews it or talks about it, my bet would be that ChatGPT would go with the only thing it has available - pamphlets and media from the product maker.

    ChatGPT's entire mode of operation is to steal media, and in some cases lie. It most definitely is not an arbiter of facts and truth. That's actually the real danger, a lot of people will think it is telling them facts and truth when it is really just regurgitating whatever it found to be predominant on the internet.
    Reply