Facebook To Design Its Own Chips For Real-Time Content Filtering

Facebook wants to be able to filter content, including live video streams, in real-time. The company said at a Paris technology conference that it’s going to design its own machine learning (ML) processors to achieve that goal. Facebook had previously designed its own server architecture, motherboards, and its own communication chips for the data center.

High-Performance Content Filtering

Facebook’s chief artificial intelligence scientist Yann LeCun said that the company would like to take down offensive videos, like someone live-streaming a murder or a suicide, as they happen. However, such capability would require “a huge amount of compute power,” as well as consume a lot of power.

At the Viva Technology conference, LeCun noted:

"There’s a huge drive to design chips that are more energy-efficient for that. A large number of companies are working on this, including Facebook.

You’ve seen that trend from hardware companies like Intel, Samsung, Nvidia. But now you start seeing people lower in the pipeline of usage having their own needs and working on their own hardware."

Being able to filter content in real-time may not sound like such a bad idea when the company actually takes down violent videos or hate speech, but the same technology could also allow the company to censor certain free speech or other types of non-aggressive content with lightning speed. That means few people would be aware that important content is censored unless the person who posted that content can raise awareness about it through other channels and expose Facebook's actions.

Software Companies Embrace ML Hardware

Google is another example of a company that now builds its own ML hardware that better fits its own requirements. Google surprised many when it built its Tensor Processing Unit (TPU) in 2015 (and announced it in 2016) to run its AlphaGo AI on faster hardware. The chip promised to be a three-generation leap forward with orders of magnitude higher inference performance than Nvidia’s Tesla K80 GPUs.

In 2017, Google launched the even more powerful TPU 2.0, which prioritized training over inference. The company recently announced the TPU 3.0, too, which promises another big increase in performance.

It’s not just large online services focusing on ML hardware, either. Smartphone makers, for instance, have increasingly adopted ML processors into their devices, promising much better efficiency for certain ML tasks such as improving photo quality, managing battery life, organizing your photos with client-side intelligence, and so on.

This trend doesn’t show any signs of a slowdown, so we should be expecting even more companies adopt ML accelerators in their data centers or consumer products soon.

Create a new thread in the News comments forum about this subject
11 comments
Comment from the forums
    Your comment
  • bit_user
    Something tells me this real-time filtering of all live streams is a stretch goal. Maybe something they can start to think about, after getting a couple generations under their belt.

    On the other hand, I do think it's plausible they could deploy real-time filtering based on speech recognition. And that might work well enough to eliminate the majority of certain types of content.

    I also think we're going to see some of thees homegrown efforts fizzle, after they build one generation of hardware and look around to see how many of their competitors & potential suppliers have far surpassed their efforts. Google was really ahead of the curve, on this one. Not everybody is a Google.
  • therealduckofdeath
    Designed to help users, will be used to exploit. Facebook is one of those companies having as much connection to reality as the spam abusers they pretend they've got control over now. What was it they said they automatically filtered now? 99 point something percent? I call BS. Just look at any comment section using Facebook and you'll see infinitely more spam today compared to last year. "I make $$$$$ sitting at my computer posting this spam, so a scam company can use my processor power to <insert-your-desired-malice-here>". Facebook is doing as little to counter spam and scams today as they were five years ago. Best scenario they'll keep doing that, worst (most likely) scenario they'll just use these processors to ramp it up.
  • mlee 2500
    Yeah, Qualcomm went down the path of developing low-power data-center CPU's....Centriq..and recently decided the performance wasn't there with the ARM architecture. Not sure how a software company thinks they can do better.

    This smells more like a public relations vapor project.