Facebook Bolsters Immersive Video Content With New Video Encoding Technique, Releases Source Code

If you use Facebook, then you would have noticed that the company has added video sharing to the social media website, which has been getting very popular. More recently, the company added the ability to share immersive video content filmed in 360 degrees, as well as video shot in VR. Facebook said these new formats of video produce considerably larger file sizes, which is a big problem for a company hosting millions of videos. To fix this problem, Facebook Engineering worked on ways to render immersive content much more efficiently, and today the company is sharing those techniques.

Facebook said it adapted tools that have been used for computer graphics and image processing for years, to bring the same benefits to 360-degree video. The company developed a technique to "remap equirectangular layouts to cube maps," which it said had a dramatic effect reducing file size and eliminating image distortion at the top and bottom of the video. Facebook is calling this method "Transform."

Facebook Engineering explained the process in a video it shared today on Facebook, but in essence, Transform maps spherical video to six flat cube face sections. Each section corresponds to a different part of the view, with one section for the top, one for the bottom, and four to make up the surroundings. Facebook said that by doing this, each cube face has an undistorted view, which is what does away with the warping normally found in 360-degree video.

Facebook Engineering said that these improvements work great for 360-degree content, but streaming VR videos required approaching the problem differently. Rather than use the traditional cube mapping, Facebook Engineering adapted the process with pyramid geometry. The company said that by doing this, rather than having six equal sides that are fully rendered, a pyramid has only one full resolution side.

Facebook said there are 30 viewpoints to render with this process, and it processes each video in five different resolutions, so rather than encoding the video on the fly, Facebook stores pre-generated video files on a server. Clients have only their current view streamed at any given time, rather than have the whole video file buffer in the background. The company said this reduces the streaming file size by as much as 80 percent.

Facebook is holding on to the pyramid maps code for now, but the company released the source code for Transform on GitHub and said it is “eager for people to adopt this tool, and we can't wait to see how developers build on top of it.”

Follow Kevin Carbotte @pumcypuhoy. Follow us on Facebook, Google+, RSS, Twitter and YouTube

TOPICS

 Kevin Carbotte is a contributing writer for Tom's Hardware who primarily covers VR and AR hardware. He has been writing for us for more than four years. 

Latest in Virtual Reality
Meta Quest 3S
Quest 3S Review: Most of the same thrills as the Quest 3 for $200 less
vision pro wwdc 2023
Apple reportedly slows down Vision Pro production — a more affordable version may be in the works
Kopin NeuralDisplay in Action
Microdisplay tracks your pupils to adjust brightness, avoid HUD fatigue
Apple Vision Pro
Apple announces visionOS 2 supporting Dual 4K resolution with Mac Virtual Display, Vision Pro sales go global June 28
"All but 1 user attributed it to imperfections in the VR platform"
VR 'inception' attacks exploit developer mode loophole and VR's dreamlike unreality to manipulate what you see, steal real personal data
Vision Pro lying on a bed of money
$10,000 for a $3,500 Apple Vision Pro? Scalpers mark up Apple's headset, despite the fact that it's still in stock
Latest in News
RX 9070 XT Sapphire
Lisa Su says Radeon RX 9070-series GPU sales are 10X higher than its predecessors — for the first week of availability
RTX 5070, RX 9070 XT, Arc B580
Real-world GPU prices cost up to twice the MSRP — a look at current FPS per dollar values
Zotac Gaming GeForce RTX 5090 AMP Extreme Infinity
Zotac raises RTX 5090 prices by 20% and seemingly eliminates MSRP models
ASRock fixes AM5 motherboard by cleaning it
ASRock claims to fix 'burned out' AM5 motherboard by cleaning the socket
ChatGPT Security
Some ChatGPT users are addicted and will suffer withdrawal symptoms if cut off, say researchers
project-g-assist-nvidia-geforce-rtx-ogimage
Nvidia releases public G-Assist in latest App to provide in-game AI assistance — also introduces DLSS custom scaling factors
  • dstarr3
    Awesome, now all the Facebook pirates can post even better stolen content!
    Reply
  • Hashmael
    Spoiler Alert for Silicon Valley Season 3:
    Facebook has bought out Pied Piper!

    (P.S. I know Pied Piper is depicted as a format-agnostic lossless compression on the show, whatever)
    Reply