Spatial audio — bringing realistic sound to 360 video

What this post added

Introduced new 360 audio encoding and rendering technology, including a hybrid higher-order ambisonics system (8-channel) with rendering optimizations for large-scale consumption. Developed the Spatial Workstation tool for creators to design spatial audio for 360 video and VR, and the FB360 Encoder tool for exporting to multiple platforms. The rendering SDK is integrated into Facebook and Oculus Video. The system supports simultaneous spatial and head-locked audio with sub-millisecond latency. The audio engine (Audio360) is cross-platform, written in C++ with asm.js for web, and is lightweight (approx. 100KB binary). Encoding uses MP4 with H.264 video and AAC audio, employing a three-track configuration for spatial and head-locked audio, with metadata stored in an XML box within the MP4 file.