Identified worldwide for its contributions to the MPEG format — the compression expertise utilized in MP3 audio information and MP4 movies — Germany’s Fraunhofer has not too long ago turned its consideration to the following frontier in media: digital actuality. After unveiling reasonably priced VR headset microdisplay final yr, the corporate is now exhibiting off next-generation video compression software program utilizing the brand new MPEG-OMAF customary, the primary VR specification enabling 360-degree movies to stream over 5G networks.
Based mostly in “vital” half upon Fraunhofer video compression applied sciences, MPEG-OMAF breaks wraparound movies into grids of tiles encoded at a number of resolutions. The explanatory picture above makes use of crimson tiles to point areas which are being streamed at low decision, versus usually coloured tiles which are being streamed at excessive decision.
Not like conventional movies, which stream from servers at one user-selected decision, these VR movies dynamically use high-resolution tiles the place the viewer is at the moment trying, and low-resolution tiles for components which are out of sight. Because the person’s head place modifications, the headset or show system requests a special mixture of streamed tiles optimized for the person’s present focus space.
This trick permits the whole 360-degree video to proceed streaming whereas devoting most element to regardless of the person is viewing. It parallels the current use of foveated rendering to maximise realtime 3D graphics for VR customers, guaranteeing that head-moving viewers will at all times be capable of see one thing by way of their peripheral imaginative and prescient, even when it’s decrease in constancy.
Worldwide mobile requirements group 3GPP has adopted the MPEG-OMAF customary for 5G VR streaming, so it’ll probably underpin loads of 360-degree digital actuality video streams — similar to MP3 and MP4 outlined prior generations of digital audio and video. Present 360-degree VR movies streamed over 4G and even Wi-Fi networks are likely to undergo from low total resolutions, across-the-board compression artifacts, and excessive latency, all of which the brand new customary and better bandwidth networks may remove.