Immersive Video Sample on the Open Visual Cloud

- OMAF Dash Access Library: This library provides basic functions to parse mpd file, select extractor track based on current viewport, download relative tile segments, parse the extractor and tile segments, and then output a standard HEVC frame with RWPK information for decoding.
- WebRTC Linux Client Library: This library establishes a WebRTC connection with the OWT media server, and retrieves the tile-based FoV RTP stream. It supports dynamically switching the viewport, by sending a feedback message to the server to transfer different tiles in the RTP stream. The received RTP stream is depacketized as a standard HEVC frame with RWPK SEI for decoding.
- Reference OMAF player: This reference player gets an aggregated video bit stream based on OMAF Dash Access library or WebRTC Linux Client library, decodes the bit stream with or without HW acceleration, and then renders the picture to a sphere or cube mesh based on RWPK of each tile in the frame.
- Provide a unified interface for tile-based HEVC bitstream processing and viewport-based content processing;
- Support HEVC bitstream processing: VPS/SPS/PPS parsing and generating, 360 video relative SEI generating and parsing, HEVC tile-based bitstream aggregation;
- Support viewport generation, viewport-based tile selection and extractor selection based on content coverage;
- FFMPEG Plugins in this solution provide a quick way for user to try this tiled 360 video streaming solution using common FFmpeg command line.
To get started building the Immersive Video Sample and to set up the developer environment, check out these two tutorials:
- OMAF Packing: https://github.com/OpenVisualCloud/Immersive-Video-Sample/blob/master/sr...
- Dash Access Library: https://github.com/OpenVisualCloud/Immersive-Video-Sample/blob/master/sr...
- 360SCVP (Stream Concatenation and Viewport Processing) Library: https://github.com/OpenVisualCloud/Immersive-Video-Sample/blob/master/sr...
- Reference Player: https://github.com/OpenVisualCloud/Immersive-Video-Sample/blob/master/sr...