Intel media stack is a comprehensive set of software packages for hardware accelerated video encode, decode, and processing on Linux*. Intel graphics processing units (GPUs) contain one or more hardware-based decoder, encoder, and video processor for several popular codecs and features.
You can use existing applications for decoding, encoding, and processing hardware accelerators on your GPU, by leveraging the integration available in the FFmpeg*, Gstreamer*, Open Broadcaster Software*, Intel® Media SDK, and Chrome OS* media framework.
Based on strong hardware support, several customers chose Intel® Graphics Technology for popular uses such as: game streaming, cloud gaming, video analytics, short video, video cloud, In-Vehicle Infotainment system (IVI), video surveillance, and others.
The Intel® Media stack provides a total media solution based on Intel® Graphics Technology. It includes the Intel® Media driver, Intel® Media SDK, LibVA, middleware support, and HDCP service. The Intel® Media Stack also supports well-known open source media frameworks like FFmpeg and Gstreamer.
For more introduction and performance data according to discrete card, please refer to GPGPU Media.
The following diagram shows all media stack components.
- Media Driver: an open source hardware accelerated video driver that supports Intel® HD Graphics starting from Broadwell. The following is a list of processors currently supported:
- 1st Discrete card - Intel® Iris® Xe MAX Graphics - DG1
- 11th Generation Intel® Core™ processors with Intel® HD Graphics - Tiger Lake
- 10th Generation Intel® Core™ processors with Intel® HD Graphics - Ice Lake
- 8th Generation Intel® Core™ processors with Intel® HD Graphics - Coffee Lake
- 4th Generation Intel® Pentium/Celeron™ processors with Intel® HD Graphics - Gemini-Lake
- 7th Generation Intel® Core™ processors with Intel® HD Graphics - Kaby Lake
- 3rd Generation Intel® Pentium/Celeron/Atom™ processors with Intel® HD Graphics - Apollo-Lake
- 6th Generation Intel® Core™ processors with Intel® HD Graphics - Skylake
- 5th Generation Intel® Core™ processors with Intel® HD Graphics - Broadwell
- Source code development libraries and SDK to access hardware capabilities:
- LibVA: an implementation for VA-API (Video Acceleration API) - an open-source library which provides access to graphics hardware acceleration capabilities.
- LibVA-utils: a collection of utilities and examples to exercise VA-API in accordance with the libva project.
- Media SDK: an API to access hardware-accelerated video decode, encode and filtering on Intel platforms with integrated graphics. See details on Media SDK page.
- 360 SDK: provides a 360 stitching with 2/6 cameras inputs, in open source plan.
- Capture SDK: provides a game capture solution for game streaming, in open source plan.
Reference design for popular usage:
- Video Analysis: based on openVINO and clDNN, in open source plan.
Third party frameworks with access to hardware capabilities:
- ffmpeg: integrated support of hardware-accelerated video decoding, encoding and processing on Intel graphics via avcodec. There are 2 possible paths: one for VAAPI, another for QSV which stands for Media SDK. See ffmpeg-vaapi and ffmpeg-qsv for details.
- gstreamer: supports hardware-accelerated video decoding, encoding and processing on Intel graphics. There are 2 possible paths: one for VAAPI, another for Media SDK. See gstreamer-vaapi and gstreamer-MSDK for details.
- Content Protection:
- HDCP: includes HDCP SDK and HDCP Srv to provide HDCP solution for GEN based graphics.
Intel Owned Components
Intel® Media Driver (see Note)
|Intel® Media SDK||https://github.com/Intel-Media-SDK/MediaSDK|
|Intel Libva Sample Code||https://github.com/intel/libva-utils|
|Intel® C-for-Media Compiler||https://github.com/intel/cm-compiler|
Intel® Graphics Memory Management Library
|Intel Hardware Composer for Android* OS||https://github.com/intel/IA-Hardware-Composer|
|3D Graphics Library|
|Compute Library for Deep Neural Networks||https://github.com/intel/clDNN|
|Intel® Graphics Compute Runtime for OpenCL™ Driver||https://github.com/intel/compute-runtime|
|Intel® Graphics Compiler for OpenCL™||https://github.com/intel/intel-graphics-compiler|
Note: The vaapi-driver supports up to Cannon Lake, which will be replaced by the Intel® Media driver.
Third party components
Branch & Release
To adapt more requests from customer, media stack switched to more flexible release model including quarterly release and bi-weekly rolling release.
Rolling release is designed to replace previous pre-release with higher verification coverage and better critieria but the cadence is also bi-weekly. If you plan to early engage some new features development, rolling release build is good choise for you.
Our branch module and release schedule is shown in the following diagram.
Note: All information provided here is subject to change without notice. Contact your Intel representative to obtain the latest Intel product specifications and roadmaps.