Moving Next Generation Audio Production Workflows into the Cloud

With new broadcast standards evolving all over the world and OTT streaming striving for the pole position in media consumption, both next-gen video and audio codecs are gaining momentum. While emerging video formats like VVC/H.266 or AV1 are the major drivers of such initiatives, Next Generation Audio (NGA) production workflows still require more attention and further research and development, especially when targeting live events. In on-premises environments, NGA workflows have been in use for many years. For cloud and hybrid pipelines, debate continues as to the ideal structure.

The production process for real-time events like sports and concerts is complex regardless of whether you are targeting TV broadcast or adaptive bitrate streaming workflows. The authoring step of immersive, object-based audio, which is required to create NGA content such as MPEG-H Audio, needs careful human interaction.

The NGA Codec in Focus: MPEG-H Audio Fraunhofer IIS is the primary driver behind one of the major NGA codecs: MPEG-H Audio. It delivers personalized immersive sound that offers an unprecedented user experience. MPEG-H Audio is included in the ATSC (North America), DVB (Europe), TTA (South Korea) and SBTVD (Brazil) TV standards. In fact, the world's first terrestrial UHD TV service in South Korea is already broadcasting MPEG-H Audio. In Brazil, it has been selected as the mandatory audio system for the country's next-generation DTV+ broadcast service combining the next-gen video codec VVC/H.266 with NGA MPEG-H. Other countries and organizations, including ATSC 3.0 in the US, DVB in Europe, and ARIB in Japan, have been evaluating MPEG-H Audio as their sole or supplemental audio format.

In contrast to traditional audio formats with their fixed stereo or surround mixes, immersive audio codecs such as MPEG-H handle the individual sound elements (e.g. dialogue, commentary, music, sound effects) as separate audio objects. Each object is accompanied by metadata that defines, for example, what the audio element represents, where it should be positioned, when it is active over time, how it should be rendered on different playback devices, what user interactivity is permitted, or its loudness characteristics.

Classic on-premises NGA production workflows are well established and have been running smoothly for many years now. However, broadcasters are tending to move parts of the MPEG-H production workflows to the cloud to reduce hardware costs and increase flexibility. As a result, we need to rethink and adapt the current approach where source video and audio (with or without metadata) must be transferred and processed differently. For NAB 2026, several leading software companies and technology providers put their heads together to introduce a Proof of Concept (POF) for how an MPEG-H production workflow in the cloud can look.

A Unique Partner Collaboration of Leading Media Companies

For the POC at NAB, five companies teamed up to present a real-time NGA production chain in the cloud. Each company contributes to the showcase with its proven expertise in the broadcast market:

Fraunhofer IIS, the research organization behind MPEG-H Audio technology, provides encoding, decoding, and player libraries that enable the entire NGA experience from production through playback.

J nger Audio brings deep expertise in audio processing with their flexAI platform, which handles the complex task of real-time metadata authoring and rendering. flexAI enables broadcasters to create and manage NGA audio and metadata streams in live production environments, supporting both S-ADM and MPEG-H Control Track workflows.

MainConcept provides their professional-grade AVC, HEVC and VVC Encoder as well as Decoder SDK technology combined with both MPEG-H contribution and emission encoding to ensure broadcast-quality video and audio throughout the complete production chain, including multiplexing and packaging for ABR formats like HLS, DASH and CMAF.

Techex contributes txdarwin, a sophisticated stream processing platform that demultiplexes incoming feeds, routes audio to processing systems, and remultiplexes the processed streams while maintaining frame-accurate time alignment - critical for professional broadcast applications.

AWS provides the cloud infrastructure that serves as a platform for the complete POC. All partner solutions are deployed on dedicated EC2 instances hosted by AWS.

NAB 2026: An NGA Production Workflow for the Cloud

Historically, the traditional live production workflow was based on on-premises infrastructure, i.e. Outside Broadcasting (OB) vans, studios, and dedicated hardware, that was capable of dealing with uncompressed audio, real-time metadata authoring, and contribution to distribution processing pipelines. Nowadays, cloud technologies have the ability to extend these workflows beyond physical facilities without compromising audio quality, latency or creative control while evolving toward greater immersion and personalization.

The solution that Fraunhofer, J nger Audio, MainConcept and Techex have set up on AWS for NAB 2026 is a first step to port the complete NGA production workflow to the cloud. Here is the solution architecture and signal workflow at a glance:

01 - Audio Capture: For live events, this first step is still happening on-site, i.e. at the event location where individual video and audio sources - such as commentary, ambient sounds, and effects - are captured separately as discrete PCM audio signals and processed in the OB van. The separation of the various feeds enables interactivity and immersive rendering later on. MainConcept's video and audio codec technology used in Contribution Mode receives video and audio (16 channels of PCM audio) over baseband (SDI). The MainConcept MPEG-H Encoder library - powered by Fraunhofer's immersive audio technology - encodes and o

LINK:	https://junger-audio.com/en/press-release/moving-next-generation-audio...
	See more stories from junger

Most recent headlines