LIPS stands for Live Interactive PMSE (Program Making and Special Events) Services. It is a research project funded by the German Federal Ministry for Economic Affairs and Energy (BMWi), in which several industrial and institutional partners work together on a professional production network. It is about the synchronization of audio, video, and light with extremely low latency to create the most immersive user experience possible. The LIPS project aims to interactively and immersively link live events performed at different locations by using new platforms and technical possibilities. The overall goal is to identify-based on newly developed IP-based audio/video production equipment-solutions to improve the access and participation of rural areas on creative, cultural, and political operation of metropolitan areas and vice versa. LIPS also makes significant contributions to inclusion, since it provides solutions which allow people with disabilities who are unable to travel to participate holistically and immersively in events.
LIPS consortiumTo improve the immersive audio/visual experience for the connected users and to develop the technological background for connecting and merging various devices and locations into one production network, several parties had to bring in their individual know-how. Therefore the LIPS consortium was founded in 2018. It consists of the companies Sennheiser, TVN, Smart Mobile Labs, and ARRI, as well as the institutions Leibnitz University Hannover, Fraunhofer Heinrich Hertz Institute, and Friedrich Alexander University Erlangen-Nuremberg. Each partner has a different focus for the project. ARRI was responsible for cameras and lighting with equipment and services, explains Hermann Popp, Systems Architect at ARRI and technical project manager for LIPS. Within ARRI, numerous colleagues were involved with fundamental contributions.
Numerous ARRI colleagues were involved with LIPS, including Hermann Popp, Systems Architect
Use case networked music performance As a use case, the idea of realistic joint performances of musicians at remote geographic locations was born. One part of the student band-piano (Victor Ardelean Montelongo) and bass (Hans Koennecke)-was based at the University for Music and Theater Munich (HMTM), the other-drums (Max Dost), guitar (Julian Scarcella), and keyboards (Lukas Blecks)-570 kilometers (354 miles) north in Wedemark, near Hannover, at the Sennheiser headquarters. The playing of the LIPS Brothers took place in joint sessions, so-called field tests, which were transmitted via internet. A virtual window between the two linked rooms was created, which allows a visually and audibly plausible look in almost real-time into the other locations. In addition to the broadcast of video and audio, the lighting at both locations was also continuously adjusted. The goal was to achieve the most immersive and authentic linking of these two exercise rooms. All participants should always have the same impression, says Hermann Popp.
Both locations were equipped with the same setup and were connected via Wide-Area-Network with a data transfer rate of 1 Gbps. In both directions, six audio channels and one video stream as well as the lighting control information were transmitted.
One part of the student band was based in Munich (pictured), the other 570 kilometers (354 miles) north in Wedemark. Two ARRI SkyPanels S60-C provide a solid baselight
Camera and display An immersive bidirectional image path with low latency was required. This related to the camera as well as the display at each side. The software and firmware of the cameras were specifically designed for LIPS by ARRI. These R&D cameras contain the same sensor and image processing like ARRI standard products with color filters matching characteristics of human eye receptors and high contrast capabilities. But they provide native all-IP functionality for image transfer, synchronization, and control. Each sends its image stream out of a 10-Gb/s-capable-Ethernet-copper-cable and, at the same time, receives the remote image stream over IP. A ProRes codec inside the cameras is used for image compression and decompression. Decompressed images were passed to a large format display via a synchronous serial digital interface (SDI) socket. Both cameras in Munich and Wedemark were synchronized via the Precision Time Protocol (PTP) and used the typical protocol stack for media production: Ethernet, IP, UDP, RTP, a media wrapper, and the compressed video payload. With the media wrapper MXF Live, data consistency and a seamless transition across stream and file was achieved.
LIPS aims a calibrated, linear image path from scene to image reproduction. With respect to displays, this required a defined and constant relation between a digital input value and the corresponding output luminance. The standard SMPTE ST 2084 defines a suited relation over a wide dynamic range and with an efficient perception-based quantization. After testing various kinds of displays large-format OLED displays were selected. They are able to provide this characteristic in a constant and adequate way.
Lighting Immersive integration of separate locations is essentially supported by matched lighting. At LIPS, natural available light was maintained as much as possible to preserve a natural vivid live environment and to avoid a studio feeling. To achieve this, available light, the spectral power distribution of light at each location, was measured and processed by a central lighting control. A common target value for both locations with respect to lighting color coordinates and lighting intensity was calculated. The target was achieved by adding some minimal artificial lighting. This was calculated specifically for each site.
This process was executed continuously and maintained identical lighting conditions at both locat
Europe Stories
05/01/2027
Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...
07/10/2026
Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...
06/09/2026
June 9 2026, 23:00 (PDT) Dolby and MagentaTV Bring Fans Closer to the FIFA Worl...
04/08/2026
Dalet, a leading technology and service provider for media-rich organizations, t...
24/07/2026
First string library captured at Studio Richter Mahr
The latest sample library to be created at Max Richter's Studio Richter Mahr facility captures the ...
24/07/2026
Official emulation of Blackbird Studios reverb chamber
In their latest collaboration with Blackbird Studios, KIT Plugins have captured the sound of the Stud...
24/07/2026
Angela Gomez brings over 14 years of experience in broadcast communications and audio engineering, specialising in live outside broadcasts, live sports and larg...
24/07/2026
Article courtesy of postPerspective
Read the article
While Toy Story 5 maintai...
24/07/2026
Kerry and Mayo fans Up For The Match as excitement builds in Croke Park on the e...
23/07/2026
Staines-upon-Thames, UK, 23rd, JULY, 2026 - Yospace, the trusted leader in Dynamic Ad Insertion (DAI), stitched 11.57 billion one-to-one addressable advertisem...
23/07/2026
Quickly creates reverse reverb effects
Low End Candy have recently released a new plug-in that offers a quick and simple way to create reverse reverb effect...
23/07/2026
New engines, resonators, effects & more
Expressive E's versatile soft synth has just been treated to an update that greatly expands its sonic range. Noi...
23/07/2026
SGL Carbon has further expanded its photovoltaic capacity at its Ort im Innkreis site in Austria. With the commissioning of new PV carports, the sites solar sys...
23/07/2026
Rohde & Schwarz presents new software for three-phase power analysis on MXO seri...
23/07/2026
In our latest blog, Laura Rognoni explores how the launch of Play Snooker reflects a wider shift in sports economics - from monetising peak broadcast audiences ...
23/07/2026
Download Now!
To receive a short case study showcasing Vivid Broadcast's audio setup, please enter the following details:
--
First Name* First Name ...
23/07/2026
X-Rite Pantone and Fashion Institute of Technology (FIT) Partner to Advance Digi...
23/07/2026
Thursday 23 July 2026
New Samsung Galaxy Foldable range available now to pre-order on Sky Mobile
Sky Mobile, the award-winning network voted this year by Expe...
23/07/2026
Thursday 23 July 2026
Jason Statham leads Sky Original action thriller MUTINY in explosive new trailerTurn on cookies to view this content. Go to Privacy optio...
23/07/2026
Wuppertal July 23, 2026
Riedel Implements RefCam and Easy5G for the First Time...
23/07/2026
RT Commercial has today announced Centra as the official food partner once again of The Traitors Ireland, coming to RT One and RT Player later this year.
Ce...
23/07/2026
RT Commercial today announced Honda as sponsor of Today with David McCullagh RT Radio 1, weekdays 9am 11am.
Broadcasting directly after Morning Ireland in ...
23/07/2026
RT News is pleased to announce Barry Gallagher has been assigned as the new journalist covering news from Cork, Kerry and the wider Southern region
Working al...
22/07/2026
Library now available in Engine Player
Another of Eduardo Tarilonte's popular sample libraries has just been moved over to Engine Audio's Engine Pla...
22/07/2026
All-in-one mic & DSP interface overhauled
Cloudvocal have just refreshed the design of their all-in-one mic, audio interface and DSP processor, introducing ...
22/07/2026
The final boss of the lost dual-op-amp circuit
Electro-Harmonix have just introduced the Deluxe Big Muff Pi 2, which they say offers their latest take on t...
22/07/2026
eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({ content_source:......
22/07/2026
A poisoned spy, a secret war, and a small English city contaminated by a deadly chemical weapon. Available on Sky Documentaries from 4 AugustWednesday 22 July 2...
22/07/2026
Audio at Parity: Comscore Launches Transcript-Level Targeting and Measurement wi...
22/07/2026
Arvato Systems and Lobster Enter into a Partnership and Combine the Integration Platform and Managed Services
Flexible integration solutions for cloud, hybrid...
22/07/2026
RT REPORTS NET SURPLUS OF 22.5 MILLION IN 2025...
22/07/2026
In the Opinion of the Censor airs Monday 27 July at 9.35pm on RT One and RT Player
In the Opinion of the Censor looks at how films for theatrical release wer...
21/07/2026
New research involving a cross-section of Mongolias independent media landscape finds enthusiasm for AI as a tool to improve efficiency, sustainability and resi...
21/07/2026
High-end analogue channel strip boasts plug-in recall
Originally revealed as a prototype back at NAMM 2024, the Channex Studio channel strip represented a b...
21/07/2026
Relies on same DSP as plug-in range
Musik Hack's line-up has been influenced heavily by founder Stan Greene's work as a mixing engineer, and their M...
21/07/2026
Official collaboration with boutique builder Dirty Boy Pedals
Warm Audio have just announced the launch of a new guitar pedal range created in collaboration...
21/07/2026
Rohde & Schwarz showcases broad range of EMC test solutions at EMC SIPI 2026 in ...
21/07/2026
X-Rite Pantone and NIFT Partner to Build Color Management Skills for India's...
21/07/2026
Harmonics cOS Virtualized Broadband Platform and Pearl Remote OLTs Enable Flexible PON Migration, While SeaStar Optical Node Powers Cost-Effective Multi-Gigabit...
21/07/2026
160 hours of Irish storytelling for 2026
KIN and The Walsh Sisters return
RT has today unveiled its most ambitious drama slate ever, with a record-breakin...
20/07/2026
Product range now readily available in the UK
Graph Tech Guitar Labs have just announced the launch of a new UK Online Store that makes it quicker and easie...
20/07/2026
Popular headset gains active noise cancellation
The Maxwell headet was Audeze's first foray into the gaming world, and thanks to its Dolby Atmos compati...
20/07/2026
Monday 20 July 2026
Sky brings free global roaming to millions of loyal custome...
20/07/2026
Red Seat Ventures Announces Introduction of Premium Creator and Podcast Communit...
20/07/2026
FIFA World Cup Final sets new RT Player record as the most-streamed single event in the platform's history
Over 1 million viewers watched live on RT 2 as ...
19/07/2026
Channel strip plug-in gets upgraded
Acustica Audio's vintage-inspired channel strip plug-in has just been treated to an update that expands its tonal ra...
18/07/2026
Captures nine sought-after Fender amps
IK Multimedia's latest TONEX expansion captures a selection of nine rare Brown Panel' Fender amps that were ...
18/07/2026
Latest batch ships alongside firmware update
Since being unveiled at Superbooth 2025, Frap Tools' debut polysynth has been met with widespread praise, a...
17/07/2026
Full engine access with reduced soundset
Sonuscore have steadily been introducing a selection of reduced-cost and free versions of their flagship products r...
LIPS stands for Live Interactive PMSE (Program Making and Special Events) Services. It is a research project funded by the German Federal Ministry for Economic Affairs and Energy (BMWi), in which several industrial and institutional partners work together on a professional production network. It is about the synchronization of audio, video, and light with extremely low latency to create the most immersive user experience possible. The LIPS project aims to interactively and immersively link live events performed at different locations by using new platforms and technical possibilities. The overall goal is to identify-based on newly developed IP-based audio/video production equipment-solutions to improve the access and participation of rural areas on creative, cultural, and political operation of metropolitan areas and vice versa. LIPS also makes significant contributions to inclusion, since it provides solutions which allow people with disabilities who are unable to travel to participate holistically and immersively in events.
