LIPS stands for Live Interactive PMSE (Program Making and Special Events) Services. It is a research project funded by the German Federal Ministry for Economic Affairs and Energy (BMWi), in which several industrial and institutional partners work together on a professional production network. It is about the synchronization of audio, video, and light with extremely low latency to create the most immersive user experience possible. The LIPS project aims to interactively and immersively link live events performed at different locations by using new platforms and technical possibilities. The overall goal is to identify-based on newly developed IP-based audio/video production equipment-solutions to improve the access and participation of rural areas on creative, cultural, and political operation of metropolitan areas and vice versa. LIPS also makes significant contributions to inclusion, since it provides solutions which allow people with disabilities who are unable to travel to participate holistically and immersively in events.
LIPS consortiumTo improve the immersive audio/visual experience for the connected users and to develop the technological background for connecting and merging various devices and locations into one production network, several parties had to bring in their individual know-how. Therefore the LIPS consortium was founded in 2018. It consists of the companies Sennheiser, TVN, Smart Mobile Labs, and ARRI, as well as the institutions Leibnitz University Hannover, Fraunhofer Heinrich Hertz Institute, and Friedrich Alexander University Erlangen-Nuremberg. Each partner has a different focus for the project. ARRI was responsible for cameras and lighting with equipment and services, explains Hermann Popp, Systems Architect at ARRI and technical project manager for LIPS. Within ARRI, numerous colleagues were involved with fundamental contributions.
Numerous ARRI colleagues were involved with LIPS, including Hermann Popp, Systems Architect
Use case networked music performance As a use case, the idea of realistic joint performances of musicians at remote geographic locations was born. One part of the student band-piano (Victor Ardelean Montelongo) and bass (Hans Koennecke)-was based at the University for Music and Theater Munich (HMTM), the other-drums (Max Dost), guitar (Julian Scarcella), and keyboards (Lukas Blecks)-570 kilometers (354 miles) north in Wedemark, near Hannover, at the Sennheiser headquarters. The playing of the LIPS Brothers took place in joint sessions, so-called field tests, which were transmitted via internet. A virtual window between the two linked rooms was created, which allows a visually and audibly plausible look in almost real-time into the other locations. In addition to the broadcast of video and audio, the lighting at both locations was also continuously adjusted. The goal was to achieve the most immersive and authentic linking of these two exercise rooms. All participants should always have the same impression, says Hermann Popp.
Both locations were equipped with the same setup and were connected via Wide-Area-Network with a data transfer rate of 1 Gbps. In both directions, six audio channels and one video stream as well as the lighting control information were transmitted.
One part of the student band was based in Munich (pictured), the other 570 kilometers (354 miles) north in Wedemark. Two ARRI SkyPanels S60-C provide a solid baselight
Camera and display An immersive bidirectional image path with low latency was required. This related to the camera as well as the display at each side. The software and firmware of the cameras were specifically designed for LIPS by ARRI. These R&D cameras contain the same sensor and image processing like ARRI standard products with color filters matching characteristics of human eye receptors and high contrast capabilities. But they provide native all-IP functionality for image transfer, synchronization, and control. Each sends its image stream out of a 10-Gb/s-capable-Ethernet-copper-cable and, at the same time, receives the remote image stream over IP. A ProRes codec inside the cameras is used for image compression and decompression. Decompressed images were passed to a large format display via a synchronous serial digital interface (SDI) socket. Both cameras in Munich and Wedemark were synchronized via the Precision Time Protocol (PTP) and used the typical protocol stack for media production: Ethernet, IP, UDP, RTP, a media wrapper, and the compressed video payload. With the media wrapper MXF Live, data consistency and a seamless transition across stream and file was achieved.
LIPS aims a calibrated, linear image path from scene to image reproduction. With respect to displays, this required a defined and constant relation between a digital input value and the corresponding output luminance. The standard SMPTE ST 2084 defines a suited relation over a wide dynamic range and with an efficient perception-based quantization. After testing various kinds of displays large-format OLED displays were selected. They are able to provide this characteristic in a constant and adequate way.
Lighting Immersive integration of separate locations is essentially supported by matched lighting. At LIPS, natural available light was maintained as much as possible to preserve a natural vivid live environment and to avoid a studio feeling. To achieve this, available light, the spectral power distribution of light at each location, was measured and processed by a central lighting control. A common target value for both locations with respect to lighting color coordinates and lighting intensity was calculated. The target was achieved by adding some minimal artificial lighting. This was calculated specifically for each site.
This process was executed continuously and maintained identical lighting conditions at both locat
Europe Stories
05/01/2027
Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...
01/06/2026
January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026
Throughout the week, Dolby brings to life the latest innovatio...
02/05/2026
Dalet, a leading technology and service provider for media-rich organizations, t...
01/05/2026
January 5 2026, 18:30 (PST) NBCUniversal's Peacock to Be First Streamer to ...
01/04/2026
January 4 2026, 18:00 (PST) DOLBY AND DOUYIN EMPOWER THE NEXT GENERATON OF CREATORS WITH DOLBY VISION
Douyin Users Can Now Create And Share Videos With Stun...
12/03/2026
In Latin America, women are shaping music and defining its future. To kick off t...
12/03/2026
En Am rica Latina, las mujeres est n moldeando la m sica y definiendo su futuro....
12/03/2026
Let's turn back the clock 20 years: The music landscape was a world away fro...
12/03/2026
Bad Bunny is no stranger to Spotify's Billions Club. In fact, he has a whopp...
12/03/2026
Spotify was at the London Book Fair this week, joining conversations across the publishing industry about how people can make reading part of their daily lives....
12/03/2026
Mastering tool improves mono compatibility
Tokyo Dawn Labs' Ohlhorst Digital range is a series of mastering-focused plug-ins developed by Jan Ohlhorst, ...
12/03/2026
Wave FX processor integrated into four products
Lewitt have teamed up with Elgato to create a new processor for the company's Wave Next product range, i...
12/03/2026
Free tool for annotating audio files
Mix Notes is a new, free iOS App that provides users with a simple way to annotate their audio files. It's been cre...
12/03/2026
Side-chain ducking tool gets an upgrade
Devious Machines' popular side-chaining and envelope-shaping tool has just been kitted out with an improved enve...
12/03/2026
Ceremony to take place on 16 April 2026
The MPG (Music Producers Guild) have revealed the full shortlist for this year's MPG Awards, which will be takin...
12/03/2026
Emulates three classic dbx 160 variants
The latest arrival to Overloud's Gem Series plug-in range faithfully recreates not one, but three versions of th...
12/03/2026
New granular soft synth announced
Said to be their most advanced software synthesizer to date, Baby Audio's latest release has been built on a new granu...
12/03/2026
Latest version now live!
Edit 11 March 2026 - Bitwig Studio 6 is now live, and available for all to download!
The latest version of Bitwig's DAW softwa...
12/03/2026
Latest free eBook now available!
Designed for recording engineers, audio-technology students and technically minded musicians, our latest free eBook deliver...
12/03/2026
Rohde & Schwarz Cybersecurity expands SITLine network encryptor portfolio - more...
12/03/2026
Rohde & Schwarz to showcase future-proof EMC testing solutions at EMV 2026 Rohde & Schwarz will participate in EMV 2026, Europe's premier trade fair and c...
12/03/2026
Modern media operations demand a platform that unites automation, orchestration, and human oversight without compromise. In this post, we explore the six key te...
12/03/2026
A deep dive into the platform
Architecture The Blue Lucy platform follows a distributed microservices architecture, meaning the overall operational capability...
12/03/2026
Orchestration platform enables broadcasters to deploy multiple AI models safely with full auditability, rights protection, and regulatory oversight.
LONDON, En...
12/03/2026
Wuppertal March 12, 2026
Riedel Expands Managed Technology Division in the Ame...
12/03/2026
Advanced Media Server Delivers Double the Channel Density at Half the Cost per C...
12/03/2026
The Late Late Show Show St Patrick's Day special
Dancing with the Stars f...
11/03/2026
First Medium-Earth Orbit (MEO) deployment of the emergency.lu platform for refugees and their host communities' use provides dependable broadband for humani...
11/03/2026
Following a successful first series, UKTV today announces the commission of two ...
11/03/2026
Wednesday 11 March 2026
Sky and CANAL launch new partnership to develop English-language drama
Sky and CANAL are today announcing a strategic co commissioni...
11/03/2026
NTCA, Cartesian Release New Report on the Business Case for USF
March 11, 2026
Network Economics
News
NTCA - March 11, 2026 - As the FCC and Congr...
11/03/2026
TELL US YOUR (SHORT) STORIES
The 2026 RT Short Story Competition is now open for entries
Recognising and rewarding the best new Irish fiction writing for...
11/03/2026
RT 's The Traitors Ireland is among the nominees for the 2026 Celtic Media Festival Torc Awards for Excellence, announced today....
09/03/2026
Contains all six dual-ensemble libraries
VSL's Duality Strings series offers an intriguing alternative to your average string library, capturing two str...
09/03/2026
Outstanding Contribution To UK Music
Photo: Samuel Bradley
Ahead of their upcoming MPG Awards, the Music Producers Guild (MPG) have revealed the latest win...
09/03/2026
Two new high-quality DI boxes announced
Boasting some impressive technical specifications and versatile routing options, Strymon's latest active DI boxe...
09/03/2026
Latest MPE-capable Soundbox library released
The follow-up release for Sonora Cinematic's Pure Nylon has arrived, and becomes the latest addition to the...
09/03/2026
Popular wireless mic head design revived
Sennheiser have revealed that the MD 9235, a cardioid mic head designed to pair up with their handheld wireless sys...
09/03/2026
Captures two sought-after Dumble combo amps
The latest TONEX release captures a pair of sought-after Dumble amplifiers from IK Multimedia's private amp ...
09/03/2026
Flexible all-analogue insert matrix joins line-up
HUM Audio Devices don't tend to do things by halves - even the quickest of glances at the likes of the...
09/03/2026
Captures three sought-after pianos
Rhodes latest software release brings together a collection of three virtual pianos: a concert grand, an acoustic upright...
09/03/2026
Flagship compressor gets an upgrade
Techivation's flagship compressor plug-in has just been treated to a ground-up rebuild that kits it out with some po...
09/03/2026
Profiler OS 14.0 enters open beta
Kemper's amp-modelling systems already have a great reputation, but the latest update to their systems' underlying...
09/03/2026
Procedural stems smasher & recomposition engine
Blinksonic have recently launched a new Reaktor-based tool which they say takes a radical departure from yo...
09/03/2026
13 - 15 March 2026 at University of Warwick Conference Centre
The Institute of Professional Sound (IPS) have announced that The IPS Training Weekend 2026 wi...
09/03/2026
Rohde & Schwarz and NETGEAR collaborate for next generation Wi-Fi 8 access point...
09/03/2026
UKTV has agreed a new partnership deal with Samsung that makes UKTV's free linear channels available to internet-only Samsung TV viewers in the UK for the f...
09/03/2026
Monday 9 March 2026
Sky reveals first look trailer and sets premiere date for S...
09/03/2026
Monday 9 March 2026
Sky Appoints Damian Saunders as Managing Director of Sky Business
Sky has today announced the appointment of Damian Saunders as Managing D...
LIPS stands for Live Interactive PMSE (Program Making and Special Events) Services. It is a research project funded by the German Federal Ministry for Economic Affairs and Energy (BMWi), in which several industrial and institutional partners work together on a professional production network. It is about the synchronization of audio, video, and light with extremely low latency to create the most immersive user experience possible. The LIPS project aims to interactively and immersively link live events performed at different locations by using new platforms and technical possibilities. The overall goal is to identify-based on newly developed IP-based audio/video production equipment-solutions to improve the access and participation of rural areas on creative, cultural, and political operation of metropolitan areas and vice versa. LIPS also makes significant contributions to inclusion, since it provides solutions which allow people with disabilities who are unable to travel to participate holistically and immersively in events.
