LIPS stands for Live Interactive PMSE (Program Making and Special Events) Services. It is a research project funded by the German Federal Ministry for Economic Affairs and Energy (BMWi), in which several industrial and institutional partners work together on a professional production network. It is about the synchronization of audio, video, and light with extremely low latency to create the most immersive user experience possible. The LIPS project aims to interactively and immersively link live events performed at different locations by using new platforms and technical possibilities. The overall goal is to identify-based on newly developed IP-based audio/video production equipment-solutions to improve the access and participation of rural areas on creative, cultural, and political operation of metropolitan areas and vice versa. LIPS also makes significant contributions to inclusion, since it provides solutions which allow people with disabilities who are unable to travel to participate holistically and immersively in events.
LIPS consortiumTo improve the immersive audio/visual experience for the connected users and to develop the technological background for connecting and merging various devices and locations into one production network, several parties had to bring in their individual know-how. Therefore the LIPS consortium was founded in 2018. It consists of the companies Sennheiser, TVN, Smart Mobile Labs, and ARRI, as well as the institutions Leibnitz University Hannover, Fraunhofer Heinrich Hertz Institute, and Friedrich Alexander University Erlangen-Nuremberg. Each partner has a different focus for the project. ARRI was responsible for cameras and lighting with equipment and services, explains Hermann Popp, Systems Architect at ARRI and technical project manager for LIPS. Within ARRI, numerous colleagues were involved with fundamental contributions.
Numerous ARRI colleagues were involved with LIPS, including Hermann Popp, Systems Architect
Use case networked music performance As a use case, the idea of realistic joint performances of musicians at remote geographic locations was born. One part of the student band-piano (Victor Ardelean Montelongo) and bass (Hans Koennecke)-was based at the University for Music and Theater Munich (HMTM), the other-drums (Max Dost), guitar (Julian Scarcella), and keyboards (Lukas Blecks)-570 kilometers (354 miles) north in Wedemark, near Hannover, at the Sennheiser headquarters. The playing of the LIPS Brothers took place in joint sessions, so-called field tests, which were transmitted via internet. A virtual window between the two linked rooms was created, which allows a visually and audibly plausible look in almost real-time into the other locations. In addition to the broadcast of video and audio, the lighting at both locations was also continuously adjusted. The goal was to achieve the most immersive and authentic linking of these two exercise rooms. All participants should always have the same impression, says Hermann Popp.
Both locations were equipped with the same setup and were connected via Wide-Area-Network with a data transfer rate of 1 Gbps. In both directions, six audio channels and one video stream as well as the lighting control information were transmitted.
One part of the student band was based in Munich (pictured), the other 570 kilometers (354 miles) north in Wedemark. Two ARRI SkyPanels S60-C provide a solid baselight
Camera and display An immersive bidirectional image path with low latency was required. This related to the camera as well as the display at each side. The software and firmware of the cameras were specifically designed for LIPS by ARRI. These R&D cameras contain the same sensor and image processing like ARRI standard products with color filters matching characteristics of human eye receptors and high contrast capabilities. But they provide native all-IP functionality for image transfer, synchronization, and control. Each sends its image stream out of a 10-Gb/s-capable-Ethernet-copper-cable and, at the same time, receives the remote image stream over IP. A ProRes codec inside the cameras is used for image compression and decompression. Decompressed images were passed to a large format display via a synchronous serial digital interface (SDI) socket. Both cameras in Munich and Wedemark were synchronized via the Precision Time Protocol (PTP) and used the typical protocol stack for media production: Ethernet, IP, UDP, RTP, a media wrapper, and the compressed video payload. With the media wrapper MXF Live, data consistency and a seamless transition across stream and file was achieved.
LIPS aims a calibrated, linear image path from scene to image reproduction. With respect to displays, this required a defined and constant relation between a digital input value and the corresponding output luminance. The standard SMPTE ST 2084 defines a suited relation over a wide dynamic range and with an efficient perception-based quantization. After testing various kinds of displays large-format OLED displays were selected. They are able to provide this characteristic in a constant and adequate way.
Lighting Immersive integration of separate locations is essentially supported by matched lighting. At LIPS, natural available light was maintained as much as possible to preserve a natural vivid live environment and to avoid a studio feeling. To achieve this, available light, the spectral power distribution of light at each location, was measured and processed by a central lighting control. A common target value for both locations with respect to lighting color coordinates and lighting intensity was calculated. The target was achieved by adding some minimal artificial lighting. This was calculated specifically for each site.
This process was executed continuously and maintained identical lighting conditions at both locat
Europe Stories
11/12/2025
Dalet, a leading provider of cloud-native, end-to-end media workflow solutions, ...
02/12/2025
eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({...
02/12/2025
--
The International Electrotechnical Commission (IEC), the International Organization for Standardization (ISO), and the International Telecommunication Unio...
02/12/2025
Harmonic's cOS Platform Will Redefine Subscribers' Quality of Experience, Lowering Churn SAN JOSE, Calif. - Dec. 2, 2025 - Harmonic (NASDAQ: HLIT) today...
02/12/2025
S an Nollaig
Hollywood blockbusters The Banshees of Inisherin, Barbie and Oppenheimer make their Irish TV debut
Tune into the classics such as Love Actual...
02/12/2025
Showcasing fresh Irish storytelling and emerging talent Storyland 2025 signals a fantastic time for Irish drama
RT and F s ireann/Screen Ireland are proud to...
01/12/2025
MANCHESTER, UK - November 2025 - Announced two days before the 30th anniversary of Oasis' debut album, Definitely Maybe, the Oasis Live '25 tour marks t...
01/12/2025
01 Dec 2025
Kyivstar and Ukrainian Ministry of Digital Transformation Select Go...
01/12/2025
The prequel to the global hit Sky Original mob crime saga, Gomorrah' is a s...
01/12/2025
Featuring Florence Welch, Red Hot Chilli Peppers' Flea, designer Bella Freud...
01/12/2025
Fox Corporation Chief Financial Officer Steve Tomsic to Participate in Upcoming ...
01/12/2025
Arvato Systems' Virtual Private Cloud (VPC) Receives BSI C5 Certification (T...
01/12/2025
Summary This short video gives you an summary of the changes in under two minutes.
--...
01/12/2025
As the festive season approaches, RT Supporting the Arts is proud to showcase a...
01/12/2025
Festive specials of Christmas in Kilmainham presented by Marty Whelan, High Road Low Road, Callan Kicks the Year and Keys to My Life
Ring in the New Year with ...
01/12/2025
Architect and television presenter Hugh Wallace, best known to RT audiences as a long-serving judge on Home of the Year, has died at the age of 68.
In a state...
28/11/2025
It's easy to ignore those little red update available badges. But when it ...
28/11/2025
Friday 28 November 2025
Sky Sports x Slawn drop limited-edition football jersey...
28/11/2025
Rohde & Schwarz shows resilience in a challenging environment, revenue exceeds t...
28/11/2025
Unwrapped: The Toy Show Appeal - airing this Sunday on RT One and RT Player- s...
27/11/2025
27 Nov 2025
GSMA brings M360 Eurasia 2026 to Samarkand in partnership with VEON...
27/11/2025
Tahar Rahim and Izuka Hoyle star in the gripping six-part Sky Original from Acad...
27/11/2025
Thursday 27 November 2025
Sky Arts Reveals the Nation's Greatest Basslines - and Queen Reign Supreme
The UK's most iconic basslines have been revealed...
27/11/2025
Rating reflects rating progress across areas including policies, diversity & inclusion, health & safety and Net Zero leadership
Winchester, UK, 27 November 202...
27/11/2025
What are the industry standards for Retail Media? Kathryn explains that certification is based on the IAB Europe Retail Media Measurement Standards and the IAB ...
27/11/2025
World champion boxer and Irish sporting icon Katie Taylor will be in studio this...
27/11/2025
Roblox, one of the world's most popular online gaming platforms for primary ...
26/11/2025
Book podcasts are booming. On Spotify, you'll find everything from celebrity book clubs to deep dives with bestselling authors. And in markets where audiobo...
26/11/2025
YouView Achieves Greenly Gold Certification for SustainabilityNov 26, 2025
YouView is proud to announce a Gold Certification award from Greenly for our perform...
25/11/2025
Tracy Bonareri Onchoke, an investigative journalist from Kenya is the winner of the Thomson Foundation's Young Journalist Award 2025.
The 26-year-old-sele...
25/11/2025
The best playlists, podcasts, and audiobooks bring a little extra magic to your daily routine. With new features and offerings, Spotify Premium delivers even mo...
25/11/2025
Comprehensive new research confirms what we already knew: Australian music fans love the quality, quantity, and access they have to new and local music on strea...
25/11/2025
Applicable Products
Objectives The purpose of this application note is to give a brief background on 5G (NR) wireless communication an explain the reason a SN...
25/11/2025
25. November 2025 Cecilia Pierron
Last week, we took part in OnDAM 2025, an educational conference fully dedicated to DAM, hosted by Activo Consulting. The ...
25/11/2025
25 Nov 2025
VEON's QazCode and MeetKai Sign Agreement to Power National LLM...
25/11/2025
UKTV has acquired a high-profile slate of US dramas from Paramount Global Conten...
25/11/2025
A symphony of genius, rivalry and vengeance, boldly reimagined from Peter Shaffe...
25/11/2025
Article courtesy of Cinematography World
Read the article
FilmLight has finalised the prestigious 2025 FilmLight Colour Awards jury and welcomed award-winning...
25/11/2025
Article courtesy of Prensario
Read the article
La serie fue dirigida por Juli n de Tavira, Rodrigo Santos, y David Leche Ruiz, con direcci n de fotograf a a...
25/11/2025
Article courtesy of The Hollywood Reporter
Read the article
The awards, celebr...
25/11/2025
Article courtesy of Televisual
Read the article
Already live in Los Angeles and rolling out in New York and London, Nara gives producers, colourists, conform ...
25/11/2025
Article courtesy of Digital Media World
Read the article
ARTONE post-house in Tokyo is the first facility in Japan to integrate Baselight M, choosing its prec...
25/11/2025
Article courtesy of The Hollywood Reporter
Read the article
Once hidden in post-production suites, the artists who make movies and TV shows look the way they ...
25/11/2025
Article courtesy of Deadline
Read the article
The Brutalist' & Bad Bunny's Nuevayol' Music Video Among 2025 FilmLight Colour Award Winners - Cam...
24/11/2025
Robyn made her long-awaited return to the stage this week, as Spotify and Acne Studios brought friends and top fans together for an unforgettable evening at the...
24/11/2025
After more than two years of redevelopment, FC Barcelona returned to its spiritual home on November 22, hosting Athletic Club in the first La Liga match at the ...
24/11/2025
24 Nov 2025
Kyivstar Launches Starlink Direct to Cell Satellite Connectivity in Ukraine Today's Launch Makes Ukraine the First Country in Europe Where Star...
24/11/2025
Ahead of the new ninth series of Dancing with the Stars, kicking off in January 2026, RT and Shinawil have announced the arrival of three new faces to the hit ...
21/11/2025
Fans have been counting down the days until the final theatrical chapter of Wicked is revealed. To celebrate the highly anticipated release of Wicked: For Good ...
LIPS stands for Live Interactive PMSE (Program Making and Special Events) Services. It is a research project funded by the German Federal Ministry for Economic Affairs and Energy (BMWi), in which several industrial and institutional partners work together on a professional production network. It is about the synchronization of audio, video, and light with extremely low latency to create the most immersive user experience possible. The LIPS project aims to interactively and immersively link live events performed at different locations by using new platforms and technical possibilities. The overall goal is to identify-based on newly developed IP-based audio/video production equipment-solutions to improve the access and participation of rural areas on creative, cultural, and political operation of metropolitan areas and vice versa. LIPS also makes significant contributions to inclusion, since it provides solutions which allow people with disabilities who are unable to travel to participate holistically and immersively in events.
