LIPS stands for Live Interactive PMSE (Program Making and Special Events) Services. It is a research project funded by the German Federal Ministry for Economic Affairs and Energy (BMWi), in which several industrial and institutional partners work together on a professional production network. It is about the synchronization of audio, video, and light with extremely low latency to create the most immersive user experience possible. The LIPS project aims to interactively and immersively link live events performed at different locations by using new platforms and technical possibilities. The overall goal is to identify-based on newly developed IP-based audio/video production equipment-solutions to improve the access and participation of rural areas on creative, cultural, and political operation of metropolitan areas and vice versa. LIPS also makes significant contributions to inclusion, since it provides solutions which allow people with disabilities who are unable to travel to participate holistically and immersively in events.
LIPS consortiumTo improve the immersive audio/visual experience for the connected users and to develop the technological background for connecting and merging various devices and locations into one production network, several parties had to bring in their individual know-how. Therefore the LIPS consortium was founded in 2018. It consists of the companies Sennheiser, TVN, Smart Mobile Labs, and ARRI, as well as the institutions Leibnitz University Hannover, Fraunhofer Heinrich Hertz Institute, and Friedrich Alexander University Erlangen-Nuremberg. Each partner has a different focus for the project. ARRI was responsible for cameras and lighting with equipment and services, explains Hermann Popp, Systems Architect at ARRI and technical project manager for LIPS. Within ARRI, numerous colleagues were involved with fundamental contributions.
Numerous ARRI colleagues were involved with LIPS, including Hermann Popp, Systems Architect
Use case networked music performance As a use case, the idea of realistic joint performances of musicians at remote geographic locations was born. One part of the student band-piano (Victor Ardelean Montelongo) and bass (Hans Koennecke)-was based at the University for Music and Theater Munich (HMTM), the other-drums (Max Dost), guitar (Julian Scarcella), and keyboards (Lukas Blecks)-570 kilometers (354 miles) north in Wedemark, near Hannover, at the Sennheiser headquarters. The playing of the LIPS Brothers took place in joint sessions, so-called field tests, which were transmitted via internet. A virtual window between the two linked rooms was created, which allows a visually and audibly plausible look in almost real-time into the other locations. In addition to the broadcast of video and audio, the lighting at both locations was also continuously adjusted. The goal was to achieve the most immersive and authentic linking of these two exercise rooms. All participants should always have the same impression, says Hermann Popp.
Both locations were equipped with the same setup and were connected via Wide-Area-Network with a data transfer rate of 1 Gbps. In both directions, six audio channels and one video stream as well as the lighting control information were transmitted.
One part of the student band was based in Munich (pictured), the other 570 kilometers (354 miles) north in Wedemark. Two ARRI SkyPanels S60-C provide a solid baselight
Camera and display An immersive bidirectional image path with low latency was required. This related to the camera as well as the display at each side. The software and firmware of the cameras were specifically designed for LIPS by ARRI. These R&D cameras contain the same sensor and image processing like ARRI standard products with color filters matching characteristics of human eye receptors and high contrast capabilities. But they provide native all-IP functionality for image transfer, synchronization, and control. Each sends its image stream out of a 10-Gb/s-capable-Ethernet-copper-cable and, at the same time, receives the remote image stream over IP. A ProRes codec inside the cameras is used for image compression and decompression. Decompressed images were passed to a large format display via a synchronous serial digital interface (SDI) socket. Both cameras in Munich and Wedemark were synchronized via the Precision Time Protocol (PTP) and used the typical protocol stack for media production: Ethernet, IP, UDP, RTP, a media wrapper, and the compressed video payload. With the media wrapper MXF Live, data consistency and a seamless transition across stream and file was achieved.
LIPS aims a calibrated, linear image path from scene to image reproduction. With respect to displays, this required a defined and constant relation between a digital input value and the corresponding output luminance. The standard SMPTE ST 2084 defines a suited relation over a wide dynamic range and with an efficient perception-based quantization. After testing various kinds of displays large-format OLED displays were selected. They are able to provide this characteristic in a constant and adequate way.
Lighting Immersive integration of separate locations is essentially supported by matched lighting. At LIPS, natural available light was maintained as much as possible to preserve a natural vivid live environment and to avoid a studio feeling. To achieve this, available light, the spectral power distribution of light at each location, was measured and processed by a central lighting control. A common target value for both locations with respect to lighting color coordinates and lighting intensity was calculated. The target was achieved by adding some minimal artificial lighting. This was calculated specifically for each site.
This process was executed continuously and maintained identical lighting conditions at both locat
Europe Stories
06/10/2025
France T l visions, France's leading broadcaster, has received the 2025 EBU ...
04/09/2025
Monumental Sports & Entertainment (MSE), in collaboration with Dalet, has been a...
07/08/2025
July 8 2025, 22:30 (PDT) Tata Motors & Dolby Bring Dolby Atmos to Harrier.ev, R...
18/07/2025
Friday 18 July 2025
Credit: Marc Sethi
The Sky Arts Awards will return on 16 September, once again taking place at the iconic Roundhouse in London. Produced b...
18/07/2025
This month, players can dive into special crossover events featuring SpongeBob SquarePants in Snake.io+ and Crossy Road Castle, available exclusively on Apple A...
18/07/2025
Up for the Match brings the fun, the passion-and a bit of Riverdance- tomorrow n...
17/07/2025
Spotify's goal with audiobooks is to help grow the publishing industry and create the best possible experience for booklovers, which is why we're launch...
17/07/2025
Luxembourg, 14 July 2025 - SES received the final regulatory approvals for the SES-Intelsat transaction, including the US Federal Communications Commission.
O...
17/07/2025
Wuppertal July 17, 2025
Riedel Communications Powers Handa Opera on Sydney Har...
17/07/2025
Fox Corporation Executives to Discuss Fourth Quarter and Full Year Fiscal 2025 F...
17/07/2025
Dalet, a leading technology and service provider for media-rich organizations, w...
17/07/2025
The summer is here and RT Radio 1 has unveiled a lively seasonal lineup, packed...
16/07/2025
Spotify's podcast editorial team is always on the hunt for shows and episodes that spark conversation, push boundaries, and keep us coming back for more. As...
16/07/2025
eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({...
16/07/2025
Join us at IBC this September and take control of your content. Discover how we're bringing a new level of purpose and precision to the application of AI in...
16/07/2025
Wednesday 16 July 2025
Sky and ITV today announced an extension of their long-standing partnership, which will see ITV's content and services remain seamle...
16/07/2025
Sky Sports lifts the lid on Lions life with hilarious behind-the-scenes mockumentaryWednesday 16 July 2025
To view this content, please enable our use of cooki...
16/07/2025
CULVER CITY, CALIFORNIA Apple TV+ today earned a record-breaking 81 Emmy Award nominations across 14 hit Apple Original titles for this year's 77th Emmy Awa...
15/07/2025
Independent media outlets in Brazil and Colombia are invited to apply for a new programme aimed at strengthening the long-term resilience of journalism in the f...
15/07/2025
Spotify une fuerzas con DiDi, la app l der en servicios de movilidad, delivery y...
15/07/2025
NOT FOR DISTRIBUTION IN OR INTO OR TO ANY PERSON LOCATED OR RESIDENT IN THE UNIT...
15/07/2025
U&GOLD has acquired the broadcast rights for Fawlty Towers: The Play (1x120'). Recorded during the show's run at the West End with its original cast, Fa...
15/07/2025
TV SIM builds for the future with high efficiency transmitter from Rohde & Schwa...
15/07/2025
Harmonic's Hybrid, AI-Powered and Live Sports Streaming Innovations are Key ...
15/07/2025
The well-known and well-loved 4099 has been completely revamped. It features amazing CORE+ technology, which eliminates distortion and extends dynamic range, a ...
15/07/2025
Comscore Partners with HyphaMetrics to Launch Advanced Person-Level Audience Mea...
15/07/2025
Peak audiences of over half a million tune into both Kerry v Tyrone and Donegal ...
15/07/2025
PROTON Announces Production Facility Expansion Ahead of IBC2025 posted: 15/07/2025
Proton Announces Production Facility Expansion Ahead of IBC2025
Alongs...
14/07/2025
Enhancing Public Service Broadcasting with
Innovation, Accuracy & Sustainability
New regional detail and local towns featured...
11/07/2025
If you've ever wondered what might be playing in Clark Kent's headphones...
11/07/2025
AI and Multimedia Authenticity Standards Collaboration launches two papers to guide the future of AI integration, today at the AI for Good Global Summit
The...
10/07/2025
The current holder of the prestigious Thomson Foundation Young Journalist of the Year Award has been forced to stop reporting over fears for her safety in Afgha...
10/07/2025
Spotify is turning up the volume on Australian music with a multipronged initiative designed to highlight the dominance of Australian artists on the global stag...
10/07/2025
This is not a drill: Oasis is back on the road-marking its first live performanc...
10/07/2025
The music industry depends on fresh ideas, bold voices, and emerging talent. Yet across the U.K., too many young musicians lack the space to develop their craft...
10/07/2025
10 Jul 2025
VEON and Cohen Circle Secure Investor Commitments for Kyivstar Listing Kyiv, New York, Dubai, and Philadelphia - July 10, 2025 - VEON Ltd. (Nasdaq:...
10/07/2025
Thursday 10 July 2025
The Very Small Creatures
Jaime's Treetop Tales
Emerald
BooSnoo! Christmas Mashup
Pip & Posy's Spooktacular Party
The Very Sm...
10/07/2025
Thursday 10 July 2025
Brand new rewards are coming to Sky customers, with free ...
10/07/2025
Comscore Achieves Full JIC Certification for National TV Measurement Including...
09/07/2025
Wednesday 9 July 2025
Sky Broadband now has the UK's fastest broadband spee...
09/07/2025
CUPERTINO, CALIFORNIA Apple today announced Jeff Williams will transition his role as chief operating officer later this month to Sabih Khan, Apple's senior...
08/07/2025
In an era where digital threats to journalists are becoming increasingly aggressive and widespread, MediaSafe Africa launches as a vital online resource to help...
08/07/2025
This summer, as the energy builds for one of the biggest moments in women's ...
08/07/2025
UKTV today announces that Richard Watsham, Chief Creative Officer at UKTV and Global Director of Acquisitions for BBC Studios/UKTV, has decided to step down fro...
08/07/2025
SAN JOSE, Calif. - July 8, 2025 - Harmonic (NASDAQ: HLIT) today announced a reco...
08/07/2025
Arvato Systems Optimizes Customer Communication with AOK Niedersachsen
New project in the statutory health insurance sector
Arvato Systems and AOK Niedersach...
LIPS stands for Live Interactive PMSE (Program Making and Special Events) Services. It is a research project funded by the German Federal Ministry for Economic Affairs and Energy (BMWi), in which several industrial and institutional partners work together on a professional production network. It is about the synchronization of audio, video, and light with extremely low latency to create the most immersive user experience possible. The LIPS project aims to interactively and immersively link live events performed at different locations by using new platforms and technical possibilities. The overall goal is to identify-based on newly developed IP-based audio/video production equipment-solutions to improve the access and participation of rural areas on creative, cultural, and political operation of metropolitan areas and vice versa. LIPS also makes significant contributions to inclusion, since it provides solutions which allow people with disabilities who are unable to travel to participate holistically and immersively in events.
