
LIPS stands for Live Interactive PMSE (Program Making and Special Events) Services. It is a research project funded by the German Federal Ministry for Economic Affairs and Energy (BMWi), in which several industrial and institutional partners work together on a professional production network. It is about the synchronization of audio, video, and light with extremely low latency to create the most immersive user experience possible. The LIPS project aims to interactively and immersively link live events performed at different locations by using new platforms and technical possibilities. The overall goal is to identify-based on newly developed IP-based audio/video production equipment-solutions to improve the access and participation of rural areas on creative, cultural, and political operation of metropolitan areas and vice versa. LIPS also makes significant contributions to inclusion, since it provides solutions which allow people with disabilities who are unable to travel to participate holistically and immersively in events.
LIPS consortiumTo improve the immersive audio/visual experience for the connected users and to develop the technological background for connecting and merging various devices and locations into one production network, several parties had to bring in their individual know-how. Therefore the LIPS consortium was founded in 2018. It consists of the companies Sennheiser, TVN, Smart Mobile Labs, and ARRI, as well as the institutions Leibnitz University Hannover, Fraunhofer Heinrich Hertz Institute, and Friedrich Alexander University Erlangen-Nuremberg. Each partner has a different focus for the project. ARRI was responsible for cameras and lighting with equipment and services, explains Hermann Popp, Systems Architect at ARRI and technical project manager for LIPS. Within ARRI, numerous colleagues were involved with fundamental contributions.
Numerous ARRI colleagues were involved with LIPS, including Hermann Popp, Systems Architect
Use case networked music performance As a use case, the idea of realistic joint performances of musicians at remote geographic locations was born. One part of the student band-piano (Victor Ardelean Montelongo) and bass (Hans Koennecke)-was based at the University for Music and Theater Munich (HMTM), the other-drums (Max Dost), guitar (Julian Scarcella), and keyboards (Lukas Blecks)-570 kilometers (354 miles) north in Wedemark, near Hannover, at the Sennheiser headquarters. The playing of the LIPS Brothers took place in joint sessions, so-called field tests, which were transmitted via internet. A virtual window between the two linked rooms was created, which allows a visually and audibly plausible look in almost real-time into the other locations. In addition to the broadcast of video and audio, the lighting at both locations was also continuously adjusted. The goal was to achieve the most immersive and authentic linking of these two exercise rooms. All participants should always have the same impression, says Hermann Popp.
Both locations were equipped with the same setup and were connected via Wide-Area-Network with a data transfer rate of 1 Gbps. In both directions, six audio channels and one video stream as well as the lighting control information were transmitted.
One part of the student band was based in Munich (pictured), the other 570 kilometers (354 miles) north in Wedemark. Two ARRI SkyPanels S60-C provide a solid baselight
Camera and display An immersive bidirectional image path with low latency was required. This related to the camera as well as the display at each side. The software and firmware of the cameras were specifically designed for LIPS by ARRI. These R&D cameras contain the same sensor and image processing like ARRI standard products with color filters matching characteristics of human eye receptors and high contrast capabilities. But they provide native all-IP functionality for image transfer, synchronization, and control. Each sends its image stream out of a 10-Gb/s-capable-Ethernet-copper-cable and, at the same time, receives the remote image stream over IP. A ProRes codec inside the cameras is used for image compression and decompression. Decompressed images were passed to a large format display via a synchronous serial digital interface (SDI) socket. Both cameras in Munich and Wedemark were synchronized via the Precision Time Protocol (PTP) and used the typical protocol stack for media production: Ethernet, IP, UDP, RTP, a media wrapper, and the compressed video payload. With the media wrapper MXF Live, data consistency and a seamless transition across stream and file was achieved.
LIPS aims a calibrated, linear image path from scene to image reproduction. With respect to displays, this required a defined and constant relation between a digital input value and the corresponding output luminance. The standard SMPTE ST 2084 defines a suited relation over a wide dynamic range and with an efficient perception-based quantization. After testing various kinds of displays large-format OLED displays were selected. They are able to provide this characteristic in a constant and adequate way.
Lighting Immersive integration of separate locations is essentially supported by matched lighting. At LIPS, natural available light was maintained as much as possible to preserve a natural vivid live environment and to avoid a studio feeling. To achieve this, available light, the spectral power distribution of light at each location, was measured and processed by a central lighting control. A common target value for both locations with respect to lighting color coordinates and lighting intensity was calculated. The target was achieved by adding some minimal artificial lighting. This was calculated specifically for each site.
This process was executed continuously and maintained identical lighting conditions at both locat
Europe Stories
06/10/2025
France T l visions, France's leading broadcaster, has received the 2025 EBU ...
04/09/2025
Monumental Sports & Entertainment (MSE), in collaboration with Dalet, has been a...
04/07/2025
The Summer Reading Challenge has inspired children across the U.K. to embrace a ...
04/07/2025
Friday 4 July 2025
Watch the trailer here https://youtu.be/Od5WpvWmDr8
Further...
04/07/2025
The Pitch comes to RT Radio 1 airwaves this Sunday at 7pm. The Pitch is a brand...
03/07/2025
For our Vario-Jib, as well as for a repertoire of weights, we now have carts that make transport easier...
03/07/2025
One of our latest innovations: Slider Drive Unit!
Our Vario Slider not only comes with improvements and new features, but also with its own drive unit!
Our i...
03/07/2025
The 360 EVO lives up to its name: 360-degree rotation not only on the pan axis, but also on the roll axis, enables filmmakers to take their creative visions eve...
03/07/2025
What a buzzing few days at BSCExpo in London!
We were thrilled to connect with so many talented professionals from the world of cinematography.
A huge thank ...
03/07/2025
ADOLESCENCE - Shot with Panther Tower"The whole rig had to be detachable mid-episode
Netflix limited drama series Adolescence has been gaining attentio...
03/07/2025
** MEDIA ALERT ** Shonen Jump Store Hosting Los Angeles Pop-up During Anime Exp...
03/07/2025
Thursday 3 July 2025
David Harewood and Matthew Broome in Mozart: Genius for Hi...
03/07/2025
The Sky WNT Fund supports Womens National Team players with a 30,000 bursaryThursday 3 July 2025
Sky Ireland has announced the four recipients of the 2025 Sky...
02/07/2025
Calrec expands ecosystem at NAB 2025 giving broadcasters access to dynamic workflows and ultimate flexibility Helping broadcasters meet the shifting needs of me...
02/07/2025
02 Jul 2025
VEON Raises USD 200 Million in Private Bond Placement Dubai, July 1, 2025: VEON Ltd. (Nasdaq: VEON), a global digital operator ( VEON ), announces ...
02/07/2025
Brand new factual series follows mechanic and self-taught engineer Dom Chinea as he makes the move of his life to the far west of Cornwall
UKTV today announces...
02/07/2025
Rohde & Schwarz acquires ZES ZIMMER Electronic Systems GmbH and expands its T&M ...
02/07/2025
Wuppertal July 2, 2025
Riedel Communications Launches RefSuite Ecosystem for S...
02/07/2025
Andrew will serve as Chair of ABC alongside his role at NED, APL Media, where he supports the executive team with strategic insight and global expansion plans. ...
01/07/2025
The launch of Code of Silence, coupled with the Britains Got Talent semi final, gave ITV its best Sunday night of 2025.
The first episode of the new crime dr...
01/07/2025
ITV and Mammoth Screen have announced the start of filming for Betrayal, a gripp...
01/07/2025
eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({ content_source:......
01/07/2025
Vocal-processing plug-in joins NOIZ Hub series
Launched in 2024, KIT Plugins' NOIZ Hub series was created with the aim of providing a range of professio...
01/07/2025
New self-paced learning programme announced
Mastering.com have announced the availability of a new online course designed to cover the fundamentals of maste...
01/07/2025
The Traitors are coming: Get your first taste of the global hit as Season 1 of T...
01/07/2025
cetecom advanced certifies Rohde & Schwarz test solution for the verification of...
01/07/2025
RT has announced that Teresa Smith has been appointed Commissioning Editor with responsibility for Factual Entertainment following a public competition. This s...
01/07/2025
This July, RT is delighted to support Galway International Arts Festival, Earagail Arts Festival in Donegal, Belfast TradFest and 23 other arts and cultural ev...
30/06/2025
There's nothing quite like the magic of finding music that feels made just f...
30/06/2025
When it comes to new music, Spotify's team of editors across North America is always on the hunt for songs that make them feel, think, and move. They're...
30/06/2025
Star Studded Ensemble Cast Are Joined by Richard Rankin as Filming Begins on the Second Season
[June 12, 2025 - Boston, MA]: The Forsytes, Debbie Horsfield...
30/06/2025
Eurorack sequencer module reimagined
California-based modular synth innovators Qu-Bit have announced the launch of a new module that offers a fresh new take...
30/06/2025
Improved dynamic behaviour, improved audio quality & more
Techivation have announced the release of an upgraded edition of their very first premium plug-in,...
30/06/2025
German premiere with live flight demonstration: German industry team showcases e...
30/06/2025
The Focusrite Summer Sale is now on Don't miss unbeatable deals on Scarlett, Vocaster, and more.
Whether you're an artist, a producer, or a podcaste...
30/06/2025
All 8 episodes of Season 1 of 1923 will be available on RT Player from Tuesday ...
30/06/2025
Facebook
Twitter
LinkedIn
52% report AI security spending is displacing tr...
30/06/2025
Facebook
Twitter
LinkedIn
Cannes, June 30th, 2025 - Thales Alenia Space, t...
29/06/2025
Handpan-inspired instrument announced
Roland have announced the launch of the Mood Pan, a unique electronic hand percussion instrument that has been designe...
28/06/2025
Music theory plug-in updated
Three months on from the release of the latest version of their renowned music theory plug in, Scaler Music have launched an up...
27/06/2025
K-Pop remains one of the biggest genres globally, and many fans just can't get enough of it. That's why Spotify has launched a new series of K-Pop perf...
27/06/2025
In our latest blog post, Rafael Rivera highlights the rising threat of online scams, and the important role cybersecurity plays in protecting families across ge...
27/06/2025
From grounded realism to bending, impossible geometries
Klevgrand have announced the release of a new algorithmic reverb plug-in which they say deconstruct...
27/06/2025
Learn to use REW for room analysis
Acoustic treatment is one of the most important factors in any studio, and with the extensive range of products available...
27/06/2025
Second edition of parallel clipper plug-in announced
Soundtheory have announced the launch of Kraftur Focus, a new edition of their parallel clipper plug-in...
27/06/2025
Facebook
Twitter
LinkedIn
Thales, a global high-tech leader, and Kongsberg...
27/06/2025
Friday 27 June 2025
Combination of RTL Deutschland and Sky Deutschland (Germany, Austria, Switzerland) to create a unique proposition in entertainment, sports ...
26/06/2025
Bilbao Linz, June 26th 2025 - AgileTV, a European leader in TV and video technology solutions, has signed an agreement this week with the Austrian telco LIWES...
26/06/2025
aconnic AG (ISIN: DE000A0LBKW6), Munich, has resolved, based on the decisions ma...
26/06/2025
Three new entry-level models introduced
Catering to everything from casual listening to professional content creation, KRK's new Kreate Series monitors ...