LIPS stands for Live Interactive PMSE (Program Making and Special Events) Services. It is a research project funded by the German Federal Ministry for Economic Affairs and Energy (BMWi), in which several industrial and institutional partners work together on a professional production network. It is about the synchronization of audio, video, and light with extremely low latency to create the most immersive user experience possible. The LIPS project aims to interactively and immersively link live events performed at different locations by using new platforms and technical possibilities. The overall goal is to identify-based on newly developed IP-based audio/video production equipment-solutions to improve the access and participation of rural areas on creative, cultural, and political operation of metropolitan areas and vice versa. LIPS also makes significant contributions to inclusion, since it provides solutions which allow people with disabilities who are unable to travel to participate holistically and immersively in events.
LIPS consortiumTo improve the immersive audio/visual experience for the connected users and to develop the technological background for connecting and merging various devices and locations into one production network, several parties had to bring in their individual know-how. Therefore the LIPS consortium was founded in 2018. It consists of the companies Sennheiser, TVN, Smart Mobile Labs, and ARRI, as well as the institutions Leibnitz University Hannover, Fraunhofer Heinrich Hertz Institute, and Friedrich Alexander University Erlangen-Nuremberg. Each partner has a different focus for the project. ARRI was responsible for cameras and lighting with equipment and services, explains Hermann Popp, Systems Architect at ARRI and technical project manager for LIPS. Within ARRI, numerous colleagues were involved with fundamental contributions.
Numerous ARRI colleagues were involved with LIPS, including Hermann Popp, Systems Architect
Use case networked music performance As a use case, the idea of realistic joint performances of musicians at remote geographic locations was born. One part of the student band-piano (Victor Ardelean Montelongo) and bass (Hans Koennecke)-was based at the University for Music and Theater Munich (HMTM), the other-drums (Max Dost), guitar (Julian Scarcella), and keyboards (Lukas Blecks)-570 kilometers (354 miles) north in Wedemark, near Hannover, at the Sennheiser headquarters. The playing of the LIPS Brothers took place in joint sessions, so-called field tests, which were transmitted via internet. A virtual window between the two linked rooms was created, which allows a visually and audibly plausible look in almost real-time into the other locations. In addition to the broadcast of video and audio, the lighting at both locations was also continuously adjusted. The goal was to achieve the most immersive and authentic linking of these two exercise rooms. All participants should always have the same impression, says Hermann Popp.
Both locations were equipped with the same setup and were connected via Wide-Area-Network with a data transfer rate of 1 Gbps. In both directions, six audio channels and one video stream as well as the lighting control information were transmitted.
One part of the student band was based in Munich (pictured), the other 570 kilometers (354 miles) north in Wedemark. Two ARRI SkyPanels S60-C provide a solid baselight
Camera and display An immersive bidirectional image path with low latency was required. This related to the camera as well as the display at each side. The software and firmware of the cameras were specifically designed for LIPS by ARRI. These R&D cameras contain the same sensor and image processing like ARRI standard products with color filters matching characteristics of human eye receptors and high contrast capabilities. But they provide native all-IP functionality for image transfer, synchronization, and control. Each sends its image stream out of a 10-Gb/s-capable-Ethernet-copper-cable and, at the same time, receives the remote image stream over IP. A ProRes codec inside the cameras is used for image compression and decompression. Decompressed images were passed to a large format display via a synchronous serial digital interface (SDI) socket. Both cameras in Munich and Wedemark were synchronized via the Precision Time Protocol (PTP) and used the typical protocol stack for media production: Ethernet, IP, UDP, RTP, a media wrapper, and the compressed video payload. With the media wrapper MXF Live, data consistency and a seamless transition across stream and file was achieved.
LIPS aims a calibrated, linear image path from scene to image reproduction. With respect to displays, this required a defined and constant relation between a digital input value and the corresponding output luminance. The standard SMPTE ST 2084 defines a suited relation over a wide dynamic range and with an efficient perception-based quantization. After testing various kinds of displays large-format OLED displays were selected. They are able to provide this characteristic in a constant and adequate way.
Lighting Immersive integration of separate locations is essentially supported by matched lighting. At LIPS, natural available light was maintained as much as possible to preserve a natural vivid live environment and to avoid a studio feeling. To achieve this, available light, the spectral power distribution of light at each location, was measured and processed by a central lighting control. A common target value for both locations with respect to lighting color coordinates and lighting intensity was calculated. The target was achieved by adding some minimal artificial lighting. This was calculated specifically for each site.
This process was executed continuously and maintained identical lighting conditions at both locat
Europe Stories
05/01/2027
Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...
07/10/2026
Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...
06/09/2026
June 9 2026, 23:00 (PDT) Dolby and MagentaTV Bring Fans Closer to the FIFA Worl...
21/08/2026
Hardware-style timing shifts for software instruments
Following on from the release of Omniclock, Rapid Flow have launched a new sequencer plug-in that can ...
21/08/2026
Highly anticipated synthesizer ships in October 2026
Iceland-based Love Synthesizers have announced that their highly anticipated synthesizer is now availab...
21/08/2026
Masterpiece PBS The Forsytes has expanded its cast as its begins production in ...
21/08/2026
The BBC has unveiled first-look pictures from The Witch Farm, a new ghost story and mystery set in the Welsh countryside, coming soon to BBC iPlayer and BBC One...
21/08/2026
The BBC and BritBox have revealed the first look of Edward Bluemel as Hercule Poirot in the forthcoming six-part series Hercule from Mammoth Screen and Agatha C...
21/08/2026
eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({ content_source:......
21/08/2026
** MEDIA ALERT **
VIZ Media Takes Over Anime NYC with BLEACH, BLACK TORCH, M...
21/08/2026
Tell us a little bit about your job I'm a Marketing Manager and work across a mix of clients and projects. No two days are ever quite the same, which defini...
21/08/2026
Beat The Lotto dives into the plot behind the 1980s National Lottery scandal
24 August 2026 at 9:35pm on RT One and RT Player
Beat The Lotto is the story o...
21/08/2026
The countdown to the most wonderful night of the year has officially begun!
Host Patrick Kielty is gearing up for another unforgettable Late Late Toy Show nig...
21/08/2026
Meet puppet duo Bellie and Whizz, who are about to explore all the big feelings ...
20/08/2026
Set up your own private remote collaboration infrastructure
SoundBridge have recently put together a tutorial video that provides users with a step-by-step ...
20/08/2026
New V-Control Pro features restore basic functionality
Neyrinck's V-Control software has long been keeping older Avid control surfaces compatible with n...
20/08/2026
TV, BritBox and Mammoth Screen have announced that filming is now underway on th...
20/08/2026
Thursday 20 August 2026
Nina Sosanya, Rizzle Kicks, Roman Kemp and Paul Whiteho...
20/08/2026
Wuppertal August 20, 2026
Transformation Church Elevates Production Communicat...
20/08/2026
The music between the notes Coming together In the middle of 2026, as conversations around artificial intelligence continue to raise questions about how musi...
20/08/2026
Arvato Systems Brings Together Digital Transformation Leaders in the Manufacturi...
19/08/2026
Studio owners invited to have their say on rates cuts
The Music Producers Guild (MPG) are inviting UK-based studios to take part in an in-depth survey that ...
19/08/2026
Vintage-inspired desktop interface revealed
Harrison's latest hardware offering sees them head into the world of audio interfaces, delivering a 10-in/12...
19/08/2026
Granular effect remains locked to scale and tempo
Described as your dream granular effect , Minimal Audio's latest creation is capable of turning any s...
19/08/2026
First polyphonic SWAM instrument incoming
Audio Modeling's latest physical-modelling orchestral instrument is just around the corner, and is now availab...
19/08/2026
There's an early Christmas gift for Bookish fans, as UKTV confirms the re-commission of the hit U&alibi drama, created by and starring Mark Gatiss. Viewers ...
19/08/2026
Wednesday 19 August 2026
Sky gives sports fans the chance to watch multiple liv...
19/08/2026
On Saturday September 5 Katie Taylor will step into the ring for the fight of her life against Flora Pili in front of 80,000 fans in Croke Park. A legendary fig...
18/08/2026
Company launch with stereo-imaging tool
Panoramic is the debut release from Panorama Labs, a new company formed by mastering engineer Nicholas Di Lorenzo. C...
18/08/2026
Control software now available for older interfaces
Focusrite have just announced the launch of an update that extends Control 2 software support for their ...
18/08/2026
Tuesday 18 August 2026
Sky Sports and The Fast and the Curious announce new partnership
Sky Sports and The Fast and the Curious have announced a new long-term...
18/08/2026
Wuppertal August 18, 2026
Riedel Brings Professional Live Production Into the Classrooms of ECURiedel Communications today announced that Edith Cowan Universi...
18/08/2026
Apple today announced changes to its business terms for apps in the European Uni...
18/08/2026
THE HEALY RAES: BLOOD, SWEAT & TEARS AIRS WEDNESDAY AUGUST 19 ON RT ONE AT 9:35PM
A new documentary The Healy-Raes: Blood, Sweat & Tears airs on RT One and ...
18/08/2026
Stunning Irish performances at European Athletics and Swimming Championships rea...
18/08/2026
The two-part series begins Sunday 23 August at 6.30pm on RT One and RT Player
...
17/08/2026
New MIDI processor & macro controller revealed
SHIK have announced that they have opened pre-orders for the S32, a standalone MIDI processor and macro contr...
17/08/2026
Cover extended on innovative motorised pot system
Melbourne Instruments have just revealed that the innovative motorised pot system used in their synths and...
17/08/2026
Latest firmware version now available
1010music have just released a free firmware update that brings some nice new features to their renowned Bluebox digit...
17/08/2026
Rohde & Schwarz showcases integrated defense and test solutions at DALO Industry...
17/08/2026
Calrec's ImPulseV Virtualised Audio Mixing Engine joins NEP Platform, the industry's largest ecosystem of trusted production software, bringing scalable...
17/08/2026
Visitors to IBC 2026 will see how FilmLight is reshaping the modern post pipelin...
17/08/2026
Visitors to Stand 1.C41 can explore innovations in areas such as addressable advertising, hybrid distribution, managed services and operational simplification.
...
16/08/2026
Virtual drummer joins line-up
The latest release from Gospel Musicians adds a virtual drummer to the company's line-up, combining a pair of meticulously...
15/08/2026
In-ear monitoring line-up gains new universal models
In-ear monitoring experts JH Audio have just announced a significant expansion of their Universal-Fit r...
14/08/2026
Latest instalment delivers disco-inspired grooves
The latest addition to UJAM's virtual drum line-up has been designed with contemporary pop, disco, dan...
14/08/2026
Elite range gains giant 24-inch powered sub
The latest expansion of Yorkville's Elite range introduces what the company say is the world's first act...
14/08/2026
Friday 14 August 2026
Breaking news! Sky releases trailer for The Paper, return...
14/08/2026
It's been one year since our client, Cotswolds Designer Outlet, opened its doors and we've loved seeing the scheme come to life. Together, we've hel...
LIPS stands for Live Interactive PMSE (Program Making and Special Events) Services. It is a research project funded by the German Federal Ministry for Economic Affairs and Energy (BMWi), in which several industrial and institutional partners work together on a professional production network. It is about the synchronization of audio, video, and light with extremely low latency to create the most immersive user experience possible. The LIPS project aims to interactively and immersively link live events performed at different locations by using new platforms and technical possibilities. The overall goal is to identify-based on newly developed IP-based audio/video production equipment-solutions to improve the access and participation of rural areas on creative, cultural, and political operation of metropolitan areas and vice versa. LIPS also makes significant contributions to inclusion, since it provides solutions which allow people with disabilities who are unable to travel to participate holistically and immersively in events.
