LIPS stands for Live Interactive PMSE (Program Making and Special Events) Services. It is a research project funded by the German Federal Ministry for Economic Affairs and Energy (BMWi), in which several industrial and institutional partners work together on a professional production network. It is about the synchronization of audio, video, and light with extremely low latency to create the most immersive user experience possible. The LIPS project aims to interactively and immersively link live events performed at different locations by using new platforms and technical possibilities. The overall goal is to identify-based on newly developed IP-based audio/video production equipment-solutions to improve the access and participation of rural areas on creative, cultural, and political operation of metropolitan areas and vice versa. LIPS also makes significant contributions to inclusion, since it provides solutions which allow people with disabilities who are unable to travel to participate holistically and immersively in events.
LIPS consortiumTo improve the immersive audio/visual experience for the connected users and to develop the technological background for connecting and merging various devices and locations into one production network, several parties had to bring in their individual know-how. Therefore the LIPS consortium was founded in 2018. It consists of the companies Sennheiser, TVN, Smart Mobile Labs, and ARRI, as well as the institutions Leibnitz University Hannover, Fraunhofer Heinrich Hertz Institute, and Friedrich Alexander University Erlangen-Nuremberg. Each partner has a different focus for the project. ARRI was responsible for cameras and lighting with equipment and services, explains Hermann Popp, Systems Architect at ARRI and technical project manager for LIPS. Within ARRI, numerous colleagues were involved with fundamental contributions.
Numerous ARRI colleagues were involved with LIPS, including Hermann Popp, Systems Architect
Use case networked music performance As a use case, the idea of realistic joint performances of musicians at remote geographic locations was born. One part of the student band-piano (Victor Ardelean Montelongo) and bass (Hans Koennecke)-was based at the University for Music and Theater Munich (HMTM), the other-drums (Max Dost), guitar (Julian Scarcella), and keyboards (Lukas Blecks)-570 kilometers (354 miles) north in Wedemark, near Hannover, at the Sennheiser headquarters. The playing of the LIPS Brothers took place in joint sessions, so-called field tests, which were transmitted via internet. A virtual window between the two linked rooms was created, which allows a visually and audibly plausible look in almost real-time into the other locations. In addition to the broadcast of video and audio, the lighting at both locations was also continuously adjusted. The goal was to achieve the most immersive and authentic linking of these two exercise rooms. All participants should always have the same impression, says Hermann Popp.
Both locations were equipped with the same setup and were connected via Wide-Area-Network with a data transfer rate of 1 Gbps. In both directions, six audio channels and one video stream as well as the lighting control information were transmitted.
One part of the student band was based in Munich (pictured), the other 570 kilometers (354 miles) north in Wedemark. Two ARRI SkyPanels S60-C provide a solid baselight
Camera and display An immersive bidirectional image path with low latency was required. This related to the camera as well as the display at each side. The software and firmware of the cameras were specifically designed for LIPS by ARRI. These R&D cameras contain the same sensor and image processing like ARRI standard products with color filters matching characteristics of human eye receptors and high contrast capabilities. But they provide native all-IP functionality for image transfer, synchronization, and control. Each sends its image stream out of a 10-Gb/s-capable-Ethernet-copper-cable and, at the same time, receives the remote image stream over IP. A ProRes codec inside the cameras is used for image compression and decompression. Decompressed images were passed to a large format display via a synchronous serial digital interface (SDI) socket. Both cameras in Munich and Wedemark were synchronized via the Precision Time Protocol (PTP) and used the typical protocol stack for media production: Ethernet, IP, UDP, RTP, a media wrapper, and the compressed video payload. With the media wrapper MXF Live, data consistency and a seamless transition across stream and file was achieved.
LIPS aims a calibrated, linear image path from scene to image reproduction. With respect to displays, this required a defined and constant relation between a digital input value and the corresponding output luminance. The standard SMPTE ST 2084 defines a suited relation over a wide dynamic range and with an efficient perception-based quantization. After testing various kinds of displays large-format OLED displays were selected. They are able to provide this characteristic in a constant and adequate way.
Lighting Immersive integration of separate locations is essentially supported by matched lighting. At LIPS, natural available light was maintained as much as possible to preserve a natural vivid live environment and to avoid a studio feeling. To achieve this, available light, the spectral power distribution of light at each location, was measured and processed by a central lighting control. A common target value for both locations with respect to lighting color coordinates and lighting intensity was calculated. The target was achieved by adding some minimal artificial lighting. This was calculated specifically for each site.
This process was executed continuously and maintained identical lighting conditions at both locat
Europe Stories
05/01/2027
Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...
09/10/2026
September 10 2026, 06:00 (PDT) Dolby Expands Dolby OptiView Platform with New Capabilities at IBC 2026
New Sports Intelligence helps providers better unders...
07/10/2026
Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...
02/10/2026
v1.9.3 introduces AUv3 support
Roland have just released an update that kits their free iPad-based software synth out with AUv3 support, meaning it can now ...
02/10/2026
Dolby Atmos support, AI-powered stem separation & more
The latest version of MOTU's DAW software is now available, and marks a major step forward with t...
02/10/2026
Portable DAC created in collaboration with Steve Levine
British hi-fi experts iFi audio have unveiled a new Master Tuned variant of their praised iDSD GR2 p...
02/10/2026
In our latest blog, Tim Pearson looks at streaming piracy from a different lens, focusing on digital trust, consumer risk, and the future of subscriber protecti...
02/10/2026
Featuring performances recorded in Cork, Kilkenny, Wesmeath and Dublin culminati...
02/10/2026
Friday 2 October 2026
Crystal Lake, a Friday the 13th' prequel series, com...
02/10/2026
Friday 2 October 2026
Sky VIP helps families celebrate the Christmas season wit...
02/10/2026
How the fertility sector in Ireland remains unregulated
Undercover filming reveals how without proper regulation the promotion of controversial fertility treat...
02/10/2026
Transforming Homes, Transforming Lives
Presenter Baz Ashmawy and his team take on four life-changing builds across Kildare, Limerick, Wicklow and Offaly in the...
01/10/2026
Third collaboration with celebrated composer
Spitfire Audio have once again teamed up with Grammy-nominated composer, producer and technologist BT, creating...
01/10/2026
FL Studio gets dedicated grid controller
Novation have teamed up with FL Studio developers Image-Line to create another dedicated controller for the popular...
01/10/2026
Six new USB interfaces introduced
Universal Audio's USB audio interface line-up has just been refreshed, gaining six new models aimed at musicians, prod...
01/10/2026
Siretta's SNYPER-5G cellular network analyser has been shortlisted for the IoT Global Awards 2026.
The IoT Global Awards recognise products, services and o...
01/10/2026
Mesh Broadcast Services Fits Big-Truck Audio Power into Compact Eclipse Unit with Calrec Argo M Canadian OB company Mesh Broadcast Services has fitted its Eclip...
01/10/2026
X-Rite Pantone Launches Spectura to Advance Connected Color Quality from Lab to ...
01/10/2026
Thursday 1 October 2026
Nominees revealed for 2026 Sky Arts Awards
Current slide, 0 0, undefined1
0
Irish National Opera and Jennifer Walshe: MARS
Jacob Al...
01/10/2026
Vital TV antenna replaced at SudburyHelicopter and broadcast engineers work together to upgrade TV services for 1.5M in the East
--
Share to Linkedin
Octobe...
01/10/2026
Arqiva appoints Simon Duffy as ChairSimon Duffy joins as Chair effective 01 October 2026
--
Share to Linkedin
October 1, 2026
Press Office
01 October 2026...
01/10/2026
Season 4 of the multi-award-winning hit entertainment series The 2 Johnnies Late Night Lock In is back, serving up another round of unpredictable laughs, unforg...
01/10/2026
New season begins Sunday, 4 October at 6pm on RT lyric fm and RT Listen
RT lyric fm's arts and culture documentary series The Lyric Feature returns on S...
01/10/2026
RT is proud to continue its commitment to supporting and celebrating the arts across Ireland this October, highlighting a vibrant programme of theatre, music, ...
30/09/2026
Add an envelope generator to any plug-in
Sync Audio's latest creation is a handy utility plug-in that can be used to combine and modulate other effects ...
30/09/2026
All-analogue tape-style drive joins Series A
Strymon's reputation was built on their digital knowhow, so many were surprised (and intrigued) when they a...
30/09/2026
Two new expansion packs released
Sonuscore have just introduced two new expansion packs for The Pulse, its production engine instrument for modern cinematic...
30/09/2026
eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({...
30/09/2026
New Solution Expands Harmonic's Network Intelligence Portfolio and Brings Comcast-Developed Fiber Monitoring Technology to Broadband Operators, Providing Re...
30/09/2026
How to Shop Well Now starts Monday at 9.35pm
on RT One and RT Player
On the...
29/09/2026
Two new plug-ins launch alongside updated bundles
Zynaptiq have just announced the launch of two new plug-ins, alongside new and improved versions of two of...
29/09/2026
All-in-one bus processor revealed
Wes Audio's ng product range has come a long way since it was first introduced, and now includes a tasty selection of ...
29/09/2026
eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({ content_source:......
29/09/2026
NOT FOR RELEASE, PUBLICATION OR DISTRIBUTION IN OR INTO OR TO ANY PERSON LOCATED OR RESIDENT IN, OR AT ANY ADDRESS IN, THE UNITED STATES OF AMERICA, ITS TERRITO...
29/09/2026
We tend to think we live in a digital world, with hopes and fears around artificial intelligence (AI), quantum computing, data centres and the next big technolo...
29/09/2026
Today, in partnership with the American Academy of Pediatrics (AAP), Apple relea...
29/09/2026
Final Cut Camera, the professional filming app for iPhone, receives a major upda...
29/09/2026
RT lyric fm is proud to announce the annual Choirs for Christmas competition callout. Warm up those vocal chords and join us on RT lyric fm for a celebration ...
28/09/2026
EQ plug-in can now be played via MIDI
Scaler Music have recently released a new and improved version of their patented musical EQ plug-in, kitting it out wi...
28/09/2026
New synth developed in collaboration with philterSoup
Boutique effects pedal and Eurorack manufacturer Animal Factory Amps have announced that the new compa...
28/09/2026
Rohde & Schwarz adds an integrated multi-channel pulse analysis option to its FS...
28/09/2026
Monday 28 September 2026
Sky launches Full Fibre 1.6 Gbps for millions of homes
Sky has launched a new Full Fibre 1.6 Gbps product, rolling out from today, gi...
28/09/2026
Arvato Systems Highlights It's Role for Automotive Manufacturers and Suppliers
TISAX
Arvato Systems has successfully completed the TISAX Level 3 assess...
28/09/2026
Crimecall, presented by Carla O'Brien, returns tonight for a brand new series at 9.35pm on RT One and RT Player.
In tonight's episode, alongside appe...
28/09/2026
CELEBRATING 40 YEARS AT THE HEART OF NEW IRISH WRITING
LIVE FROM POETRY IRELAND, DUBLIN AND ON RT RADIO 1 FROM 7PM
DETAILS: www.rte.ie/writing | FOLLOW: #r...
27/09/2026
New compact pedal packs in 120 effects
The latest multi-effects pedal from Boss is a compact unit that promises to give any pedalboard a massive boost in s...
26/09/2026
Launched alongside three new expansion packs
In celebration of their 30th anniversary, Native Instruments have released a major update for their Maschine 3 ...
25/09/2026
Algorithm update & new DVA vibrato-detection engine
A new flagship version of Antares' iconic pitch-correction software has arrived, and along with a co...
25/09/2026
New flagship unit to arrive in early 2027
Two notes Audio Engineering have revealed that a new and improved version of their hugely popular reactive load bo...
LIPS stands for Live Interactive PMSE (Program Making and Special Events) Services. It is a research project funded by the German Federal Ministry for Economic Affairs and Energy (BMWi), in which several industrial and institutional partners work together on a professional production network. It is about the synchronization of audio, video, and light with extremely low latency to create the most immersive user experience possible. The LIPS project aims to interactively and immersively link live events performed at different locations by using new platforms and technical possibilities. The overall goal is to identify-based on newly developed IP-based audio/video production equipment-solutions to improve the access and participation of rural areas on creative, cultural, and political operation of metropolitan areas and vice versa. LIPS also makes significant contributions to inclusion, since it provides solutions which allow people with disabilities who are unable to travel to participate holistically and immersively in events.
