Sony Pixel Power calrec Sony

ARRI synchronizes video and light for the LIPS research project

28/10/2020

LIPS stands for Live Interactive PMSE (Program Making and Special Events) Services. It is a research project funded by the German Federal Ministry for Economic Affairs and Energy (BMWi), in which several industrial and institutional partners work together on a professional production network. It is about the synchronization of audio, video, and light with extremely low latency to create the most immersive user experience possible. The LIPS project aims to interactively and immersively link live events performed at different locations by using new platforms and technical possibilities. The overall goal is to identify-based on newly developed IP-based audio/video production equipment-solutions to improve the access and participation of rural areas on creative, cultural, and political operation of metropolitan areas and vice versa. LIPS also makes significant contributions to inclusion, since it provides solutions which allow people with disabilities who are unable to travel to participate holistically and immersively in events.

LIPS consortiumTo improve the immersive audio/visual experience for the connected users and to develop the technological background for connecting and merging various devices and locations into one production network, several parties had to bring in their individual know-how. Therefore the LIPS consortium was founded in 2018. It consists of the companies Sennheiser, TVN, Smart Mobile Labs, and ARRI, as well as the institutions Leibnitz University Hannover, Fraunhofer Heinrich Hertz Institute, and Friedrich Alexander University Erlangen-Nuremberg. Each partner has a different focus for the project. ARRI was responsible for cameras and lighting with equipment and services, explains Hermann Popp, Systems Architect at ARRI and technical project manager for LIPS. Within ARRI, numerous colleagues were involved with fundamental contributions.

Numerous ARRI colleagues were involved with LIPS, including Hermann Popp, Systems Architect

Use case networked music performance As a use case, the idea of realistic joint performances of musicians at remote geographic locations was born. One part of the student band-piano (Victor Ardelean Montelongo) and bass (Hans Koennecke)-was based at the University for Music and Theater Munich (HMTM), the other-drums (Max Dost), guitar (Julian Scarcella), and keyboards (Lukas Blecks)-570 kilometers (354 miles) north in Wedemark, near Hannover, at the Sennheiser headquarters. The playing of the LIPS Brothers took place in joint sessions, so-called field tests, which were transmitted via internet. A virtual window between the two linked rooms was created, which allows a visually and audibly plausible look in almost real-time into the other locations. In addition to the broadcast of video and audio, the lighting at both locations was also continuously adjusted. The goal was to achieve the most immersive and authentic linking of these two exercise rooms. All participants should always have the same impression, says Hermann Popp.

Both locations were equipped with the same setup and were connected via Wide-Area-Network with a data transfer rate of 1 Gbps. In both directions, six audio channels and one video stream as well as the lighting control information were transmitted.

One part of the student band was based in Munich (pictured), the other 570 kilometers (354 miles) north in Wedemark. Two ARRI SkyPanels S60-C provide a solid baselight

Camera and display An immersive bidirectional image path with low latency was required. This related to the camera as well as the display at each side. The software and firmware of the cameras were specifically designed for LIPS by ARRI. These R&D cameras contain the same sensor and image processing like ARRI standard products with color filters matching characteristics of human eye receptors and high contrast capabilities. But they provide native all-IP functionality for image transfer, synchronization, and control. Each sends its image stream out of a 10-Gb/s-capable-Ethernet-copper-cable and, at the same time, receives the remote image stream over IP. A ProRes codec inside the cameras is used for image compression and decompression. Decompressed images were passed to a large format display via a synchronous serial digital interface (SDI) socket. Both cameras in Munich and Wedemark were synchronized via the Precision Time Protocol (PTP) and used the typical protocol stack for media production: Ethernet, IP, UDP, RTP, a media wrapper, and the compressed video payload. With the media wrapper MXF Live, data consistency and a seamless transition across stream and file was achieved.

LIPS aims a calibrated, linear image path from scene to image reproduction. With respect to displays, this required a defined and constant relation between a digital input value and the corresponding output luminance. The standard SMPTE ST 2084 defines a suited relation over a wide dynamic range and with an efficient perception-based quantization. After testing various kinds of displays large-format OLED displays were selected. They are able to provide this characteristic in a constant and adequate way.

Lighting Immersive integration of separate locations is essentially supported by matched lighting. At LIPS, natural available light was maintained as much as possible to preserve a natural vivid live environment and to avoid a studio feeling. To achieve this, available light, the spectral power distribution of light at each location, was measured and processed by a central lighting control. A common target value for both locations with respect to lighting color coordinates and lighting intensity was calculated. The target was achieved by adding some minimal artificial lighting. This was calculated specifically for each site.

This process was executed continuously and maintained identical lighting conditions at both locat
LINK: https://www.arri.com/en/company/arri-news/news-stories/news-stories-20...
See more stories from arri

Europe Stories

25/11/2020

Nokia and stc launch the operation of Technology Innovation Center to stimulate innovation

Nokia and stc launch the operation of Technology Innovation Center to stimulate ...

25/11/2020

Nokia, A1 provide private wireless connectivity for Siemens renewable energy microgrid

Nokia, A1 provide private wireless connectivity for Siemens renewable energy mic...

25/11/2020

Im A Celebrity...Get Me Out Of Here! Wednesday 25th November preview (video)

Im A Celebrity...Get Me Out Of Here! Wednesday 25th November preview (video) Shane Richie and Jessica Plummer were voted by the public to take part in tonights...

25/11/2020

Connecting with young audiences - what works?

Connecting with young audiences - what works?...

25/11/2020

IABM student event with Sound Supervisor Robert Edwards

This week we were delighted to be able to have a fireside chat with top UK sound guru Robert Edwards, who has 46 years of experience as one of the primary mixer...

25/11/2020

Banijay Iberia Appoints New Managing Director for Zeppelin

Banijay today announces the appointment of a new Managing Director at Zeppelin, a Banijay Iberia company. Shifting from within Banijay's exisiting Spanish ...

25/11/2020

2020-11-25

Since Apple announced its new App Store Small Business Program, developers are sharing their positive reactions to the news. Under the new program, which launch...

25/11/2020

Netflix spends $1 billion on UK productions in 2020

Streamer says it intends to invest in the best content in every genre, and are fully committed to supporting British production and creative talent for many yea...

25/11/2020

Canal Plus preparing 700 million Ligue 1 rescue package'

French broadcaster preparing bid in case on-going negotiations between Mediapro and the French football league fail. By Jenny Priestley Published: November 25...

25/11/2020

Ofcom: Women still make up less than half of UK TV and radio industry

Ofcom has called ob broadcasters to accelerate progress across three priority areas. By Jenny Priestley Published: November 25, 2020 Ofcom has called ob br...

25/11/2020

New Vlogger Kit from Rode

Accessory pack for mobile video-making Rode have just released a handy-looking kit that looks ideal for videographers and self-streaming musicians. The apt...

25/11/2020

FOX Deportes Ahead of the Game with Dejero Connectivity in Pioneering Work From Home' Flypacks

FOX Deportes Ahead of the Game with Dejero Connectivity in Pioneering Work From...

25/11/2020

RTVE awards its cloud content management project to VSN

VSNExplorer MAM has once again been the system of choice for RTVE's HUB Innovation project, a pilot program aimed at studying the process of news generation...

25/11/2020

Magyar Telekom concluded a successful bond auction

Magyar Telekom concluded a successful bond auction Budapest, November 24, 2020 15:30 Magyar Telekom (Reuters: MTEL.BU and Bloomberg: MTELEKOM HB, hereinafte...

25/11/2020

Get in the Holiday Spirit with Dolly Parton, Jose Mari Chan, Black Pumas, and More

In a year that's brought unprecedented challenges, Spotify data suggests tha...

25/11/2020

Noel Clarke and Ashley Walters return in Bulletproof: South Africa as three-part special comes to Sky One

After two hugely successful series of Sky Original, Bulletproof, Noel Clarke and...

25/11/2020

True Crime Podcast The Nobody Zone' Returns

9 weeks at no.1 in apple podcasts chart in Ireland Most ever downloaded Irish podcast (limited series) C.5 million listens worldwide An RT true crime podcas...

25/11/2020

Riedel Introduces the RSP-1216HL SmartPanel, a New 1RU Addition to the Powerful 1200 Series of Intelligent, App-Driven User Interfaces

WUPPERTAL November 24, 2020 Riedel Introduces the RSP-1216HL SmartPanel, a New...

25/11/2020

Ofcom appoints six new Content Board members

Ofcom appoints six new Content Board members Add to Your Pages 24 November 2020 Ofcom has appointed six new members to its Content Board. Ofcoms Conte...

25/11/2020

How Penta Products Rule in Post & Film Applications

Tekst: How Penta Products Rule in Post & Film Application With new immersive standards in mind, post and film production has become increasingly demanding in t...

24/11/2020

ITV announces key new Diversity appointments

ITV announces key new Diversity appointments ITV today announces the appointment of two new Creative Diversity Partners who will play key roles in driving grea...

24/11/2020

Im A Celebrity...Get Me Out Of Here! Tuesday 24th November preview (video)

Im A Celebrity...Get Me Out Of Here! Tuesday 24th November preview (video) Shane Richie was voted by the public to take part in tonights Trial called The Cruel...

24/11/2020

I'm A Celebrity...Get Me Out Of Here! 2020 is show's biggest ever launch

I'm A Celebrity...Get Me Out Of Here! 2020 is show's biggest ever launch 14.3 million viewers watch show's first episode - an 18 year high ITV...

24/11/2020

ATV Expands Cinegy Capabilities

ATV Expand and Increase their Playout and Editing Capabilities using Cinegy Software Munich, Germany, 24th November 2020: Turkuvaz Media Group - the provider o...

24/11/2020

Transform Your Media Supply Chain with Ateme & Blue Lucy

As the complexity of media supply chain operations increases the requirement for an integrated, business focused approach is vital. ATEME and Blue Lucy experts...

24/11/2020

Cyber Security in Focus: Key Facts About IT Security

Cyber Security in Focus: Key Facts About IT Security L nendonk -whitepaper on IT security in cooperation with Arvato Systems Comprehensive L nendonk IT Sec...

24/11/2020

Riedel Introduces the RSP-1216HL SmartPanel

Riedel Introduces the RSP-1216HL SmartPanel posted: 24/11/2020 RSP-1216HL SmartPanel, a New 1RU Addition to the Powerful 1200 Series of Intelligent, App-D...

24/11/2020

His Dark Materials leads RTS Craft & Design Awards winners

Annual awards were presented during a virtual ceremony. By Jenny Priestley Published: November 24, 2020 Annual awards were presented during a virtual cerem...

24/11/2020

BAFTA's albert launches Creative Offsets scheme

ITVs Dancing on Thin Ice with Torvill & Dean is the first show to achieve the new standard of albert Certification. By Jenny Priestley Published: November 24,...

24/11/2020

Modal Cobalt 8m & 8x unveiled

Module and extended versions now available It takes some companies years to produce module versions of their instruments, but British company Modal have man...

24/11/2020

Tokyo-Based ALAMODE Live Streams and Records Web Content With AJA HELO

Tokyo-Based ALAMODE Live Streams and Records Web Content With AJA HELO posted: 24/11/2020 To meet a growing demand for high-end web content, Tokyo-based s...

24/11/2020

Robe Specified for Tallinn Salme Cultural Centre

Robe Specified for Tallinn Salme Cultural Centre posted: 24/11/2020 The Tallinn Salme Cultural Centre is one of the Estonian capital's largest cultura...

24/11/2020

Asia TV Forum & Market and ScreenSingapore 2020

Asia TV Forum & Market and ScreenSingapore 2020 posted: 24/11/2020 The 21st edition of the Asia TV Forum & Market (ATF) and the 10th ScreenSingapore, Asia...

24/11/2020

CCTV Pioneer Media & Entertainment Deploys HelixNet, LQ and Agent-IC for Social Media Live Broadcasts

CCTV Pioneer Media & Entertainment Deploys HelixNet, LQ and Agent-IC for Social ...

24/11/2020

REMOTE SPORTS PRODUCTION ENABLED BY MERGING TECHNOLOGIES

REMOTE SPORTS PRODUCTION ENABLED BY MERGING TECHNOLOGIES posted: 24/11/2020 Merging ASIO technology used with auto-mixing on Virtual Machines The introdu...

24/11/2020

Act As a Pro, SMT Takes You to Witness the Bicycle Riding Track"

Act As a Pro, SMT Takes You to Witness the Bicycle Riding Track" posted: 24/11/2020 In the hearts of cycling enthusiasts around the world, the Giro dItal...

24/11/2020

Barco and Elite Technology JSC Associate to Tap UC&C Segment in Vietnam with Barco's Innovative ClickShare Conference

Barco and Elite Technology JSC Associate to Tap UC&C Segment in Vietnam with Bar...

24/11/2020

NEP Broadcast Solutions Singapore Turns to TSL Products

NEP Broadcast Solutions Singapore Turns to TSL Products posted: 23/11/2020 In 2019, NEP purchased a large quantity of MDUs and MPA1 audio monitoring unit...

24/11/2020

Martin Leandro Camacho: The compassionate face of Peru

PROFILE: Young Journalist Award 2020 winner Mart n Leandro Camacho has always been passionate about being compassionate. The 27-year-old spent the formative...

24/11/2020

Telekom expands its 5G coverage in Budapest using Ericsson Spectrum Sharing

Telekom expands its 5G coverage in Budapest using Ericsson Spectrum Sharing Budapest, November 20, 2020 14:00 Magyar Telekom launches - first among Hungari...

24/11/2020

Claims added to CAS Files: WIPO, United States, and China for 1999 - Present

The CA/CAplus family of files now includes patent Claims content. Search the Claims content to supplement your results from Basic Index searches, and as a means...

24/11/2020

Nominations revealed for The South Bank Sky Arts Awards 2020

Having faced one of their toughest years ever, a host of talent from across the arts industry is set to be celebrated next month at the South Bank Sky Arts Awar...

24/11/2020

SGO's Black Friday special promotion countdown starts now!

-- Published On: November 23rd, 2020 -- -- data-src=https://www.sgo.es/wp-content/uploads/BF-teaser.jpg width=1920 height=900 class=lazyload wp-image-0 />...

24/11/2020

RT Chair Statement

RT Chair, Moya Doherty said: The failure to adhere to proper social distancing procedures at a recent gathering in RT is a matter of serious concern for the...

24/11/2020

RT Statement Updated (23.11.20)

Eimear Cusack, Director of Human Resources, RT said: We are very aware of the impact created by the photos which have appeared across Irish media over the la...

23/11/2020

Nokia enables China Mobile with enterprise IoT connectivity globally

Nokia enables China Mobile with enterprise IoT connectivity globally Press Release Nokia enables China Mobile with enterprise IoT connectivity globally Nok...

23/11/2020

Nokia selected as one of TELUS network infrastructure partners to provide transformational 5G mobile services for Canadians

Nokia selected as one of TELUS network infrastructure partners to provide transf...

23/11/2020

Im A Celebrity...Get Me Out Of Here! Monday 23rd November preview (video)

Im A Celebrity...Get Me Out Of Here! Monday 23rd November preview (video) Jessica Plummer and AJ Pritchard were voted by the public to take part in tonights Tr...

23/11/2020

Grant for Transformations

Imagineer are incredibly happy to announce and thank Coventry City Council Arts Development Grant and the Paul Hamlyn Foundation for their grant which together ...