"What we wanted to do was to build a file system that would support any resolution at any number of streams"
Author:
ContributorPublish date:
Aug 16, 2018
The M&E industry is one of the fastest evolving sectors. The rapid progression of frame rates and video revolution has a considerable impact on production and post-production teams, and their storage and capacity requirements. Throughout the production process, a film increases from approximately 10 TB to roughly 350 TB and the number of workstreams with users working on the same dataset grows rapidly.
To solve this data storage challenge, Technicolor created a scalable and future-proof storage infrastructure using Excelero NVMesh to provide workstations with access to high bandwidth and low latency performance that accommodates streaming, editing and reel presentation at any time.
Future-proofing post-production storage
Like many data centre and infrastructure teams at production and post-production houses, Technicolors IT department along with engineering director Amir Bemanian, were struggling to keep up with the rapid evolution from one resolution to the other.
4K is becoming the default resolution and 8K is on the horizon, and frame rates are increasing from 24 and 30 frames per second to 48fps and even 60fps. The additional storage capacity and thus also bandwidth that is needed for higher frame rates increases linearly: doubling the frame rate from 30fps to 60fps also doubles the storage needs. And increasing the resolution from 2K to 4K quadruples the storage requirements. When a studio switches from 2K 30fps to 4K 60fps, the post-production house also needs to be prepared to store and stream eight times the volume of data, which is a substantial increase.
On top of this, there are also possible investments in extra cameras, additional visual effects, High Dynamic Range (HDR), colour depth, and more. Yet another challenge for post-production workflows is avoiding dropped frames, caused by insufficient performance and high latencies, which impacts the technical quality of an asset and results in on-screen motion.
A common problem is that many companies in the M&E industry such as Technicolor, retain infrastructures which are typically based on a Fibre Channel network with storage arrays serving tens of workstations. This means that the speed to ingest data to the workstations from the Fibre Channel storage arrays is simply too slow and does not scale. At Technicolor, workstreams had to be duplicated in order for multiple people to work on the dataset at the same time.
In order to be better prepared for current and future storage and streaming needs, Amir Bemanian and his team at Technicolor began exploring new "future-proof" storage and network architectures. "What we wanted to do was to build a file system that would support any resolution at any number of streams," explains Bemanian. "And that was essentially impossible until 2017 where we saw an alignment of technologies: the networking, the PCIE slot, the NVMe drives and also the software - from Excelero - that glued it all together. This combination of technologies enabled us to do storage in a very different way to traditional methods.
The IT infrastructure required to feed dozens of workstations of 4K files at 24 fps is mind-boggling and that doesn't even consider what storage demands we'll face with 8K or even 16K formats, Bemanian continues. It's imperative that we can scale to future film standards today. Now, with innovations like the shared NVMe storage that Excelero provides, Technicolor can enjoy a hardware-agnostic approach, enabling flexibility for tomorrow while not sacrificing performance.
Excelero's NVMesh for Any-K workflows
NVMesh software-defined block storage features Elastic NVMe, a distributed block layer that allows any application to utilise pooled NVMe storage devices across a network at local speeds and latencies. Distributed NVMe storage resources are pooled with the ability to create arbitrary, dynamic block volumes that can be utilised by any host running the NVMesh block client. These virtual volumes can be striped, mirrored or both while enjoying centralised management, monitoring and administration. In short, applications can enjoy the latency, throughput and IOPS of a local NVMe device while at the same time getting the benefits of centralised, redundant storage. NVMesh is deployed as a virtual, distributed non-volatile array and supports both converged and disaggregated architectures, giving customers full freedom in their architectural design.
By deploying Excelero NVMesh and six standard NVMe servers powered by Intel 3D NAND flash, Technicolor achieved 4K streaming at 60fps to over 50 workstations concurrently. Delivering 99.8 per cent of local NVMe storage server performance across the network, the solution offers twice the performance of competing solutions at 50 per cent of the cost and requires a much lower data centre footprint.
After an initial proof of concept, the storage solution was brought into production within four weeks for use with a major Hollywood feature film. So far, three projects have been run successfully on the software-defined system.
A major benefit is that the architecture has created an optimal environment where multiple members of the post-production team can simultaneously view and work on the same data set. Bemanian concludes: "It has generated a positive and productive end user experience.
Europe Stories
05/04/2020
Health Experts Confirm No Link Between 5G and COVID-19
London: Police and counter-terrorism authorities are investigating acts of arson against mobile phone ...
05/04/2020
Blackmagic Design Announces Blackmagic Camera Update 6.9 posted: 05/04/2020
Blackmagic Camera 6.9 update adds studio camera features such as remote contro...
05/04/2020
Chorus Line dynamism on display on Marea El Azogue tour posted: 05/04/2020
Spanish band Marea has been rocking for over 20 years as one of the most pop...
05/04/2020
A10 v2.90 - MIC2WAV Conform To CVS posted: 05/04/2020
Sound Devices is pleased to announce firmware version 2.90 for the Audio Ltd A10 Digital Wireless Sy...
05/04/2020
L-ISA Delighted Audiences' Ears on Bon Iver Tour Supporting i,i posted: 05/04/2020
Minneapolis
Firehouse Productions deployed an L-Acoustics PA for ...
05/04/2020
Blackmagic Design Announces HyperDeck Studio Mini v7.1 posted: 04/04/2020
New and free software update adds new H.264 codec, new AAC audio codec, longer s...
04/04/2020
-- Don't Stop the Work at the Top
At the top of the food chain in the media and entertainment ecosystem are the broadcasters and streaming companies. These...
04/04/2020
Watch and embed this video on your website. Simply play and click on the embed icon upper right to copy the embed code.
Will.i.am reveals the results of the Li...
04/04/2020
Classic synths from Waldorf, EMS & Yamaha up for grabs
VEMIA, the auctioneers specialising in vintage electronic instruments, are holding their 50th online ...
04/04/2020
Blackmagic Design Announces New ATEM Mini Pro posted: 04/04/2020
Powerful new model adds a new hardware streaming engine via Ethernet, recording to USB fl...
04/04/2020
Coronavirus crisis - EBU calls on governments to uphold independence of Public S...
04/04/2020
ISPCC / CHILDLINE in association with RT 2FM, along with some of Ireland's top artists have come together to present a two week long digital live music eve...
04/04/2020
RT has announced additional matinee movie slots to the weekend TV schedule star...
04/04/2020
April 03, 2020 PATTAYA, Thailand-AV integrator Mahajak Development Co., Ltd., r...
04/04/2020
--
MaaS Datasheet
Our Media Focused Hybrid Cloud Storage platforms meet the tactical and strategic needs of many stakeholders and bring economic and operatio...
04/04/2020
Paris, 2 April, 2020 - To prevent network saturation during the COVID-19 pandemi...
03/04/2020
Fierce competition for viewers along with a rapidly changing multiplatform environment has put newsrooms under immense stress. In the space of just a few weeks,...
03/04/2020
Amsterdam, 3 April 2020 - VEON Ltd. (NASDAQ and Euronext Amsterdam: VEON), a leading global provider of connectivity and digital services, announces the appoint...
03/04/2020
Arts Alliance Media (AAM) is closely monitoring the ever-evolving Coronavirus situation and following all advice issued by the World Health Organisation.
The s...
03/04/2020
Changing attitudes of viewers and listeners revealed Add to Your Pages
03 April 2020
TV and radio programmes that are unsuitable for children, or which ...
03/04/2020
Paris, 2 April 2020 Reed MIDEM today announces a week-long extension of its MI...
03/04/2020
How being curious can keep you creative in isolation
by Danielle Danz' Johnson
A bit about myself: I make music under the moniker of Computer Magic. I...
03/04/2020
Sony and the World Photography Organisation are pleased to announce KyeongJun Ya...
03/04/2020
ITV to air BGT spin off in first show to be made exclusively for the ITV Hub
ITV has commissioned a brand-new Britain's Got Talent spin off, Britain's ...
03/04/2020
Wimmers has more than 24 years industry experience
By Dan Meier
Published: April 3, 2020
Wimmers has more than 24 years' industry experience
target=_...
03/04/2020
Unisum plug-in offers flexibility in abundance
Danish software boffins Tone Projects are vying for a spot at the end of your signal chain, with a new master...
03/04/2020
Infronts Amikam Kranz discusses media rights in a COVID 19 world posted: 03/04/2020
Game plan for sports broadcasting and rights' holders: Sports broa...
03/04/2020
Imagen Extends its Relationship with PA Media to Enhance the News Agencys Video ...
03/04/2020
ETC and High End Systems turn focus to education posted: 03/04/2020
As many theatres, live events, and productions across the world faced closings and unc...
03/04/2020
Ross Video Acquires Coiron Inc. posted: 03/04/2020
Ross Video is pleased to announce it has acquired the US-based technology company Coiron, Inc. Located in...
03/04/2020
Media Links Appoints Tsukasa Sugawara as new CEO posted: 03/04/2020
Media Links, manufacturer and pioneer in Media over IP transport technology, has appoint...
03/04/2020
PEBBLE BEACH SYSTEMS SUPPORTS INTERNATIONAL BROADCASTERS THROUGH CORONAVIRUS CRI...
03/04/2020
TVBEurope rounds up the new channel arrivals on streaming platforms and devices
By Dan Meier
Published: April 3, 2020
TVBEurope rounds up the new channel a...
03/04/2020
Jamie Hindhaugh explains how the broadcaster has changed its workflows to deal with the coronavirus pandemic
By Jenny Priestley
Published: April 3, 2020
Ja...
03/04/2020
Aims to develop a suite of applications for use with the XPression family of real-time motion graphics systems
By Jenny Priestley
Published: April 3, 2020
...
03/04/2020
Production companies who do it will provide a vital lifeline for people so they can eat and pay their bills
By Dan Meier
Published: April 3, 2020
Producti...
03/04/2020
#DontStopTheEducation: Sennheiser Takes SoundAcademy Online to Keep Trainings on...
03/04/2020
SOS Snap-Shot Survey
Snap-shot-plug-ins-survey
Help us better understand your use of Plug-Ins.
Please complete our quick 9 question anonymous survey.
How...
03/04/2020
ITV will pause for applause on Thursday night
Broadcaster will get behind the nation and their support for the NHS
ITV will pause its programming on Thursday ...
03/04/2020
Northampton, UK - 2nd April 2020 Rascular, designers of software-based powerfu...
02/04/2020
Always wanted to host and produce your own podcast? While it may feel like a significant undertaking, there are plenty of tools that can help-and podcast expert...
02/04/2020
Tokyo, Japan - Sony Corporation today announced the establishment of the Sony Global Relief Fund for COVID-19, a 100 million US dollar fund to support those aro...
02/04/2020
The new, fully IP-based Austrian Broadcasting Corporation (ORF) F 1 is optimally equipped for ambitious production of sports and cultural events. Central to its...
02/04/2020
RT has announced that a series of classic productions of William Shakespeare's plays, aimed at Leaving and Junior Certificate students, will broadcast on R...
02/04/2020
Posted on 02 Apr 2020
Looking at making changes to your business marketing in a global crisis - you're not alone.
Everyone is managing the Coronavirus sit...
02/04/2020
-- YOUR BEER ROUNDtable: Discussing The Ultimate Hybrid Stack
-- Cardiff, Wales, New York, USA, 2nd April 2020:
Object Matrix and CineSys-Oceana announce tha...
02/04/2020
-- Object Matrix Good News Friday!
Welcome to the first Good News Friday video series! Every Friday correspondents from all over the globe will send in their...
02/04/2020
ORF uses Lawo in first all-IP OB F 1 for sports and cultural event production posted: 02/04/2020
The new, fully IP-based Austrian Broadcasting Corporation...
"What we wanted to do was to build a file system that would support any resolution at any number of streams"
