
"What we wanted to do was to build a file system that would support any resolution at any number of streams"
Author:
ContributorPublish date:
Aug 16, 2018
The M&E industry is one of the fastest evolving sectors. The rapid progression of frame rates and video revolution has a considerable impact on production and post-production teams, and their storage and capacity requirements. Throughout the production process, a film increases from approximately 10 TB to roughly 350 TB and the number of workstreams with users working on the same dataset grows rapidly.
To solve this data storage challenge, Technicolor created a scalable and future-proof storage infrastructure using Excelero NVMesh to provide workstations with access to high bandwidth and low latency performance that accommodates streaming, editing and reel presentation at any time.
Future-proofing post-production storage
Like many data centre and infrastructure teams at production and post-production houses, Technicolors IT department along with engineering director Amir Bemanian, were struggling to keep up with the rapid evolution from one resolution to the other.
4K is becoming the default resolution and 8K is on the horizon, and frame rates are increasing from 24 and 30 frames per second to 48fps and even 60fps. The additional storage capacity and thus also bandwidth that is needed for higher frame rates increases linearly: doubling the frame rate from 30fps to 60fps also doubles the storage needs. And increasing the resolution from 2K to 4K quadruples the storage requirements. When a studio switches from 2K 30fps to 4K 60fps, the post-production house also needs to be prepared to store and stream eight times the volume of data, which is a substantial increase.
On top of this, there are also possible investments in extra cameras, additional visual effects, High Dynamic Range (HDR), colour depth, and more. Yet another challenge for post-production workflows is avoiding dropped frames, caused by insufficient performance and high latencies, which impacts the technical quality of an asset and results in on-screen motion.
A common problem is that many companies in the M&E industry such as Technicolor, retain infrastructures which are typically based on a Fibre Channel network with storage arrays serving tens of workstations. This means that the speed to ingest data to the workstations from the Fibre Channel storage arrays is simply too slow and does not scale. At Technicolor, workstreams had to be duplicated in order for multiple people to work on the dataset at the same time.
In order to be better prepared for current and future storage and streaming needs, Amir Bemanian and his team at Technicolor began exploring new "future-proof" storage and network architectures. "What we wanted to do was to build a file system that would support any resolution at any number of streams," explains Bemanian. "And that was essentially impossible until 2017 where we saw an alignment of technologies: the networking, the PCIE slot, the NVMe drives and also the software - from Excelero - that glued it all together. This combination of technologies enabled us to do storage in a very different way to traditional methods.
The IT infrastructure required to feed dozens of workstations of 4K files at 24 fps is mind-boggling and that doesn't even consider what storage demands we'll face with 8K or even 16K formats, Bemanian continues. It's imperative that we can scale to future film standards today. Now, with innovations like the shared NVMe storage that Excelero provides, Technicolor can enjoy a hardware-agnostic approach, enabling flexibility for tomorrow while not sacrificing performance.
Excelero's NVMesh for Any-K workflows
NVMesh software-defined block storage features Elastic NVMe, a distributed block layer that allows any application to utilise pooled NVMe storage devices across a network at local speeds and latencies. Distributed NVMe storage resources are pooled with the ability to create arbitrary, dynamic block volumes that can be utilised by any host running the NVMesh block client. These virtual volumes can be striped, mirrored or both while enjoying centralised management, monitoring and administration. In short, applications can enjoy the latency, throughput and IOPS of a local NVMe device while at the same time getting the benefits of centralised, redundant storage. NVMesh is deployed as a virtual, distributed non-volatile array and supports both converged and disaggregated architectures, giving customers full freedom in their architectural design.
By deploying Excelero NVMesh and six standard NVMe servers powered by Intel 3D NAND flash, Technicolor achieved 4K streaming at 60fps to over 50 workstations concurrently. Delivering 99.8 per cent of local NVMe storage server performance across the network, the solution offers twice the performance of competing solutions at 50 per cent of the cost and requires a much lower data centre footprint.
After an initial proof of concept, the storage solution was brought into production within four weeks for use with a major Hollywood feature film. So far, three projects have been run successfully on the software-defined system.
A major benefit is that the architecture has created an optimal environment where multiple members of the post-production team can simultaneously view and work on the same data set. Bemanian concludes: "It has generated a positive and productive end user experience.
Most recent headlines
04/11/2022
The best gamers know DTS Headphone:X technology ups their play. Now major magazines have caught on, too.
DTS Headphone:X technology creates immersive soundsc...
14/05/2022
Critics of the $8 billion-plus purchase of Tegnas TV station group by investment fund Standard General have told the FCC it needs to collect more data on the pr...
14/05/2022
Comedies Kenan and Mr. Mayor, and drama The Endgame will not return on NBC. Kenan lasted two seasons, as did Mr. Mayor. The Endgame lasted one....
14/05/2022
Gray Television said it named Ron Bartholomew as general manager of WNDU-TV, South Bend, Indiana....
14/05/2022
Nielsen, which has agreed to be acquired by a private-equity group led by Elliott Investment Management, said that its go-shop period has expired without an alt...
14/05/2022
The FCC, Department of Agriculture, National Telecommunications & Information Administration (all of which oversee broadband subsidy programs) and the Treasure ...
14/05/2022
Lisa White has been named vice president and news director at KPIX-KBCW San Francisco Bay Area, which are part of the CBS News and Stations group. She has been ...
14/05/2022
CBS has ordered three dramas for the 2022-2023 season, cop drama East New York, firefighter drama Fire Country and private investigator drama So Help Me Todd....
14/05/2022
Warner Bros. Discovery's U.S. Networks Group will be reorganized under Kathleen Finch, chairman and chief content officer, with long-time Discovery executiv...
14/05/2022
Natasha Lyonne will host the season finale of Saturday Night Live on NBC May 21. It is her first time hosting....
14/05/2022
ABC has renewed unscripted series America's Funniest Home Videos, American I...
14/05/2022
BRISTOL, Conn. ESPN has unveiled a record-setting 23-game NFL slate for the 2022 Season that includes 21 regular season games, plus the Monday night Super Wild ...
14/05/2022
SAN FRANCISCO Veteran local news executive Lisa White has been named vice presid...
14/05/2022
MIAMI TelevisaUnivision's audio network Uforia has announced that it is expanding its podcast offerings....
14/05/2022
ATLANTA Gray Television has named Ron Bartholomew the new general manager of WNDU, the NBC affiliate in South Bend, Indiana (DMA 99)....
14/05/2022
FREMONT, Calif. Blackmagic Design has announced that a Blackmagic URSA Mini Pro 12K digital film camera was used to capture visual effects (VFX) plates for the ...
14/05/2022
MUNICH Rohde & Schwarz has announced that its high-performance intelligent storage network, as well as its media servers for content preparation have been deplo...
14/05/2022
NEW YORK The NFL and Amazon Prime Video have unveiled the schedule for the Thursday Night Football (TNF) games that will be streamed exclusively on Prime Video....
14/05/2022
Kendrick Lamars New Album Is Full of Berklee Collaborators Berklee alumni played significant roles in every step of the creation of Kendricks double album, Mr...
14/05/2022
Ukraine wins 66th Eurovision Song Contest...
14/05/2022
A mischievous, musical experience for the whole family where the children are in charge and the adults get to be kids again!
From 10th December 2022
The Aud...
13/05/2022
Thursday 12 May 2022 Award-winning documentary maker, Stacey Dooley MBE, is set to take her hit W show overseas, in the brand-new three-part series Stacey Doole...
13/05/2022
Thursday 12 May 2022 UKTV today announces that it has commissioned two new serie...
13/05/2022
(L-R) Sian Gibson and Johnny Vegas
Friday 13 May 2022 The nations favourite com...
13/05/2022
-- John Nein is a senior programmer for the Sundance Institute....
13/05/2022
Ryan Coogler and Ludwig G ransson have worked together on several films, including Fruitvale Station.
By Vanessa Zimmer
Why do people say they watched a movie...
13/05/2022
La m sica mexicana tiene una rica tradici n narrativa. Canciones como La Jaula ...
13/05/2022
Mexican music has a rich tradition of storytelling. Songs like La Jaula de Oro ...
13/05/2022
Nations around the world - from the Pacific Ocean to the Baltic Sea - are facing increasingly aggressive actions from adversarial superpowers and terrorist orga...
13/05/2022
Imagine the scene: it's midday, and, somewhere in eastern Europe, a special operations team patrols through thick woodland to find and fix enemy positions c...
13/05/2022
SAN JOSE, Calif. Roku has announced that its most powerful streaming player, the Roku Ultra, will include Roku's top-of-the-line remote, the Roku Voice Remo...
13/05/2022
LOS ANGELES Scener, a destination for finding and sharing streaming entertainment, has announced the launch of a new mobile application designed to enhance and ...
13/05/2022
TEL AVIV, Israel Radcom has announced that it was selected by Dish Wireless to provide its Radcom Ace solution to monitor customers experience across Dishs 5G S...
13/05/2022
WASHINGTON, D.C. The NAB Leadership Foundation (NABLF) has announced that it is now accepting applications for the 2023 Technology Apprenticeship Program (TAP)....
13/05/2022
LAGUNA BEACH, Calif. Gaian Solutions unveiled its Mobius Marketplace NextGen TV monetization platform, an AI-based ATSC 3.0 spectrum planning tool intended to e...
13/05/2022
albert is working on building an accredited network of equipment suppliers for the UK production industry
By Jenny Priestley
Published: May 13, 2022
albert...
13/05/2022
V-Studios will be powered by the disguise Extended Reality (xR) workflow, featuring Absen's 10m x 5m LED wall
By Jenny Priestley
Published: May 13, 2022 ...
13/05/2022
She takes over from Sir William Sargent who has led the company for 26 years
By Jenny Priestley
Published: May 13, 2022
She takes over from Sir William Sar...
13/05/2022
A lot of the work weve done around innovation within BT Sport has been about loo...
13/05/2022
Blackbird plc announced the appointment of Sumit Rai as chief product officer. He will join the company in June, to lead the strategic development and direction...
13/05/2022
STAMFORD, Conn. & PHILADELPHIA, Penn. Charter Communications and Comcast Corporation have selected Marcien Jenckes as president of their recently announced stre...
13/05/2022
Julius P. Williams Composes Song for 54th Massachusetts Regiment Memorial Rededi...
13/05/2022
At BroadcastAsia 2022, Broadpeak will highlight how pay-TV operators, content providers, and OTT players can provide a compelling video streaming experience to ...
13/05/2022
Rohde & Schwarz, a global leader in broadcast media technologies, has today anno...
13/05/2022
Zero Density is proud to announce that its AI-powered, talent-tracking system, TRAXIS talentS, has won a Product of the Year award at this year's NAB! The a...
13/05/2022
WATCH UZALO: Tonight's episode, Friday, 13 May 2022 - E50 S8Don't get left behind, catch up on Uzalo now!
by SA TV and Soapies
13-05-2022 15:46
in ...
13/05/2022
WATCH: Gomora episode, 13 May 2022 (E15 S3)Don't miss out on what's happening on tonight's episode of Gomora, and watch the latest episode every wee...
13/05/2022
Actress Zoe Mthiyane chats about her role in Generations: The Legacy'The actress Zoe Mthiyane chats about playing Zitha in Generations: The Legacy', m...
13/05/2022
Generations: The Legacy' June Spoilers: Sphe kills serial killer' Winst...
13/05/2022
The way I found out about Studio One and PreSonus: I had lunch with Bob Moses (president of the Audio Engineering Society at one time) and I asked him some que...