"What we wanted to do was to build a file system that would support any resolution at any number of streams"
Author:
ContributorPublish date:
Aug 16, 2018
The M&E industry is one of the fastest evolving sectors. The rapid progression of frame rates and video revolution has a considerable impact on production and post-production teams, and their storage and capacity requirements. Throughout the production process, a film increases from approximately 10 TB to roughly 350 TB and the number of workstreams with users working on the same dataset grows rapidly.
To solve this data storage challenge, Technicolor created a scalable and future-proof storage infrastructure using Excelero NVMesh to provide workstations with access to high bandwidth and low latency performance that accommodates streaming, editing and reel presentation at any time.
Future-proofing post-production storage
Like many data centre and infrastructure teams at production and post-production houses, Technicolors IT department along with engineering director Amir Bemanian, were struggling to keep up with the rapid evolution from one resolution to the other.
4K is becoming the default resolution and 8K is on the horizon, and frame rates are increasing from 24 and 30 frames per second to 48fps and even 60fps. The additional storage capacity and thus also bandwidth that is needed for higher frame rates increases linearly: doubling the frame rate from 30fps to 60fps also doubles the storage needs. And increasing the resolution from 2K to 4K quadruples the storage requirements. When a studio switches from 2K 30fps to 4K 60fps, the post-production house also needs to be prepared to store and stream eight times the volume of data, which is a substantial increase.
On top of this, there are also possible investments in extra cameras, additional visual effects, High Dynamic Range (HDR), colour depth, and more. Yet another challenge for post-production workflows is avoiding dropped frames, caused by insufficient performance and high latencies, which impacts the technical quality of an asset and results in on-screen motion.
A common problem is that many companies in the M&E industry such as Technicolor, retain infrastructures which are typically based on a Fibre Channel network with storage arrays serving tens of workstations. This means that the speed to ingest data to the workstations from the Fibre Channel storage arrays is simply too slow and does not scale. At Technicolor, workstreams had to be duplicated in order for multiple people to work on the dataset at the same time.
In order to be better prepared for current and future storage and streaming needs, Amir Bemanian and his team at Technicolor began exploring new "future-proof" storage and network architectures. "What we wanted to do was to build a file system that would support any resolution at any number of streams," explains Bemanian. "And that was essentially impossible until 2017 where we saw an alignment of technologies: the networking, the PCIE slot, the NVMe drives and also the software - from Excelero - that glued it all together. This combination of technologies enabled us to do storage in a very different way to traditional methods.
The IT infrastructure required to feed dozens of workstations of 4K files at 24 fps is mind-boggling and that doesn't even consider what storage demands we'll face with 8K or even 16K formats, Bemanian continues. It's imperative that we can scale to future film standards today. Now, with innovations like the shared NVMe storage that Excelero provides, Technicolor can enjoy a hardware-agnostic approach, enabling flexibility for tomorrow while not sacrificing performance.
Excelero's NVMesh for Any-K workflows
NVMesh software-defined block storage features Elastic NVMe, a distributed block layer that allows any application to utilise pooled NVMe storage devices across a network at local speeds and latencies. Distributed NVMe storage resources are pooled with the ability to create arbitrary, dynamic block volumes that can be utilised by any host running the NVMesh block client. These virtual volumes can be striped, mirrored or both while enjoying centralised management, monitoring and administration. In short, applications can enjoy the latency, throughput and IOPS of a local NVMe device while at the same time getting the benefits of centralised, redundant storage. NVMesh is deployed as a virtual, distributed non-volatile array and supports both converged and disaggregated architectures, giving customers full freedom in their architectural design.
By deploying Excelero NVMesh and six standard NVMe servers powered by Intel 3D NAND flash, Technicolor achieved 4K streaming at 60fps to over 50 workstations concurrently. Delivering 99.8 per cent of local NVMe storage server performance across the network, the solution offers twice the performance of competing solutions at 50 per cent of the cost and requires a much lower data centre footprint.
After an initial proof of concept, the storage solution was brought into production within four weeks for use with a major Hollywood feature film. So far, three projects have been run successfully on the software-defined system.
A major benefit is that the architecture has created an optimal environment where multiple members of the post-production team can simultaneously view and work on the same data set. Bemanian concludes: "It has generated a positive and productive end user experience.
Europe Stories
07/12/2022
Dalet, a leading technology and service provider for media-rich organizations, today announced key new capabilities available in Dalet Flex that support importa...
02/12/2022
Making life and business more sustainable is now a priority for governments, manufacturers and individuals. The audio market is among those playing its part, wh...
02/12/2022
Andy O'Neil, regional head of sports, Vizrt, explains how billions of eyeballs around the world will be tuning into tournament coverage with graphics powere...
02/12/2022
Post Haste Digital has been acquired by Deluxe as part of the latters global expansion and technology investment strategy
By TVBEurope Staff
Published: Decemb...
01/12/2022
Spotify listeners all over the world are taking part in Wrapped and learning abo...
01/12/2022
Across the TV and film industries, writers with disabilities are heavily underre...
01/12/2022
FOH Engineer Kenny Kaiser and Monitor Engineer Marty Beath rely on DPA's Live Sound Solutions
Always on the lookout for the newest audio solutions for the ...
01/12/2022
Live streaming's usage has been growing steadily over the past few years, in large part due to the pandemic, and is expected to increase further in 2023 wit...
01/12/2022
Imagine Communication's Landmark Sales ad management platform and GamePlan dynamic ad placement engine are both being deployed as part of a new partnership ...
01/12/2022
Annual Rise Awards celebrate the outstanding women working in the media technology industry
By Jenny Priestley
Published: December 1, 2022
Annual Rise Awar...
01/12/2022
Wuppertal December 1, 2022
Dyn Media Chooses Riedel as Connectivity PartnerRiedel Networks, a Riedel Group company, today announced that they have been appoin...
01/12/2022
ProSiebenSat.1 prepays promissory notes in the amount of EUR 275 million from av...
01/12/2022
The sunk cost fallacy is when we continue to do something because of our past decisions (time or money spent) rather than making a rational choice to change thi...
01/12/2022
Fox Corporation Chief Financial Officer Steve Tomsic to Participate in Upcoming ...
01/12/2022
Flexsat artist view for Eutelsat by Thales Alenia Space
Press release - 1 Dec...
01/12/2022
Set on a migrant steamship, Netflix's mystery series 1899 tells the stories of a multicultural cast in search of new lives in the US, whose journey quickl...
01/12/2022
DJI Introduces the O3 Air Unit to Empower FPV to Truly go the Distance posted: 01/12/2022
The O3 Air Unit Brings Incredibly Reliable, Low-Latency, High-Re...
01/12/2022
Royal Television Society Ireland is inviting submissions from Irish programme makers to celebrate excellence and achievement in the Irish television industry in...
01/12/2022
Narrated by Brendan Gleeson, produced by RT in partnership with University College Cork as part of the Decade of Centenary commemorations and based on UCC'...
01/12/2022
The first four celebrity contestants for this year's Dancing with the Stars,...
01/12/2022
Public service media goes green...
01/12/2022
Facebook
Twitter
LinkedIn
Based on its secure payment and connectivity expertise, Thales developed a solution to protect visually impaired people from fra...
01/12/2022
Facebook
Twitter
LinkedIn
New generation of high-throughput, software-defi...
30/11/2022
Tuesday 29 November 2022 Hit crime drama Miss Scarlet and the Duke is set to return to Alibi in late Spring 2023, whilst filming on a fourth series gets underwa...
30/11/2022
When you open your 2022 Spotify Wrapped, you'll notice multicolored and mult...
30/11/2022
Listen to this story read aloud in 5 minutes and 30 seconds.
https://storage.googleapis.com/pr-newsroom-wp/1/2022/11/FTR-Wrapped-Experience-Article.mp3
What ...
30/11/2022
Det r om jligt att definiera 2022 p ett enkelt s tt. Efter de senaste rens ovisshet har var och en av oss beh vt hitta ett det nya normala i v r relation t...
30/11/2022
No hay una sola forma de definir lo que ha sido el 2022. El volver luego de algu...
30/11/2022
Spotify listeners all over the world are taking part in Wrapped and learning abo...
30/11/2022
There's no single way to define what a year 2022 has been. Coming back after a few years of uncertainty has led each of us to create a new normal in our r...
30/11/2022
My career has spanned many genres, a journey I could have never predicted, says cinematographer Simon Reay. With credits that run the gamut from the series Man...
30/11/2022
Starring Taylor Russell as Maren and Timoth e Chalamet as Lee, director Luca Guadagnino's feature Bones and All is a film about cannibal lovers, cinematog...
30/11/2022
The new rebrand, announced today, reflects ITNs evolution to a global production powerhouse
By TVBEurope Staff
Published: November 30, 2022
The new rebrand...
30/11/2022
Two new hires, Ian Morrison and Leila Ghazzawi, are welcomed to the business equipment rental division
By TVBEurope Staff
Published: November 30, 2022
Two ...
30/11/2022
TV ads and commercial insertions are the main way to monetize content in linear and non-linear channels. Advertising is becoming more and more important nowaday...
30/11/2022
Amsterdam, 30 November 2022: VEON Ltd. (NASDAQ: VEON, Euronext Amsterdam: VEON), a global digital operator that provides converged connectivity and online servi...
30/11/2022
9 minute read
Share
New Company Well-Placed to Serve the Nation and Consum...
30/11/2022
11 minute read
Share
Digi Telenor Asia
For over 20 years, Digi has emp...
30/11/2022
As the world was limbering up for the World Cup, my colleague Pascal Metral, a proud Swiss supporter and NAGRA's VP of Anti-Piracy Services, was heading to ...
30/11/2022
Sankofa is a Ghanian word from the Akan tribe meaning:
to learn from the past I must return and get it
This does not mean to dwell in the past. Rather the w...
30/11/2022
dB Broadcast Has Attracted New Talent in a Number of Positions
Mike Birch has joined dB Broadcast as Senior Systems Engineer. Mike has over 25 years' exper...
30/11/2022
Banijay Rights today announces Big Brother VIP will be adapted for the Republic of Kosovo. Co-produced byKlan Kosova and Artmotion, the new series will air on K...
30/11/2022
British Speedway Fans Benefit from Streaming Quality Upgrade as ExStream Media D...
30/11/2022
Interview with Milen Mitev, Director General of Bulgarian National Radio...
30/11/2022
Thinking differently about the metaverse and shared experiences...
29/11/2022
Six-part true story of the Mitford sisters
29th November 2022 UKTV free-to-air channel Drama announces its first UKTV Original commission Outrageous (6x60), pr...
29/11/2022
Yashraj Sharma is the interim editor of the online news portal of The Kashmir Walla. He is the winner of the Thomson Foundation's Young Journalist Award 202...
29/11/2022
Rede Evangelizar boosts capabilities and moves to cloud archive with EditShare
Brazilian broadcaster adds storage, control and cloud sync
Boston, MA, November...
29/11/2022
The UK's leading television facility is serving as the UK production base for BBC Sport's coverage of the FIFA World Cup 2022
By TVBEurope Staff
Publi...
"What we wanted to do was to build a file system that would support any resolution at any number of streams"
