
"What we wanted to do was to build a file system that would support any resolution at any number of streams"
Author:
ContributorPublish date:
Aug 16, 2018
The M&E industry is one of the fastest evolving sectors. The rapid progression of frame rates and video revolution has a considerable impact on production and post-production teams, and their storage and capacity requirements. Throughout the production process, a film increases from approximately 10 TB to roughly 350 TB and the number of workstreams with users working on the same dataset grows rapidly.
To solve this data storage challenge, Technicolor created a scalable and future-proof storage infrastructure using Excelero NVMesh to provide workstations with access to high bandwidth and low latency performance that accommodates streaming, editing and reel presentation at any time.
Future-proofing post-production storage
Like many data centre and infrastructure teams at production and post-production houses, Technicolors IT department along with engineering director Amir Bemanian, were struggling to keep up with the rapid evolution from one resolution to the other.
4K is becoming the default resolution and 8K is on the horizon, and frame rates are increasing from 24 and 30 frames per second to 48fps and even 60fps. The additional storage capacity and thus also bandwidth that is needed for higher frame rates increases linearly: doubling the frame rate from 30fps to 60fps also doubles the storage needs. And increasing the resolution from 2K to 4K quadruples the storage requirements. When a studio switches from 2K 30fps to 4K 60fps, the post-production house also needs to be prepared to store and stream eight times the volume of data, which is a substantial increase.
On top of this, there are also possible investments in extra cameras, additional visual effects, High Dynamic Range (HDR), colour depth, and more. Yet another challenge for post-production workflows is avoiding dropped frames, caused by insufficient performance and high latencies, which impacts the technical quality of an asset and results in on-screen motion.
A common problem is that many companies in the M&E industry such as Technicolor, retain infrastructures which are typically based on a Fibre Channel network with storage arrays serving tens of workstations. This means that the speed to ingest data to the workstations from the Fibre Channel storage arrays is simply too slow and does not scale. At Technicolor, workstreams had to be duplicated in order for multiple people to work on the dataset at the same time.
In order to be better prepared for current and future storage and streaming needs, Amir Bemanian and his team at Technicolor began exploring new "future-proof" storage and network architectures. "What we wanted to do was to build a file system that would support any resolution at any number of streams," explains Bemanian. "And that was essentially impossible until 2017 where we saw an alignment of technologies: the networking, the PCIE slot, the NVMe drives and also the software - from Excelero - that glued it all together. This combination of technologies enabled us to do storage in a very different way to traditional methods.
The IT infrastructure required to feed dozens of workstations of 4K files at 24 fps is mind-boggling and that doesn't even consider what storage demands we'll face with 8K or even 16K formats, Bemanian continues. It's imperative that we can scale to future film standards today. Now, with innovations like the shared NVMe storage that Excelero provides, Technicolor can enjoy a hardware-agnostic approach, enabling flexibility for tomorrow while not sacrificing performance.
Excelero's NVMesh for Any-K workflows
NVMesh software-defined block storage features Elastic NVMe, a distributed block layer that allows any application to utilise pooled NVMe storage devices across a network at local speeds and latencies. Distributed NVMe storage resources are pooled with the ability to create arbitrary, dynamic block volumes that can be utilised by any host running the NVMesh block client. These virtual volumes can be striped, mirrored or both while enjoying centralised management, monitoring and administration. In short, applications can enjoy the latency, throughput and IOPS of a local NVMe device while at the same time getting the benefits of centralised, redundant storage. NVMesh is deployed as a virtual, distributed non-volatile array and supports both converged and disaggregated architectures, giving customers full freedom in their architectural design.
By deploying Excelero NVMesh and six standard NVMe servers powered by Intel 3D NAND flash, Technicolor achieved 4K streaming at 60fps to over 50 workstations concurrently. Delivering 99.8 per cent of local NVMe storage server performance across the network, the solution offers twice the performance of competing solutions at 50 per cent of the cost and requires a much lower data centre footprint.
After an initial proof of concept, the storage solution was brought into production within four weeks for use with a major Hollywood feature film. So far, three projects have been run successfully on the software-defined system.
A major benefit is that the architecture has created an optimal environment where multiple members of the post-production team can simultaneously view and work on the same data set. Bemanian concludes: "It has generated a positive and productive end user experience.
Europe Stories
04/11/2022
The best gamers know DTS Headphone:X technology ups their play. Now major magazines have caught on, too.
DTS Headphone:X technology creates immersive soundsc...
27/06/2022
The Great, MasterChef and Expendables 4 have all recently filmed at the studios
By Jenny Priestley
Published: June 27, 2022
The Great, MasterChef and Expen...
27/06/2022
He is also inventor or co-inventor on 230 patents worldwide
By Jenny Priestley
Published: June 27, 2022
He is also inventor or co-inventor on 230 patents w...
27/06/2022
Deal is expected to complete in the second half of 2022
By Jenny Priestley
Published: June 27, 2022
Deal is expected to complete in the second half of 2022...
27/06/2022
TIM tests multicast technology on satellite, live streaming available even in re...
27/06/2022
Banijay Rights today announces new adaptations for two of its leading entertainment programmes with broadcasters in Greece, as NATPE Budapest International gets...
27/06/2022
1000th software-defined airborne radio delivered for F-16 Rohde & Schwarz delivers 1000th radio to Lockheed Martin for integration on export F-16.
(Image: Ro...
27/06/2022
Rohde & Schwarz Offers New Ultra-Wideband Test Solution Validated for FiRa Conso...
27/06/2022
Rapidly growing niche sport, D dsing, breaks through barriers to cloud-based liv...
27/06/2022
Rohde & Schwarz helps secure large, high-profile public events R&S ARDRONIS counter drone solutions from Rohde & Schwarz successfully and effectively locate ro...
26/06/2022
It all started with electric street lighting in Berlin, as well as electrically conductive components for electric trains and the melting of steel - the industr...
24/06/2022
20th May 2022
Award-winning broadcaster UKTV has today announced it has invested in online start-up easyGuide, using its multi-million pound investment fund, U...
24/06/2022
Hello, can you hear me? The zoom screen springs to life and the responses quickly follow.
Yes, we can. Good morning . The greetings come from Kenya, Nigeri...
24/06/2022
New tool enables sports organisations to instantly create, package and convert clips into NFTs which can be used as a revenue source
By Jenny Priestley
Publis...
24/06/2022
Elements created by xR and AR included plants, skies, graphics, animated cityscapes, fireflies and butterflies
By Jenny Priestley
Published: June 24, 2022
...
24/06/2022
ScreenSkills suggests production spend on film and HETV is likely to hit between...
24/06/2022
Avid CEO Jeff Rosica said the company is confident that the improving conditions and handling of the pandemic can help to ensure that IBC 2022 can be successful...
24/06/2022
UEFA Women's Euro 2022 kicks off on July 6th, and RT Sport have today relea...
24/06/2022
Designing resilient media distribution networks for resilient societies...
23/06/2022
There are few things like going to see your favorite artist in person. The energy, the bass pulsing beneath your feet, the other just-as-obsessed fans belting o...
23/06/2022
Photo credit: David M. Benett/Dave Benett/Getty Images From engaging discussions...
23/06/2022
Last year, Spotify unveiled Frequency, a global initiative and holistic destination for celebrating Black art, entertainment, creativity, culture, and community...
23/06/2022
All-in-all I found the DPA 4055 to be an excellent microphone for its intended purpose and I have a feeling that we will be seeing a lot more of this around, pa...
23/06/2022
Production sound mixer Chris Giles talk to TVBEurope about the challenges of working on Marvels latest TV series, and how he can walk into a space and hear the ...
23/06/2022
An expert panel will discuss how 5G is expected to unlock higher resolution video services and new forms of media, such as volumetric content, and enable new au...
23/06/2022
The league will use Dalet Flex to ingest, prepare and publishing video highlights from both Ligue 1 and 2
By Jenny Priestley
Published: June 23, 2022
The l...
23/06/2022
TBY2 is due to open in September
By Jenny Priestley
Published: June 23, 2022
TBY2 is due to open in September
target=_blank title=Share on LinkedIn class...
23/06/2022
New 6K model adds an adjustable LCD touchscreen, larger longer battery life, support for the OLED viewfinder and improved on screen menus
By Jenny Priestley
P...
23/06/2022
Sky Studios Elstree North would add another 10 stages to the companys footprint
By Jenny Priestley
Published: June 23, 2022 Updated: June 24, 2022
Sky St...
23/06/2022
New location will join the company's other European studios in London, UK and Sofia, Bulgaria
By Jenny Priestley
Published: June 23, 2022
New location ...
23/06/2022
According to the company, its OTT solutions have approximately 25 million end users per day
By Jenny Priestley
Published: June 23, 2022 Updated: June 24, 20...
23/06/2022
Patent authorities for which Claims are being added to CA/CAplus in June 2022 are:
AU (Australia) - coverage from 2000, over 20,000 records
BR (Brazil) - cov...
23/06/2022
New research from Sky Mobile unveils the importance of tuning into uplifting pos...
23/06/2022
Published On: June 23rd, 2022
--
--
--
--
data-orig-src=https://www.sg...
23/06/2022
Wuppertal June 23, 2022
Riedel Intercom Delivers Clear Communications for the Royal Shakespeare Company Riedel Communications today announced that the Royal S...
23/06/2022
A campaign to safeguard digital terrestrial TV and radio launches today as new r...
23/06/2022
Barco Demetra skin imaging solution and MediPortal announce new partnership Kortrijk, Belgium, 23 June 2022 - Barco today announced a new partnership between it...
23/06/2022
Anton/Bauer Announces Next Generation VCLX Free Standing Battery posted: 23/06/2022
VCLX NM2 Delivers Consistent High Quality Feature Length Production Po...
23/06/2022
Interview with Robert veb, Director General of HRT...
23/06/2022
Shkumbin Ahmetxhekaj elected Director General of RTK in Kosovo...
23/06/2022
ILA 2022: Rohde & Schwarz is shaping the future with trusted end-to-end communic...
22/06/2022
One of the universal qualities of hip-hop is how artists use the genre to expres...
22/06/2022
Spotify is making a splash in France for this year's Cannes Lions. It's ...
22/06/2022
When Jason King was a kid, his family had a compilation full of disco hits from ...
22/06/2022
The Metaverse Standards Forum will focus on technologies around 3D assets and rendering, AR and VR, and user-created content
By Jenny Priestley
Published: Jun...
22/06/2022
New operating licence would give the broadcaster greater flexibility to adapt an...
22/06/2022
The training was developed by AFP's award-winning digital investigations team, with the support of the Google News Initiative. Every journalist will receive...
22/06/2022
It's time to roll out the red carpet for a mountain of entertainment. On 22 June, Paramount makes its big debut in the UK and Sky Cinema customers on Sky p...
22/06/2022
Nokia donates EUR 1,1 million to universities in Finland
Nokia donates EUR 1,1 million to universities in Finland
Nokia donates four Finnish universities a...
22/06/2022
Dalet, a leading technology and service provider for media-rich organizations, today announced the Ligue de Football Professionnel (LFP) is using Dalet Flex, th...