Sony Pixel Power calrec Sony

A Simple Guide to Formats and Codecs

09/04/2020

ORLANDO, Fla.- All I need is a QuickTime file. How many times have you heard this from a client? Unfortunately, that's not enough information. Here are the reasons why.

Digital files consist of format wrappers, data, and metadata. A format wrapper defines the type of file it is, as identified by the file extension, like .mpeg, .mov, .mp4, .mxf, etc. Think of a wrapper like a videocassette tape. It earmarks which player application should be compatible with that file, just like a VHS cassette told you that a VHS player was required. The data is the audio/video content contained within that format wrapper. The metadata is information about that data, such as date/time stamps, color profiles, and more.

UNDERSTANDING THEM

Audio and video signals are encoded into digital files using codecs-shorthand for compression/decompression. Most video files use data compression, whereas the audio signal in professional formats is typically uncompressed. On the other hand, consumer audio formats such as .mp3 and .m4a use a highly compressed codec. While we tend to associate certain codecs together with specific formats, like ProRes and .mov, they are not synonymous. For example, files can be encoded with the ProRes codec and stored in .mxf wrappers.

Video compression is defined as either lossy or visually lossless. This is determined by the codec type, data rate used to encode the file, frame rate, and frame size. File sizes will be smaller when a lossy method is used. But, they will display compression artifacts visible to the eye, because so much signal information is thrown away. Streaming services like Netflix and YouTube use lossy methods to get the signal to your home over the internet. Visually lossless codecs, like high bit-rate versions of the Avid DNx or the Apple ProRes family of codecs, are used in camera acquisition and post production. These codecs employ a high data rate for compression and will have significantly larger file sizes. However, compression artifacts are generally indiscernible to the eye compared to uncompressed video.

The vast majority of codecs used in production and post today are the proprietary intellectual property of companies or associations. They are not open source or open standard, even though their use may be ubiquitous. The use of a codec, especially to encode data to that codec, requires a licensing agreement. Typically, this is transparent and appears to be free to the user, but rest assured that an arrangement between companies has been made. As with all intellectual property, this can result in a codec no longer being available within an application if such an arrangement has ended between companies.

LIBRARY COMPONENTS AND THE 64-BIT TRANSITIONWhen a video file is played by an application, its data is decoded on-the-fly and displayed as RGB pixels to your screen or a viewer within the interface. This requires a set of installed library components that the application draws upon in order to read, decode, and display the video data. These components may be part of the computer's operating system or they are custom-installed components that only function for that one application.

Over time, Apple and Microsoft have dropped or deprecated support for older codecs within their own operating systems. For example, Apple's Catalina is a 64-bit operating system, with no support for 32-bit applications and library components. This means that certain codecs - including many still in active use, like DNxHD/HR-can no longer be decoded (played) through any application that depends on the 32-bit QuickTime framework used in previous versions of macOS. This is not an issue of the codec itself, but rather the library components used.

In order for such files to work within Catalina, Apple or the application developer has to write new 64-bit library components to play such files going forward. In the case of DNx, Avid and Adobe can read and write these files in the .mxf format, but Apple's own applications, like Final Cut Pro X or QuickTime Player, are not able to do the same. Expect that to be updated later this year.

WHY CAN'T I WRITE CAMERA RAW FILES IN POST?Digital video cameras convert raw sensor data into RGB pixel information and record that to a digital file using a defined codec and format. Processing is done in the camera to bake in the conversion of the Bayer pattern sensor data to RGB, along with its native ISO and a color profile. These files are then easily played by most professional editing and player applications.

Ever since the launch of RED Digital Cinema's RED One camera, compressed raw codecs have grown in popularity. When you record a camera raw signal, the conversion/processing step to RGB is skipped, thus enabling access to more latitude for color correction in post. It also generates higher quality images for an equivalent data rate and file size. The trade-off is that camera raw files tax the hardware systems used in post. That's because the conversions that would have been done in the camera are now performed in real-time by the computer.

Raw codecs store information generated by a camera's sensor and are only intended for image acquisition. You cannot write or re-encode camera raw files in post, because there is no sensor data available. Camera raw codecs are also proprietary to individual companies, including RED, ARRI, Apple, Blackmagic Design, and others. For now, there is no video equivalent to CinemaDNG, a photographic raw format developed by Adobe and then offered up as an open standard to the community. Although it could be argued that GoPro's CineForm RAW codec is a comparable solution for video.

The video from non-raw codecs can be adjusted through color correction, but you aren't actually altering the underlying color processing of the file itself. You are skewing the RGB information that
LINK: https://www.tvtechnology.com/news/a-simple-guide-to-formats-and-codecs...
See more stories from tvtechnology

Most recent headlines

03/06/2024

Dalet and Veritone Reach Agreement to Distribute, Transact and Monetize Media Archives

Dalet, a leading technology and service provider for media-rich organizations, a...

19/03/2024

Barco announces collaboration with NVIDIA and SoftAcuity to add AI and data analytics applications to the operating room

Mar 18, 2024 Barco announces collaboration with NVIDIA and SoftAcuity to a...

19/03/2024

Hear from New Bulls Manager Morgan Ensberg on latest The Durham Bulls Podcast

Meet the Bulls' new manager, hear from 2 former managers, a former player and a person with a very special connection to Wool E. Bull. Tune in to The Durham...

19/03/2024

What Is Dembow? Tracing the Roots of a Global Phenomenon

What Is Dembow? Tracing the Roots of a Global Phenomenon The story of the dembow beat, which can be found in reggaeton, hip-hop, pop, and far beyond, speaks t...

19/03/2024

Berklee's Roger H. Brown Jr. Building Honored by Boston Society for Architecture

Berklee's Roger H. Brown Jr. Building Honored by Boston Society for Architec...

19/03/2024

Applications Open for 2024 Berklee at Umbria Jazz Clinics

Applications Open for 2024 Berklee at Umbria Jazz Clinics The 39th edition of the program will be held from July 9-21. By Callista Chan March 21, 2024 Ima...

19/03/2024

Smoke and Mirrors: Monday's episode, 18 March 2024 [VIDEO]

Smoke and Mirrors: Monday's episode, 18 March 2024 [VIDEO]Stay up to date with the latest episodes of your favourite South African soapie on The South Afric...

19/03/2024

Umkhokha: The Curse - Monday's episode, 18 March 2024 [VIDEO]

Umkhokha: The Curse - Monday's episode, 18 March 2024 [VIDEO]Stay up to date with the latest episodes of your favourite South African soapie on The South Af...

19/03/2024

Gqeberha: The Empire - Monday's episode, 18 March 2024 [VIDEO]

Gqeberha: The Empire - Monday's episode, 18 March 2024 [VIDEO]Stay up to date with the latest episodes of your favourite South African soapie on The South A...

19/03/2024

Muvhango: Monday's episode, 18 March 2024 [VIDEO]

Muvhango: Monday's episode, 18 March 2024 [VIDEO]Stay up to date with the latest episodes of your favourite South African soapie on The South African websit...

19/03/2024

Uzalo: Monday's episode, 18 March 2024 [video]

Uzalo: Monday's episode, 18 March 2024 [video]Stay up to date with the latest episodes of your favourite South African soapie on The South African website. ...

19/03/2024

Generations: The Legacy - Monday's episode, 18 March 2024 [VIDEO]

Generations: The Legacy - Monday's episode, 18 March 2024 [VIDEO]Stay up to date with the latest episodes of your favourite South African soapie on The Sout...

19/03/2024

Skeem Saam: Monday's episode, 18 March 2024 [VIDEO]

Skeem Saam: Monday's episode, 18 March 2024 [VIDEO]Missed an episode of Skeem Saam? No problem! Watch the latest episode of your favourite South African soa...

18/03/2024

USC Basketball Star Juju Watkins on Fashion, Film, Friendship Bracelets, and More

Listeners turn to Spotify to connect with their favorites-from artists and album...

18/03/2024

Young professionals successfully complete vocational training at SGL's Meitingen site

Seven young professionals completed their vocational training at SGL Carbon in M...

18/03/2024

Vintage Allure

Released this past January, the music video for Ariana Grande's yes, and? brings a modern approach to vintage allure. The video was directed by Christian ...

18/03/2024

ST Engineering iDirect Unveils Intuition at SATELLITE 2024 Conference and Exhibition

Global satellite communications leader gives market a first look at its next-gen...

18/03/2024

Box to Box Films shares with MediaSilo

Box to Box Films Shares with MediaSilo Amy and Drive to Survive producer updates collaborators simply and securely Boston, MA, March 18, 2024 - Box to Box Fi...

18/03/2024

Telestream Introduces AI-Powered Tools for Rapid Content Delivery at NAB Show 2024

Telestream Introduces AI-Powered Tools for Rapid Content Delivery at NAB Show 20...

18/03/2024

Docufiction Film Bringing Down a Mountain Edited with DaVinci Resolve Studio

Docufiction Film Bringing Down a Mountain Edited with DaVinci Resolve Studio Brie Clayton March 18, 2024 0 Comments Blackmagic Design today announced ...

18/03/2024

FingerWorks Telestrators Releases Enhancements to Computer Vision Live Tracking Software at NAB 2024

FingerWorks Telestrators Releases Enhancements to Computer Vision Live Tracking ...

18/03/2024

DirecTV to Allow Subscribers to Opt Out of Local Stations

DirecTV announced a new feature over the weekend that will allow its subscribers to opt out of their local stations in return for a discount. Customers who ch...

18/03/2024

Logging and reviewing: Moving towards a sustainable workflow

Jane Sung, COO at Cinedeck, explains how broadcasters and content production companies can achieve the goal of moving towards creating a more sustainable, effic...

18/03/2024

Altice Media sold to French shipping tycoon for 1.55 billion

The deal includes BFM TV, one of the country's largest 24-hour news channels, as well as documentary channel RMC D couverte, and RMC Story By Jenny Priestl...

18/03/2024

Meet the CEO and founder

By TVBEurope Staff Published: March 18, 2024 Nick Franco tells TVBEurope how he went from being a master plasterer and refurbishing the ornate plasterwork ...

18/03/2024

Master the Avatar State: Glowing Eyes in Adobe After Effects

Master the Avatar State: Glowing Eyes in Adobe After Effects Levi Borland March 18, 2024 0 Comments In this step-by-step tutorial, learn how to recrea...

18/03/2024

Next Season of Doctor Who' on Disney Plus May 10

The next season of Doctor Who, with Ncuti Gatwa as the 15th Doctor, premieres on Disney Plus and around the world May 10. It is the first season to launch on Di...

18/03/2024

Screen Australia and VicScreen launch new Screen Careers initiative

18 03 2024 - Media release Screen Australia and VicScreen launch new Screen Careers initiative LTR Denise Eriksen, Esther Coleman Hawkins, Caroline Pitcher, K...

18/03/2024

CBC/WRAL Night Helps Bring in Over $26k for PBS NC

Capitol Broadcasting and WRAL-TV continued a decades-long tradition of supporting PBS North Carolina, our state's public television station, to good result ...

18/03/2024

Tonight on My Brother's Keeper: Nomusa leaves Moketsi's house in a rush

Tonight on My Brother's Keeper: Nomusa leaves Moketsi's house in a rushDon't miss Monday, 18 March's riveting episode of South African soapie My...

18/03/2024

Tonight on House of Zwide: Zola discovers she's pregnant

Tonight on House of Zwide: Zola discovers she's pregnantDon't miss Monday, 18 March's riveting episode of South African soapie House of Zwide on e.t...

18/03/2024

Big Brother Mzansi 4: Papa Ghost secures back-to-back Head of House wins

Big Brother Mzansi 4: Papa Ghost secures back-to-back Head of House winsPapa Ghost has clinched consecutive victories as Head of the House in the latest edition...

18/03/2024

NVIDIA Edify Unlocks 3D Generative AI, New Image Controls for Visual Content Providers

NVIDIA Edify, a multimodal architecture for visual generative AI, is entering a ...

18/03/2024

From Atoms to Supercomputers: NVIDIA, Partners Scale Quantum Computing

The latest advances in quantum computing include investigating molecules, deploying giant supercomputers and building the quantum workforce with a new academic ...

18/03/2024

New NVIDIA Storage Partner Validation Program Streamlines Enterprise AI Deployments

A sharp increase in generative AI deployments is driving business innovation for...

18/03/2024

NVIDIA Unveils Digital Blueprint for Building Next-Gen Data Centers

Designing, simulating and bringing up modern data centers is incredibly complex, involving multiple considerations like performance, energy efficiency and scala...

18/03/2024

Generative AI Developers Harness NVIDIA Technologies to Transform In-Vehicle Experiences

Cars of the future will be more than just modes of transportation; they'll b...

18/03/2024

All Eyes on AI: Automotive Tech on Full Display at GTC 2024

All eyes across the auto industry are on GTC - the global AI conference running in San Jose, Calif., and online through Thursday, March 21 - as the world's ...

18/03/2024

All Aboard: NVIDIA Scores 23 World Records for Route Optimization

With nearly two dozen world records to its name, NVIDIA cuOpt now holds the top spot for 100% of the largest routing benchmarks in the last three years. And thi...

18/03/2024

We Created a Processor for the Generative AI Era,' NVIDIA CEO Says

Generative AI promises to revolutionize every industry it touches - all that's been needed is the technology to meet the challenge. NVIDIA founder and CEO ...

18/03/2024

Banglalink Gets Unified Licence to Deliver Superior Digital Services in Bangladesh

18 Mar 2024 Banglalink Gets Unified Licence to Deliver Superior Digital Service...

18/03/2024

Thuraya partners with Niflink to deliver telemedicine and eLearning to users across its network

Abu Dhabi, 18 March, 2024 : Abu Dhabi, 18 March 2024: Thuraya Telecommunication...

18/03/2024

Thuraya partners with Niflink to deliver telemedicine and eLearning to users across its ne...

Abu Dhabi, 18 March, 2024 : Abu Dhabi, 18 March 2024: Thuraya Telecommunication...

18/03/2024

Major League Soccer: IMG on Capturing Fan Rituals and Delivering Consistent Coverage

Major League Soccer: IMG on capturing fan rituals and delivering consistent cove...

18/03/2024

Smashing Padel: Inside Aurora's Innovative Production of the Inaugural Hexagon Cup

Smashing padel: Inside Aurora's innovative production of the inaugural Hexag...

18/03/2024

Airspeeder Teams Up With EMG for World's First Live Broadcast of Flying Car Series

Airspeeder teams up with EMG for world's first live broadcast of flying car ...

18/03/2024

Netflix Announces News About 26 Upcoming Nordic Titles - Including 12 Brand New Titles

Back to All News Netflix Announces News About 26 Upcoming Nordic Titles - Inclu...

18/03/2024

Final sprint in the AS4 market communication

Final Sprint in the AS4 Market Communication: All Arvato Systems Customers Are Ready to Go Customers for market communication AS4-ready Arvato Systems is now...

18/03/2024

Tonight on Uzalo: Nkunzi takes a drastic decision

Tonight on Uzalo: Nkunzi takes a drastic decisionDon't miss Monday, 18 March's riveting episode of South African soapie Uzalo on SABC 1 on DStv channel ...

18/03/2024

Thales to modernize Montreal Mtro blue Line,improving passengers' punctuality and train reliability

Facebook Twitter LinkedIn Following a call for tenders, the Soci t de tra...