Sony Pixel Power calrec Sony

A Simple Guide to Formats and Codecs

09/04/2020

ORLANDO, Fla.- All I need is a QuickTime file. How many times have you heard this from a client? Unfortunately, that's not enough information. Here are the reasons why.

Digital files consist of format wrappers, data, and metadata. A format wrapper defines the type of file it is, as identified by the file extension, like .mpeg, .mov, .mp4, .mxf, etc. Think of a wrapper like a videocassette tape. It earmarks which player application should be compatible with that file, just like a VHS cassette told you that a VHS player was required. The data is the audio/video content contained within that format wrapper. The metadata is information about that data, such as date/time stamps, color profiles, and more.

UNDERSTANDING THEM

Audio and video signals are encoded into digital files using codecs-shorthand for compression/decompression. Most video files use data compression, whereas the audio signal in professional formats is typically uncompressed. On the other hand, consumer audio formats such as .mp3 and .m4a use a highly compressed codec. While we tend to associate certain codecs together with specific formats, like ProRes and .mov, they are not synonymous. For example, files can be encoded with the ProRes codec and stored in .mxf wrappers.

Video compression is defined as either lossy or visually lossless. This is determined by the codec type, data rate used to encode the file, frame rate, and frame size. File sizes will be smaller when a lossy method is used. But, they will display compression artifacts visible to the eye, because so much signal information is thrown away. Streaming services like Netflix and YouTube use lossy methods to get the signal to your home over the internet. Visually lossless codecs, like high bit-rate versions of the Avid DNx or the Apple ProRes family of codecs, are used in camera acquisition and post production. These codecs employ a high data rate for compression and will have significantly larger file sizes. However, compression artifacts are generally indiscernible to the eye compared to uncompressed video.

The vast majority of codecs used in production and post today are the proprietary intellectual property of companies or associations. They are not open source or open standard, even though their use may be ubiquitous. The use of a codec, especially to encode data to that codec, requires a licensing agreement. Typically, this is transparent and appears to be free to the user, but rest assured that an arrangement between companies has been made. As with all intellectual property, this can result in a codec no longer being available within an application if such an arrangement has ended between companies.

LIBRARY COMPONENTS AND THE 64-BIT TRANSITIONWhen a video file is played by an application, its data is decoded on-the-fly and displayed as RGB pixels to your screen or a viewer within the interface. This requires a set of installed library components that the application draws upon in order to read, decode, and display the video data. These components may be part of the computer's operating system or they are custom-installed components that only function for that one application.

Over time, Apple and Microsoft have dropped or deprecated support for older codecs within their own operating systems. For example, Apple's Catalina is a 64-bit operating system, with no support for 32-bit applications and library components. This means that certain codecs - including many still in active use, like DNxHD/HR-can no longer be decoded (played) through any application that depends on the 32-bit QuickTime framework used in previous versions of macOS. This is not an issue of the codec itself, but rather the library components used.

In order for such files to work within Catalina, Apple or the application developer has to write new 64-bit library components to play such files going forward. In the case of DNx, Avid and Adobe can read and write these files in the .mxf format, but Apple's own applications, like Final Cut Pro X or QuickTime Player, are not able to do the same. Expect that to be updated later this year.

WHY CAN'T I WRITE CAMERA RAW FILES IN POST?Digital video cameras convert raw sensor data into RGB pixel information and record that to a digital file using a defined codec and format. Processing is done in the camera to bake in the conversion of the Bayer pattern sensor data to RGB, along with its native ISO and a color profile. These files are then easily played by most professional editing and player applications.

Ever since the launch of RED Digital Cinema's RED One camera, compressed raw codecs have grown in popularity. When you record a camera raw signal, the conversion/processing step to RGB is skipped, thus enabling access to more latitude for color correction in post. It also generates higher quality images for an equivalent data rate and file size. The trade-off is that camera raw files tax the hardware systems used in post. That's because the conversions that would have been done in the camera are now performed in real-time by the computer.

Raw codecs store information generated by a camera's sensor and are only intended for image acquisition. You cannot write or re-encode camera raw files in post, because there is no sensor data available. Camera raw codecs are also proprietary to individual companies, including RED, ARRI, Apple, Blackmagic Design, and others. For now, there is no video equivalent to CinemaDNG, a photographic raw format developed by Adobe and then offered up as an open standard to the community. Although it could be argued that GoPro's CineForm RAW codec is a comparable solution for video.

The video from non-raw codecs can be adjusted through color correction, but you aren't actually altering the underlying color processing of the file itself. You are skewing the RGB information that
LINK: https://www.tvtechnology.com/news/a-simple-guide-to-formats-and-codecs...
See more stories from tvtechnology

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

04/08/2026

Dalet Announces Commercial Availability of Dalia, Bringing Media-Aware Agentic AI to Enterprise Productions

Dalet, a leading technology and service provider for media-rich organizations, t...

04/07/2026

Detective Conan: Fallen Angel of the Highway Opens in Dolby Cinemas Across Japan, Presented in Dolby Atmos and Dolby ...

April 7 2026, 19:00 (PDT) Detective Conan: Fallen Angel of the Highway Opens in...

01/06/2026

Dolby Sets the New Standard for Premium Entertainment at CES 2026

January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026 Throughout the week, Dolby brings to life the latest innovatio...

22/05/2026

Study: AI Labeling Does Not Hurt Video Ad Performance

Share Copy link Facebook X Linkedin Bluesky Email...

22/05/2026

NAB Show Makes 200+ Sessions Available on Demand

Share Copy link Facebook X Linkedin Bluesky Email...

22/05/2026

Torneos Upgrades Multichannel Playout with Imagine's Versio

Share Copy link Facebook X Linkedin Bluesky Email...

21/05/2026

CBS Sports Expands WNBA Tip-Off Show To Cover Half of 20-Game, Regular-Season Package

Game Creek Video Columbia and Celtic, NEP Supershooter 8 will house onsite produ...

21/05/2026

SVG Students To Watch: Christina Zelin, Rowan University

Freshly graduated, this upstart producer, director, and camera operator is already working as an AP on videoboard shows for the Philadelphia Phillies In the li...

21/05/2026

Media Links Announces Channel Partnership with Clearcast Asia Ahead of BroadcastAsia 2026

Media Links has announced a channel partnership with Clearcast Asia, a broadcast...

21/05/2026

SiriusXM and NASCAR Announce Multi-Year Broadcasting Agreement Renewal

SiriusXM and NASCAR have announced a multi-year renewal of their broadcasting agreement. SiriusXM will continue to carry live broadcasts of every NASCAR Cup Ser...

21/05/2026

Audio-Technica Hosts High-Density Wireless Microphone Demo at Technica House in New York City

Audio-Technica held a demonstration event at its Technica House location in New ...

21/05/2026

RTL Deutschland Selects Ateme Frame-Rate Conversion Technology for Live Event Workflows

Ateme has announced that RTL Deutschland has selected Ateme's software-based...

21/05/2026

BCC Live Deploys LiveU LU900Q for Record-Breaking IRONMAN Texas Broadcast

LiveU has announced that BCC Live deployed the LU900Q intelligent production unit for the first time during the 2026 Memorial Hermann IRONMAN Texas North Americ...

21/05/2026

Mark Aitken to Receive 2026 ATSC Mark Richer Industry Leadership Medal

ATSC has announced that Mark Aitken, President of ONE Media and Senior VP of Advanced Technology at Sinclair Broadcast Group, will receive the 2026 Mark Richer ...

21/05/2026

BBright Outlines MXL Integration Strategy for Software-Defined Broadcast Workflows

BBright has published a technical analysis of the Media eXchange Layer (MXL), de...

21/05/2026

Esports World Cup 2026 to Be Held in Paris, France

The Esports Foundation has announced that the 2026 Esports World Cup (EWC) will be hosted in Paris, France, from July 6 through August 23. The event marks the f...

21/05/2026

Chyron Announces PRIME Scorebug and Expanded Chyron LIVE Scorebug Capabilities

Chyron has announced PRIME Scorebug, a scorebug solution built on the PRIME Platform for on-premises sports production, and has expanded Chyron LIVE with purpos...

21/05/2026

Media Links Integrates Xscend Platform with DataMiner at BroadcastAsia 2026

Media Links has announced the integration of its Xscend IP transport platform with Skyline Communications' DataMiner xOps platform. The integration will be ...

21/05/2026

SVG New Sponsor Spotlight: Nova Lume CEO Jim Casey on Bringing Flexible IP Intercom to Live Production

As live sports productions continue to demand more flexible, scalable, and cost-...

21/05/2026

SVG Rewind: ESPN's Use of POVORA Wireless Tilt Control CapCam Gives College Football Fans a First-Person View of the Game

In advance of this year's Sports Emmy Awards, SVG is taking a deep dive into...

21/05/2026

Join Shade in Miami and Atlanta for Post-Production Networking Events

Hey Miami & Atlanta post-production folks! Shade is hosting a free private suite at a Braves game (6/2) and Marlins game (6/5) and have about a dozen extra tic...

21/05/2026

Phoenix Suns, Mercury, and Gray Media Extend Broadcast Partnership Through 2030

The Suns and Mercury become the first NBA and WNBA teams to make games available under a single broadcast partner across both over-the-air and streaming....

21/05/2026

Apple TV, MLS to Produce First Major Pro Sporting Event Shot Entirely on iPhone 17 Pros

iPhones are part of the the regular production rotation for Friday Night Baseba...

21/05/2026

SVG Rewind: AIQ: Where Data Meets Dirt Technology Brings Real-Time Data Analysis to Rodeo

In advance of this year's Sports Emmy Awards, SVG is taking a deep dive into...

21/05/2026

Filmmakers' Favorites: Sundance Film Festival Alums on Welcome to the Dollhouse

Heather Matarazzo as Dawn Wiener in Todd Solondz's Welcome to the Dollhouse...

21/05/2026

Create, Control, and Personalize Your Listening Across Every Moment

Spotify has always been about helping you find something you want to listen to. And over the years, we've learned your taste and the moments that matter to ...

21/05/2026

You Know Every Song. We Saved You Two Tickets. Introducing Reserved.

Getting concert tickets today can feel like a race you're set up to lose. You show up at the right time, refresh endlessly, and still miss out. Too often, ...

21/05/2026

Books on Spotify: New Updates for Listeners and Authors

In 2022, Spotify entered a new chapter by introducing audiobooks to our platform. Since then, we've grown our catalog to include more than 700,000 titles, e...

21/05/2026

Investor Day 2026 Remarks From Spotify Co-CEOs Alex Norstrm and Gustav Sderstrm

Opening remarks ALEX Good morning everyone, I'm Alex [Norstr m]. GUSTAV And I'm Gustav [S derstr m]. ALEX Whether you've been following our j...

21/05/2026

Spotify's 2026 Investor Day Recap: Raising Ambition for the Next Era of Media

Today, Spotify hosted our third Investor Day in New York City, offering the fina...

21/05/2026

Spotifys Investor Day 2026: Ambitioniert in die nchste ra der Medien

Spotify hat heute seinen dritten Investor Day in New York City veranstaltet und der Finanzwelt tiefere Einblicke in das Gesch ft, die Produktstrategie und die l...

21/05/2026

Rcapitulatif de l'Investor Day 2026 de Spotify : Des ambitions renouveles pour la prochaine re des mdias

Aujourd'hui, Spotify a organis son troisi me Investor Day New York. En pl...

21/05/2026

Il riepilogo dell'Investor Day 2026 di Spotify: eleviamo le ambizioni per la prossima era dei media

Oggi, a New York City, Spotify ha presentato il suo terzo Investor Day, offrendo...

21/05/2026

Resumen del Investor Day 2026 de Spotify: elevando la ambicin para la prxima era de los medios

Hoy Spotify celebr su tercer Investor Day en Nueva York, donde ofrecimos a la c...

21/05/2026

Rangkuman Investor Day Spotify 2026: Meningkatkan Ambisi untuk Era Media Berikutnya

Hari ini, Spotify menyelenggarakan Investor Day yang ketiga di New York City, me...

21/05/2026

2026 (Investor Day):

2026 : (Investor Day) , , . ...

21/05/2026

2026 :

20 2026 ...

21/05/2026

Resumo do Investor Day 2026 do Spotify: elevando a ambio para a prxima era da mdia

Hoje, o Spotify realizou seu terceiro Investor Day em Nova York, oferecendo co...

21/05/2026

2026: Spotify

Spotify Investor Day ...

21/05/2026

Spotify'n 2026 Investor Day zeti: Medyann Yeni a in Byk Hedefler

Spotify bug n, 20'nci y l d n m m z kutlad m z bu y lda, finans camias na, i modelimiz, r n stratejimiz ve uzun vadeli vizyonumuz hakk nda daha detayl ...

21/05/2026

Cinematic Motion & Ethereal Flows for Sonuscore's The Score

Two new Story Packs join orchestral instrument line-up Sonuscore have just introduced two new additions to The Score, marking the instrument's first maj...

21/05/2026

Heavyocity release Oblivion Drums

30,000 samples, 99 presets & 504 loops Heavyocity are well known for their hard-hitting cinematic instruments, and their latest release is no exception to t...

21/05/2026

Rohde & Schwarz AI powered voice to data: The future of air traffic control takes flight at Airspace World 2026

Rohde & Schwarz AI powered voice to data: The future of air traffic control take...

21/05/2026

Redefining Persistent and Affordable Airpower for Special Operations Forces

SKY RAIDER II INTERNATIONAL's modular open systems architecture delivers expanded operational reach and mission flexibility....

21/05/2026

From Payload to Platform: Autonomous ISR Where It Actually Matters

ASO-enabled WESCAM MX-10 systems conduct systematic wide-area maritime search patterns, autonomously managing sensor scan operations to expand coverage, reduce ...

21/05/2026

Sports content accounts for fastest-growing portion of top global SVOD catalogs

HBO Max, a new addition to Gracenote Data Hub, is home to the most sports programming among major streamers NEW YORK May 21, 2026 New analysis by Gracenote...

21/05/2026

Study: Nearly Half of U.S. Viewers Watch Video With Captions

Share Copy link Facebook X Linkedin Bluesky Email...

21/05/2026

Apple TV to Capture MLS Game Entirely on iPhone 17 Pro

Share Copy link Facebook X Linkedin Bluesky Email...

21/05/2026

MPTS 2026 Draws Record Numbers for Landmark 10th Annivers...

The UK's leading event for the creative industries united thousands of professionals for two days of networking, debate, industry insight and getting hands-...