Sony Pixel Power calrec Sony

A Simple Guide to Formats and Codecs

09/04/2020

ORLANDO, Fla.- All I need is a QuickTime file. How many times have you heard this from a client? Unfortunately, that's not enough information. Here are the reasons why.

Digital files consist of format wrappers, data, and metadata. A format wrapper defines the type of file it is, as identified by the file extension, like .mpeg, .mov, .mp4, .mxf, etc. Think of a wrapper like a videocassette tape. It earmarks which player application should be compatible with that file, just like a VHS cassette told you that a VHS player was required. The data is the audio/video content contained within that format wrapper. The metadata is information about that data, such as date/time stamps, color profiles, and more.

UNDERSTANDING THEM

Audio and video signals are encoded into digital files using codecs-shorthand for compression/decompression. Most video files use data compression, whereas the audio signal in professional formats is typically uncompressed. On the other hand, consumer audio formats such as .mp3 and .m4a use a highly compressed codec. While we tend to associate certain codecs together with specific formats, like ProRes and .mov, they are not synonymous. For example, files can be encoded with the ProRes codec and stored in .mxf wrappers.

Video compression is defined as either lossy or visually lossless. This is determined by the codec type, data rate used to encode the file, frame rate, and frame size. File sizes will be smaller when a lossy method is used. But, they will display compression artifacts visible to the eye, because so much signal information is thrown away. Streaming services like Netflix and YouTube use lossy methods to get the signal to your home over the internet. Visually lossless codecs, like high bit-rate versions of the Avid DNx or the Apple ProRes family of codecs, are used in camera acquisition and post production. These codecs employ a high data rate for compression and will have significantly larger file sizes. However, compression artifacts are generally indiscernible to the eye compared to uncompressed video.

The vast majority of codecs used in production and post today are the proprietary intellectual property of companies or associations. They are not open source or open standard, even though their use may be ubiquitous. The use of a codec, especially to encode data to that codec, requires a licensing agreement. Typically, this is transparent and appears to be free to the user, but rest assured that an arrangement between companies has been made. As with all intellectual property, this can result in a codec no longer being available within an application if such an arrangement has ended between companies.

LIBRARY COMPONENTS AND THE 64-BIT TRANSITIONWhen a video file is played by an application, its data is decoded on-the-fly and displayed as RGB pixels to your screen or a viewer within the interface. This requires a set of installed library components that the application draws upon in order to read, decode, and display the video data. These components may be part of the computer's operating system or they are custom-installed components that only function for that one application.

Over time, Apple and Microsoft have dropped or deprecated support for older codecs within their own operating systems. For example, Apple's Catalina is a 64-bit operating system, with no support for 32-bit applications and library components. This means that certain codecs - including many still in active use, like DNxHD/HR-can no longer be decoded (played) through any application that depends on the 32-bit QuickTime framework used in previous versions of macOS. This is not an issue of the codec itself, but rather the library components used.

In order for such files to work within Catalina, Apple or the application developer has to write new 64-bit library components to play such files going forward. In the case of DNx, Avid and Adobe can read and write these files in the .mxf format, but Apple's own applications, like Final Cut Pro X or QuickTime Player, are not able to do the same. Expect that to be updated later this year.

WHY CAN'T I WRITE CAMERA RAW FILES IN POST?Digital video cameras convert raw sensor data into RGB pixel information and record that to a digital file using a defined codec and format. Processing is done in the camera to bake in the conversion of the Bayer pattern sensor data to RGB, along with its native ISO and a color profile. These files are then easily played by most professional editing and player applications.

Ever since the launch of RED Digital Cinema's RED One camera, compressed raw codecs have grown in popularity. When you record a camera raw signal, the conversion/processing step to RGB is skipped, thus enabling access to more latitude for color correction in post. It also generates higher quality images for an equivalent data rate and file size. The trade-off is that camera raw files tax the hardware systems used in post. That's because the conversions that would have been done in the camera are now performed in real-time by the computer.

Raw codecs store information generated by a camera's sensor and are only intended for image acquisition. You cannot write or re-encode camera raw files in post, because there is no sensor data available. Camera raw codecs are also proprietary to individual companies, including RED, ARRI, Apple, Blackmagic Design, and others. For now, there is no video equivalent to CinemaDNG, a photographic raw format developed by Adobe and then offered up as an open standard to the community. Although it could be argued that GoPro's CineForm RAW codec is a comparable solution for video.

The video from non-raw codecs can be adjusted through color correction, but you aren't actually altering the underlying color processing of the file itself. You are skewing the RGB information that
LINK: https://www.tvtechnology.com/news/a-simple-guide-to-formats-and-codecs...
See more stories from tvtechnology

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

04/08/2026

Dalet Announces Commercial Availability of Dalia, Bringing Media-Aware Agentic AI to Enterprise Productions

Dalet, a leading technology and service provider for media-rich organizations, t...

04/07/2026

Detective Conan: Fallen Angel of the Highway Opens in Dolby Cinemas Across Japan, Presented in Dolby Atmos and Dolby ...

April 7 2026, 19:00 (PDT) Detective Conan: Fallen Angel of the Highway Opens in...

01/06/2026

Dolby Sets the New Standard for Premium Entertainment at CES 2026

January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026 Throughout the week, Dolby brings to life the latest innovatio...

02/05/2026

Dalet Flex LTS Delivers Smarter Search, Faster Editing, and an AI-Ready Foundation for Modern Media

Dalet, a leading technology and service provider for media-rich organizations, t...

01/05/2026

NBCUniversal's Peacock to Be First Streamer to Integrate Dolby's Full Suite of Premium Picture and Sound Innovations

January 5 2026, 18:30 (PST) NBCUniversal's Peacock to Be First Streamer to ...

16/04/2026

Telsie T - SonicWorlds extended classic German Equaliser

Vintage broadcast experts release second plug-in Telsie T is the second plug-in to be released by SonicWorld, a German audio company who specialise in servi...

16/04/2026

Softube unveil Flow Studio

Compact unit offers hands-on plug-in control Softube have just announced the launch of their latest hardware unit, the Flow Studio. Housed in a compact desk...

16/04/2026

Fiedler Audio release Armada

Use any VST3 plug-in on immersive audio Fiedler Audio have just released a powerful new plug-in wrapper that brings full VST3 processing to Dolby Atmos and ...

16/04/2026

Nugen Audio update Halo Vision

Analysis plug-in gains enhanced frequency readouts Nugen Audio's real-time analysis plug-in has just received a significant update that introduces some ...

16/04/2026

GearExpo UK Announced

Recording & Music Technology Show Sound On Sound are pleased to announce a new recording and music technology exhibition taking place in London on Saturday ...

16/04/2026

SBS reveals all-star alumni team to celebrate 70 years of the Eurovision Song Contest

SBS reveals all-star alumni team to celebrate 70 years of the Eurovision Song Co...

16/04/2026

Reimagining Earth Measurement for the AI Era: L3Harris and Xoople Develop a New Spaceborne Capability

For decades, understanding the physical world from space has required a trade-of...

16/04/2026

Locality and Nielsen Announce Landmark Integration of Media Data Engine, Transforming Local TV Measurement

The integration accelerates demographic audience delivery across local markets a...

16/04/2026

Quickplay Deploys Gray Medias New Streaming Platform

Share Copy link Facebook X Linkedin Bluesky Email...

16/04/2026

Spectrum TV App Launches On Google TV and Other Android TV Devices

Share Copy link Facebook X Linkedin Bluesky Email...

16/04/2026

Telestream Enables Multi-Cloud Media Workflows with Oracl...

Telestream Cloud Services, including Vantage Cloud, UP, and SENTRY monitoring tools, are now optimized for OCI, powering flexible multi-cloud media orchestratio...

16/04/2026

Fox Corporation Names Amazon Web Services its Preferred A...

Fox Corporation (Nasdaq: FOXA, FOX; FOX or the Company ) today announced a strategic collaboration with Amazon Web Services (AWS), naming AWS as its preferre...

16/04/2026

Triveni Digital Introduces New StreamScope Analyzer to Br...

Triveni Digital, a trusted leader in ATSC 1.0 and 3.0 service delivery, data broadcasting, and quality assurance solutions, today announced an ISDB-Tb capabilit...

16/04/2026

Synamedia and SoFast team up to accelerate FAST and OTT

Synamedia and SoFast announce strategic go-to-market partnership to accelerate FAST, pay-TV, and VOD At the NAB Show 2026, Synamedia and SoFast are announcing ...

16/04/2026

Imagine Builds on a Decade of ST 2110 Leadership at 2026...

Showcases New, Open-Standard IP Solutions Across Its Portfolio, From Production to Playout Imagine Communications is marking a decade of leadership in ST 2110 ...

16/04/2026

Roku Marks 100M Milestone

Share Copy link Facebook X Linkedin Bluesky Email...

16/04/2026

Sportway and Broadcast Solutions acquire Studio Automated...

Sportway Media Group, a world leading AI-automated sports production company and Broadcast Solutions, a leading system integrator and provider of innovative sol...

16/04/2026

AJA to Acquire Video Encoding Software Company Comprimato

Share Copy link Facebook X Linkedin Bluesky Email...

16/04/2026

NAB Show 2026: Sony Announces New Cameras, Virtual Production Tools

Share Copy link Facebook X Linkedin Bluesky Email...

16/04/2026

Synamedia launches GO Shorts

Share Copy link Facebook X Linkedin Bluesky Email...

16/04/2026

Clear-Com Introduces Arcadia and Eclipse HX Updates

Share Copy link Facebook X Linkedin Bluesky Email...

16/04/2026

AJA Enters into Agreement to Acquire Video Encoding Software Company Comprimato

AJA Enters into Agreement to Acquire Video Encoding Software Company Comprimato Brie Clayton April 15, 2026 0 Comments Deal will expand AJA's video ...

16/04/2026

Deity Announces PR-4 Compact Field Recorder with Pre-Orders Launching April 14

Deity Announces PR-4 Compact Field Recorder with Pre-Orders Launching April 14 Brie Clayton April 15, 2026 0 Comments Deity Microphones today announce...

16/04/2026

Berklee's First Homecoming Brings Global Alumni to Boston for a Block Party Celebration

Berklee's First Homecoming Brings Global Alumni to Boston for a Block Party ...

16/04/2026

One Unforgettable Night in an Unfamiliar Place Shakes Everyday Life to Its Core in Netflix's New Series The Facade of Love'

Back to All News One Unforgettable Night in an Unfamiliar Place Shakes Everyday...

16/04/2026

The Law According to Lidia Pot': How Italy's Beloved Legal Show Left a Mark on the Country

Back to All News The Law According to Lidia Po t': How Italys Beloved Lega...

16/04/2026

Fox Corporation Names Amazon Web Services its Preferred AI Cloud Provider

Fox Corporation Names Amazon Web Services its Preferred AI Cloud Provider New York, NY and Los Angeles, CA - April 16, 2026 - Fox Corporation (Nasdaq: FOXA, F...

16/04/2026

Midnight in Vegas have been revealed as the fourth act set to compete on The Late Late Show Opening Act

The search for Ireland's newest country music star takes place live on Frida...

16/04/2026

No Need for Space Gear - Capcom's PRAGMATA' Joins GeForce NOW on Launch Day

Head straight for orbit with GeForce NOW - no space helmet required. PRAGMATA,...

15/04/2026

BBC World Service TV Selects Open Broadcast Systems IP Decoders for Global Distribution

Open Broadcast Systems has announced that BBC World Service has selected its IP ...

15/04/2026

NAB 2026: LiveU Expands Collaboration with Sony to Include File-Based Workflow Integration

LiveU has announced an expansion of its collaboration with Sony Corporation, add...

15/04/2026

NAB 2026: Ateme and NVIDIA Announce Immersive Video Workflow for Apple Vision Pro

Ateme has announced a collaboration with NVIDIA to support live Apple Immersive ...

15/04/2026

Professional Fighters League Renews Multi-Year Partnership with DAZN DACH

The Professional Fighters League (PFL) has announced a multi-year partnership renewal with DAZN DACH, covering Germany, Switzerland, Austria, Liechtenstein, and...

15/04/2026

NAB 2026: Canon Sets New Benchmark with CINE-SERVO 40-1200m Lens; New Remote Camera Controller Supports Up to 200 Cameras

Canon U.S.A. (NAB Booth C3825) today took the lid off of the CINE-SERVO 40-1200m...

15/04/2026

NAB 2026: Panasonic and NEP Group to Demonstrate KAIROS and NEP Platform Integration

Panasonic Video and Audio Systems North America and NEP Group will demonstrate a...

15/04/2026

Exclusive Wasabi Report: AI Spending Is Surging, But ROI Tells a Different Story

For the fourth year running, independent analysts found businesses across all industries and verticals pay roughly the same amount in fees as they spend on stor...

15/04/2026

NBC Sports to Broadcast The Soccer Tournament Live on NBC, Peacock, and NBCSN, May 30-June 1

The Soccer Tournament (TST) has announced a media rights deal with NBC Sports to...

15/04/2026

NAB 2026: JB&A Announces Exhibitors for Pre-NAB 2026 Technology Event

JB&A will host the Pre-NAB 2026 Technology Event on April 17-18 at Flamingo Las Vegas, ahead of NAB Show. The event features hands-on demonstrations and technic...

15/04/2026

NAB 2026: Sennheiser Group to Exhibit with Spectera and AMBEO Updates

The Sennheiser Group will exhibit at NAB Show 2026 (Booth 4931, Central Hall), with demonstrations from Sennheiser, Neumann, and Merging across three areas: Rel...

15/04/2026

NAB 2026: NAB Show 2026 to Feature Expanded AI, Sports, and Creator Economy Programming

NAB Show 2026 will take place April 18-22 at the Las Vegas Convention Center, wi...

15/04/2026

NAB 2026: AI-Media Launches LEXI Text Encoder and LEXI Voice Encoder

AI-Media has announced the LEXI Text Encoder and LEXI Voice Encoder at NAB Show 2026, the company's first new encoder hardware release in more than a decade...

15/04/2026

NAB 2026: Cartoni Debuts New Camera Support Products

Italian camera support manufacturer Cartoni will introduce several new products at NAB Show 2026 (Booth C6540, Central Hall), including the Master 30 OB fluid h...

15/04/2026

NAB 2026: Lawo and swXtch.io Sign MOU to Explore groundSwXtch Integration

Lawo and swXtch.io have announced a memorandum of understanding at NAB Show 2026, under which Lawo will explore incorporating swXtch.io's groundSwXtch softw...

15/04/2026

NAB 2026: CacheFly to Demonstrate New CDN Features

CacheFly will exhibit at NAB Show 2026 (Booth W3129, April 19-22, Las Vegas Convention Center), showcasing three new additions to its content delivery platform:...