Sony Pixel Power calrec Sony

A Simple Guide to Formats and Codecs

09/04/2020

ORLANDO, Fla.- All I need is a QuickTime file. How many times have you heard this from a client? Unfortunately, that's not enough information. Here are the reasons why.

Digital files consist of format wrappers, data, and metadata. A format wrapper defines the type of file it is, as identified by the file extension, like .mpeg, .mov, .mp4, .mxf, etc. Think of a wrapper like a videocassette tape. It earmarks which player application should be compatible with that file, just like a VHS cassette told you that a VHS player was required. The data is the audio/video content contained within that format wrapper. The metadata is information about that data, such as date/time stamps, color profiles, and more.

UNDERSTANDING THEM

Audio and video signals are encoded into digital files using codecs-shorthand for compression/decompression. Most video files use data compression, whereas the audio signal in professional formats is typically uncompressed. On the other hand, consumer audio formats such as .mp3 and .m4a use a highly compressed codec. While we tend to associate certain codecs together with specific formats, like ProRes and .mov, they are not synonymous. For example, files can be encoded with the ProRes codec and stored in .mxf wrappers.

Video compression is defined as either lossy or visually lossless. This is determined by the codec type, data rate used to encode the file, frame rate, and frame size. File sizes will be smaller when a lossy method is used. But, they will display compression artifacts visible to the eye, because so much signal information is thrown away. Streaming services like Netflix and YouTube use lossy methods to get the signal to your home over the internet. Visually lossless codecs, like high bit-rate versions of the Avid DNx or the Apple ProRes family of codecs, are used in camera acquisition and post production. These codecs employ a high data rate for compression and will have significantly larger file sizes. However, compression artifacts are generally indiscernible to the eye compared to uncompressed video.

The vast majority of codecs used in production and post today are the proprietary intellectual property of companies or associations. They are not open source or open standard, even though their use may be ubiquitous. The use of a codec, especially to encode data to that codec, requires a licensing agreement. Typically, this is transparent and appears to be free to the user, but rest assured that an arrangement between companies has been made. As with all intellectual property, this can result in a codec no longer being available within an application if such an arrangement has ended between companies.

LIBRARY COMPONENTS AND THE 64-BIT TRANSITIONWhen a video file is played by an application, its data is decoded on-the-fly and displayed as RGB pixels to your screen or a viewer within the interface. This requires a set of installed library components that the application draws upon in order to read, decode, and display the video data. These components may be part of the computer's operating system or they are custom-installed components that only function for that one application.

Over time, Apple and Microsoft have dropped or deprecated support for older codecs within their own operating systems. For example, Apple's Catalina is a 64-bit operating system, with no support for 32-bit applications and library components. This means that certain codecs - including many still in active use, like DNxHD/HR-can no longer be decoded (played) through any application that depends on the 32-bit QuickTime framework used in previous versions of macOS. This is not an issue of the codec itself, but rather the library components used.

In order for such files to work within Catalina, Apple or the application developer has to write new 64-bit library components to play such files going forward. In the case of DNx, Avid and Adobe can read and write these files in the .mxf format, but Apple's own applications, like Final Cut Pro X or QuickTime Player, are not able to do the same. Expect that to be updated later this year.

WHY CAN'T I WRITE CAMERA RAW FILES IN POST?Digital video cameras convert raw sensor data into RGB pixel information and record that to a digital file using a defined codec and format. Processing is done in the camera to bake in the conversion of the Bayer pattern sensor data to RGB, along with its native ISO and a color profile. These files are then easily played by most professional editing and player applications.

Ever since the launch of RED Digital Cinema's RED One camera, compressed raw codecs have grown in popularity. When you record a camera raw signal, the conversion/processing step to RGB is skipped, thus enabling access to more latitude for color correction in post. It also generates higher quality images for an equivalent data rate and file size. The trade-off is that camera raw files tax the hardware systems used in post. That's because the conversions that would have been done in the camera are now performed in real-time by the computer.

Raw codecs store information generated by a camera's sensor and are only intended for image acquisition. You cannot write or re-encode camera raw files in post, because there is no sensor data available. Camera raw codecs are also proprietary to individual companies, including RED, ARRI, Apple, Blackmagic Design, and others. For now, there is no video equivalent to CinemaDNG, a photographic raw format developed by Adobe and then offered up as an open standard to the community. Although it could be argued that GoPro's CineForm RAW codec is a comparable solution for video.

The video from non-raw codecs can be adjusted through color correction, but you aren't actually altering the underlying color processing of the file itself. You are skewing the RGB information that
LINK: https://www.tvtechnology.com/news/a-simple-guide-to-formats-and-codecs...
See more stories from tvtechnology

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

04/08/2026

Dalet Announces Commercial Availability of Dalia, Bringing Media-Aware Agentic AI to Enterprise Productions

Dalet, a leading technology and service provider for media-rich organizations, t...

04/07/2026

Detective Conan: Fallen Angel of the Highway Opens in Dolby Cinemas Across Japan, Presented in Dolby Atmos and Dolby ...

April 7 2026, 19:00 (PDT) Detective Conan: Fallen Angel of the Highway Opens in...

01/06/2026

Dolby Sets the New Standard for Premium Entertainment at CES 2026

January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026 Throughout the week, Dolby brings to life the latest innovatio...

21/05/2026

Sports content accounts for fastest-growing portion of top global SVOD catalogs

HBO Max, a new addition to Gracenote Data Hub, is home to the most sports programming among major streamers NEW YORK May 21, 2026 New analysis by Gracenote...

21/05/2026

Study: Nearly Half of U.S. Viewers Watch Video With Captions

Share Copy link Facebook X Linkedin Bluesky Email...

21/05/2026

Apple TV to Capture MLS Game Entirely on iPhone 17 Pro

Share Copy link Facebook X Linkedin Bluesky Email...

21/05/2026

MPTS 2026 Draws Record Numbers for Landmark 10th Annivers...

The UK's leading event for the creative industries united thousands of professionals for two days of networking, debate, industry insight and getting hands-...

21/05/2026

Recreating Doug Trumbull's Slitscan VFX - After Effects Mastery

Recreating Doug Trumbull's Slitscan VFX - After Effects Mastery Graham Quince May 21, 2026 0 Comments In this After Effects tutorial, I'm divi...

21/05/2026

Cavalry: An Array of Fun Stuff

Cavalry: An Array of Fun Stuff Simon Ubsdell May 21, 2026 0 Comments Arrays are a really powerful feature of Cavalry and here we'll go over some o...

21/05/2026

Chyron Launches PRIME Scorebug

Share Copy link Facebook X Linkedin Bluesky Email...

21/05/2026

Watch Brasil Selects Bitmovin to Improve Streaming Perfor...

Bitmovin, a leading provider of video streaming solutions, has announced that streaming service provider, Watch Brasil, has replaced its legacy systems with Bit...

21/05/2026

OWC Launches Dads and Grads Promotion with Exclusive Savings

OWC Launches Dads and Grads Promotion with Exclusive Savings Brie Clayton May 21, 2026 0 Comments The gifts they'll actually use - save on cutting...

21/05/2026

Spectrum Launches New California News Networks

Share Copy link Facebook X Linkedin Bluesky Email...

21/05/2026

Vivid Unease Ashley Barron ACS Lights Netflixs How to Get...

For cinematographer Ashley Barron ACS ( Rivals , Dangerous Liaisons , Disney's Doctor Who ), setting the look of Netflix's How to Get to Heaven from ...

21/05/2026

Hensgens Pairs Airglow and LiteMat on Cannes 2026 Premier...

Jean-Fran ois Hensgens, AFC, SBC, (Tueurs, Six Days in Spring, Le Fil) brings his signature visual approach to Cannes 2026 premiering biopic L'Affaire Marie...

21/05/2026

2026 delegation for Partner with Australia (UK) initiative announced

2026 delegation for Partner with Australia (UK) initiative announced 21 May 2026 Screen Australia and Ausfilm have today announced the delegation for the 2026 ...

21/05/2026

Beeble launches Canvas, a node-based AI compositor for VFX and Virtual Production pipelines

Beeble launches Canvas, a node-based AI compositor for VFX and Virtual Productio...

21/05/2026

Shelly Johnson Elected President of American Society of Cinematographers

Shelly Johnson Elected President of American Society of Cinematographers Brie Clayton May 20, 2026 0 Comments The American Society of Cinematographers...

21/05/2026

ARRI expands Management Board to accelerate next phase of growth and innovation

ARRI expands Management Board to accelerate next phase of growth and innovation Brie Clayton May 20, 2026 0 Comments ARRI expands its Management Board...

21/05/2026

RT 2FM announces winner of nationwide search for next superstar DJ

Dublin DJ RKM333 wins 2FM competition and a coveted slot at this year's Forbidden Fruit Festival 2FM's search for the next big Irish DJ concluded this ...

21/05/2026

License to Stream: 007 First Light' Coming to GeForce NOW With an Ultimate Bundle

The mission begins now. GeForce NOW is dialing up the action with a blockbuster...

20/05/2026

New Nissan Stadium Is First NFL Venue With Permanent Built-In Music Stage

True to the Music City theme, the Tennessee Titans plan to make live music a prominent fixture on game days at the new venue Reflecting the continuing converge...

20/05/2026

NHL Taps Honeywell To Make Arenas, Facilities More Energy-Efficient

The long-term goal is innovation for the next generation of hockey rinks at both the professional and the community level The National Hockey League (NHL) toda...

20/05/2026

A Look Into the Future: What It Takes To Power the Next Generation of Sports Stadiums

End-users and vendors alike work toward cost-effective yet high-quality solution...

20/05/2026

Nasvhvilles New Nissan Stadium To Host Super Bowl LXIV in 2030

The National Football League has announced that Nashville will host Super Bowl LXIV in 2030 at the new Nissan Stadium. The announcement was made at the NFL Spri...

20/05/2026

NFL Awards Minnesota as Host Site of 2028 NFL Draft

The NFL has announced that the 2028 NFL Draft presented by Bud Light will take place in Minnesota, uniting fans from around the world to celebrate one of the mo...

20/05/2026

Lawo Highlights Edge One at InfoComm 2026

As professional AV workflows continue to evolve, expectations around audio, video, networking, and control are rising rapidly. At InfoComm 2026 in Las Vegas, La...

20/05/2026

Haivision to Showcase Video Wall, IPTV, and Ultra-Low Latency Video Innovations at InfoComm 2026

Haivision will showcase its latest innovations at InfoComm 2026, taking place fr...

20/05/2026

Spotify House Returns to CMA Fest With 3 Days of Nonstop Country Music

For the seventh year, Spotify is returning to CMA Fest with Spotify House, the festival's premiere destination for fans. We're taking over downtown Nash...

20/05/2026

Aero 2 from Acustica Audio

Amp-simulation software expanded Acustica Audio's latest release greatly expands on their amp-simulation platform, turning it into a complete amplifica...

20/05/2026

Arturia update the KeyLab Mk3

MainStage integration, Analog Lab improvements & more Arturia have just announced the release of an update that brings an assortment of new features to thei...

20/05/2026

SGL Carbon holds successful Annual General Meeting with strong approval of proposed resolutions

At the Annual General Meeting held on May 20, 2026, the shareholders of SGL Carb...

20/05/2026

From Gulkula to the nation: Yothu Yindi Foundation and NITV deepen national access to Garma Festival

From Gulkula to the nation: Yothu Yindi Foundation and NITV deepen national acce...

20/05/2026

SBS appoints David Fernandez as National Manager, Digital & TV Sales

SBS appoints David Fernandez as National Manager, Digital & TV Sales 20 May, 2026 Media releases SBS has appointed David Fernandez as National Manager, Dig...

20/05/2026

Rohde & Schwarz and INFOZAHYST: A strategic alliance set to redefine modern defense

Rohde & Schwarz and INFOZAHYST: A strategic alliance set to redefine modern defe...

20/05/2026

L3Harris Achieves Major Milestones With Latest Series of Rotating Detonation Engine Tests

A Rotating Detonation Engine being hot fire tested at Purdue University's Zu...

20/05/2026

VAMPIRE Confirms Integrated Capability During Live Exercises

A U.S. Army VAMPIRE system, assigned to Bravo Battery, 1st Battalion, 51st Air Defense Artillery Regiment, 7th Infantry Division/Multi-Domain Command - Pacific ...

20/05/2026

NCAA Tournaments Spark March Madness for Paramount and Warner Bros. Discovery in Nielsen's The Gauge

Cable Captures Only Monthly Increase Among Viewing Categories in March, Earns it...

20/05/2026

The Gauge: Poland | April 2026

April brought a symbolic decrease in the overall time spent in front of television screens. On average, Poles watched video content for 3 hours and 51 minutes a...

20/05/2026

DirecTV Asks FCC to Block Scripps' INYO Acquisition

Share Copy link Facebook X Linkedin Bluesky Email...

20/05/2026

RTS Technology Centre Launches the RTS Technology Awards...

The Royal Television Society Technology Centre today announces the launch of the RTS Technology Awards 2026, celebrating excellence, innovation and achievement ...

20/05/2026

Lightware powers immersive video spectacle for The Hunger...

In the heart of London's financial district, the new purpose-built Troubadour Canary Wharf Theatre invites audiences to experience Suzanne Collins' inte...

20/05/2026

New LiveU LU900Q Powers Record Breaking Broadcast of the...

LiveU, the leader in live IP-video solutions, today announced that production powerhouse BCC Live successfully deployed the new LU900Q intelligent production un...

20/05/2026

Nella Mente di Narciso Docuseries Uses Blackmagic Design Workflow

Nella Mente di Narciso Docuseries Uses Blackmagic Design Workflow Brie Clayton May 19, 2026 0 Comments PYXIS 6K full frame camera and DaVinci Resolve ...

20/05/2026

Beeble launches Canvas, a node-based AI compositor for VFX and Virtual Production pipelinesx

Beeble launches Canvas, a node-based AI compositor for VFX and Virtual Productio...

20/05/2026

DSPolitical and FreeWheel Partner on Political CTV Ads

Share Copy link Facebook X Linkedin Bluesky Email...

20/05/2026

Amazon, Netflix and Google to Capture Half of CTV Ad Market by 2030

Share Copy link Facebook X Linkedin Bluesky Email...

20/05/2026

Roku Introduces 'Creator Hub

Share Copy link Facebook X Linkedin Bluesky Email...

20/05/2026

First Nations Factual Co-production Development Fund launched to elevate Indigenous storytelling in global markets

First Nations Factual Co-production Development Fund launched to elevate Indigen...