Tools Of The Trade
Oct 23, 2019
The following words are by GoPro Technical Fellow David Newman and Spherical Software Manager Daryl Stimm.
With the release of GoPro MAX, weve introduced some unique, new 360 modes and features as well as a .360 file format that set MAX apart from existing 360 cameras, including GoPro Fusion.
And now that MAX is out in the wild, we want to share the backstory of some of MAXs inner workings that tech specs at face value, especially in 360 capture, just cant convey properly. Take resolution for example, specficially the difference between capture and stitched resolutions. With MAX, spherical videos are captured at 6K resolution and stitched to 5.6K, and spherical photos are captured at 18MP resolution and stitched to 16.6MP. Two different resolutions, one incredible output-read on to find out how.
To get started, it's best to look at the key goals we identified when we started developing MAX:
Significantly decrease the time users spend editing 360 in post-production
Simplify media management
Increase final stitched resolution output
Maintain playback compatibility with mobile devices
Fine grain control of stabilization options
Improve the spherical stitching and blending quality established with Fusion
In order to achieve these goals, we focused on the following key technical areas:
In-camera stitching
Encoding to a single MP4 file
Creative use of a new 360 projection
Improving processing of sensor data store as metadata
Perfecting a multi-lens blend
Thanks in large part to the power of the GP1 Chip that is the heart of MAX, we are proud to report that all of these goals are achieved with MAX. However, when faced with a camera that captures source resolutions of 6K video and 18MP photos, even with the power of GP1 on our side, some tricky challenges arose.
For example, once you have a 5.6K stitched equirectangular video, that is equivalent to a resolution of 5376x2688, which is near impossible to encode with a modern encoder and, to make things more challenging, most high-end devices (PCs and smartphones alike) struggle to decode such a large file. Most decoders are only optimized around UHD (4K), which is 3840x2160-that is a difference of 6,156,288 pixels! So, we knew that encoding to the 5.6K resolution wouldn't be feasible, but if we changed the projection, we could fit the same amount of resolution into a much smaller container size.
The best projection for this is Google's Equal Area Cubemap, or EAC. EAC has a 25 percent drop in pixels for the same resolution as equirectangular. This can easily be seen in the image below where there are redundant pixels at the poles in equirectangular, but each face of the cube map is equal area in EAC (hence the name). This, in turn, allows us to pack 5.6k into a container of 4032x2688-3,612,672 less pixels! Sadly, this file is also too large for most decoders to play back smoothly, so we had to employ one more trick. And it happens to be one of our favorites.
By breaking the top and bottom faces of the cube map into two separate video tracks, this creates two videos at the resolution of 4032x1344. 4032x1344 is very easy for all UHD decoders play back. And if said decoder can decode one 4032x1344 file, it should have no problem decoding two. That did the trick! So, we built a special player that can decode both streams in real time and re-project them into a sphere. You can see this in action with the GoPro App and the newly released GoPro Player for Desktop.
Now, on to the next challenge. We still needed to provide users a way to convert these .360 files into standard videos or convert them into the larger equirectangular projection for upload to YouTube or 360 editors, such as Adobe Premiere Pro and Final Cut Pro. This is now much faster thanks to it being packaged in a stitched EAC format.
Because of this success, and knowing that Google is also using EAC to power YouTube 360 playback, we really hope to help in propelling EAC as the future standard. Once more tools start to support EAC, we will be able to skip this conversion step altogether and save even more time since no reprojection is needed.
Another huge advantage of EAC over the previous standard (dual fisheye) is that there is no need to encode unused pixels. Previously, we had to encode a round image into a square container, leaving the encoded edges completely unused. With EAC encoding 25 percent less pixels than Fusion, we can achieve a net bitrate increase even though the overall bitrate is less, meaning much smaller file sizes. File sizes get even smaller with one final MAX advantage. With MAX, we are also encoding in HEVC, and 60Mbps in HEVC is equivalent to 90Mbps with H.264.
Here is an example of Equirectangular:
Here is an example of EAC. Notice the savings in pixels since we don't have any redundancy, and everything is equal area. We can compact the same number of pixels in a much smaller container.
Now let's talk stitching and blending. Where the stitch aligns the front and back images, automatically correcting for near and far object parallaxes, the blend balances the exposure differences between the front and back lens. When we developed Fusion, we set the industry bar very high for stitching and blending, and we did so by combining the overlap on the 194 dual fisheyes.
With MAX, we are proud to say we are again setting the bar by retaining the small overlapped areas inside the EAC projection. While the stitching is completed in MAX, the blending is enhanced by retaining a small overlap in post to improve quality even beyond that of Fusion. We did this by adding overlap areas on the stitch line and increasing the width of the EAC projection by an additional 64 pixels.
The image below shows overlap areas outlined in red.
The following image shows these areas blended correctly. Notice th
Most recent headlines
11/12/2025
Dalet, a leading provider of cloud-native, end-to-end media workflow solutions, ...
06/12/2025
In a live broadcast from the Reagan National Defense Forum, L3Harris Chair and CEO Christopher Kubasik joined Morgan Brennan on CNBCs Closing Bell: Overtime. Ku...
06/12/2025
FORT LAUDERDALE, Fla. A new survey from Pixitmedia by Datacore revealed a major shift in the Media & Entertainment industry in media archiving, with 85% of resp...
06/12/2025
HACKENSACK, N.J. LiveU has announced that the national public broadcaster Czech Television has completed one of the largest LiveU live production deployments fo...
06/12/2025
NEW YORK The National Academy of Television Arts and Sciences (NATAS) presented the Excellence in Production Technology Emmy Award to NASA+ and Dr. Tom Leight...
05/12/2025
2025 Sports Broadcasting Hall of Fame: Curt Gowdy Jr. - Master Storyteller, Nati...
05/12/2025
SVG Sit-Down: Veritone's Sean King on the Power of Mining Video, Audio DataThe company's Data Refinery offers users total control and governance over da...
05/12/2025
Platinum White Paper: Inside the Nashville Predators' Unified, Flexible, Sca...
05/12/2025
Netflix Reaches Agreement To Acquire Warner Bros. Following Planned WBD SplitThe deal does not include WBDs sports assets like TNT Sports (US, UK, LatAm), Euros...
05/12/2025
FOX Sports Returns to Indianapolis for Primetime Broadcast of Big Ten Championsh...
05/12/2025
SVG Summit 2025 Preview: Digital Engagement & Monetization Workshop Tackles the ...
05/12/2025
Atlanta United Lights Up New Emory Healthcare Studio With First Live Broadcast f...
05/12/2025
As Messi Takes the Pitch, MLS, Apple, NEP Roll Out Largest MLS Cup Production Ev...
05/12/2025
ESPN Enters College Football's Most Intense Month With Elevated Workflows fo...
05/12/2025
It's about that time! Awards season is in full swing, and the Film Independe...
05/12/2025
Every year, Spotify Wrapped offers a personalized look back at the audio that defined your year. It's a snapshot of your listening habits, designed to tell ...
05/12/2025
In 2025, Spotify's EQUAL, GLOW, and RADAR programs celebrated women, LGBTQIA , and emerging artists who turned moments into milestones. From breaking record...
05/12/2025
In our latest blog, we explain how Wi-Fi 7 rollouts can drive consumer loyalty with value-add services such as consumer cybersecurity. We also explore how this ...
05/12/2025
LOS ANGELES Netflix announced it has entered into an agreement to acquire the assets of Warner Bros. for $82.7 billion....
05/12/2025
NEW YORK Nielsens Gracenote has launched Gracenote Content Connect, a new ad platform that provides agencies, brands, supply-side platforms (SSPs) and demand-si...
05/12/2025
NEW YORK In an most important update to the workings of deal-based programmatic advertising, IAB Tech Lab has released version 1.0 of its Deals API for public c...
05/12/2025
NEW YORK Pass the turkey. Pass the stuffing. Pass the cranberry sauce. All are common requests of Americans celebrating Thanksgiving Day with family and f...
05/12/2025
NEW YORK Iris, the new cloud-connected camera control platform, has officially launched with features that turn virtually any PTZ camera into a software-connect...
05/12/2025
HOLLYWOOD, Calif. Netflix announced today that it has entered into an agreement to acquire the assets of Warner Bros. for $82.7 billion....
05/12/2025
NEW YORK Iris, the new cloud-connected camera control platform, has officially launched with features that turn virtually any PTZ camera into a software-connect...
05/12/2025
WASHINGTON The Federal Communications Commission has approved AT&T's $1.02 billion acquisition of spectrum from UScellular in a decision that was issued sho...
05/12/2025
The Best Coldplay Songs: 21 Tracks That Shoot for the Stars From Yellow to Viva La Vida, Fix You to Paradise, this playlist goes back to the start.
December ...
05/12/2025
Zafris Lecture Series Brings Nabil Ayers to Berklee The 32nd annual James G. Zafris Distinguished Lecture series was held on Thursday, November 13, with guest...
05/12/2025
Introducing New Perks to Help You Get Even More from LinkedIn Premium Published on Dec 5, 2025 Categories: Company News, Product News
LinkedIn Corporate Co...
05/12/2025
Friday 5 December 2025
A new Game of Thrones Tale: Official trailer for Sky Exc...
05/12/2025
Back to All News
Don Lee, Lee Jin-uk, and Lalisa Manobal to Star in Netflix Act...
05/12/2025
Tis the season of giving once again and this year we've taken our Give Back Fridays' concept and turned it on its head.
In the autumn we were approach...
05/12/2025
Brayden Gogis doesn't remember a time when he wasn't completely fixated on games in all forms. In preschool, when they asked us to dress up as what we ...
05/12/2025
The Grinch steals the spotlight as the theme for The Late Late Toy Show 2025
Tune in tonight at 9:35pm on RT One and worldwide on RT Player
#LateLateToyShow...
05/12/2025
RT Announces New Presenters of Flagship News Programmes
New RT Six One News co-presenter Tommy Meskill
Sarah McInerney & Justin McCarthy join Morning Ir...
04/12/2025
ToolsOnAir Blackmagic Design HyperDeck Event Presets for just:in mac pro 2025 & ...
04/12/2025
ToolsOnAir AJA Ki Pro Event Presets for just:in mac pro 2025 & just:in linux
More Details:Starting with version 5.5, both just:in mac pro and just:in linux sol...
04/12/2025
Wangu Kanuri from Kenya and Godwin Asediba from Ghana are two of this years finalists for Thomsons Young Journalist of the Year Award. The pair are runners-up i...
04/12/2025
SVG Sit-Down: ProximaVision's Claudio Lisman on Why Tethered Drones Could Be...
04/12/2025
SVG Campus Shot Callers: Imry Halevi, Senior Associate Director of Athletics, Co...
04/12/2025
Platinum White Paper: LiveU Lightweight Sports Production: A Step Change in Spor...
04/12/2025
London to Riyadh: DAZN brings the boxing glamour to new production levels for Be...
04/12/2025
Analysis: Paramount bets on the battering ram' with Champions League play By Callum McCarthy, Editor-at-Large
Tuesday, December 2, 2025 - 10:12
Print ...
04/12/2025
Space City Home Network Launches SCHN DTC App for Astros and RocketsThe Rockets and Astros were previously the lone NBA and MLB teams without a DTC appBy Jason...
04/12/2025
SVG Summit 2025 Preview: Content Workflows Workshop Spotlights Evolution of Spor...
04/12/2025
New Sponsor Spotlight: Geotech's Patrick Wambold On the Unreal Engine Revolu...
04/12/2025
Curt Gowdy Jr. - Master Storyteller, Nationally and RegionallyBy Jason Dachman, Editorial Director, U.S.
Thursday, December 4, 2025 - 1:52 pm
Print This Sto...
04/12/2025
(L-R) Rebecca Lichtenfeld, Mohammadreza Eyni, Sara Khaki, and Judith Helfand att...
04/12/2025
SBS launches Future Frames initiative to support emerging First Nations video ed...
Tools Of The Trade 
