Tools Of The Trade
Oct 23, 2019
The following words are by GoPro Technical Fellow David Newman and Spherical Software Manager Daryl Stimm.
With the release of GoPro MAX, weve introduced some unique, new 360 modes and features as well as a .360 file format that set MAX apart from existing 360 cameras, including GoPro Fusion.
And now that MAX is out in the wild, we want to share the backstory of some of MAXs inner workings that tech specs at face value, especially in 360 capture, just cant convey properly. Take resolution for example, specficially the difference between capture and stitched resolutions. With MAX, spherical videos are captured at 6K resolution and stitched to 5.6K, and spherical photos are captured at 18MP resolution and stitched to 16.6MP. Two different resolutions, one incredible output-read on to find out how.
To get started, it's best to look at the key goals we identified when we started developing MAX:
Significantly decrease the time users spend editing 360 in post-production
Simplify media management
Increase final stitched resolution output
Maintain playback compatibility with mobile devices
Fine grain control of stabilization options
Improve the spherical stitching and blending quality established with Fusion
In order to achieve these goals, we focused on the following key technical areas:
In-camera stitching
Encoding to a single MP4 file
Creative use of a new 360 projection
Improving processing of sensor data store as metadata
Perfecting a multi-lens blend
Thanks in large part to the power of the GP1 Chip that is the heart of MAX, we are proud to report that all of these goals are achieved with MAX. However, when faced with a camera that captures source resolutions of 6K video and 18MP photos, even with the power of GP1 on our side, some tricky challenges arose.
For example, once you have a 5.6K stitched equirectangular video, that is equivalent to a resolution of 5376x2688, which is near impossible to encode with a modern encoder and, to make things more challenging, most high-end devices (PCs and smartphones alike) struggle to decode such a large file. Most decoders are only optimized around UHD (4K), which is 3840x2160-that is a difference of 6,156,288 pixels! So, we knew that encoding to the 5.6K resolution wouldn't be feasible, but if we changed the projection, we could fit the same amount of resolution into a much smaller container size.
The best projection for this is Google's Equal Area Cubemap, or EAC. EAC has a 25 percent drop in pixels for the same resolution as equirectangular. This can easily be seen in the image below where there are redundant pixels at the poles in equirectangular, but each face of the cube map is equal area in EAC (hence the name). This, in turn, allows us to pack 5.6k into a container of 4032x2688-3,612,672 less pixels! Sadly, this file is also too large for most decoders to play back smoothly, so we had to employ one more trick. And it happens to be one of our favorites.
By breaking the top and bottom faces of the cube map into two separate video tracks, this creates two videos at the resolution of 4032x1344. 4032x1344 is very easy for all UHD decoders play back. And if said decoder can decode one 4032x1344 file, it should have no problem decoding two. That did the trick! So, we built a special player that can decode both streams in real time and re-project them into a sphere. You can see this in action with the GoPro App and the newly released GoPro Player for Desktop.
Now, on to the next challenge. We still needed to provide users a way to convert these .360 files into standard videos or convert them into the larger equirectangular projection for upload to YouTube or 360 editors, such as Adobe Premiere Pro and Final Cut Pro. This is now much faster thanks to it being packaged in a stitched EAC format.
Because of this success, and knowing that Google is also using EAC to power YouTube 360 playback, we really hope to help in propelling EAC as the future standard. Once more tools start to support EAC, we will be able to skip this conversion step altogether and save even more time since no reprojection is needed.
Another huge advantage of EAC over the previous standard (dual fisheye) is that there is no need to encode unused pixels. Previously, we had to encode a round image into a square container, leaving the encoded edges completely unused. With EAC encoding 25 percent less pixels than Fusion, we can achieve a net bitrate increase even though the overall bitrate is less, meaning much smaller file sizes. File sizes get even smaller with one final MAX advantage. With MAX, we are also encoding in HEVC, and 60Mbps in HEVC is equivalent to 90Mbps with H.264.
Here is an example of Equirectangular:
Here is an example of EAC. Notice the savings in pixels since we don't have any redundancy, and everything is equal area. We can compact the same number of pixels in a much smaller container.
Now let's talk stitching and blending. Where the stitch aligns the front and back images, automatically correcting for near and far object parallaxes, the blend balances the exposure differences between the front and back lens. When we developed Fusion, we set the industry bar very high for stitching and blending, and we did so by combining the overlap on the 194 dual fisheyes.
With MAX, we are proud to say we are again setting the bar by retaining the small overlapped areas inside the EAC projection. While the stitching is completed in MAX, the blending is enhanced by retaining a small overlap in post to improve quality even beyond that of Fusion. We did this by adding overlap areas on the stitch line and increasing the width of the EAC projection by an additional 64 pixels.
The image below shows overlap areas outlined in red.
The following image shows these areas blended correctly. Notice th
Most recent headlines
05/01/2027
Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...
04/08/2026
Dalet, a leading technology and service provider for media-rich organizations, t...
04/07/2026
April 7 2026, 19:00 (PDT) Detective Conan: Fallen Angel of the Highway Opens in...
01/06/2026
January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026
Throughout the week, Dolby brings to life the latest innovatio...
06/05/2026
Gravity Media Chief RF Communications Engineer Glenn Willems uses Wisycom RF over Fiber and wireless solutions across major cycling events and international mar...
06/05/2026
A Sennheiser Spectera module is now available in Bitfocus Companion and Buttons, enabling direct integration of Spectera with the two software platforms. The mo...
06/05/2026
Ted Turner, the visionary media entrepreneur whose appetite for disruption helpe...
06/05/2026
Peacock is going all-in on the beautiful game - streaming all 104 FIFA World Cup...
06/05/2026
New pricing tiers for vocal/dialogue restoration tool
NoiseWorks Audio's AI-powered vocal and dialogue processing plug-in is now available in three diff...
06/05/2026
Popular mixing & routing software overhauled
Following a recent public beta test, RME have launched the final release version of the powerful mixing and rou...
06/05/2026
New SOS Video Feature
Focusrites ISA C8X is a milestone product that brings together the companys analogue heritage and their expertise in digital audio. Yo...
06/05/2026
Polands Miecznik-class frigates are part of the largest contract in Polish shipbuilding history. (Image Credit: PGZ Stocznia Wojenna)...
06/05/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
06/05/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
06/05/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
06/05/2026
Riedel Communications today announced the expansion of its leadership structure as part of a strategic initiative to strengthen both its operational management ...
06/05/2026
For nearly three decades, Veteran Production Sound Mixer and Five-time Emmy Award Winner Dirk Sciarrotta has helped define the sonic identity of the long-runnin...
06/05/2026
ZEISS CinCraft LensCore: Cinema Lens Looks for Compositing
Brie Clayton May 6, 2026
0 Comments
ZEISS announces the launch of CinCraft LensCore, a nove...
06/05/2026
Wisycom Solves Extreme RF Challenges Across Miles of Live Action for Gravity Med...
06/05/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
06/05/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
06/05/2026
Narrative Entertainment has partnered with Encompass to deliver high-quality subtitling of its Great! network content using the Altitude Intelligence AI assiste...
06/05/2026
SipRadius, widely recognized for making content processing and connectivity secure and seamless, is proud to launch a dramatic new approach to AI content creati...
06/05/2026
When the broadband and media industry gathers at ANGA COM in Cologne from May 19 to 21, Big Blue Marble will be at the forefront. The international broadcast an...
06/05/2026
Cinegy GmbH, a leading developer of software-defined television technology, is proud to exhibit at MPTS for the first time. Visitors to the stand will discover ...
06/05/2026
Val Jeanty Receives 2026 Doris Duke Artist Award Jeanty, a composer, percussionist, and turntablist, is the fourth Berklee recipient of the prestigious award ...
06/05/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
06/05/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
06/05/2026
When live cycling races and international marathons stretch for miles across cities and countryside, there is no margin for RF failure in live broadcast. As Chi...
06/05/2026
Oberkochen/Germany, May 5, 2026
ZEISS announces the launch of CinCraft LensCore, a novel solution for creating physically based cinematic lens looks for visual...
06/05/2026
06 May 2026
VEON's Kyivstar Authorized to Resell Starlink for Businesses & ...
06/05/2026
UKTV has secured the exclusive rights to the early back catalogue of iconic Australian drama series Neighbours, following a landmark content deal with Fremantle...
06/05/2026
Wednesday 6 May 2026
Sky commissions feature documentary to mark 10th anniversa...
06/05/2026
Wednesday 6 May 2026
Sky and Formula 1 agree long-term partnership across UK, Ireland and Italy
Sky in the UK & Ireland to remain the home of Formula 1 until ...
06/05/2026
Sky Zero Footprint Fund-backed TV campaign launches nationwide, supported by new...
06/05/2026
Wuppertal May 6, 2026
Riedel Expands Leadership Structure, Appoints Marc Engro...
06/05/2026
SAN JOSE, Calif. - May 6, 2026 - Harmonic (NASDAQ: HLIT) today announced its latest broadband innovations for ANGA COM 2026, highlighting its vision for a new e...
06/05/2026
Statement from Rupert Murdoch, Chairman Emeritus, Fox Corporation on Ted Turner&...
06/05/2026
Friday 8 May on RT One and RT Player
Meet the NSPCA team caring for and protecting animals in need in this six-part series
Fly on the wall, six-part series...
06/05/2026
The race to build the world's most powerful AI factories demands networking ...
06/05/2026
How changes to proteins can alter drug interactions for new precision therapies Scripps Research team maps how chemical modifications to proteins affect drug bi...
05/05/2026
Experts from the world of academia, tech, business, politics and media convened for a Thomson Talks at the Cambridge Disinformation Summit in April. It's th...
05/05/2026
Three phones were hardwired for power and transmission to the truck; camera feat...
05/05/2026
The creative studio behind campaigns for the NBA, Fanatics Sportsbook & Casino, ...
05/05/2026
Nielsen has announced results from a co-viewing pilot program covering February&...
05/05/2026
viztrick AiDi, an on-device AI solution developed by Nippon TV, delivered global...
05/05/2026
ARRI has announced Omnibar, a battery-powered, IP65-rated multi-color LED linear...
05/05/2026
Imagine Communications has announced that France T l visions is the first broadc...
05/05/2026
The Women's National Basketball Association (WNBA) and Bell Media today announced a multiyear agreement to broadcast and stream WNBA games in Canada beginni...
Tools Of The Trade 
