Beyond Counting Pixels: Defining Resolution in Spherical
30/06/2017
Jun 21, 2017
By David Newman, Technical Fellow at GoPro
GoPro's sneak preview announcement of the upcoming Fusion camera came with one key specification, a resolution of 5.2K, creating speculation on where that number comes from. This might sound like a classic resolution race, where 5.2K is better than 4K, however establishing an effective resolution for a 360 camera is more complicated than single lens cameras and I'd like to outline how we've arrived at that number from a technical perspective.
My colleague, Daniel Sherer, recently published his thoughts about what 5.2K allows him to achieve as a filmmaker using OverCapture, and that piece provides some context to why 5.2K is an important benchmark for us from a product-standpoint. But scientifically speaking, the range of manufactures have yet to agree on a standard methodology for this key spec, so I'd like to share the thinking for how we arrive at 5.2K and how we think the industry should be standardizing these calculations.
RESOLUTION IN A SINGLE-LENS CAMERA
There are engineering standards that measure resolution, such as the ISO 12233 specification, but sadly you don't find these results in the specs for your average consumer camera. Instead, resolution for all single lens consumer cameras is based on the number of pixels encoded. If the marketing material for a camera states it is 4K, then 3840x2160 pixels from an image sensor should be encoded. For reasons beyond this article, when describing resolution, a K is equivalent to 960 pixels, e.g. your 4K TV is 3840 pixels wide (4 x 960 = 3840). Other factors like lens sharpness, spot size, over-sampling, debayering quality, and compression level are not mentioned, yet these all have significant impact on the perceived resolution. And as we all know, not all 4K cameras are equal, which is why I love a good camera shootout on YouTube or Vimeo - keep them coming! For a 360 camera, the number of pixels encoded is even less useful for defining resolution.
DEFINING RESOLUTION IN 360
With all full sphere 360 cameras, we have multiple image sensors, as no single lens can see everything. For example, in GoPro's Omni camera system, six HERO4 Black Edition cameras are each shooting 2704x2032. So does that mean the resolution should be 6x2704x2032? Well, no, it doesn't. That is the amount of pixel data collected, but it is not the resolution of the stitched 360 image. To produce a 360 image, there is intentional overlap between the cameras with each camera capturing a small segment seen by an adjacent camera. The greater the overlap, the better the stitch quality, however the lower the effective resolution since redundant pixels do not add to the final output. Omni stitches up to 8K, which is the standard 7680 pixels by 3840 (using the common equirectangular 360 projection). Again 8K = 8 x 960 or 7680 pixels. Here, the 8K is the number of pixels across the horizon-line, the unique number of pixels from left to right before the image would repeat. The number pixels across the horizon is a good indicator for resolution, as it is independent of 360 projection type and it is not falsely counting overlap regions as active pixels, so this is what GoPro is using for all our 360 products. 4K 360 means at least 3840 pixels are used across the horizon. 6K is at 5760 pixels, and 5.2K is at least 4992 pixels across the horizon [see figure 1]. All resolutions are determined after stitching.
figure 1
LENS DISTORTION
A final consideration is lens distortion. The preferred lens for any 360 imaging-system is an ideal fisheye, yet no lenses are perfect. For consumer-spherical cameras using a two-lens configuration, with each shooting a field-of-view greater than 180 , there is more distortion at the edges - the most deviation from the ideal lens curvature. The lenses typically have more resolution looking straight forward than they do shooting images 90 off-axis, where the stitch occurs. The average resolution would be somewhere between the front and side views.
While this lens distortion does impact the distribution of resolution (again not all 360 cameras will be equal) the average resolution for any 360 system can be simply determined without stitching. In a dual lens system, the active pixels are within the 180 circle that each lens captures. From the typically 200 + image captured (which includes the overlap for stitching), you can easily determine the resolution using a distant object appearing in both lenses. The number of pixels across the sphere can be measured as the diameter to the same object in each lens, added for the average 360 resolution [see figure 2].
figure 2
WHY 5.2K?
With Fusion it is straight forward to determine an average 360 resolution of 6K for photos, and 5.2K for 30p video. However, GoPro's goal for releasing our first integrated 360 camera with a resolution beyond 5K, was not about specsmanship. A Fusion camera is compelling, even for those with no plans on shooting for VR. As Daniel Sherer pointed out in his recent byline, through OverCapture a user can create a virtual GoPro image from a 360 image with an output resolution equivalent to 1080p HD.
5.2K is the base resolution required to simulate a GoPro shooting in 1080p pointed in any direction. With Fusion's 5.2K resolution, and the flexibility it offers in both immersive capture and capture for flat screens, we are excited to be taking the first step to starting the next revolution in POV capture.
LINK: | https://gopro.com/news/beyond-counting-pixels--defining-resolution-in-... |
See more stories from gopro |
Most recent headlines
04/08/2024
Dalet Appoints Santiago Solanas as CEO to Lead Next Era of Growth and Innovation
Dalet, a leading technology and service provider for media-rich organizations, is excited to announce Santiago Solanas as its new Chief Executive Officer (CEO)....
03/06/2024
Dalet and Veritone Reach Agreement to Distribute, Transact and Monetize Media Archives
Dalet, a leading technology and service provider for media-rich organizations, a...
15/05/2024
Netflix to Stream Live Christmas Day NFL Games
In a major example of how large streaming services are successfully battling for lucrative sports rights, Netflix has announced that it has secured global right...
15/05/2024
NAB Show: Creative Lens on Live Sports
LAS VEGAS The premise of the 2024 NAB Shows Creative Lens on Live Sports: Next Gen Video Production and Fan Experiences session was very simple to understand if...
15/05/2024
ATEME Integrates Advanced HDR by Technicolor into TITAN Encoders
SILVER SPRINGS, Md. Encoder specialist ATEME has integrated Advanced HDR by Technicolor into its TITAN video compression solution, Technicolor said today....
15/05/2024
Berklee Artists to Perform at Major US Music Festivals this Summer and Fall
Berklee Artists to Perform at Major US Music Festivals this Summer and Fall The Berklee Popular Music Institute arranged placements at top festivals including...
15/05/2024
ABC Sets The Golden Bachelorette' for Fall Schedule
ABC shared its 2024-2025 fall schedule hours before the Disney upfront presentation Tuesday, May 14. There's The Golden Bachelorette, a new Ryan Murphy show...
15/05/2024
Alicia Keys Kicks Off Amazon Upfront Show, Reese Witherspoon Wraps It Up
Amazon's first-ever upfront presentation, at Pier 36 in Lower Manhattan, got a late start due to its remote location. But the energy spiked when Alicia Keys...
15/05/2024
Disney Upfront Welcomes Back Bob Iger and Jimmy Kimmel
The Walt Disney Co.'s upfront presentation went on with a connections theme, and Bob Iger himself appeared onstage moments after it began. Emma Stone introd...
15/05/2024
Hulu's Under the Bridge' Tops TVision Power Score Rankings
Hulu's Under the Bridge moved up to take the top spot in TVision's Power Score rankings of the top shows on connected TV for the week of May 6....
15/05/2024
The CW Gets Rights to 11 PAC-12 Football Games
BURBANK, Calif. The CW Network has announced it will be the broadcast home for 11 Pac-12 football games featuring Oregon State and Washington State during the u...
15/05/2024
Nielsen: Disney Is Top Media Distributor with 11.5% of TV Usage
NEW YORK Disney has landed on top of Nielsens newly launched Media Distributor Gauge, which offers its first cross-platform view of total TV consumption across ...
15/05/2024
Max Sets a May 21 Streaming Debut for 'Dune: Part Two
Warner Bros. Discoverys Max streaming services has finally set a launch date for Dune: Part Two with the announcement that the film will begin streaming on Thur...
15/05/2024
FCC Establishes Spectrum Steering Team
WASHINGTON, D.C. FCC Chairwoman Jessica Rosenworcel has announced the establishment of the Spectrum Steering Team that will lead the FCC's efforts to develo...
15/05/2024
Gary Heelas joins TSL as principal engineer
TSL said the appointment marks a strategic enhancement in the companys commitment to focusing on UK and US-designed and manufactured solutions By Jenny Priestl...
15/05/2024
Is Sony about to pull out of its bid for Paramount?
Sony and Apollo may decide to acquire Shari Redstone's National Amusements, which is the controlling shareholder of Paramount Global By Jenny Priestley P...
15/05/2024
Presteigne Broadcast Hire enters administration
The company appointed administrators yesterday (May 14th) By Jenny Priestley Published: May 15, 2024 The company appointed administrators yesterday (May 1...
15/05/2024
Matrox Video Demos at InfoComm 2024 Will Showcase New AVo...
Technology innovator Matrox Video today announced that the company will highlight its leading AV-over-IP (AVoIP) technologies including the brand-new, next-g...
15/05/2024
RMi Amplifies Connectivity and Clarity at Major 2024 Musi...
Riedel Communications today announced its pivotal role in bringing unparalleled audio clarity and connectivity to one of the U.S.'s biggest 2024 music and a...
15/05/2024
Chyron Unveils Significant Updates to Chyron LIVE Cloud P...
Chyron today released a series of significant updates to its Chyron LIVE cloud-native live production platform that were demonstrated at the 2024 NAB Show in La...
15/05/2024
VisualOn to Showcase Revolutionary Optimizer Content-Awar...
VisualOn, a leader in video software technology, is set to unveil its groundbreaking Optimizer suite at Broadcast Asia 2024. The unveiling will take place in th...
15/05/2024
StreamVue announce exclusive parnership with DigiBox
StreamVue, one of the global leaders in IPTV and digital signage solutions is excited to announce an exclusive distribution partnership with DigiBox, one of the...
15/05/2024
Vega Project Uses Blackmagic Design Workflow for XR Studio in Hilton Tokyo
Vega Project Uses Blackmagic Design Workflow for XR Studio in Hilton Tokyo Brie Clayton May 14, 2024 0 Comments Blackmagic Design announced today that...
15/05/2024
Chaos Releases V-Ray 6 Benchmark
Chaos Releases V-Ray 6 Benchmark Brie Clayton May 14, 2024 0 Comments Popular Rendering Benchmark Brings Back CPU/GPU Stats in a Minute; New Benchmark...
15/05/2024
Rose City Futsal Sets New Standard for Community Sports Venues with AI-Automated Sports Production & Streaming Solution
Rose City Futsal Sets New Standard for Community Sports Venues with AI-Automated...
15/05/2024
That Station Artist Notes Series Returns This Summer
Artist Notes is back! Join That Station this summer for the conversation and concert series where you get to hear an artist on stage to not only play music, but...
15/05/2024
Assembling Disney's Upfront: It Takes More Than Magic (Video)
A lot goes into making The Walt Disney Co.'s upfront presentation....
15/05/2024
Madhive Names Premion Founder Jim Wilson President
Madhive, which provides technology for local connected TV advertising, said that it named Jim Wilson as president....
15/05/2024
Amazon Prime Video Swings With Nicholas Cage Spider-Man Series
At its first upfront presentation to advertisers, Amazon Prime Video announced new series and renewed some of its hits....
15/05/2024
Nielsen Crowns Disney in New Ranking of Media Distributors
Nielsen released a new ranking of companies in the media distribution business, including broadcast, cable and streaming, and The Walt Disney Co. was at the top...
15/05/2024
Latin Culture Is Key at TelevisaUnivision Upfront
TelevisaUnivision told advertisers at its upfront presentation Tuesday about more ways they can connect with Latin culture, including through music and live eve...
15/05/2024
2024-05-15
Apple Watch is a versatile device for golfers to stay connected, active, and healthy, and a suite of great golfing apps offers users course information, as well...
15/05/2024
Getting transparent about the AATP - what you need to know
What is the AATP initiative? David: The Advanced Advertising Transparency Programme (AATP) is a set of standards that has been collectively agreed by the online...
15/05/2024
Tonight on Smoke and Mirrors: Tiny is intimidated by Petunia and tries to have her removed from the hotel
Tonight on Smoke and Mirrors: Tiny is intimidated by Petunia and tries to have h...
15/05/2024
The Pocket Queen | Take the Leap | Quantum Audio Interfaces
Professional drummer, producer, and New Orleans native talks about taking the leap. A life in music requires passion, creativity, and dedication - and for many...
15/05/2024
Fire It Up: Mozilla Firefox Adds Support for AI-Powered NVIDIA RTX Video
Editor's note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible, and which showcases new hardware, ...
15/05/2024
How Basecamp Research Helps Catalog Earth's Biodiversity
Basecamp Research is on a mission to capture the vastness of life on Earth at an unprecedented scale. Phil Lorenz, CTO at Basecamp Research, discusses using AI ...
15/05/2024
Needle-Moving AI Research Trains Surgical Robots in Simulation
A collaboration between NVIDIA and academic researchers is prepping robots for surgery. ORBIT-Surgical - developed by researchers from the University of Toront...
14/05/2024
Give Me the Backstory: Get to Know Stephen Maing, the Co-Director of Union
By Lucy Spicer One of the most exciting things about the Sundance Film Festival is having a front-row seat for the bright future of independent filmmaking. Whi...
14/05/2024
The Making of The Fall Guy
The feature film The Fall Guy marks the latest collaboration between director David Leitch and cinematographer Jonathan Sela, ASC. Sela describes the movie as ...
14/05/2024
Aerojet Rocketdyne to be Propulsion Provider for the Next Generation Interceptor
Notional render of Lockheed Martins Next Generation Interceptor. Credit: Lockheed Martin...
14/05/2024
5 Misconceptions About Satellite Imagery, Part 2
Access to commercial satellite imagery has become increasingly democratized. Students, startups, researchers and casual enthusiasts are leveraging satellite dat...
14/05/2024
Grass Valley Equips Fujairah TV with Advanced Live Production Technology
Montreal, Canada - May 14, 2024 - Grass Valley, a leader in live production solutions, proudly announces its collaboration with Fujairah TV, a prominent broadca...
14/05/2024
OpenVault Harnesses Generative AI to Improve Broadband Networks
JERSEY CITY, N.J. & COLOGNE, Germany OpenVault has released new details about how it is leveraging the power of Generative AI to significantly and securely expa...
14/05/2024
Comcast Plans Peacock, Netflix, Apple TV+ Streaming Bundle
Comcast is planning to begin offering a new streaming bundle of Peacock, Netflix and Apple TV+ sometime later this month at a vastly reduced price, Comcast ch...
14/05/2024
Chyron Releases Enhancements For LIVE Cloud Production Platform
MELVILLE, N.Y. Chyron has released a series of updates for its LIVE cloud-native production platform....
14/05/2024
CueScript announces passing of founder Brian Larter
Larter co-founded CueScript with Michael Accardi in 2014 By Jenny Priestley Published: May 14, 2024 Updated: May 15, 2024 Larter co-founded CueScript wi...
14/05/2024
EMG Gravity Media Showcases its Combined Live Broadcast E...
EMG / Gravity Media, will be sharing the Group's knowledge and expertise at The Media Production & Technology Show (MPTS), held on 15th and 16th May in Lond...
14/05/2024
Glensound highlights the latest in networked audio at Bro...
Glensound, industry leader in high quality audio systems, is showcasing the latest additions to its extensive portfolio of networked audio products at Broadcast...
14/05/2024
Spotlight on UK Media Tech Vendors at BroadcastAsia
The GREAT Britain and Northern Ireland pavilion at BroadcastAsia 2024 (stand 6I1-5, Singapore Expo, 29 31 May) puts a group of innovative and dynamic media te...