Sony Pixel Power calrec Sony

Decoding How AI-Powered Upscaling on NVIDIA RTX Improves Video Quality

17/07/2024

Editor's note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible, and showcases new hardware, software, tools and accelerations for RTX PC and workstation users.

Video is everywhere - nearly 80% of internet bandwidth today is used to stream video from content providers and social networks. While screens have become bigger and support higher resolutions, nearly all video is only 1080p quality or lower.

Upscalers can help sharpen streamed video and, powered by AI on the NVIDIA RTX platform, significantly enhance image quality and detail.

What Is an Upscaler? The larger file size of videos makes it harder to compress and transmit compared to images or text. Platforms like Netflix, Vimeo and YouTube work around this limitation by encoding video - the process of compressing the raw source of a video into a smaller container format.

The encoder first analyzes the video to decide what information it can remove to make it fit a target resolution and frame rate. If the target bitrate is insufficient, the video quality decreases, resulting in a loss of detail and sharpness and the presence of encoding artifacts. The smaller the file, the easier it is to share on the internet - but the worse it looks.

Typically, software on the viewer's device will upscale the video file to fit the display's native resolution. However, these upscalers are fairly simplistic, merely multiplying pixels to meet the desired resolution. They can help sharpen the outlines of objects and scenes, but the final video typically carries encoding artifacts and sometimes looks over-sharpened and unnatural.

AI Know a Better Way The NVIDIA RTX platform uses AI to easily de-artifact and upscale videos.

Easily de-artifact and upscale videos with RTX. The process of AI upscaling involves analyzing images and motion vectors to generate new details not present in the original video. Instead of merely multiplying pixels, it recognizes the patterns of the image and enhances them to provide greater detail and video quality.

Images must be first de-artifacted before any processing begins. Artifacts - or unwanted distortions and anomalies that appear in video and image files - occur due to overcompression or data loss during transmission and storage.

NVIDIA AI networks can de-artifact images, helping remove blocky areas sometimes seen in streamed video. Without this first step, AI upscalers might end up enhancing the artifacted image itself instead of the desired content.

Super-Sized Video Just like putting on a pair of prescription glasses can instantly snap the world into focus, RTX Video Super Resolution, one of NVIDIA's latest innovations in AI-enhanced video technology, gives users a clearer picture into the world of streamed video.

Click the image to see the differences between bicubic upscaling (left) and RTX Video Super Resolution (right). Available on GeForce RTX 40 and 30 Series GPUs and RTX professional GPUs, it uses AI running on dedicated Tensor Cores to remove block compression artifacts and upscale lower-resolution content up to 4K, matching the user's native display resolution.

RTX Video Super Resolution can be used to enhance all video watched on browsers. By combining de-artifacting with AI upscaling techniques, it can make even low-bitrate Twitch streams look stunningly clear. RTX Video Super Resolution is also supported in popular video apps like VLC so users can apply the same upscaling process to their offline videos.

Creators can soon use RTX Video Super Resolution in editing apps like Black Magic's Davinci Resolve, making it easier than ever to upscale lower-quality video files to 4K resolution, as well as convert standard-dynamic range source files into high-dynamic range (HDR).

Say Hi to High-Dynamic Range RTX Video now also supports AI HDR. HDR video supports a wider range of colors, lending greater detail especially to the darker and lighter areas of images. The problem is that there isn't that much HDR content online yet.

Enter RTX Video HDR - by simply turning on the feature, the AI network will turn any standard or low-dynamic-range content into HDR, performing the correct tone mapping so the image still looks natural and retains its original colors.

AI Across the Board RTX Video is just the latest implementation of AI upscaling powered by NVIDIA RTX.

Members of the GeForce NOW cloud streaming service can play their favorite PC games on nearly any device. GeForce RTX servers located all over the world first render the game video content, encode it and then stream it to the player's local device - just like streaming video from other content providers.

Members on older NVIDIA GPU-powered devices can still use AI-enhanced upscaling to improve gameplay quality. This means they can enjoy the best of both worlds - gameplay rendered on servers powered by RTX 4080-class GPUs in the cloud and AI-enhanced streaming quality. Get more information on enabling AI-enhanced upscaling on GeForce NOW.

The NVIDIA SHIELD TV takes this one step further, processing AI neural networks directly on its NVIDIA Tegra system-on-a-chip to upscale 1080p-quality or lower content from nearly any streaming platform to a display's native resolution. That means users can improve the video quality of content streamed from Netflix, Prime Video, Max, Disney+ and more at the push of a remote button.

SHIELD TV is currently available for up to $30 off in North America and £30 or 35 off in Europe as part of Amazon's Prime Day event running July 16-17. For Prime members in Europe, eligible SHIELD TV purchases also include one month of the GeForce NOW Ultimate membership for free, enabling GeForce RTX 4080-class PC gameplay streamed directly to the living room.

AI has enabled unprecedented improvements in video quality, helping set a new
LINK: https://blogs.nvidia.com/blog/ai-decoded-upscaling/...
See more stories from nvidia

North America Stories

18/03/2026

SMPTE Unveils 2026 NAB Show Educational Presentations

SMPTE Unveils 2026 NAB Show Educational Presentations Brie Clayton March 18, 2026 0 Comments SMPTE , the home of media professionals, technologists, a...

18/03/2026

Auditel Ad Campaign Shot on Blackmagic PYXIS 12K

Auditel Ad Campaign Shot on Blackmagic PYXIS 12K Brie Clayton March 18, 2026 0 Comments LED wall virtual production blends 12K open gate acquisition w...

18/03/2026

Brainstorm transforms productivity and sustainability with Suite 7 at NAB Show 2026

Brainstorm transforms productivity and sustainability with Suite 7 at NAB Show 2...

18/03/2026

Neutrik To Showcase opticalCON ADVANCED Connectors At 2026 NAB Show

Share Copy link Facebook X Linkedin Bluesky Email...

18/03/2026

SMPTE Details 2026 NAB Show Educational Sessions

Share Copy link Facebook X Linkedin Bluesky Email...

18/03/2026

Ben Bradshaw Joins PSSI as Director, Product and Network Development

Share Copy link Facebook X Linkedin Bluesky Email...

18/03/2026

Peter Thordarson Joins ASG as Technical Account Executive

Share Copy link Facebook X Linkedin Bluesky Email...

18/03/2026

Survey: Voters Trust TV News Over AI, Social and Search

Share Copy link Facebook X Linkedin Bluesky Email...

18/03/2026

2026 NAB Show Exhibitor Insight: Amazon Web Services (AWS)

Share Copy link Facebook X Linkedin Bluesky Email...

18/03/2026

SMPTE Unveils 2026 NAB Show Educational Presentations

SMPTE , the home of media professionals, technologists, and engineers, today unveiled its educational presentations for the 2026 NAB Show. This year SMPTE will ...

18/03/2026

Maxon Marks Its Official Entry Into the AEC Market With I...

Maxon, maker of powerful, approachable software solutions for creators working in 2D and 3D design, motion graphics, visual effects, gaming, and more, today ann...

18/03/2026

Digital Alert Systems NAB Preview 2026

Digital Alert Systems Preview 2026 NAB Show April 19 - 22 Booth C3452 At the 2026 NAB Show, Digital Alert Systems will showcase Version 6.0 of its DASDEC ...

18/03/2026

Setplex Transforms Video Streaming with AI and Super Aggr...

Setplex today announced that it will showcase its complete, fully integrated Zapflex platform for the first time at the 2026 NAB Show, introducing powerful new ...

18/03/2026

COW Jobs: Seeking DP for Low Budget Dramedy - Chicago

COW Jobs: Seeking DP for Low Budget Dramedy - Chicago Brie Clayton March 17, 2026 0 Comments Seeking Director of Photography for Low Budget Dramedy Fe...

18/03/2026

COW Jobs: Seeking Gaffer for Low Budget Dramedy - Chicago

COW Jobs: Seeking Gaffer for Low Budget Dramedy - Chicago Brie Clayton March 17, 2026 0 Comments Seeking Gaffer for Low Budget Dramedy Feature Film- I...

18/03/2026

COW Jobs: Seeking Location, Sound for Low Budget Dramedy - Chicago

COW Jobs: Seeking Location, Sound for Low Budget Dramedy - Chicago Brie Clayton March 17, 2026 0 Comments Seeking Location/Sound for Low Budget Dramed...

18/03/2026

COW Jobs: Seeking Child Wrangler for Low Budget Film - Chicago

COW Jobs: Seeking Child Wrangler for Low Budget Film - Chicago Brie Clayton March 17, 2026 0 Comments Seeking Child Wrangler for Low Budget Dramedy Fe...

18/03/2026

Calrec Redefines Broadcast Workflows at NAB 2026 with its Most Powerful Hardware, Virtual and Hybrid Audio Lineup Yet

Calrec Redefines Broadcast Workflows at NAB 2026 with its Most Powerful Hardware...

18/03/2026

Oscar Nominated Two People Exchanging Saliva Posted with DaVinci Resolve Studio

Oscar Nominated Two People Exchanging Saliva Posted with DaVinci Resolve Studio Brie Clayton March 17, 2026 0 Comments DaVinci Resolve Studio handle...

18/03/2026

Boston Conservatory Presents Celebrated Musical Satire Urinetown

Boston Conservatory Presents Celebrated Musical Satire Urinetown Performances for this Center Stage production will take place at Boston Conservatory Theater ...

18/03/2026

Charlie Puth Joins Switched On Pop at Berklee NYC

Charlie Puth Joins Switched On Pop at Berklee NYC The Berklee alum spoke with host and Berklee NYC professor Charlie Harding for a live taping, answering audi...

17/03/2026

NASA+ Prepares To Live Stream Historic Artemis II Mission, Bringing Deep-Space Exploration to Global Audiences

NASA+'s Rebecca Sirmons and Brittany Brown offer unique look at live streami...

17/03/2026

BBright's TTML & SMPTE ST 2110-43: One Single Stream For the Whole World

The transition to IP has fundamentally reshaped professional media infrastructures. Video, audio, and increasingly metadata now circulate as independent, precis...

17/03/2026

Op-Ed: How Generative AI Is Transforming Live Sports Streaming Optimization

Live sports streaming can push every element in your video delivery chain to its limit, exposing every potential weakness in seconds. When the Super Bowl, the O...

17/03/2026

Dell Case Study: Powering the Future of Sports Media One Experience at a Time at UT Austin

Texas Athletics sought to modernize its media production, enhance fan experience...

17/03/2026

NAB 2026: Ikegami to Showcase Latest Generation TV Production Cameras, Controllers and Monitors

Ikegami USA will demonstrate the latest additions to its wide range of broadcast...

17/03/2026

TNA Wrestling and iHeartMedia Announce Major Multi-Platform Collaboration

TNA Wrestling and iHeartMedia announces a new multi-platform collaboration that will integrate iHeartMedia across TNA's premium live events, weekly televisi...

17/03/2026

The Miami Dolphins and Dell Boost Fan Experience, Safety, and Efficiency at Hard Rock Stadium

The goal was to transform Hard Rock Stadium into a global leader in sports and e...

17/03/2026

Spectrum Launches Multiview for NCAA Basketball Tournaments

Spectrum has announced the launch of its new Multiview feature in the Spectrum TV App, giving customers the ability to watch up to four NCAA men's or women&...

17/03/2026

Pac-12 Inks Integrity/Data Deals With Genius Sports, IC360

Genius Sports deal also covers data technology, AI, fan engagement, and performance analysis....

17/03/2026

Rede Massa Chooses Net Insight to Enable State-Wide Centralized Operations

Net Insight is supporting the rollout of a new state-wide centralized operation with Rede Massa, which is an SBT affiliate, the Brazilian regional television ne...

17/03/2026

F1 The Movie' Wins the Academy Award for Best Sound

Featuring audio from practice sessions, qualifying races, and Grand Prix races, the film represents Apple's sports-media ambitions At Sunday night's Ac...

17/03/2026

SVG New Sponsor Spotlight: Oracle's Mark Ramberg on the Future of Live Broadcast in the Cloud with OCI

Live broadcast has always been one of the most demanding environments in media a...

17/03/2026

DIRECTV Adds Multiview and Sports Central Features Ahead of NCAA Tournament

DirecTV is introducing several new viewing features, including a multi-screen March Madness Mix channel and an updated Sports Central mobile app hub, ahead of...

17/03/2026

Deltatre and ATP Media Announce Multi-Year Broadcast Graphics/Data Partnership

Deltatre has announced a multi-year partnership with ATP Media, the media arm of the ATP Tour, covering broadcast graphics, data, and production across the 2026...

17/03/2026

Detroit Pistons, Scripps Sports To Air Five Games Free Over the Air on TV-20 Detroit

The Detroit Pistons have announced a third consecutive season partnering with Sc...

17/03/2026

NAB Appoints Two New Members to Television Board of Directors

Share Copy link Facebook X Linkedin Bluesky Email...

17/03/2026

PMVG's TechConnect Goes Virtual for 2026

Share Copy link Facebook X Linkedin Bluesky Email...

17/03/2026

Miris unlocks high-fidelity 3D asset streaming at scale

3D streaming infrastructure provider Miris today announced the launch of a public beta for its new 3D asset streaming platform. Miris is building the infrastruc...

17/03/2026

Tedial Powers the Future of Media Operations at NAB Show...

As media organizations face mounting pressure to produce more content, faster, while maximizing value and operational efficiency, Tedial, a leading provider of ...

17/03/2026

Brainstorm transforms productivity and sustainability wit...

Brainstorm, a leading manufacturer of real-time graphics, augmented and virtual production, is launching the newest version of its platform, Brainstorm Suite 7,...

17/03/2026

Limecraft Introduces New Platform Update Adding Greater C...

Limecraft today announces the release of Limecraft 2026.2, the second platform update in its 2026 release cycle. Limecraft is an AI-powered production platform ...

17/03/2026

Pioneering the Next Era of Sports Broadcasting - Broadcas...

Broadcast Solutions, a leading system integrator and provider of innovative solutions for the broadcast and media industry, showcased its latest broadcast and V...

17/03/2026

FCC Announces TV Translator Call Sign Changes

Share Copy link Facebook X Linkedin Bluesky Email...

17/03/2026

2026 NAB Show Offering Free Show Floor Passes to Creators

Share Copy link Facebook X Linkedin Bluesky Email...

17/03/2026

QuickLink's Latest StudioEdge Models to Make North American Debut at NAB 202

QuickLink's Latest StudioEdge Models to Make North American Debut at NAB 202 Brie Clayton March 16, 2026 0 Comments The Multi-platform Remote Gues...

17/03/2026

Frankenstein Graded with DaVinci Resolve Studio

Frankenstein Graded with DaVinci Resolve Studio Brie Clayton March 16, 2026 0 Comments Sonnenfeld enhances the controlled interplay between warm and c...

17/03/2026

New Voyavox from Link Electronics with Real-Time Speech-to-Text Captioning to be Featured in NAB Booth #W2910

New Voyavox from Link Electronics with Real-Time Speech-to-Text Captioning to be...

17/03/2026

Berklee City Music Stewards META Fellowship Supporting Massachusetts Music Educators

Berklee City Music Stewards META Fellowship Supporting Massachusetts Music Educa...