Sony Pixel Power calrec Sony

Decoding How AI-Powered Upscaling on NVIDIA RTX Improves Video Quality

17/07/2024

Editor's note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible, and showcases new hardware, software, tools and accelerations for RTX PC and workstation users.

Video is everywhere - nearly 80% of internet bandwidth today is used to stream video from content providers and social networks. While screens have become bigger and support higher resolutions, nearly all video is only 1080p quality or lower.

Upscalers can help sharpen streamed video and, powered by AI on the NVIDIA RTX platform, significantly enhance image quality and detail.

What Is an Upscaler? The larger file size of videos makes it harder to compress and transmit compared to images or text. Platforms like Netflix, Vimeo and YouTube work around this limitation by encoding video - the process of compressing the raw source of a video into a smaller container format.

The encoder first analyzes the video to decide what information it can remove to make it fit a target resolution and frame rate. If the target bitrate is insufficient, the video quality decreases, resulting in a loss of detail and sharpness and the presence of encoding artifacts. The smaller the file, the easier it is to share on the internet - but the worse it looks.

Typically, software on the viewer's device will upscale the video file to fit the display's native resolution. However, these upscalers are fairly simplistic, merely multiplying pixels to meet the desired resolution. They can help sharpen the outlines of objects and scenes, but the final video typically carries encoding artifacts and sometimes looks over-sharpened and unnatural.

AI Know a Better Way The NVIDIA RTX platform uses AI to easily de-artifact and upscale videos.

Easily de-artifact and upscale videos with RTX. The process of AI upscaling involves analyzing images and motion vectors to generate new details not present in the original video. Instead of merely multiplying pixels, it recognizes the patterns of the image and enhances them to provide greater detail and video quality.

Images must be first de-artifacted before any processing begins. Artifacts - or unwanted distortions and anomalies that appear in video and image files - occur due to overcompression or data loss during transmission and storage.

NVIDIA AI networks can de-artifact images, helping remove blocky areas sometimes seen in streamed video. Without this first step, AI upscalers might end up enhancing the artifacted image itself instead of the desired content.

Super-Sized Video Just like putting on a pair of prescription glasses can instantly snap the world into focus, RTX Video Super Resolution, one of NVIDIA's latest innovations in AI-enhanced video technology, gives users a clearer picture into the world of streamed video.

Click the image to see the differences between bicubic upscaling (left) and RTX Video Super Resolution (right). Available on GeForce RTX 40 and 30 Series GPUs and RTX professional GPUs, it uses AI running on dedicated Tensor Cores to remove block compression artifacts and upscale lower-resolution content up to 4K, matching the user's native display resolution.

RTX Video Super Resolution can be used to enhance all video watched on browsers. By combining de-artifacting with AI upscaling techniques, it can make even low-bitrate Twitch streams look stunningly clear. RTX Video Super Resolution is also supported in popular video apps like VLC so users can apply the same upscaling process to their offline videos.

Creators can soon use RTX Video Super Resolution in editing apps like Black Magic's Davinci Resolve, making it easier than ever to upscale lower-quality video files to 4K resolution, as well as convert standard-dynamic range source files into high-dynamic range (HDR).

Say Hi to High-Dynamic Range RTX Video now also supports AI HDR. HDR video supports a wider range of colors, lending greater detail especially to the darker and lighter areas of images. The problem is that there isn't that much HDR content online yet.

Enter RTX Video HDR - by simply turning on the feature, the AI network will turn any standard or low-dynamic-range content into HDR, performing the correct tone mapping so the image still looks natural and retains its original colors.

AI Across the Board RTX Video is just the latest implementation of AI upscaling powered by NVIDIA RTX.

Members of the GeForce NOW cloud streaming service can play their favorite PC games on nearly any device. GeForce RTX servers located all over the world first render the game video content, encode it and then stream it to the player's local device - just like streaming video from other content providers.

Members on older NVIDIA GPU-powered devices can still use AI-enhanced upscaling to improve gameplay quality. This means they can enjoy the best of both worlds - gameplay rendered on servers powered by RTX 4080-class GPUs in the cloud and AI-enhanced streaming quality. Get more information on enabling AI-enhanced upscaling on GeForce NOW.

The NVIDIA SHIELD TV takes this one step further, processing AI neural networks directly on its NVIDIA Tegra system-on-a-chip to upscale 1080p-quality or lower content from nearly any streaming platform to a display's native resolution. That means users can improve the video quality of content streamed from Netflix, Prime Video, Max, Disney+ and more at the push of a remote button.

SHIELD TV is currently available for up to $30 off in North America and £30 or 35 off in Europe as part of Amazon's Prime Day event running July 16-17. For Prime members in Europe, eligible SHIELD TV purchases also include one month of the GeForce NOW Ultimate membership for free, enabling GeForce RTX 4080-class PC gameplay streamed directly to the living room.

AI has enabled unprecedented improvements in video quality, helping set a new
LINK: https://blogs.nvidia.com/blog/ai-decoded-upscaling/...
See more stories from nvidia

North America Stories

25/03/2026

Samsung Launches Shoppable TV Experience with Amazon

Share Copy link Facebook X Linkedin Bluesky Email...

25/03/2026

Gray Media to Simulcast 2026 Atlanta Braves to Home Opener

Share Copy link Facebook X Linkedin Bluesky Email...

25/03/2026

Starfish highlights flexible TS Splicer releases and new Monitoring Dashboard at NAB Show

Starfish highlights flexible TS Splicer releases and new Monitoring Dashboard at...

25/03/2026

XLNTSOUND Elevates Video Production with Blackmagic Design

XLNTSOUND Elevates Video Production with Blackmagic Design Brie Clayton March 24, 2026 0 Comments Audio company upgrades workflow with Blackmagic Cine...

25/03/2026

First Time Exhibitor IPC Introduces One Link Keypanels for One Connect Intercom Platform at NAB 2026

First Time Exhibitor IPC Introduces One Link Keypanels for One Connect Intercom ...

24/03/2026

Utah Scientific to Showcase a Variety of Hybrid SDI/IP Innovations at the 2026 NAB Show

Utah Scientific to Showcase a Variety of Hybrid SDI/IP Innovations at the 2026 N...

24/03/2026

NAB 2026: Mediaproxy Highlights Enhancements to its LogServer suite at NAB Show 2026

Mediaproxy will showcase an updated version of its LogPlayer interface at NAB Sh...

24/03/2026

Canada's Cgep de Jonquire and Calrec Take Five With a TV Studio Upgrade

C gep de Jonqui re, a public college in Qu bec, has upgraded its TV studio complex with five Calrec Brio consoles and a Dante IP network. The installation was c...

24/03/2026

American Association of Professional Baseball Expands Broadcast Partnerships with RYZ, Bally Sports Live, NLSE, FTF Sports, and SLVR

The American Association of Professional Baseball (AAPB) has announced new and r...

24/03/2026

Ateme KYRION Enabled NT's Nationwide Contribution Network During Southeast Asian Games 2025

National Telecom Public Company Limited (NT) used Ateme's KYRION platform fo...

24/03/2026

FDJ United Upgrades Lottery Production with Grass Valley UHD Cameras

Grass Valley has expanded its relationship with ImSoPROD, the TV production entity of FDJ United, with the deployment of LDX C98 compact cameras across its nati...

24/03/2026

Scripps Sports Launches Free Streaming Channel Scripps Sports Network on March 24

The E.W. Scripps Company is launching Scripps Sports Network (SSN), a free, ad-s...

24/03/2026

SVG Sit-Down: NEP Platform VP Dan Murphy on Software-Driven Production and the Future of Live Sports Workflows

NEP Group has launched NEP Platform, a new software orchestration system that un...

24/03/2026

Daktronics Installs New Video Display and Ribbon Boards at Chase Field

Daktronics has partnered with the Arizona Diamondbacks to design, manufacture and install a new LED video display and three ribbon boards at Chase Field in Phoe...

24/03/2026

Grass Valley Upgrades University of Pittsburgh Athletics to ST 2110 IP Production Infrastructure

Grass Valley has completed an upgrade of University of Pittsburgh Athletics'...

24/03/2026

Daktronics to Upgrade LED Displays at Wrigley Field

Daktronics is upgrading eight LED displays at Wrigley Field in Chicago, totaling more than 8,300 square feet, using the Daktronics Renew product line. The upgra...

24/03/2026

ASG Appoints Kevin Poole as Senior Project and Support Manager

Advanced Systems Group has appointed Kevin Poole as Senior Project and Support Manager within the ASG Workflow and Tools practice. The position is newly created...

24/03/2026

SVG New Sponsor Spotlight: Verimatrix's Juan Martinez on Safeguarding Live Sports Content

In an increasingly streaming-centric world, protecting high-value live sports co...

24/03/2026

The Countdown Is On! Prep for Vegas with SVG's SportsTech@NABShow Blog

Mediaproxy will showcase an updated version of its LogPlayer interface at NAB Show, April 19-22 in Las Vegas, booth W1423. The update includes AI tools, native ...

24/03/2026

The Creator Economy's Growing Impact: Building the Modern Production Studio With Second Rodeo Productions' CEO Scott Brown

The production studio has worked with content juggernauts such as MrBeast, The R...

24/03/2026

MLB Local Media To Keynote Regional Sports Production Summit, June 29-30, Denver

The event will also feature a State of the Industry address from sports-media veteran and strategic advisor Patrick Crakes....

24/03/2026

Victory+ Launches NWSL Sunday Night Soccer Franchise

Victory , a free sports streaming service owned by A Parent Media Co. (APMC), has launched its NWSL Sunday Night Soccer franchise. The platform says the launch ...

24/03/2026

FAST Sports: Contrary to Some Data, Sports Does Have a Future on FAST

Sports content in free streaming is still relatively scant, but it's growing, right along with its monetization capabilities Streaming-tech company Wurl re...

24/03/2026

New Doc Sports Heaven: The Birth of ESPN' Produced by ESPN Historian Mike Soltys Arriving April 6

Directed by Greg DeHart, the doc will feature Sports Broadcasting Hall of Famers...

24/03/2026

Tubi Unveils Plans for Creator-Driven Formula 1 Altcasts in Partnership With Apple TV

For the first time ever, Tubi - Fox's free streaming service - is working w...

24/03/2026

L3Harris Ramps Up Production for Counter-Unmanned Systems

L3Harris ramps up production of its VAMPIRE C-UxS system....

24/03/2026

Delivering Victory Through Fuzing Precision and Scale

For more than 70 years, L3Harris has delivered essential fuzes and safe-and-arm solutions that bring the might to multi-domain battlefields across the globe, ...

24/03/2026

FDJ United Leaves Nothing to Chance with UHD Lottery Prod...

Grass Valley has strengthened its long-standing relationship with ImSoPROD, the TV production entity of the FDJ United, with the deployment of Grass Valley LDX ...

24/03/2026

Utah Scientific to Showcase a Variety of Hybrid SDI IP In...

At the 2026 NAB Show in Las Vegas, Utah Scientific will spotlight its expanding portfolio of hybrid SDI/IP routing, conversion, control, and signal management s...

24/03/2026

Miri V410 Live 4K Encoder-Decoder to Make North American...

Fresh off its global reveal at ISE 2026 in Barcelona, the new V410 live 4K encoder/decoder from Miri Technologies Inc. will make its North American debut at the...

24/03/2026

Cinegy delivers software defined television for the real...

Cinegy GmbH, premier provider of software-defined television technology, will show how its solutions answer the real challenges facing content creators and broa...

24/03/2026

ArtSound FM Futureproofs with DHD Audio Production Consol...

Canberra-based radio and online broadcast network ArtSound FM (https://artsound.fm/) has invested in DHD audio mixing consoles for two new studios at its headqu...

24/03/2026

IBC unveils 2026 Accelerator projects tackling industry c...

IBC today announced the nine projects selected for its 2026 Accelerator Media Innovation Programme, bringing together organisations from across broadcast, strea...

24/03/2026

Mediaproxy Highlights Significant Enhancements to its Log...

Mediaproxy, the global standard for software-based IP compliance monitoring and multiviewing solutions, will showcase the next generation of its industry-leadin...

24/03/2026

Cegep de Jonquiere and Calrec take five with a substantia...

Underscoring its global reputation as one of Canada's most renowned colleges for television production, the C gep de Jonqui re public college in Qu bec has ...

24/03/2026

Synamedia launches industry-first edge watermarking solut...

Leading video software provider Synamedia today announced the launch of the industry's first edge watermarking solution that enables faster disruption of pi...

24/03/2026

Experience Commerce Wins Social Media Mandate for Fintech...

Experience Commerce, a leading full-service digital marketing agency and part of the Cheil SWA Group, has secured the annual social media mandate for Fiat Payme...

24/03/2026

FCC Approves TV Station License Transfers to Gray

Share Copy link Facebook X Linkedin Bluesky Email...

24/03/2026

Study: Globally HBO Max Is Most Widely Bundled Streaming Service

Share Copy link Facebook X Linkedin Bluesky Email...

24/03/2026

Charter Communications Names John Lee Head Of Intelligence Ventures

Share Copy link Facebook X Linkedin Bluesky Email...

24/03/2026

Intinor introduces enhanced SRT monitoring, HDR transport and NDI Advanced support at NAB Show 2026

Intinor introduces enhanced SRT monitoring, HDR transport and NDI Advanced suppo...

24/03/2026

Miri V410 Live 4K Encoder/Decoder to Make North American Debut at 2026 NAB Show

Miri V410 Live 4K Encoder/Decoder to Make North American Debut at 2026 NAB Show Brie Clayton March 23, 2026 0 Comments Powerful new solution for strea...

24/03/2026

Tribeca Festival And Vulture Partner To Bring Vulture Festival Back To New York For Tribeca's 25th Anniversary

March 24th, 2026 TRIBECA FESTIVAL AND VULTURE PARTNER TO BRING VULTURE FESTI...

24/03/2026

Tribeca X Announces Preliminary 2026 Speaker Lineup

March 24th, 2026 TRIBECA X ANNOUNCES PRELIMINARY 2026 SPEAKER LINEUP Cedric the Entertainer, Ted Danson, Brooklyn Peltz Beckham, Dhar Mann, K-Pop Demon ...

24/03/2026

McDonald's and Netflix Call on Fans to Pick a Side With Two New 'KPop Demon Hunters'-Inspired Meals

Back to All News McDonalds and Netflix Call on Fans to Pick a Side With Two New...

24/03/2026

BTS Commands the Global Stage as 'BTS THE COMEBACK LIVE | ARIRANG' Draws 18.4 Millions Global Viewers

Back to All News BTS Commands the Global Stage as BTS THE COMEBACK LIVE | ARIRA...

24/03/2026

Advancing Open Source AI, NVIDIA Donates Dynamic Resource Allocation Driver for GPUs to Kubernetes Community

Artificial intelligence has rapidly emerged as one of the most critical workload...

23/03/2026

Professional Fighters League & U-Next Renew Multi-year Partnership to Broadcast PFL Events Live in Japan

The Professional Fighters League (PFL) has renewed its multi-year partnership wi...

23/03/2026

The Snow League Announces Google Cloud as Official Cloud and AI Partner to Power Personalized Fan Experiences Worldwide

The Snow League has named Google Cloud as its Official Cloud and AI Partner. The...

23/03/2026

Chyron Appoints Eric Wolff as Director of Venues Sales, North America

Chyron has appointed Eric Wolff as Director of Venues Sales, North America. Wolff previously served as Director of Broadcast Operations & Media Production for T...