Sony Pixel Power calrec Sony

Decoding How AI-Powered Upscaling on NVIDIA RTX Improves Video Quality

17/07/2024

Editor's note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible, and showcases new hardware, software, tools and accelerations for RTX PC and workstation users.

Video is everywhere - nearly 80% of internet bandwidth today is used to stream video from content providers and social networks. While screens have become bigger and support higher resolutions, nearly all video is only 1080p quality or lower.

Upscalers can help sharpen streamed video and, powered by AI on the NVIDIA RTX platform, significantly enhance image quality and detail.

What Is an Upscaler? The larger file size of videos makes it harder to compress and transmit compared to images or text. Platforms like Netflix, Vimeo and YouTube work around this limitation by encoding video - the process of compressing the raw source of a video into a smaller container format.

The encoder first analyzes the video to decide what information it can remove to make it fit a target resolution and frame rate. If the target bitrate is insufficient, the video quality decreases, resulting in a loss of detail and sharpness and the presence of encoding artifacts. The smaller the file, the easier it is to share on the internet - but the worse it looks.

Typically, software on the viewer's device will upscale the video file to fit the display's native resolution. However, these upscalers are fairly simplistic, merely multiplying pixels to meet the desired resolution. They can help sharpen the outlines of objects and scenes, but the final video typically carries encoding artifacts and sometimes looks over-sharpened and unnatural.

AI Know a Better Way The NVIDIA RTX platform uses AI to easily de-artifact and upscale videos.

Easily de-artifact and upscale videos with RTX. The process of AI upscaling involves analyzing images and motion vectors to generate new details not present in the original video. Instead of merely multiplying pixels, it recognizes the patterns of the image and enhances them to provide greater detail and video quality.

Images must be first de-artifacted before any processing begins. Artifacts - or unwanted distortions and anomalies that appear in video and image files - occur due to overcompression or data loss during transmission and storage.

NVIDIA AI networks can de-artifact images, helping remove blocky areas sometimes seen in streamed video. Without this first step, AI upscalers might end up enhancing the artifacted image itself instead of the desired content.

Super-Sized Video Just like putting on a pair of prescription glasses can instantly snap the world into focus, RTX Video Super Resolution, one of NVIDIA's latest innovations in AI-enhanced video technology, gives users a clearer picture into the world of streamed video.

Click the image to see the differences between bicubic upscaling (left) and RTX Video Super Resolution (right). Available on GeForce RTX 40 and 30 Series GPUs and RTX professional GPUs, it uses AI running on dedicated Tensor Cores to remove block compression artifacts and upscale lower-resolution content up to 4K, matching the user's native display resolution.

RTX Video Super Resolution can be used to enhance all video watched on browsers. By combining de-artifacting with AI upscaling techniques, it can make even low-bitrate Twitch streams look stunningly clear. RTX Video Super Resolution is also supported in popular video apps like VLC so users can apply the same upscaling process to their offline videos.

Creators can soon use RTX Video Super Resolution in editing apps like Black Magic's Davinci Resolve, making it easier than ever to upscale lower-quality video files to 4K resolution, as well as convert standard-dynamic range source files into high-dynamic range (HDR).

Say Hi to High-Dynamic Range RTX Video now also supports AI HDR. HDR video supports a wider range of colors, lending greater detail especially to the darker and lighter areas of images. The problem is that there isn't that much HDR content online yet.

Enter RTX Video HDR - by simply turning on the feature, the AI network will turn any standard or low-dynamic-range content into HDR, performing the correct tone mapping so the image still looks natural and retains its original colors.

AI Across the Board RTX Video is just the latest implementation of AI upscaling powered by NVIDIA RTX.

Members of the GeForce NOW cloud streaming service can play their favorite PC games on nearly any device. GeForce RTX servers located all over the world first render the game video content, encode it and then stream it to the player's local device - just like streaming video from other content providers.

Members on older NVIDIA GPU-powered devices can still use AI-enhanced upscaling to improve gameplay quality. This means they can enjoy the best of both worlds - gameplay rendered on servers powered by RTX 4080-class GPUs in the cloud and AI-enhanced streaming quality. Get more information on enabling AI-enhanced upscaling on GeForce NOW.

The NVIDIA SHIELD TV takes this one step further, processing AI neural networks directly on its NVIDIA Tegra system-on-a-chip to upscale 1080p-quality or lower content from nearly any streaming platform to a display's native resolution. That means users can improve the video quality of content streamed from Netflix, Prime Video, Max, Disney+ and more at the push of a remote button.

SHIELD TV is currently available for up to $30 off in North America and £30 or 35 off in Europe as part of Amazon's Prime Day event running July 16-17. For Prime members in Europe, eligible SHIELD TV purchases also include one month of the GeForce NOW Ultimate membership for free, enabling GeForce RTX 4080-class PC gameplay streamed directly to the living room.

AI has enabled unprecedented improvements in video quality, helping set a new
LINK: https://blogs.nvidia.com/blog/ai-decoded-upscaling/...
See more stories from nvidia

North America Stories

25/03/2026

L3Harris, RFTEQ Sign Agreement to Advance Sovereign Electronic Warfare Capability in Australia

L3Harris Technologies and RFTEQ Pty Ltd signed a memorandum of understanding to ...

25/03/2026

L3Harris to Provide Autonomous Underwater Capability for US Navy Submarines

L3Harris delivers combat-ready Torpedo Tube Launch and Recovery system, which deploys and retrieves Iver4 900 autonomous underwater vehicles through submarine t...

25/03/2026

Nielsen Names New Senior Leaders Supporting Sports, Advertising and Publishing Clients

The company expands leadership team under Chief Revenue Officer Amilcar Perez S...

25/03/2026

Stable TV Viewership in Poland in February as Warner Bros. Discovery Retains Top Spot

Winter Olympic Games Opening Ceremony features in top 10 programmes of the month...

25/03/2026

Mediaproxy to Show Upgrades to LogServer at 2026 NAB Show

Share Copy link Facebook X Linkedin Bluesky Email...

25/03/2026

Hitomi transforms production synchronisation with the lau...

Providing wide view timing visibility across the entire production chain...

25/03/2026

Bitfocus showcases complete control at NAB Show 2026

Continuing development drives advances in security, availability, access and connectivity...

25/03/2026

Caudalie Paris HQ elevates brand experience with INFiLED...

Caudalie, the renowned French cosmetics brand, has unveiled a state-of-the-art 200-seat auditorium at its new headquarters in the historic Marais district of ce...

25/03/2026

Telestream Unlocks Adobe-Centric Media Pipeline and Strea...

Telestream, a global leader in media workflow technologies, today announced expanded integration with Adobe Premiere, Adobe Media Encoder (AME), and Frame.io, d...

25/03/2026

Marshall Electronics Showcases New Feature Rich CV320 and...

Marshall Electronics is expanding its lineup of high-performance POV cameras designed for broadcast, live production and professional AV applications with the d...

25/03/2026

OOONA Achieves TPN Gold Star Shield - the Highest Level o...

OOONA, a global provider of professional management and production tools for the media localization industry, announced today that it has been awarded the TPN G...

25/03/2026

Gray Media to Simulcast 2026 Atlanta Braves Home Opener

Share Copy link Facebook X Linkedin Bluesky Email...

25/03/2026

2026 NAB Show Exhibitor Insight: Appear

Share Copy link Facebook X Linkedin Bluesky Email...

25/03/2026

Deepfakes Vulnerable to AI Fingerprint Hacks, Study Finds

Share Copy link Facebook X Linkedin Bluesky Email...

25/03/2026

SipMX launches at NAB Show 2026 to democratize media orch...

SipRadius, specialists in secure, low-latency media transport, will drive innovation and interoperability still further with the launch of the SipMX Alliance at...

25/03/2026

QuickLink to Showcase StudioPro Video Production Ecosyste...

QuickLink, a leading provider of award-winning video production and remote contribution solutions, will showcase its award-winning StudioPro ecosystem at The 2...

25/03/2026

Alfalite returns to NAB Show alongside FOR-A showcasing L...

Alfalite, the only European manufacturer of LED screens, will once again be present at NAB Show, the leading global event for the broadcast, media and entertain...

25/03/2026

First Time Exhibitor IPC Introduces One Link Keypanels fo...

PC, a leading provider of integrated communication solutions, will make its NAB 2026 Show debut in Booth C 3341. The company will highlight the newly branded On...

25/03/2026

LTN showcases satellite-to-IP migration solutions for cha...

Open video transport network simplifies satellite transition with new partnerships and global reach as spectrum auction nears LTN will demonstrate how its purp...

25/03/2026

Leader to present full suite of advanced Test and Measure...

Test & measurement innovator, Leader Electronics, will present the full range of Leader, PHABRIX and LeaderPhabrix T&M solutions at the NAB Show, which takes pl...

25/03/2026

MNC Software Appoints Heartland Video Systems as North Am...

MNC Software, a global leader in network management and operational support systems tailored to the broadcast and media industry, today announced the appointmen...

25/03/2026

Samsung Launches Shoppable TV Experience with Amazon

Share Copy link Facebook X Linkedin Bluesky Email...

25/03/2026

Gray Media to Simulcast 2026 Atlanta Braves to Home Opener

Share Copy link Facebook X Linkedin Bluesky Email...

25/03/2026

Starfish highlights flexible TS Splicer releases and new Monitoring Dashboard at NAB Show

Starfish highlights flexible TS Splicer releases and new Monitoring Dashboard at...

25/03/2026

XLNTSOUND Elevates Video Production with Blackmagic Design

XLNTSOUND Elevates Video Production with Blackmagic Design Brie Clayton March 24, 2026 0 Comments Audio company upgrades workflow with Blackmagic Cine...

25/03/2026

First Time Exhibitor IPC Introduces One Link Keypanels for One Connect Intercom Platform at NAB 2026

First Time Exhibitor IPC Introduces One Link Keypanels for One Connect Intercom ...

25/03/2026

Netflix Announces the Start of Production for 'Reasonable Doubts'

Back to All News Netflix Announces the Start of Production for Reasonable Doubts Entertainment 25 March 2026 GlobalSpain Link copied to clipboard Download...

25/03/2026

FOR-As Software-Defined, AI-Powered Development Advances with Nippon TV and NVIDIA Technology

NBC Sports Deploys viztrick AiDi to Stream Live Events in 9:16 Mobile-First Form...

25/03/2026

Blowing Off Steam: How Power-Flexible AI Factories Can Stabilize the Global Energy Grid

At the half-time whistle of the UEFA EURO 2020 round of 16 football match betwee...

24/03/2026

Utah Scientific to Showcase a Variety of Hybrid SDI/IP Innovations at the 2026 NAB Show

Utah Scientific to Showcase a Variety of Hybrid SDI/IP Innovations at the 2026 N...

24/03/2026

NAB 2026: Mediaproxy Highlights Enhancements to its LogServer suite at NAB Show 2026

Mediaproxy will showcase an updated version of its LogPlayer interface at NAB Sh...

24/03/2026

Canada's Cgep de Jonquire and Calrec Take Five With a TV Studio Upgrade

C gep de Jonqui re, a public college in Qu bec, has upgraded its TV studio complex with five Calrec Brio consoles and a Dante IP network. The installation was c...

24/03/2026

American Association of Professional Baseball Expands Broadcast Partnerships with RYZ, Bally Sports Live, NLSE, FTF Sports, and SLVR

The American Association of Professional Baseball (AAPB) has announced new and r...

24/03/2026

Ateme KYRION Enabled NT's Nationwide Contribution Network During Southeast Asian Games 2025

National Telecom Public Company Limited (NT) used Ateme's KYRION platform fo...

24/03/2026

FDJ United Upgrades Lottery Production with Grass Valley UHD Cameras

Grass Valley has expanded its relationship with ImSoPROD, the TV production entity of FDJ United, with the deployment of LDX C98 compact cameras across its nati...

24/03/2026

Scripps Sports Launches Free Streaming Channel Scripps Sports Network on March 24

The E.W. Scripps Company is launching Scripps Sports Network (SSN), a free, ad-s...

24/03/2026

SVG Sit-Down: NEP Platform VP Dan Murphy on Software-Driven Production and the Future of Live Sports Workflows

NEP Group has launched NEP Platform, a new software orchestration system that un...

24/03/2026

Daktronics Installs New Video Display and Ribbon Boards at Chase Field

Daktronics has partnered with the Arizona Diamondbacks to design, manufacture and install a new LED video display and three ribbon boards at Chase Field in Phoe...

24/03/2026

Grass Valley Upgrades University of Pittsburgh Athletics to ST 2110 IP Production Infrastructure

Grass Valley has completed an upgrade of University of Pittsburgh Athletics'...

24/03/2026

Daktronics to Upgrade LED Displays at Wrigley Field

Daktronics is upgrading eight LED displays at Wrigley Field in Chicago, totaling more than 8,300 square feet, using the Daktronics Renew product line. The upgra...

24/03/2026

ASG Appoints Kevin Poole as Senior Project and Support Manager

Advanced Systems Group has appointed Kevin Poole as Senior Project and Support Manager within the ASG Workflow and Tools practice. The position is newly created...

24/03/2026

SVG New Sponsor Spotlight: Verimatrix's Juan Martinez on Safeguarding Live Sports Content

In an increasingly streaming-centric world, protecting high-value live sports co...

24/03/2026

The Countdown Is On! Prep for Vegas with SVG's SportsTech@NABShow Blog

Mediaproxy will showcase an updated version of its LogPlayer interface at NAB Show, April 19-22 in Las Vegas, booth W1423. The update includes AI tools, native ...

24/03/2026

The Creator Economy's Growing Impact: Building the Modern Production Studio With Second Rodeo Productions' CEO Scott Brown

The production studio has worked with content juggernauts such as MrBeast, The R...

24/03/2026

MLB Local Media To Keynote Regional Sports Production Summit, June 29-30, Denver

The event will also feature a State of the Industry address from sports-media veteran and strategic advisor Patrick Crakes....

24/03/2026

Victory+ Launches NWSL Sunday Night Soccer Franchise

Victory , a free sports streaming service owned by A Parent Media Co. (APMC), has launched its NWSL Sunday Night Soccer franchise. The platform says the launch ...

24/03/2026

FAST Sports: Contrary to Some Data, Sports Does Have a Future on FAST

Sports content in free streaming is still relatively scant, but it's growing, right along with its monetization capabilities Streaming-tech company Wurl re...

24/03/2026

New Doc Sports Heaven: The Birth of ESPN' Produced by ESPN Historian Mike Soltys Arriving April 6

Directed by Greg DeHart, the doc will feature Sports Broadcasting Hall of Famers...

24/03/2026

Tubi Unveils Plans for Creator-Driven Formula 1 Altcasts in Partnership With Apple TV

For the first time ever, Tubi - Fox's free streaming service - is working w...