Sony Pixel Power calrec Sony

Decoding How AI-Powered Upscaling on NVIDIA RTX Improves Video Quality

17/07/2024

Editor's note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible, and showcases new hardware, software, tools and accelerations for RTX PC and workstation users.

Video is everywhere - nearly 80% of internet bandwidth today is used to stream video from content providers and social networks. While screens have become bigger and support higher resolutions, nearly all video is only 1080p quality or lower.

Upscalers can help sharpen streamed video and, powered by AI on the NVIDIA RTX platform, significantly enhance image quality and detail.

What Is an Upscaler? The larger file size of videos makes it harder to compress and transmit compared to images or text. Platforms like Netflix, Vimeo and YouTube work around this limitation by encoding video - the process of compressing the raw source of a video into a smaller container format.

The encoder first analyzes the video to decide what information it can remove to make it fit a target resolution and frame rate. If the target bitrate is insufficient, the video quality decreases, resulting in a loss of detail and sharpness and the presence of encoding artifacts. The smaller the file, the easier it is to share on the internet - but the worse it looks.

Typically, software on the viewer's device will upscale the video file to fit the display's native resolution. However, these upscalers are fairly simplistic, merely multiplying pixels to meet the desired resolution. They can help sharpen the outlines of objects and scenes, but the final video typically carries encoding artifacts and sometimes looks over-sharpened and unnatural.

AI Know a Better Way The NVIDIA RTX platform uses AI to easily de-artifact and upscale videos.

Easily de-artifact and upscale videos with RTX. The process of AI upscaling involves analyzing images and motion vectors to generate new details not present in the original video. Instead of merely multiplying pixels, it recognizes the patterns of the image and enhances them to provide greater detail and video quality.

Images must be first de-artifacted before any processing begins. Artifacts - or unwanted distortions and anomalies that appear in video and image files - occur due to overcompression or data loss during transmission and storage.

NVIDIA AI networks can de-artifact images, helping remove blocky areas sometimes seen in streamed video. Without this first step, AI upscalers might end up enhancing the artifacted image itself instead of the desired content.

Super-Sized Video Just like putting on a pair of prescription glasses can instantly snap the world into focus, RTX Video Super Resolution, one of NVIDIA's latest innovations in AI-enhanced video technology, gives users a clearer picture into the world of streamed video.

Click the image to see the differences between bicubic upscaling (left) and RTX Video Super Resolution (right). Available on GeForce RTX 40 and 30 Series GPUs and RTX professional GPUs, it uses AI running on dedicated Tensor Cores to remove block compression artifacts and upscale lower-resolution content up to 4K, matching the user's native display resolution.

RTX Video Super Resolution can be used to enhance all video watched on browsers. By combining de-artifacting with AI upscaling techniques, it can make even low-bitrate Twitch streams look stunningly clear. RTX Video Super Resolution is also supported in popular video apps like VLC so users can apply the same upscaling process to their offline videos.

Creators can soon use RTX Video Super Resolution in editing apps like Black Magic's Davinci Resolve, making it easier than ever to upscale lower-quality video files to 4K resolution, as well as convert standard-dynamic range source files into high-dynamic range (HDR).

Say Hi to High-Dynamic Range RTX Video now also supports AI HDR. HDR video supports a wider range of colors, lending greater detail especially to the darker and lighter areas of images. The problem is that there isn't that much HDR content online yet.

Enter RTX Video HDR - by simply turning on the feature, the AI network will turn any standard or low-dynamic-range content into HDR, performing the correct tone mapping so the image still looks natural and retains its original colors.

AI Across the Board RTX Video is just the latest implementation of AI upscaling powered by NVIDIA RTX.

Members of the GeForce NOW cloud streaming service can play their favorite PC games on nearly any device. GeForce RTX servers located all over the world first render the game video content, encode it and then stream it to the player's local device - just like streaming video from other content providers.

Members on older NVIDIA GPU-powered devices can still use AI-enhanced upscaling to improve gameplay quality. This means they can enjoy the best of both worlds - gameplay rendered on servers powered by RTX 4080-class GPUs in the cloud and AI-enhanced streaming quality. Get more information on enabling AI-enhanced upscaling on GeForce NOW.

The NVIDIA SHIELD TV takes this one step further, processing AI neural networks directly on its NVIDIA Tegra system-on-a-chip to upscale 1080p-quality or lower content from nearly any streaming platform to a display's native resolution. That means users can improve the video quality of content streamed from Netflix, Prime Video, Max, Disney+ and more at the push of a remote button.

SHIELD TV is currently available for up to $30 off in North America and £30 or 35 off in Europe as part of Amazon's Prime Day event running July 16-17. For Prime members in Europe, eligible SHIELD TV purchases also include one month of the GeForce NOW Ultimate membership for free, enabling GeForce RTX 4080-class PC gameplay streamed directly to the living room.

AI has enabled unprecedented improvements in video quality, helping set a new
LINK: https://blogs.nvidia.com/blog/ai-decoded-upscaling/...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

09/10/2026

Dolby Expands Dolby OptiView Platform with New Capabilities at IBC 2026

September 10 2026, 06:00 (PDT) Dolby Expands Dolby OptiView Platform with New Capabilities at IBC 2026 New Sports Intelligence helps providers better unders...

07/10/2026

Dalet Flex LTS Delivers Smarter Media Operations from Ingest to Distribution

Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...

29/09/2026

Oak View Group Names Cisco as Official Technology Partner

Oak View Group (OVG) has announced Cisco as an Official Technology Partner, with plans to standardize infrastructure across its venue network on Cisco solutions...

29/09/2026

SportsNet Pittsburgh Wins Three Mid-Atlantic Emmy Awards

SportsNet Pittsburgh (SNP) won three honors at the 2026 Mid-Atlantic Emmy Awards. Program awards went to Bucs BP in the Sports Program Live category (produced ...

29/09/2026

CBC, PWHL Revive Hockey Night in Canada' on Saturdays

The Professional Women's Hockey League has announced home openers for all 12 teams for the 2026-27 season, along with a broadcast partnership with CBC under...

29/09/2026

Manifold Technologies Recognized as MXL Contributor Following IBC Innovation Award

Manifold technologies has been recognized as a contributor to the Media eXchange...

29/09/2026

Fubo Launches My Local Sports RSN Add-On Package

FuboTV has announced My Local Sports, allowing subscribers in select markets to add their local regional sports network (RSN) as an add-on to a Fubo Sports subs...

29/09/2026

ANI Deploys Grass Valley AMPP and Framelight X for News Operations

Asian News International (ANI), a wire agency and video news provider based in India, has deployed Grass Valley's AMPP Media Operating System and Framelight...

29/09/2026

SABC Deploys Ikegami UHK-X600 Cameras for IP-Based Production

South African Broadcasting Corporation (SABC) has deployed Ikegami UHK-X600 cameras as part of an upgrade to IP-based production infrastructure. The deployment ...

29/09/2026

Busy in Bristol: ESPN Headquarters Come Alive With New Studio W, Remote-Production Workflows

REMI, REMCO models will drive the bulk of the broadcaster's NHL productions ...

29/09/2026

NASCAR Productions' Keith D'Alessandro on the Continued Evolution of Its Centralized Production Hub

Three years in, the facility is supporting more centralized race production, com...

29/09/2026

NBC Sports Brings Robust Sunday Night Baseball Production Playbook to MLB Wild Card Round

NBC, Peacock, and NBSN are carrying all four Wild Card series with a production ...

29/09/2026

Sundance Institute Announces 2026 Doc Fund Grantees

19 Nonfiction Projects Across All Stages of Production to Receive More Than $1 million in Support as Documentary Film Program Approaches 25th Anniversary LOS ...

29/09/2026

Zynaptiq introduce Loud & Wide

Two new plug-ins launch alongside updated bundles Zynaptiq have just announced the launch of two new plug-ins, alongside new and improved versions of two of...

29/09/2026

Wes Audio unveil the ngOmniBox

All-in-one bus processor revealed Wes Audio's ng product range has come a long way since it was first introduced, and now includes a tasty selection of ...

29/09/2026

First Baptist Nashville Drastically Upgrades Production Communications with...

eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({ content_source:......

29/09/2026

Fubo TV Launches My Local Sports'

Share Copy link Facebook X Linkedin Bluesky Email...

29/09/2026

ARRI Targets Content Creators with New HONOR Smartphone

Share Copy link Facebook X Linkedin Bluesky Email...

29/09/2026

Asian News International Enhances Workflow with Grass Valley AMPP, FramelightX

Share Copy link Facebook X Linkedin Bluesky Email...

29/09/2026

SABC Chooses Ikegami UHK-X600 Cameras to Support IP Studio Transition

Share Copy link Facebook X Linkedin Bluesky Email...

29/09/2026

SABC Upgrades to IP-Based Production with Ikegami UHK-X60...

Ikegami announces that the South African Broadcasting Corporation, SABC, has chosen Ikegami UHK-X600 camera systems as part of an advance to IP-based operation ...

29/09/2026

Blendkit Offers 20% Discount to Celebrate Crossing 150K Asset Milestone

Blendkit Offers 20% Discount to Celebrate Crossing 150K Asset Milestone Brie Clayton September 29, 2026 0 Comments Blendkit, the largest 3D asset libr...

29/09/2026

Ease Live Reports over 75 Million Interactive Sessions Du...

Interactive streaming specialist Ease Live supported more than 76.5 million fan sessions across three major European media operators during this summers FIFA Wo...

29/09/2026

Ease Live to monetise key moments in live sports

Ease Live has added support for VAST (Video Ad Serving Template) to its graphical overlay technology, opening up new ways for broadcasters, streamers and rights...

29/09/2026

Rise AV launches awards celebrating the women advocates a...

Rise AV has announced the launch of the inaugural Rise AV Awards, a new global awards programme celebrating the women, advocates and organisations across the AV...

29/09/2026

Netflix Deploys Advanced Sony PTZ Cameras For Wonka's The Golden Ticket' Production

Share Copy link Facebook X Linkedin Bluesky Email...

29/09/2026

Massachusetts Broadcasters Association Names Gene Lavanchy 2026 Broadcaster of the Year

Share Copy link Facebook X Linkedin Bluesky Email...

29/09/2026

ESPN Reports Its Most-Watched WNBA Regular Season

Share Copy link Facebook X Linkedin Bluesky Email...

29/09/2026

Scripps Taps Digital News Veteran Sean McGarvy to Lead News Strategy

Share Copy link Facebook X Linkedin Bluesky Email...

29/09/2026

Gray Raises Political Ad Revenue Estimates

Share Copy link Facebook X Linkedin Bluesky Email...

29/09/2026

Edward Czarnecki Uses Game Theory to Assess ATSC 3.0 Transition Policies

Share Copy link Facebook X Linkedin Bluesky Email...

29/09/2026

First Baptist Nashville Drastically Upgrades Production C...

Clear-Com announced that First Baptist Nashville has upgraded its production communications with a Clear-Com intercom solution as part of a comprehensive sanct...

29/09/2026

Blackmagic Cinema Camera 6K Captured Action Shots for Sketch

Blackmagic Cinema Camera 6K Captured Action Shots for Sketch Brie Clayton September 28, 2026 0 Comments Camera's portable design and dynamic range...

29/09/2026

Kean Production Services Deploys AJA ColorBox to Deliver Consistent, Accurate Color Across In-venue Displays at Live Events

Kean Production Services Deploys AJA ColorBox to Deliver Consistent, Accurate Co...

29/09/2026

Berklee Alumni and Faculty Nominated for the 2026 Latin Grammy Awards

Berklee Alumni and Faculty Nominated for the 2026 Latin Grammy Awards A total of 28 Berklee alumni and faculty earned nominations across 20 categories this ye...

29/09/2026

Berklee's K-Pop & Beyond Explores Connections Between K-Pop and Hip-Hop

Berklee's K-Pop & Beyond Explores Connections Between K-Pop and Hip-Hop Now in its fifth year, the series brings together artists, industry leaders, and s...

29/09/2026

The energy transition will only succeed if it lasts

We tend to think we live in a digital world, with hopes and fears around artificial intelligence (AI), quantum computing, data centres and the next big technolo...

29/09/2026

Apple releases new guide to help families build healthy digital habits - UPDATE - Posted on 29 September 2026

Today, in partnership with the American Academy of Pediatrics (AAP), Apple relea...

29/09/2026

Final Cut Camera now supports variable aperture on iPhone\u00A018\u00A0Pro - UPDATE - Posted on 29 September 2026

Final Cut Camera, the professional filming app for iPhone, receives a major upda...

29/09/2026

RT lyric fm launch the hunt for Choirs for Christmas

RT lyric fm is proud to announce the annual Choirs for Christmas competition callout. Warm up those vocal chords and join us on RT lyric fm for a celebration ...

28/09/2026

NHL Names Adobe as an Official Creative, Marketing and AI Partner

The NHL has announced Adobe as an Official Creative, Marketing and AI Partner beginning with the 2026-27 season. The partnership will provide the league and its...

28/09/2026

MultiDyne to Showcase Expanded Portfolio Including MRMC Robotics at CABSAT 2026

MultiDyne will exhibit at CABSAT 2026 (October 5-7, Dubai Exhibition Centre), showcasing an expanded technology portfolio following its June 2026 acquisition of...

28/09/2026

ARRI and HONOR Launch Co-Branded HONOR Magic9 Pro Max

ARRI and HONOR have announced the HONOR Magic9 Pro Max, a flagship smartphone carrying ARRI branding on the device and packaging as the first product-level expr...

28/09/2026

Net Insight Adds Nimbra 1020G to Pan-Asian Live Media Trial Network

Net Insight has added the Nimbra 1020G to its pan-Asian live media trial network, giving customers and partners in the region a way to evaluate ST 2110 and JPEG...

28/09/2026

Vindral Named Recipient of 2026 Technology and Engineering Emmy Award

Vindral has been named a recipient of a 2026 Technology and Engineering Emmy Award by the National Academy of Television Arts and Sciences in the category of We...

28/09/2026

Interra Systems to Demonstrate QC and Monitoring Portfolio at CABSAT 2026

Interra Systems will exhibit at CABSAT 2026 (Stand B2-37, Dubai Exhibition Centre, October 5-7), demonstrating its BATON QC platform, ORION monitoring solutions...

28/09/2026

PGA TOUR's Michael Raimondo on Agentic Production, ShotLink Automation, and the Evolution of PGA TOUR Studios

Two years into its new production facility, the TOUR is expanding centralized wo...