Sony Pixel Power calrec Sony

Cut the Noise: NVIDIA Broadcast Supercharges Livestreaming, Remote Work

26/06/2024

Editor's note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible, and showcases new hardware, software, tools and accelerations for RTX PC users.

AI has changed computing forever. The spotlight has most recently been on generative AI, but AI-accelerated, NVIDIA RTX-powered tools have also been key in improving gaming, content creation and productivity over the years.

The NVIDIA Broadcast app is one example, using Tensor Cores on a local RTX GPU to seamlessly improve audio and video quality. Paired with the NVIDIA encoder (NVENC) built into GeForce RTX and NVIDIA RTX GPUs, the app makes it easy to get started as a livestreamer or to look professional during video conference calls.

The Stream Dream

High-quality livestreaming traditionally required expensive hardware. Many livestreamers relied on software CPU encoding using the x264 software library, which often impacted gameplay quality. This led many to use a dual-PC setup, with one PC focused on gaming and content and the other on encoding the stream. It was complicated to assemble, difficult to troubleshoot and often cost-prohibitive for budding livestreamers.

NVENC is here to help. It's a dedicated hardware video encoder on NVIDIA GPUs that processes the encoding, freeing up the rest of the system to focus on game and content performance. Industry-leading streaming apps like Open Broadcaster Software (OBS) are adding support for NVENC, paving the way for a new generation of broadcasters on popular platforms like Twitch and YouTube.

Meanwhile, NVIDIA Maxine helps solve the issue of expensive equipment. It includes free, AI-powered features like virtual green screens and webcam-based augmented reality tracking that eliminate the need for special equipment like physical green screens or motion- capture suits. Broadcasters first got to experience the technology at TwitchCon 2019, where they tested OBS live on the show floor with an AI-accelerated green screen on a GeForce RTX 2080 GPU.

Maxine's AI-powered effects debuted for RTX users in the RTX Voice beta, and moved into the NVIDIA Broadcast app.

Now Showing: NVIDIA Broadcast NVIDIA Broadcast offers AI-powered features that improve audio and video quality for a variety of use cases. It's user-friendly, works in any app and is a breeze to set up.

It includes:

Noise and Acoustic Echo Removal: AI eliminates unwanted background noise from both the mic and inbound audio at the touch of a button.

Virtual Backgrounds: Features like Background Removal, Replacement and Blur help customize backgrounds without the need for expensive equipment or complex lighting setups.

Eye Contact: AI helps make it appear as though a streamer is looking directly at the camera, even when they're glancing off camera or taking notes.

Auto Frame: Dynamically tracks movements in real time, automatically cropping and zooming moving objects regardless of their position.

Vignette: AI applies a darkening effect to the corners of camera images, providing visual contrast to draw attention to the center of the video and adding stylistic flair.

Video Noise Removal: Removes visual noise from low-light situations for a cleaner picture.

NVIDIA Broadcast works by creating a virtual camera, microphone or speaker in Windows so that users can set up their devices once and use them in any broadcasting, video conferencing or voice chat apps, including Discord, Google Meet, Microsoft Teams, OBS Studio, Slack, Webex and Zoom.

Those with an NVIDIA GeForce RTX, TITAN RTX, NVIDIA RTX or Quadro RTX GPU can use their GPU's dedicated Tensor Cores to help the app's AI networks run in real time.

The same AI-powered technology in NVIDIA Broadcast is also available to app developers as a software development kit. Audiovisual technology company Elgato includes Maxine's AI audio noise removal technology in its Wave Link software, while VTube Studio - a popular app for connecting a 3D model to a webcam for streaming as an animated character - offers an RTX-accelerated model tracker plug-in as a free download. Independent developer Xaymar uses NVIDIA Maxine in his VoiceFX plug-in.

Content creators can use this plug-in or Elgato's virtual studio technology (VST) filter to clean up noise and echo from recordings in post-processing in video editing suites like Adobe Premiere Pro or in digital audio workstations like Ableton Live and Adobe Audition.

(Not) Hearing Is Believing Since its release, NVIDIA Broadcast has been used by millions.

I've utilized the video noise removal and background replacement the most, said Mr_Vudoo, a Twitch personality and broadcaster. The eye contact feature was very interesting and quite honestly took me by surprise at how well it worked.

Unmesh Dinda, host of the YouTube channel PiXimperfect, demonstrated NVIDIA Broadcast's noise-canceling and echo-removal AI features in an extreme scenario. He set an electric fan whirring directly into his microphone and donned a helmet that was intensely hammered on. Even with these loud sounds in the background, Dinda could be heard crystal clear with Broadcast's noise-removal feature turned on. The video has racked up more than 12 million views.

NVIDIA Broadcast is also a useful tool for the growing remote workforce. In an article, Tom's Hardware editor-in-chief Avram Piltch detailed his testing of the app's noise reduction features against noisy air conditioners, lawn-mowing neighbors and even a robot-wielding, tantrum-throwing child. Broadcast's AI audio filters prevailed every time:

I got my eight-year-old to fake throwing a fit right behind me and, once I enabled noise removal, every whine of I'm not going to bed' went silent (at least on the recording), said Piltch. To double the challenge, we had him throw a tantrum while carrying
LINK: https://blogs.nvidia.com/blog/ai-decoded-broadcast/...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

04/08/2026

Dalet Announces Commercial Availability of Dalia, Bringing Media-Aware Agentic AI to Enterprise Productions

Dalet, a leading technology and service provider for media-rich organizations, t...

04/07/2026

Detective Conan: Fallen Angel of the Highway Opens in Dolby Cinemas Across Japan, Presented in Dolby Atmos and Dolby ...

April 7 2026, 19:00 (PDT) Detective Conan: Fallen Angel of the Highway Opens in...

01/06/2026

Dolby Sets the New Standard for Premium Entertainment at CES 2026

January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026 Throughout the week, Dolby brings to life the latest innovatio...

08/05/2026

Miri V410 Encoder-Decoder Wins 2026 NAB Show Product of t...

For the second straight year, Miri Technologies Inc. has been honored with a pair of coveted awards at the broadcast, media and entertainment industry's pre...

08/05/2026

Nine Alumni Nominated for Tony Awards

Nine Alumni Nominated for Tony Awards More than 20 alumni contributed to this year's Tony-nominated productions. May 7, 2026 By Tori Donahue Boston Co...

08/05/2026

Report: Rise of Video Podcasts Prompts Hybrid Approach

Share Copy link Facebook X Linkedin Bluesky Email...

08/05/2026

U.K. Military Broadcaster Taps Synamedia for Digital Platform

Share Copy link Facebook X Linkedin Bluesky Email...

08/05/2026

Gayle Benson To Receive NAB Leadership Foundation Leadership Award

Share Copy link Facebook X Linkedin Bluesky Email...

08/05/2026

Dems Blast FCC Disney Probe As 'Egregious Abuse of Power'

Share Copy link Facebook X Linkedin Bluesky Email...

08/05/2026

Liberty University on why broadcast technology isn't just a technical investment, it's a human one

Liberty University on why broadcast technology isn't just a technical invest...

08/05/2026

COW Jobs: UGC, On-Camera Video Content

COW Jobs: UGC, On-Camera Video Content Brie Clayton May 7, 2026 0 Comments UGC, On-Camera Video Content April 17, 2026Documentary Editor - US,......

07/05/2026

Sudan Digital Investigation Hub launches to support journalists navigating disinformation in conflict

Journalists reporting on Sudan are working in one of the most complex and fast-m...

07/05/2026

Victory+ CEO Neil Gruninger on the Impact of the Dallas Cowboys Deal, Creator-Led Content, and Free In-Market Access for Fans

Multi-year partnership positions Victory+ as a free home for Dallas Cowboys orig...

07/05/2026

SVG Students To Watch: Ella Peterson, University of Illinois

From sideline reporting to directing and producing, the talented sophomore is building a well-rounded foundation for a career in live sports production In the ...

07/05/2026

NAB 2026: Cobalt Digital Wins Two Future Best of Show Awards

Cobalt Digital has received two Future Best of Show awards at NAB Show 2026. The COBALT blueCORE platform was recognized by TV Tech, and the COBALT PACIFIC ULL-...

07/05/2026

Scripps National Spelling Bee Revamps Broadcast; Mina Kimes to Host, Embassy Rows Michael Davies to Produce

ESPN analyst Mina Kimes will host the televised semifinals and finals of the 202...

07/05/2026

MUBI Selects Bitmovin as Cloud VOD Encoding Partner

Bitmovin has announced that MUBI, the global film streaming platform, has selected Bitmovin as its cloud VOD encoding partner. Bitmovin's encoding infrastru...

07/05/2026

NBCUniversal Telemundo Enterprises and U.S. Soccer Extend Spanish-Language Media Rights Through 2030

NBCUniversal Telemundo Enterprises and the U.S. Soccer Federation have announced...

07/05/2026

Angel City Football Club and Victory+ Announce Regional Broadcast Partnership

Angel City Football Club (ACFC) and Victory have announced a regional broadcast partnership bringing live match coverage to fans across the greater Los Angeles...

07/05/2026

Spiideo Launches AI Highlights for Automated Highlight and Clip Creation

Spiideo has announced the launch of AI Highlights inside Spiideo Play, its automated sports production platform. AI Highlights combines video, event data, audio...

07/05/2026

Leostream Announces Unified HPC Remote Access Ecosystem for Post-Production and Enterprise Workflows

Leostream Corporation has announced a unified remote access ecosystem for high-p...

07/05/2026

Victory+ Adds Atlanta Dream Local Broadcasts to Free Streaming Platform

The Atlanta Dream has partnered with Victory to stream all locally broadcast Dream games for free, expanding the team's digital distribution strategy and g...

07/05/2026

Riedel Communications Appoints Marc Engroff as CFO; Frank Eischet Moves to Group COO Role

Riedel Communications has announced the appointment of Marc Engroff as Chief Fin...

07/05/2026

ARD Extends SES Satellite Distribution Agreement Through 2039

SES and ARD, Germany's largest public broadcasting network, have announced a long-term extension of their satellite distribution partnership through 2039. U...

07/05/2026

Case Study: How Pro Cheer League Built a Broadcast-First Arena Production

UpLight Technologies delivers a flexible video and lighting system for a new televised sportLaunching the Pro Cheer League required more than creating a compell...

07/05/2026

Full Day Productions and GSE Worldwide Launch Womens College Volleyball Showcase at AT&T Stadium

Full Day Productions and GSE Worldwide have announced Spikes Under the Lights, a...

07/05/2026

Deine persnliche Spotify DJ Experience ist jetzt in vier neuen Sprachen und weiteren Mrkten verfgbar

Seit dem Start im Jahr 2023 hat DJ (Beta) das personalisierte H rerlebnis von 94...

07/05/2026

Il DJ personalizzato di Spotify ora disponibile in 4 nuove lingue e in pi Paesi

Da quando stata presentata nel 2023, DJ (beta) ha aiutato a definire un'esperienza d'ascolto pi personalizzata per 94 milioni di utenti Spotify Premi...

07/05/2026

Your Personalized DJ Experience Is Expanding With 4 New Languages and More Markets

Since launching in 2023, DJ (beta) has helped shape a more personalized listenin...

07/05/2026

Seu DJ personalizado do Spotify t chegando em mais lugares - agora em 4 novos idiomas

Desde o lan amento em 2023, o DJ (beta) j ajudou a deixar a experi ncia de ouvi...

07/05/2026

Save Your Personal Podcast to Spotify and Listen Anywhere

From our earliest days, Spotify has been built on a simple principle: Great audio should be easy to reach. It's what's driven us to expand from music to...

07/05/2026

Spotify Celebrates API Heritage Month With New Music and Artist Spotlights

Asian and Pacific Islander artists continue to shape the global soundscape, pushing creative boundaries and connecting with fans worldwide. This Asian & Pacific...

07/05/2026

Symphonic Elements Chooir by UJAM

Company announce long-requested choir instrument In the latest expansion of their Symphonic Elements series, UJAM have introduced an all-new vocal instrumen...

07/05/2026

Buchla debut Ziggy synthesizer

Modular-inspired sound generation with digital control Buchla have introduced Ziggy, a new compact synthesizer built around the company's complex oscill...

07/05/2026

Polyend Drums hybrid drum machine

Combines analogue voices with digital synthesis and sequencing Polyend have announced Drums, a new hybrid analogue and digital drum machine that combines sy...

07/05/2026

Nektar Panorama CS12: Reaper & Fender Studio Pro support

Control surface now officially supports four DAWs When Nektar launched the Panorama CS12 control surface, it worked exclusively with Apple's Logic Pro, ...

07/05/2026

SGL Carbon: Expected lower sales, but EBITDA margin improved. Forecast confirmed

In the first quarter 2026, SGL Carbon generated consolidated sales of 184.5 million, which was 49.8 million, or 21.3%, lower than in the prior year (Q1 2025: ...

07/05/2026

Rohde & Schwarz and Greenerwave achieve precise and fast ESA antenna characterization using near-field technology

Rohde & Schwarz and Greenerwave achieve precise and fast ESA antenna characteriz...

07/05/2026

L3Harris Red Wolf + SKY RAIDER II INTERNATIONAL: Unmatched Flexibility for Kinetic Strike, EW, ISR and Support Missions

Two multi-role L3Harris products - the Red Wolf launched effects vehicle and SK...

07/05/2026

US Air Force Selects L3Harris to Develop Digital Infrastructure for its Advanced Battle Management System Network

L3Harris will be developing key features of a secure and resilient digital infra...

07/05/2026

New Nielsen Report Shows The Profound Impact of Asian Influence on Sports and Pop Culture

Alysa Liu and Shohei Ohtani Help Drive Viewership as 91 of the Top 100 Broadcast...

07/05/2026

IAB Tech Lab Introduces Standardized Signals For CTV Ad Portfolio

Share Copy link Facebook X Linkedin Bluesky Email...

07/05/2026

Cobalt Digital Wins Two Future Best of Show Awards at 202...

Cobalt Digital Wins Two Future Best of Show Awards at 2026 NAB Show Manufacturer Recognized by TV Tech and TVBEurope for Innovation in signal processing Cobal...

07/05/2026

FOR-A delivers creativity practicality and technical exce...

Software and hardware platforms, AI power and user-friendliness on show...

07/05/2026

Intinor brings advanced IP transport diagnostics and HDR...

Intinor will demonstrate its latest technical enhancements for the Direkt series at BroadcastAsia 2026. With a continued focus on reliable contribution and remo...

07/05/2026

Bitmovin Powers Global Film Streaming Platform MUBI

Bitmovin has announced that MUBI has chosen Bitmovin as its cloud VOD encoding partner, replacing MUBI's legacy on premises encoding setup to improve scalab...

07/05/2026

Meet Graduates from Berklees Class of 2026

Meet Graduates from Berklees Class of 2026 Members of this years graduating class reflect on their proudest moments at Berklee and look ahead to whats next. ...

07/05/2026

Convergence is Now Established Reality,' Says NAB 2026 Report

Share Copy link Facebook X Linkedin Bluesky Email...