Sony Pixel Power calrec Sony

Cut the Noise: NVIDIA Broadcast Supercharges Livestreaming, Remote Work

26/06/2024

Editor's note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible, and showcases new hardware, software, tools and accelerations for RTX PC users.

AI has changed computing forever. The spotlight has most recently been on generative AI, but AI-accelerated, NVIDIA RTX-powered tools have also been key in improving gaming, content creation and productivity over the years.

The NVIDIA Broadcast app is one example, using Tensor Cores on a local RTX GPU to seamlessly improve audio and video quality. Paired with the NVIDIA encoder (NVENC) built into GeForce RTX and NVIDIA RTX GPUs, the app makes it easy to get started as a livestreamer or to look professional during video conference calls.

The Stream Dream

High-quality livestreaming traditionally required expensive hardware. Many livestreamers relied on software CPU encoding using the x264 software library, which often impacted gameplay quality. This led many to use a dual-PC setup, with one PC focused on gaming and content and the other on encoding the stream. It was complicated to assemble, difficult to troubleshoot and often cost-prohibitive for budding livestreamers.

NVENC is here to help. It's a dedicated hardware video encoder on NVIDIA GPUs that processes the encoding, freeing up the rest of the system to focus on game and content performance. Industry-leading streaming apps like Open Broadcaster Software (OBS) are adding support for NVENC, paving the way for a new generation of broadcasters on popular platforms like Twitch and YouTube.

Meanwhile, NVIDIA Maxine helps solve the issue of expensive equipment. It includes free, AI-powered features like virtual green screens and webcam-based augmented reality tracking that eliminate the need for special equipment like physical green screens or motion- capture suits. Broadcasters first got to experience the technology at TwitchCon 2019, where they tested OBS live on the show floor with an AI-accelerated green screen on a GeForce RTX 2080 GPU.

Maxine's AI-powered effects debuted for RTX users in the RTX Voice beta, and moved into the NVIDIA Broadcast app.

Now Showing: NVIDIA Broadcast NVIDIA Broadcast offers AI-powered features that improve audio and video quality for a variety of use cases. It's user-friendly, works in any app and is a breeze to set up.

It includes:

Noise and Acoustic Echo Removal: AI eliminates unwanted background noise from both the mic and inbound audio at the touch of a button.

Virtual Backgrounds: Features like Background Removal, Replacement and Blur help customize backgrounds without the need for expensive equipment or complex lighting setups.

Eye Contact: AI helps make it appear as though a streamer is looking directly at the camera, even when they're glancing off camera or taking notes.

Auto Frame: Dynamically tracks movements in real time, automatically cropping and zooming moving objects regardless of their position.

Vignette: AI applies a darkening effect to the corners of camera images, providing visual contrast to draw attention to the center of the video and adding stylistic flair.

Video Noise Removal: Removes visual noise from low-light situations for a cleaner picture.

NVIDIA Broadcast works by creating a virtual camera, microphone or speaker in Windows so that users can set up their devices once and use them in any broadcasting, video conferencing or voice chat apps, including Discord, Google Meet, Microsoft Teams, OBS Studio, Slack, Webex and Zoom.

Those with an NVIDIA GeForce RTX, TITAN RTX, NVIDIA RTX or Quadro RTX GPU can use their GPU's dedicated Tensor Cores to help the app's AI networks run in real time.

The same AI-powered technology in NVIDIA Broadcast is also available to app developers as a software development kit. Audiovisual technology company Elgato includes Maxine's AI audio noise removal technology in its Wave Link software, while VTube Studio - a popular app for connecting a 3D model to a webcam for streaming as an animated character - offers an RTX-accelerated model tracker plug-in as a free download. Independent developer Xaymar uses NVIDIA Maxine in his VoiceFX plug-in.

Content creators can use this plug-in or Elgato's virtual studio technology (VST) filter to clean up noise and echo from recordings in post-processing in video editing suites like Adobe Premiere Pro or in digital audio workstations like Ableton Live and Adobe Audition.

(Not) Hearing Is Believing Since its release, NVIDIA Broadcast has been used by millions.

I've utilized the video noise removal and background replacement the most, said Mr_Vudoo, a Twitch personality and broadcaster. The eye contact feature was very interesting and quite honestly took me by surprise at how well it worked.

Unmesh Dinda, host of the YouTube channel PiXimperfect, demonstrated NVIDIA Broadcast's noise-canceling and echo-removal AI features in an extreme scenario. He set an electric fan whirring directly into his microphone and donned a helmet that was intensely hammered on. Even with these loud sounds in the background, Dinda could be heard crystal clear with Broadcast's noise-removal feature turned on. The video has racked up more than 12 million views.

NVIDIA Broadcast is also a useful tool for the growing remote workforce. In an article, Tom's Hardware editor-in-chief Avram Piltch detailed his testing of the app's noise reduction features against noisy air conditioners, lawn-mowing neighbors and even a robot-wielding, tantrum-throwing child. Broadcast's AI audio filters prevailed every time:

I got my eight-year-old to fake throwing a fit right behind me and, once I enabled noise removal, every whine of I'm not going to bed' went silent (at least on the recording), said Piltch. To double the challenge, we had him throw a tantrum while carrying
LINK: https://blogs.nvidia.com/blog/ai-decoded-broadcast/...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

04/08/2026

Dalet Announces Commercial Availability of Dalia, Bringing Media-Aware Agentic AI to Enterprise Productions

Dalet, a leading technology and service provider for media-rich organizations, t...

04/07/2026

Detective Conan: Fallen Angel of the Highway Opens in Dolby Cinemas Across Japan, Presented in Dolby Atmos and Dolby ...

April 7 2026, 19:00 (PDT) Detective Conan: Fallen Angel of the Highway Opens in...

01/06/2026

Dolby Sets the New Standard for Premium Entertainment at CES 2026

January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026 Throughout the week, Dolby brings to life the latest innovatio...

17/05/2026

Delta Goodrem's Eurovision Eclipse marks end of a stellar run

Delta Goodrem's Eurovision Eclipse marks end of a stellar run 17 May, 2026 Media releases Bulgaria wins Eurovision 2026 Relive every spellbinding mome...

16/05/2026

Eventide & Newfangled Audio release Fixate:Midrange

Helps to deliver a clean, balanced midrange Developed alongside Newfangled Audio, the latest plug-in in Eventide's software collection has been designed...

16/05/2026

Engine DJ 5.0 update now live

Brings onboard stem rendering to RANE System One Engine DJ have just released Engine DJ 5.0, a free update for their Engine DJ OS embedded hardware and Engi...

16/05/2026

Boris FX Continuum Pairs AI Precision and Advanced Creative Controls

Boris FX Continuum Pairs AI Precision and Advanced Creative Controls Jessie Electa Petrov May 16, 2026 0 Comments The 2026.5 release adds automatic de...

16/05/2026

Spectrum TV Adds Free Access to Discovery+

Share Copy link Facebook X Linkedin Bluesky Email...

16/05/2026

Tower Family Foundation Passes $3.5 Million Milestone

Share Copy link Facebook X Linkedin Bluesky Email...

16/05/2026

AIMS to Offer IPMX Education at InfoComm 2026

Share Copy link Facebook X Linkedin Bluesky Email...

16/05/2026

Rise AV Launches Second Year of UK Elevate Program

Share Copy link Facebook X Linkedin Bluesky Email...

15/05/2026

Seattle Sounders FC and Reign FC Announce Seattle Soccer Celebration at Waterfront Park

Seattle Sounders FC and Seattle Reign FC, in partnership with RAVE Foundation an...

15/05/2026

How Sound Designer Dan Brumm Built Blueys Audio World with Sennheiser and Neumann

Dan Brumm has served as sound designer on Bluey, the Australian children's t...

15/05/2026

Applications Close May 31 for Mark Brunner Professional Audio Scholarship

The Professional Audio Manufacturers Alliance (PAMA) and Shure Incorporated are accepting applications for the 6th annual Mark Brunner Professional Audio Schola...

15/05/2026

Netflix Expands NFL Coverage With Additional Games Starting in 2026

Netflix has announced an expanded NFL schedule for 2026 and beyond under a four-year partnership extension with the NFL through the 2029-30 season. Each season,...

15/05/2026

Ateme Supports TVRIs SRT-Based Live Sports Contribution and Distribution Workflow

Ateme is supporting TVRI (Televisi Republik Indonesia) with a contribution and d...

15/05/2026

Concacaf Launches New Website and Mobile App Powered by Deltatre

Concacaf has announced the launch of a new website and mobile app built on Deltatre's FORGE platform. Concacaf.com and the mobile app, available on iOS and ...

15/05/2026

Qatar Media Corporation Launches QBC Business Channel in 4K via Eutelsat

Eutelsat has announced the launch of QBC Business Economic Channel by Qatar Media Corporation, broadcasting in 4K/UHD via Eutelsat's 7/8 West video neighbo...

15/05/2026

Amazon to Serve as Exclusive Launch Home of MLS Original Series Cup Dreams on May 14

Major League Soccer has announced four original content series timed to the 2026...

15/05/2026

AIMS to Focus on IPMX Education at InfoComm 2026

The Alliance for IP Media Solutions (AIMS) has announced it will exhibit and present at InfoComm 2026, taking place June 13-19 at the Las Vegas Convention Cente...

15/05/2026

InfoComm 2026To Feature Sports, Broadcast, and Live Event Technologies

InfoComm 2026 will take place June 13-19 (exhibits June 17-19) at the Las Vegas Convention Center. The show will include sessions and exhibits covering broadcas...

15/05/2026

Tracy McGradys Ones Basketball League Signs First Streaming Agreement with Fubo Sports Network

Tracy McGrady's Ones Basketball League (OBL) and FuboTV Inc. have announced ...

15/05/2026

Disguise and Creative Technology Return for Eighth Year at Eurovision Song Contest 2026

Disguise has partnered with Creative Technology (CT) to deliver visual playback ...

15/05/2026

Sony Announces Alpha 7R VI Camera and FE 100-400mm F4.5 GM OSS Lens

Sony Electronics has announced two new products for professional imaging: the Alpha 7R VI full-frame mirrorless camera and the FE 100-400mm F4.5 GM OSS super-te...

15/05/2026

SVG GameDay, Ep. 15: New Jersey Devils Joe Kuchie - Growing the Game in the Garden State

In-venue and creative video staffers at the professional and collegiate level ha...

15/05/2026

Ratings Roundup: ESPN Secures Top Viewed Second Round Game 4 of Stanley Cup on Cable; NBA Draft Lottery Viewership Up 23%

Ratings Roundup is a rundown of recent rating news and is derived from press rel...

15/05/2026

The Future of Sports Analytics: Building Trust and Intelligence With SmerSports and Cisco

For sports organizations, the most valuable assets are often the most sensitive:...

15/05/2026

NFL Broadcast Schedule Roundup: Breaking Down CBS, ESPN, FOX, NBC, Netflix, and Prime Lineups

The NFL's broadcast partners released their 2026 regular season schedules ye...

15/05/2026

Netflix Steps Into the Cage for First MMA Production With Rousey-Carano Showdown at Intuit Dome

When MMA icons Ronda Rousey and Gina Carano meet inside the Hexagon at Intuit Do...

15/05/2026

Dustin Hoffman and Leo Woodall Bring the Noise in Daniel Roher's Tuner

Daniel Roher attends the Tuner Premiere during the 2026 Sundance Film Festival at Eccles Theatre on January 22, 2026 in Park City, Utah. (Photo by Neilson Bar...

15/05/2026

And The Winners of the 2026 Spotify Podcast Awards in Mexico Are

Last night, the Spotify Podcast Awards in Mexico returned to the country's capital. Now in its second year, the evening honors creators whose voices are hel...

15/05/2026

Music Expo (San Francisco) becomes MONO Music Conference

Rebranded show announced Ahead of their 2026 return, Music Expo have announced that they have now officially changed their name to the MONO Music Conference...

15/05/2026

Buzzing Bugs Audio Devices introduce the Bolster

Fuzz pedal joins UK companys line-up UK-based pedal makers Buzzing Bugs Audio Devices have recently unveiled their latest creation, the Bolster. Said to pay...

15/05/2026

Joint Statement: News Bargaining Incentive

Joint Statement: News Bargaining Incentive 28 April, 2026 Media releases The vibrancy of Australian democracy relies on the robust and open exchange of new...

15/05/2026

Call it Deltavision, Australia's through to the Grand Final of this year's Eurovision Song Contest!

Call it Deltavision, Australia's through to the Grand Final of this year'...

15/05/2026

Join Calrec at MPTS 2026

Join Calrec at MPTS 2026 | May 13-14 | Stand A40 | Olympia, London We're looking forward to meeting up with customers and partners at this year's Media ...

15/05/2026

CTV's Data Gap Holding Back Bigger Ad Budgets, New Gracenote Research Finds

86% of media planners would move more linear TV budget to CTV if they had show-level targeting and reporting - and 65% would also shift dollars from programmati...

15/05/2026

Scripps Completes Station Swaps with Gray Media

Share Copy link Facebook X Linkedin Bluesky Email...

15/05/2026

Clear-Com Takes Communications Further at InfoComm 2026

Clear-Com will showcase new communications solutions and major platform updates at InfoComm 2026 (Booth N7005), June 17-19, in the North and Central Halls of t...

15/05/2026

Rise AV Launches Second Year of UK Elevate Programme Foll...

Following an outstanding inaugural year in 2025, Rise AV is proud to announce the return of its flagship leadership initiative, Elevate. The programme continues...

15/05/2026

Berklee Announces Lineup for Inaugural AI Music Summit

Berklee Announces Lineup for Inaugural AI Music Summit The three-day event puts musicians at the center of the future of music creation, ethics, and the indus...

15/05/2026

Lightware Highlights Scalable USB-C and AV-over-IP Innova...

Lightware returns to InfoComm 2026 with a focused showcase of scalable USB-C connectivity, next-generation AV-over-IP solutions, and technologies that help over...

15/05/2026

IAB Releases Campaign Data Standards 1.0 for Public Comment

Share Copy link Facebook X Linkedin Bluesky Email...

15/05/2026

ARRI Expands Management Board

Share Copy link Facebook X Linkedin Bluesky Email...

15/05/2026

Gray Media Names Joanie Vasiliadis SVP of Transformation

Share Copy link Facebook X Linkedin Bluesky Email...

15/05/2026

Study: Data and Measurement Problems Reduce CTV Ad Budgets

Share Copy link Facebook X Linkedin Bluesky Email...

15/05/2026

Upfronts: WBD Expands Advanced Ad Capabilities and AI Ad Tech

Share Copy link Facebook X Linkedin Bluesky Email...

15/05/2026

VLAST Powers PLAVEs Asia Tour Encore with AJA Gear

Delivering a live, arena-scale production of a massively popular band is no small feat. Between expansive in-arena LED walls and a global live stream fed to onl...