Sony Pixel Power calrec Sony

Cut the Noise: NVIDIA Broadcast Supercharges Livestreaming, Remote Work

26/06/2024

Editor's note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible, and showcases new hardware, software, tools and accelerations for RTX PC users.

AI has changed computing forever. The spotlight has most recently been on generative AI, but AI-accelerated, NVIDIA RTX-powered tools have also been key in improving gaming, content creation and productivity over the years.

The NVIDIA Broadcast app is one example, using Tensor Cores on a local RTX GPU to seamlessly improve audio and video quality. Paired with the NVIDIA encoder (NVENC) built into GeForce RTX and NVIDIA RTX GPUs, the app makes it easy to get started as a livestreamer or to look professional during video conference calls.

The Stream Dream

High-quality livestreaming traditionally required expensive hardware. Many livestreamers relied on software CPU encoding using the x264 software library, which often impacted gameplay quality. This led many to use a dual-PC setup, with one PC focused on gaming and content and the other on encoding the stream. It was complicated to assemble, difficult to troubleshoot and often cost-prohibitive for budding livestreamers.

NVENC is here to help. It's a dedicated hardware video encoder on NVIDIA GPUs that processes the encoding, freeing up the rest of the system to focus on game and content performance. Industry-leading streaming apps like Open Broadcaster Software (OBS) are adding support for NVENC, paving the way for a new generation of broadcasters on popular platforms like Twitch and YouTube.

Meanwhile, NVIDIA Maxine helps solve the issue of expensive equipment. It includes free, AI-powered features like virtual green screens and webcam-based augmented reality tracking that eliminate the need for special equipment like physical green screens or motion- capture suits. Broadcasters first got to experience the technology at TwitchCon 2019, where they tested OBS live on the show floor with an AI-accelerated green screen on a GeForce RTX 2080 GPU.

Maxine's AI-powered effects debuted for RTX users in the RTX Voice beta, and moved into the NVIDIA Broadcast app.

Now Showing: NVIDIA Broadcast NVIDIA Broadcast offers AI-powered features that improve audio and video quality for a variety of use cases. It's user-friendly, works in any app and is a breeze to set up.

It includes:

Noise and Acoustic Echo Removal: AI eliminates unwanted background noise from both the mic and inbound audio at the touch of a button.

Virtual Backgrounds: Features like Background Removal, Replacement and Blur help customize backgrounds without the need for expensive equipment or complex lighting setups.

Eye Contact: AI helps make it appear as though a streamer is looking directly at the camera, even when they're glancing off camera or taking notes.

Auto Frame: Dynamically tracks movements in real time, automatically cropping and zooming moving objects regardless of their position.

Vignette: AI applies a darkening effect to the corners of camera images, providing visual contrast to draw attention to the center of the video and adding stylistic flair.

Video Noise Removal: Removes visual noise from low-light situations for a cleaner picture.

NVIDIA Broadcast works by creating a virtual camera, microphone or speaker in Windows so that users can set up their devices once and use them in any broadcasting, video conferencing or voice chat apps, including Discord, Google Meet, Microsoft Teams, OBS Studio, Slack, Webex and Zoom.

Those with an NVIDIA GeForce RTX, TITAN RTX, NVIDIA RTX or Quadro RTX GPU can use their GPU's dedicated Tensor Cores to help the app's AI networks run in real time.

The same AI-powered technology in NVIDIA Broadcast is also available to app developers as a software development kit. Audiovisual technology company Elgato includes Maxine's AI audio noise removal technology in its Wave Link software, while VTube Studio - a popular app for connecting a 3D model to a webcam for streaming as an animated character - offers an RTX-accelerated model tracker plug-in as a free download. Independent developer Xaymar uses NVIDIA Maxine in his VoiceFX plug-in.

Content creators can use this plug-in or Elgato's virtual studio technology (VST) filter to clean up noise and echo from recordings in post-processing in video editing suites like Adobe Premiere Pro or in digital audio workstations like Ableton Live and Adobe Audition.

(Not) Hearing Is Believing Since its release, NVIDIA Broadcast has been used by millions.

I've utilized the video noise removal and background replacement the most, said Mr_Vudoo, a Twitch personality and broadcaster. The eye contact feature was very interesting and quite honestly took me by surprise at how well it worked.

Unmesh Dinda, host of the YouTube channel PiXimperfect, demonstrated NVIDIA Broadcast's noise-canceling and echo-removal AI features in an extreme scenario. He set an electric fan whirring directly into his microphone and donned a helmet that was intensely hammered on. Even with these loud sounds in the background, Dinda could be heard crystal clear with Broadcast's noise-removal feature turned on. The video has racked up more than 12 million views.

NVIDIA Broadcast is also a useful tool for the growing remote workforce. In an article, Tom's Hardware editor-in-chief Avram Piltch detailed his testing of the app's noise reduction features against noisy air conditioners, lawn-mowing neighbors and even a robot-wielding, tantrum-throwing child. Broadcast's AI audio filters prevailed every time:

I got my eight-year-old to fake throwing a fit right behind me and, once I enabled noise removal, every whine of I'm not going to bed' went silent (at least on the recording), said Piltch. To double the challenge, we had him throw a tantrum while carrying
LINK: https://blogs.nvidia.com/blog/ai-decoded-broadcast/...
See more stories from nvidia

More from Nvidia

13/09/2025

Reaching Across the Isles: UK-LLM Brings AI to UK Languages With NVIDIA Nemotron

Celtic languages - including Cornish, Irish, Scottish Gaelic and Welsh - are the U.K.'s oldest living languages. To empower their speakers, the UK-LLM sover...

10/09/2025

Paint It Blackwell: GeForce RTX 5080 SuperPOD Rollout Begins

GeForce NOW Blackwell RTX 5080-class SuperPODs are now rolling out, unlocking a new level of ultra high-performance, cinematic cloud gaming. GeForce NOW Ultima...

09/09/2025

NVIDIA Rubin CPX Accelerates Inference Performance and Efficiency for 1M+ Token Context Workloads

Inference has emerged as the new frontier of complexity in AI. Modern models are...

09/09/2025

NVIDIA Blackwell Ultra Sets New Inference Records in MLPerf Debut

As large language models (LLMs) grow larger, they get smarter, with open models from leading developers now featuring hundreds of billions of parameters. At the...

09/09/2025

NVIDIA Partners With AI Infrastructure Ecosystem to Unveil Reference Design for Giga-Scale AI Factories

At this week's AI Infrastructure Summit in Silicon Valley, NVIDIA's VP o...

09/09/2025

NVIDIA Blackwell Ultra Sets the Bar in New MLPerf Inference Benchmark

Inference performance is critical, as it directly influences the economics of an AI factory. The higher the throughput of AI factory infrastructure, the more to...

09/09/2025

Safety First, Always,' NVIDIA VP of Automotive Says, Unveiling the Future of AI-Defined Vehicles at IAA Mobility

At this week's IAA Mobility conference in Munich, NVIDIA Vice President of A...

09/09/2025

Get Started Using Generative AI for Content Creation With ComfyUI and NVIDIA RTX AI PCs

ComfyUI - an open-source, node-based graphical interface for running and buildin...

04/09/2025

NVIDIA Pledges AI Education Funding for K-12 Programs

NVIDIA today announced new AI education support for K-12 programs at a White House event to celebrate public-private partnerships that advance artificial intell...

04/09/2025

AI On: 6 Ways AI Agents Are Raising Team Performance - and How to Measure It

Editor's note: This post is part of the AI On blog series, which explores the latest techniques and real-world applications of agentic AI, chatbots and copi...

04/09/2025

Cloud Gaming to Reach New Heights: GeForce NOW's Blackwell RTX Upgrade Begins Next Week

NVIDIA Blackwell RTX is coming to the cloud on Wednesday, Sept. 10 - an upgrade ...

03/09/2025

Scene It to Believe It: Populate 3D Worlds Quickly With NVIDIA AI Blueprints

3D artists are constantly prototyping. In traditional workflows, modelers must build placeholder, low-fidelity assets to populate 3D scenes, tinkering and adju...

02/09/2025

It's the Humidity: How International Researchers in Poland, Deep Learning and NVIDIA GPUs Could Change the Forecast

For more than a century, meteorologists have chased storms with chalkboards, equ...

28/08/2025

Drop Into the Battle: Gears of War: Reloaded Unleashed' Launches on GeForce NOW

Brace yourself, COGs - the Locusts aren't the only thing rising up. The Coal...

28/08/2025

Game On: How Modders Reimagine Classic Games With NVIDIA RTX Remix and Generative AI

Last week at Gamescom, NVIDIA announced the winners of the NVIDIA and ModDB RTX ...

27/08/2025

How Do You Teach an AI Model to Reason? With Humans

AI models are advancing at a rapid rate and scale. But what might they lack that (most) humans don't? Common sense: an understanding, developed through rea...

25/08/2025

NVIDIA Jetson Thor Unlocks Real-Time Reasoning for General Robotics and Physical AI

Robots around the world are about to get a lot smarter as physical AI developers...

25/08/2025

Take It for a Spin: NVIDIA Rolls Out DRIVE AGX Thor Developer Kit to World's Automotive Developers

As autonomous vehicle systems rapidly grow in complexity, equipped with reasonin...

22/08/2025

Inside NVIDIA Blackwell Ultra: The Chip Powering the AI Factory Era

As the latest member of the NVIDIA Blackwell architecture family, the NVIDIA Blackwell Ultra GPU builds on core innovations to accelerate training and AI reason...

22/08/2025

Hot Topics at Hot Chips: Inference, Networking, AI Innovation at Every Scale - All Built on NVIDIA

AI reasoning, inference and networking will be top of mind for attendees of next...

21/08/2025

RIKEN, Japan's Leading Science Institute, Taps Fujitsu and NVIDIA for Next Flagship Supercomputer

Japan is once again building a landmark high-performance computing system - not ...

21/08/2025

Think SMART: How to Optimize AI Factory Inference Performance

From AI assistants doing deep research to autonomous vehicles making split-second navigation decisions, AI adoption is exploding across industries. Behind ever...

21/08/2025

Gearing Up for the Gigawatt Data Center Age

Across the globe, AI factories are rising - massive new data centers built not to serve up web pages or email, but to train and deploy intelligence itself. Inte...

21/08/2025

GeForce NOW Brings RTX 5080 Power to the Ultimate Membership

Get a glimpse into the future of gaming. The NVIDIA Blackwell RTX architecture is coming to GeForce NOW in September, marking the service's biggest upgrade...

20/08/2025

Into the Omniverse: How OpenUSD and Digital Twins Are Powering Industrial and Physical AI

Editor's note: This blog is a part of Into the Omniverse, a series focused o...

18/08/2025

At Gamescom 2025, NVIDIA DLSS 4 and Ray Tracing Come to This Year's Biggest Titles

With over 175 games now supporting NVIDIA DLSS 4 - a suite of advanced, AI-power...

18/08/2025

New Lightweight AI Model for Project G-Assist Brings Support for 6GB NVIDIA GeForce RTX and RTX PRO GPUs

At Gamescom, NVIDIA is releasing its first major update to Project G Assist - an...

15/08/2025

Now We're Talking: NVIDIA Releases Open Dataset, Models for Multilingual Speech AI

Of around 7,000 languages in the world, a tiny fraction are supported by AI lang...

14/08/2025

NVIDIA, National Science Foundation Support Ai2 Development of Open AI Models to Drive U.S. Scientific Leadership

NVIDIA is partnering with the U.S. National Science Foundation (NSF) to create a...

14/08/2025

Warhammer 40,000: Dawn of War - Definitive Edition' Storms GeForce NOW at Launch

Warhammer 40,000: Dawn of War - Definitive Edition is marching onto GeForce NOW,...

13/08/2025

FLUX.1 Kontext NVIDIA NIM Microservice Now Available for Download

Black Forest Labs' FLUX.1 Kontext [dev] image editing model is now available as an NVIDIA NIM microservice. FLUX.1 models allow users to edit existing imag...

11/08/2025

Amazon Devices & Services Achieves Major Step Toward Zero-Touch Manufacturing With NVIDIA AI and Digital Twins

Using NVIDIA digital twin technologies, Amazon Devices & Services is powering bi...

11/08/2025

Mini Footprint, Mighty AI: NVIDIA Blackwell Architecture Powers AI Acceleration in Compact Workstations

Packing the power of the NVIDIA Blackwell architecture in compact, energy-effici...

11/08/2025

Making Safer Spaces: NVIDIA and Partners Bring Physical AI to Cities and Industrial Infrastructure

Physical AI is becoming the foundation of smart cities, facilities and industria...

07/08/2025

The Saga Continues: Stream 2K's Mafia: The Old Country' at Launch on GeForce NOW

This GFN Thursday brings an offer members can't refuse - 2K's highly ant...

05/08/2025

OpenAI and NVIDIA Propel AI Innovation With New Open Models Optimized for the World's Largest AI Inference Infrastructure

Two new open-weight AI reasoning models from OpenAI released today bring cutting...

05/08/2025

OpenAI's New Open Models Accelerated Locally on NVIDIA GeForce RTX and RTX PRO GPUs

In collaboration with OpenAI, NVIDIA has optimized the company's new open-so...

05/08/2025

Delivering 1.5M TPS Inference on NVIDIA GB200 NVL72, NVIDIA Accelerates OpenAI gpt-oss Models From Cloud to Edge

NVIDIA and OpenAI began pushing the boundaries of AI with the launch of NVIDIA D...

05/08/2025

No Backdoors. No Kill Switches. No Spyware.

NVIDIA GPUs are at the heart of modern computing. They're used across industries - from healthcare and finance to scientific research, autonomous systems an...

31/07/2025

Embark on Epic Adventures in August With a Dozen New Games Coming to GeForce NOW

August brings new levels of gaming excitement on GeForce NOW, with 2,300 titles now available to stream in the cloud. Grab a controller and get ready for epic ...

31/07/2025

Wired for Action: Langflow Enables Local AI Agent Creation on NVIDIA RTX PCs

Interest in generative AI is continuing to grow, as new models include more capabilities. With the latest advancements, even enthusiasts without a developer bac...

29/07/2025

FourCastNet 3 Enables Fast and Accurate Large Ensemble Weather Forecasting With Scalable Geometric ML

FourCastNet3 (FCN3) is the latest AI global weather forecasting system from NVID...

28/07/2025

How New GB300 NVL72 Features Provide Steady Power for AI

The electrical grid is designed to support loads that are relatively steady, such as lighting, household appliances, and industrial machines that operate at con...

24/07/2025

Creative Agency Black Mixture Creates Stunning Visuals With Generative AI Powered by NVIDIA RTX

For media company Black Mixture, AI isn't just a tool - it's an entire p...

24/07/2025

WUCHANG: Fallen Feathers' Lands in the Cloud

Sharpen the blade and brace for a journey steeped in myth and mystery. WUCHANG: Fallen Feathers has launched in the cloud. Ride in style with skateboarding leg...

23/07/2025

Into the Omniverse: How Global Brands Are Scaling Personalized Advertising With AI and 3D Content Generation

In today's fast-evolving digital landscape, marketing teams face increasing ...

22/07/2025

AI On: How Financial Services Companies Use Agentic AI to Enhance Productivity, Efficiency and Security

Editor's note: This post is part of the AI On blog series, which explores th...

17/07/2025

GeForce NOW Delivers Justice With RoboCop: Rogue City - Unfinished Business'

Listen up citizens, the law is back and patrolling the cloud. Nacon's RoboCop Rogue City - Unfinished Business launches today in the cloud, bringing justice...

15/07/2025

Deadline Extended - Create a Project G-Assist Plug-In for a Chance to Win an NVIDIA GeForce RTX GPU and Laptop

Submissions for NVIDIA's Plug and Play: Project G-Assist Plug-In Hackathon a...