Sony Pixel Power calrec Sony

Cut the Noise: NVIDIA Broadcast Supercharges Livestreaming, Remote Work

26/06/2024

Editor's note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible, and showcases new hardware, software, tools and accelerations for RTX PC users.

AI has changed computing forever. The spotlight has most recently been on generative AI, but AI-accelerated, NVIDIA RTX-powered tools have also been key in improving gaming, content creation and productivity over the years.

The NVIDIA Broadcast app is one example, using Tensor Cores on a local RTX GPU to seamlessly improve audio and video quality. Paired with the NVIDIA encoder (NVENC) built into GeForce RTX and NVIDIA RTX GPUs, the app makes it easy to get started as a livestreamer or to look professional during video conference calls.

The Stream Dream

High-quality livestreaming traditionally required expensive hardware. Many livestreamers relied on software CPU encoding using the x264 software library, which often impacted gameplay quality. This led many to use a dual-PC setup, with one PC focused on gaming and content and the other on encoding the stream. It was complicated to assemble, difficult to troubleshoot and often cost-prohibitive for budding livestreamers.

NVENC is here to help. It's a dedicated hardware video encoder on NVIDIA GPUs that processes the encoding, freeing up the rest of the system to focus on game and content performance. Industry-leading streaming apps like Open Broadcaster Software (OBS) are adding support for NVENC, paving the way for a new generation of broadcasters on popular platforms like Twitch and YouTube.

Meanwhile, NVIDIA Maxine helps solve the issue of expensive equipment. It includes free, AI-powered features like virtual green screens and webcam-based augmented reality tracking that eliminate the need for special equipment like physical green screens or motion- capture suits. Broadcasters first got to experience the technology at TwitchCon 2019, where they tested OBS live on the show floor with an AI-accelerated green screen on a GeForce RTX 2080 GPU.

Maxine's AI-powered effects debuted for RTX users in the RTX Voice beta, and moved into the NVIDIA Broadcast app.

Now Showing: NVIDIA Broadcast NVIDIA Broadcast offers AI-powered features that improve audio and video quality for a variety of use cases. It's user-friendly, works in any app and is a breeze to set up.

It includes:

Noise and Acoustic Echo Removal: AI eliminates unwanted background noise from both the mic and inbound audio at the touch of a button.

Virtual Backgrounds: Features like Background Removal, Replacement and Blur help customize backgrounds without the need for expensive equipment or complex lighting setups.

Eye Contact: AI helps make it appear as though a streamer is looking directly at the camera, even when they're glancing off camera or taking notes.

Auto Frame: Dynamically tracks movements in real time, automatically cropping and zooming moving objects regardless of their position.

Vignette: AI applies a darkening effect to the corners of camera images, providing visual contrast to draw attention to the center of the video and adding stylistic flair.

Video Noise Removal: Removes visual noise from low-light situations for a cleaner picture.

NVIDIA Broadcast works by creating a virtual camera, microphone or speaker in Windows so that users can set up their devices once and use them in any broadcasting, video conferencing or voice chat apps, including Discord, Google Meet, Microsoft Teams, OBS Studio, Slack, Webex and Zoom.

Those with an NVIDIA GeForce RTX, TITAN RTX, NVIDIA RTX or Quadro RTX GPU can use their GPU's dedicated Tensor Cores to help the app's AI networks run in real time.

The same AI-powered technology in NVIDIA Broadcast is also available to app developers as a software development kit. Audiovisual technology company Elgato includes Maxine's AI audio noise removal technology in its Wave Link software, while VTube Studio - a popular app for connecting a 3D model to a webcam for streaming as an animated character - offers an RTX-accelerated model tracker plug-in as a free download. Independent developer Xaymar uses NVIDIA Maxine in his VoiceFX plug-in.

Content creators can use this plug-in or Elgato's virtual studio technology (VST) filter to clean up noise and echo from recordings in post-processing in video editing suites like Adobe Premiere Pro or in digital audio workstations like Ableton Live and Adobe Audition.

(Not) Hearing Is Believing Since its release, NVIDIA Broadcast has been used by millions.

I've utilized the video noise removal and background replacement the most, said Mr_Vudoo, a Twitch personality and broadcaster. The eye contact feature was very interesting and quite honestly took me by surprise at how well it worked.

Unmesh Dinda, host of the YouTube channel PiXimperfect, demonstrated NVIDIA Broadcast's noise-canceling and echo-removal AI features in an extreme scenario. He set an electric fan whirring directly into his microphone and donned a helmet that was intensely hammered on. Even with these loud sounds in the background, Dinda could be heard crystal clear with Broadcast's noise-removal feature turned on. The video has racked up more than 12 million views.

NVIDIA Broadcast is also a useful tool for the growing remote workforce. In an article, Tom's Hardware editor-in-chief Avram Piltch detailed his testing of the app's noise reduction features against noisy air conditioners, lawn-mowing neighbors and even a robot-wielding, tantrum-throwing child. Broadcast's AI audio filters prevailed every time:

I got my eight-year-old to fake throwing a fit right behind me and, once I enabled noise removal, every whine of I'm not going to bed' went silent (at least on the recording), said Piltch. To double the challenge, we had him throw a tantrum while carrying
LINK: https://blogs.nvidia.com/blog/ai-decoded-broadcast/...
See more stories from nvidia

More from Nvidia

11/07/2025

A Gaming GPU Helps Crack the Code on a Thousand-Year Cultural Conversation

Ceramics - the humble mix of earth, fire and artistry - have been part of a global conversation for millennia. From Tang Dynasty trade routes to Renaissance pa...

10/07/2025

From Terabytes to Turnkey: AI-Powered Climate Models Go Mainstream

In the race to understand our planet's changing climate, speed and accuracy are everything. But today's most widely used climate simulators often strugg...

10/07/2025

Indonesia on Track to Achieve Sovereign AI Goals With NVIDIA, Cisco and IOH

As one of the world's largest emerging markets, Indonesia is making strides toward its Golden 2045 Vision - an initiative tapping digital technologies and...

10/07/2025

Reach the PEAK' on GeForce NOW

Grab a friend and climb toward the clouds - PEAK is now available on GeForce NOW, enabling members to try the hugely popular indie hit on virtually any device. ...

10/07/2025

How to Run Coding Assistants for Free on RTX AI PCs and Workstations

Coding assistants or copilots - AI-powered assistants that can suggest, explain and debug code - are fundamentally changing how software is developed for both e...

08/07/2025

Asking an Encyclopedia-Sized Question: How To Make the World Smarter with Multi-Million Token Real-Time Inference

Modern AI applications increasingly rely on models that combine huge parameter c...

03/07/2025

GeForce NOW's 20 July Games Bring the Heat to the Cloud

The forecast this month is showing a 100% chance of epic gaming. Catch the scorching lineup of 20 titles coming to the cloud, which gamers can play whether indo...

02/07/2025

NVIDIA RTX AI Accelerates FLUX.1 Kontext - Now Available for Download

Black Forest Labs, one of the world's leading AI research labs, just changed the game for image generation. The lab's FLUX.1 image models have earned g...

01/07/2025

How AI Factories Can Help Relieve Grid Stress

In many parts of the world, including major technology hubs in the U.S., there's a yearslong wait for AI factories to come online, pending the buildout of n...

26/06/2025

Run Google DeepMind's Gemma 3n on NVIDIA Jetson and RTX

As of today, NVIDIA now supports the general availability of Gemma 3n on NVIDIA RTX and Jetson. Gemma, previewed by Google DeepMind at Google I/O last month, in...

26/06/2025

Into the Omniverse: World Foundation Models Advance Autonomous Vehicle Simulation and Safety

Editor's note: This blog is a part of Into the Omniverse, a series focused o...

26/06/2025

Startup Uses NVIDIA RTX-Powered Generative AI to Make Coolers, Cooler

Mark Theriault founded the startup FITY envisioning a line of clever cooling products: cold drink holders that come with freezable pucks to keep beverages cold ...

26/06/2025

Game On With GeForce NOW, the Membership That Keeps on Delivering

This GFN Thursday rolls out a new reward and games for GeForce NOW members. Whether hunting for hot new releases or rediscovering timeless classics, members can...

24/06/2025

Introducing NVFP4 for Efficient and Accurate Low-Precision Inference

To get the most out of AI, optimizations are critical. When developers think about optimizing AI models for inference, model compression techniques-such as quan...

24/06/2025

HPE and NVIDIA Debut AI Factory Stack to Power Next Industrial Shift

To speed up AI adoption across industries, HPE and NVIDIA today launched new AI factory offerings at HPE Discover in Las Vegas. The new lineup includes everyth...

24/06/2025

NVIDIA and Partners Highlight Next-Generation Robotics, Automation and AI Technologies at Automatica

From the heart of Germany's automotive sector to manufacturing hubs across F...

19/06/2025

Step Inside the Vault: The Borderland' Series Arrives on GeForce NOW

GeForce NOW is throwing open the vault doors to welcome the legendary Borderland series to the cloud. Whether a seasoned Vault Hunter or new to the mayhem of P...

18/06/2025

Plug and Play: Build a G-Assist Plug-In Today

Project G-Assist - available through the NVIDIA App - is an experimental AI assistant that helps tune, control and optimize NVIDIA GeForce RTX systems. NVIDIA&...

17/06/2025

Hexagon Taps NVIDIA Robotics and AI Software to Build and Deploy AEON, a New Humanoid

As a global labor shortage leaves 50 million positions unfilled across industrie...

13/06/2025

NVIDIA and Deutsche Telekom Partner to Advance Germany's Sovereign AI

Industrial AI isn't slowing down. Germany is ready. Following London Tech Week and GTC Paris at VivaTech, NVIDIA founder and CEO Jensen Huang's Europea...

12/06/2025

NVIDIA TensorRT Boosts Stable Diffusion 3.5 Performance on NVIDIA GeForce RTX and RTX PRO GPUs

Generative AI has reshaped how people create, imagine and interact with digital ...

12/06/2025

Turn RTX ON With 40% Off Performance Day Passes

Level up GeForce NOW experiences this summer with 40% off Performance Day Passes. Enjoy 24 hours of premium cloud gaming with RTX ON, delivering low latency and...

11/06/2025

NVIDIA DRIVE Full-Stack Autonomous Vehicle Software Rolls Out

NVIDIA is launching a comprehensive, industry-defining autonomous vehicle (AV) software platform to accelerate large-scale deployment of safe, intelligent trans...

11/06/2025

NVIDIA Research Casts New Light on Scenes With AI-Powered Rendering for Physical AI Development

NVIDIA Research has developed an AI light switch for videos that can turn daytim...

11/06/2025

European Researchers Develop AI-Native Wireless Networks With NVIDIA 6G Research Portfolio

Using NVIDIA platforms, tools and libraries, European telecommunications institu...

11/06/2025

NVIDIA Scores Consecutive Win for End-to-End Autonomous Driving Grand Challenge at CVPR

NVIDIA was today named an Autonomous Grand Challenge winner at the Computer Visi...

11/06/2025

European Robot Makers Adopt NVIDIA Isaac, Omniverse and Halos to Develop Safe, Physical AI-Driven Robot Fleets

In the face of growing labor shortages and need for sustainability, European man...

11/06/2025

Retail Reboot: Major Global Brands Transform End-to-End Operations With NVIDIA

AI is packing and shipping efficiency for the retail and consumer packaged goods (CPG) industries, with a majority of surveyed companies in the space reporting ...

11/06/2025

NVIDIA Brings Physical AI to European Cities With New Blueprint for Smart City AI

Urban populations are expected to double by 2050, which means around 2.5 billion...

11/06/2025

Calling on LLMs: New NVIDIA AI Blueprint Helps Automate Telco Network Configuration

Telecom companies last year spent nearly $295 billion in capital expenditures an...

11/06/2025

European Broadcasting Union and NVIDIA Partner on Sovereign AI to Support Public Broadcasters

In a new effort to advance sovereign AI for European public service media, NVIDI...

11/06/2025

NVIDIA CEO Drops the Blueprint for Europe's AI Boom

At GTC Paris - held alongside VivaTech, Europe's largest tech event - NVIDIA founder and CEO Jensen Huang delivered a clear message: Europe isn't just a...

10/06/2025

The Blue Lion Supercomputer Will Run on NVIDIA Vera Rubin - Here's Why That Matters

Germany's Leibniz Supercomputing Centre, LRZ, is gaining a new supercomputer...

10/06/2025

Clear Skies Ahead: New NVIDIA Earth-2 Generative AI Foundation Model Simulates Global Climate at Kilometer-Scale Resolution

With a more detailed simulation of the Earth's climate, scientists and resea...

10/06/2025

Cisco and NVIDIA Advance Security for Enterprise AI Factories

Cisco and NVIDIA are helping set a new standard for secure, scalable and high-performance enterprise AI. Announced today at the Cisco Live conference in San Di...

09/06/2025

UK Prime Minister, NVIDIA CEO Set the Stage as AI Lights Up Europe

AI isn't waiting. And this week, neither is Europe. At London's Olympia, under a ceiling of steel beams and enveloped by the thrum of startup pitches, ...

08/06/2025

AI Maker, Not an AI Taker': UK Builds Its Vision With NVIDIA Infrastructure

U.K. Prime Minister Keir Starmer's ambition for Britain to be an AI maker, not an AI taker, is becoming a reality at London Tech Week. With NVIDIA's ...

05/06/2025

GeForce NOW Kicks Off a Summer of Gaming With 25 New Titles This June

GeForce NOW is a gamer's ticket to an unforgettable summer of gaming. With 25 titles coming this month and endless ways to play, the summer is going to be e...

04/06/2025

NVIDIA Blackwell Delivers Breakthrough Performance in Latest MLPerf Training Results

NVIDIA is working with companies worldwide to build out AI factories - speeding ...

04/06/2025

How 1X Technologies' Robots Are Learning to Lend a Helping Hand

Humans learn the norms, values and behaviors of society from each other - and Bernt B rnich, founder and CEO of 1X Technologies, thinks robots should learn like...

04/06/2025

NVIDIA RTX Blackwell GPUs Accelerate Professional-Grade Video Editing

4:2:2 cameras - capable of capturing double the color information compared with most standard cameras - are becoming widely available for consumers. At the same...

02/06/2025

Bring Receipts: New NVIDIA AI Blueprint Detects Fraudulent Credit Card Transactions With Precision

Editor's note: This blog, originally published on October 28, 2024, has been...

02/06/2025

Researchers and Students in Trkiye Build AI, Robotics Tools to Boost Disaster Readiness

Since a 7.8-magnitude earthquake hit Syria and T rkiye two years ago - leaving 5...

29/05/2025

The Supercomputer Designed to Accelerate Nobel-Worthy Science

Ready for a front-row seat to the next scientific revolution? That's the idea behind Doudna - a groundbreaking supercomputer announced today at Lawrence Be...

29/05/2025

Run LLMs on AnythingLLM Faster With NVIDIA RTX AI PCs

Large language models (LLMs), trained on datasets with billions of tokens, can generate high-quality content. They're the backbone for many of the most popu...

29/05/2025

RTX on Deck: The GeForce NOW Native App for Steam Deck Is Here

GeForce NOW is supercharging Valve's Steam Deck with a new native app - delivering the high-quality GeForce RTX-powered gameplay members are used to on a po...

28/05/2025

NVIDIA's Bartley Richardson on How Teams of AI Agents Provide Next-Level Automation

Building effective agentic AI systems requires rethinking how technology interac...

27/05/2025

How Dell Technologies Is Building the Engines of AI Factories With NVIDIA Blackwell

Over a century ago, Henry Ford pioneered the mass production of cars and engines...

27/05/2025

NVIDIA and Google Partnership Gains Momentum With the Latest Blackwell and Gemini Announcements

NVIDIA and Google share a long-standing relationship rooted in advancing AI inno...

22/05/2025

Sale Into Summer With 40% Off GeForce NOW Six-Month Performance Memberships

GeForce NOW is turning up the heat this summer with a hot new deal. For a limited time, save 40% on six-month Performance memberships and enjoy premium GeForce ...