Sony Pixel Power calrec Sony

New NVIDIA Maxine Cloud-Native Architecture Delivers Breakthrough Audio and Video Quality at Scale

20/09/2022

The latest release of NVIDIA Maxine is paving the way for real-time audio and video communications. Whether for a video conference, a call made to a customer service center, or a live stream, Maxine enables clear communications to enhance virtual interactions.

NVIDIA Maxine is a suite of GPU-accelerated AI software development kits (SDKs) and cloud-native microservices for deploying optimized and accelerated AI features that enhance audio, video and augmented-reality (AR) effects in real time.

And with Maxine's state-of-the-art models, end users don't need expensive gear to improve audio and video. Using NVIDIA AI-based technology, these high-quality effects can be achieved with standard microphones and camera equipment.

At GTC, NVIDIA announced the re-architecture of Maxine for cloud-native microservices, with the early-access release of Maxine's audio-effects microservice. Additionally, new Maxine SDK features were unveiled, including Speaker Focus and Face Expression Estimation, as well as the general availability of Eye Contact. NVIDIA Maxine now also includes enhanced versions of existing SDK features.

Maxine Goes Cloud Native Maxine's cloud-native microservices allow developers to build real-time AI applications. Microservices can be independently managed and deployed seamlessly in the cloud, accelerating development timelines.

The Audio Effects microservice, available in early access, contains four state-of-the-art audio features:

Background Noise Removal: Removes several common background noises using AI models, while preserving the speaker's natural voice.

Room Echo Removal: Removes reverberations from audio using AI models, restoring clarity of a speaker's voice.

Audio Super Resolution: Improves audio quality by increasing the temporal resolution of audio signal. It currently supports upsampling from 8 kHz to 16 kHz and from 16 kHz to 48 kHz.

Acoustic Echo Cancellation: Cancels real-time acoustic device echo from the input-audio stream, eliminating mismatched acoustic pairs and double-talk. With AI-based technology, more effective cancellation is achieved than with traditional digital signal processing.

Pexip, a leading provider of enterprise video conferencing and collaboration solutions, is using NVIDIA AI technologies to take virtual meetings to the next level with advanced features for the modern workforce.

With Maxine's move to cloud-native microservices, it will be even easier to combine NVIDIA's advanced AI technologies with our own unique server-side architecture, said Eddie Clifton, senior vice president of Strategic Alliances at Pexip. This allows our teams at Pexip to deliver an enhanced experience for virtual meetings.

Sign up for early access.

Explore Enhanced Features of SDKs Maxine offers three GPU-accelerated SDKs that reinvent real-time communications with AI: audio, video and AR effects.

The audio effects SDK delivers multi-effect, low-latency, AI-based audio-quality enhancement algorithms. Speaker Focus, available in early access, is a new feature that separates the audio tracks of foreground and background speakers, making each voice more intelligible. Additionally, the Audio Super Resolution SDK feature has been updated with enhanced quality.

The video effects SDK creates AI-based video effects with standard webcam input. The Virtual Background feature, which segments a person's profile and applies AI-powered background removal, replacement or blur, has been updated with enhanced temporal stability.

And the AR SDK provides AI-powered, real-time 3D face tracking and body pose estimation based on a standard web camera feed. Latest features include:

Eye Contact: Simulates eye contact by estimating and aligning gaze with the camera.

Face Expression Estimation: Tracks the face and infers what expression is presented by the subject.

The following AR features have been updated:

Body Pose Estimation: Predicts and tracks 34 key points of the human body in 2D and 3D - now with support for multi-person tracking.

Face Landmark Tracking: Recognizes facial features and contours using 126 key points. Tracks head pose and facial deformation due to head movement and expression - in three degrees of freedom in real time - now with Quality mode to achieve even higher-quality tracking.

Face Mesh: Represents a human face with a 3D mesh with up to 3,000 vertices and six degrees of freedom - now includes 3D morphable models from the USC Institute of Creative Technologies.

Try out the Maxine SDKs. To directly experience Maxine's effects, download the NVIDIA Broadcast App.

Experience State-of-the-Art Effects With the Power of AI Maxine SDKs and microservices provide a suite of low-latency AI effects that can be integrated with existing customer infrastructures. Developers can tap into cutting-edge AI capabilities with Maxine, as the technology is built on the NVIDIA AI platform and has world-class pretrained models for users to create, customize and deploy premium audio- and video-quality features.

Maxine is also part of the NVIDIA Omniverse Avatar Cloud Engine, a collection of cloud-based AI models and services for developers to build, customize and deploy interactive avatars. Maxine's customizable cloud-native microservices allow for independent deployment into AI-effects pipelines. Maxine can be deployed on premises, in the cloud or at the edge.

Learn more about NVIDIA Maxine and other technology breakthroughs by watching the GTC keynote by NVIDIA founder and CEO Jensen Huang:
LINK: https://blogs.nvidia.com/blog/2022/09/20/maxine-cloud-native/...
See more stories from nvidia

Most recent headlines

09/11/2025

Dalet Unveils Agentic AI Media Workflows at IBC2025

Dalet today announced a transformative leap forward for media operations: Agentic Artificial Intelligence (AI) that unifies the Dalet ecosystem under one natura...

29/10/2025

ESPN, Sony Ink Deal to Expand Animated Altcasts for 2025-26

ESPN said it will produce animated telecasts for NFL, NHL, NBA and WNBA games across The Walt Disney Co. and ESPN platforms during the 2025-26 season under an a...

29/10/2025

FCC Approves Notice of Proposed Rulemaking on NextGen TV

WASHINGTON Despite the government shutdown, the Federal Communications Commission has passed, with some revisions, a previously announced Notice of Proposed Rul...

29/10/2025

SBS, NITV and Screen Australia announce 2025 Digital Originals Shortlist

29 10 2025 - Media release SBS, NITV and Screen Australia announce 2025 Digital Originals Shortlist The 2025 Digital Originals shortlisted teams. Photo credit...

28/10/2025

SVG All-Stars: Catherine Chalfant, Manager, Remote Operations, ESPN

SVG All-Stars: Catherine Chalfant, Manager, Remote Operations, ESPNThe Ole Miss alum is an operational force behind ESPN's extensive college-football catalo...

28/10/2025

Elevating the Experience: AI and Data Take Ryder Cup to the Next Level

Elevating the experience: AI and data take Ryder Cup to the next level By Joe OHalloran Tuesday, October 28, 2025 - 10:25 Print This Story NBC produced th...

28/10/2025

Conquering the Air (Waves): Taking a Close Up Look at the IBC Accelerator Private 5G from Land to Sea to Sky'

Conquering the Air (waves): Taking a close up look at the IBC Accelerator Priva...

28/10/2025

World Series 2025: Spectrum SportsNet LA Brings Dodgers Fans Closer to the Action With Pre/Postgame Coverage

World Series 2025: Spectrum SportsNet LA Brings Dodgers Fans Closer to the Actio...

28/10/2025

The Thing with Feathers Brings the Horror of Grief to the Screen

Dylan Southern and Benedict Cumberbatch at the premiere of The Thing with Feathers (photo by George Pimentel / Shutterstock for Sundance Film Festival)...

28/10/2025

Spotify's Greasy Tunes Caf Serves Up the Sights, Sounds, and Flavors of Lagos

For three weeks in Lagos, Spotify's Greasy Tunes Caf pop-up brought the cit...

28/10/2025

Spotify's New OFFCULT Playlist Is a Love Letter to the Future of German Rap

Once a niche subculture, German rap has evolved into an influential cultural movement. Now, Spotify is giving the genre a new home with OFFCULT, a playlist dedi...

28/10/2025

Shane Delia's Malta serves up the Mediterranean this summer

Shane Delia's Malta serves up the Mediterranean this summer 28 October, 2025 Media releases Feast on 9,000 years of culinary history Mondays from 24 No...

28/10/2025

SBS's global sporting festival continues with the FIVB Beach Volleyball World Championships in Adelaide

SBS's global sporting festival continues with the FIVB Beach Volleyball Worl...

28/10/2025

AgileTV achieves ISO/IEC 27001 certification, strengthening its commitment to secure and reliable video services

Bilbao, October 28, 2025 - AgileTV, a leading technology solutions company for t...

28/10/2025

Football Scores Extra Points for Multi-Platform Companies in Nielsen's September Media Distributor Gauge

Disney, NBCUniversal, FOX, Paramount Each Achieve Double-Digit Monthly Growth ...

28/10/2025

Scripps to Sell WRTV to Circle City Broadcasting for $83 million

CINCINNATI The E.W. Scripps Company has announced an agreement to sell WRTV, its local ABC-affiliated station in Indianapolis, to Circle City Broadcasting for $...

28/10/2025

Berklee College of Music and Berklee Valencia Named to Billboards 2025 Top Music Business Schools List

Berklee College of Music and Berklee Valencia Named to Billboards 2025 Top Music...

28/10/2025

Survey: Consumers Rank AI as a Major Influence on Their Shopping Decisions

NEW YORK As AI usage continues to spike, a new study from IAB delves into an important aspect of how AI is transforming the advertising business with new data s...

28/10/2025

Broadcast Tech Pioneer Charlie Jablonski Has Died

Charlie Jablonski, a broadcast tech pioneer who helped shape the modern era of Olympics television coverage, died Oct. 25 at his home in Lake George N.Y., the N...

28/10/2025

Bitmovin Unveils Real-Time Observability Solution for Video Streaming

VIENNA, Austria Bitmovin has launched Bitmovin Observability, a new stand-alone video data solution that delivers real-time insights into video playback. The so...

28/10/2025

LucidLink Now Integrated With Adobe Frame.io

LOS ANGELES LucidLink, the file streaming platform, has announced a Frame.io integration and expanded mobile capabilities at Adobe Max....

28/10/2025

Mediagenix Joins AWS ISV Accelerate Program

Mediagenix, a global leader in smart content solutions to profitably connect the right content to the right audience, today announced that it has joined the Ama...

28/10/2025

Lightware Taurus product family introduces 5K support

Lightware, an industry leader in connectivity and signal management solutions, has announced a major update to its Taurus platform, which now delivers flawless...

28/10/2025

Hiltron to Promote its Broad Range of Satcom Products and...

Following a successful mid-September International Broadcasting Convention in Amsterdam, Hiltron Communications will promote its full range of satellite communi...

28/10/2025

Open Broadcast Systems Selects Media Consulting and Servi...

Open Broadcast Systems has chosen MC&S (Media Consulting & Services) as a reseller to help strengthen its presence in France. With over twenty years of experi...

28/10/2025

Bitmovin Unveils Real-Time Observability Solution for Vid...

Bitmovin, leading provider of video streaming solutions, has launched Bitmovin Observability, a new stand-alone video data solution that delivers real-time insi...

28/10/2025

Ease Live Powers Interactive Champions League Viewer Expe...

Ease Live, the leader in interactive TV technology, today announced the successful launch of interactive graphical overlays for UEFA Champions League matches fo...

28/10/2025

LucidLink unveils Frame io integration and expanded mobil...

LucidLink, the file streaming platform, today at Adobe MAX announced a Frame.io integration and expanded mobile capabilities, streamlining collaboration and hel...

28/10/2025

Nick Hascenez Named GM of WNDU South Bend

ATLANTA Gray Media has promoted Nick Hasenecz to general manager of WNDU, its NBC affiliate in the South Bend-Elkhart, Ind., market....

28/10/2025

Applications Open for Berklee Fenway Neighborhood Improvement Grant

Applications Open for Berklee Fenway Neighborhood Improvement Grant Boston nonprofits can apply by December 12 for funding to support community projects that ...

28/10/2025

NVIDIA and US Technology Leaders Unveil AI Factory Design to Modernize Government and Secure the Nation

Governments everywhere are racing to harness the power of AI - but legacy infras...

28/10/2025

NVIDIA IGX Thor Robotics Processor Brings Real-Time Physical AI to the Industrial and Medical Edge

AI is moving from the digital world into the physical one. Across factory floors...

28/10/2025

NVIDIA Open Sources Aerial Software to Accelerate AI-Native 6G

NVIDIA is delivering the telecom industry a major boost in open-source software for building AI-native 5G and 6G networks. NVIDIA Aerial software will soon be ...

28/10/2025

NVIDIA and General Atomics Advance Commercial Fusion Energy

The race to bottle a star now runs on AI. NVIDIA, General Atomics and a team of international partners have built a high-fidelity, AI-enabled digital twin for ...

28/10/2025

NVIDIA, NPS Commission the Navy's AI Flagship for Training Tomorrow's Leaders

Along the Pacific Ocean in Monterey, California, the Naval Postgraduate School (...

28/10/2025

Fueling Economic Development Across the US: How NVIDIA Is Empowering States, Municipalities and Universities to Drive Innovation

To democratize access to AI technology nationwide, AI education and deployment c...

28/10/2025

NVIDIA AI Physics Transforms Aerospace and Automotive Design, Accelerating Engineering by 500x

Leading technology companies in aerospace and automotive are accelerating their ...

28/10/2025

VEON's JazzCash Wins Silver Award for Innovation in Lending at Money20/20 USA 2025

28 Oct 2025 VEON's JazzCash Wins Silver Award for Innovation in Lending at ...

28/10/2025

A League of Their Own returns on 12 November as Romesh, Jamie, Jill and Micah celebrate the farewell series with a star-studded line-up

Guests include Wayne Rooney, Maya Jama, Dame Laura Kenny, Chloe Kelly, Chris McC...

28/10/2025

Cynthia Erivo and Ariana Grande to lead a once-in-a-lifetime musical event, Wicked: One Wonderful Night

The two-hour special, recorded live from the iconic Dolby Theatre in LA, will ai...

28/10/2025

Eutelsat upgrades teleports with Rohde & Schwarz satellite uplink amplifiers

Eutelsat upgrades teleports with Rohde & Schwarz satellite uplink amplifiers High efficiency and resilient Ku-band amplifiers for excellent RF performance ...

28/10/2025

ABC Welcomes Three New Board Members

These appointments come at a pivotal time for ABC, as the organisation continues to evolve to meet the changing needs of a digital-first media ecosystem. The ne...

28/10/2025

October 27, 2025

Scripps Research awarded $4 million to advance platform for neurodevelopmental disorders The California Institute for Regenerative Medicine (CIRM) grant support...

27/10/2025

You Can Touch This: Haptics Becoming Central to the Virtual Live Experience

You can touch this: Haptics becoming central to the virtual live experience By Adrian Pennington Friday, October 24, 2025 - 09:12 Print This Story The vid...

27/10/2025

A Tale of Two Trailers: France's Stop & Go Doubles Up With its New Hybrid Truck

A tale of two trailers: France's Stop & Go doubles up with its new hybrid tr...

27/10/2025

Pro Padel League Stages City's Cup Finals Inside NYC's Hammerstein Ballroom

Pro Padel League Stages City's Cup Finals Inside NYC's Hammerstein Ballr...

27/10/2025

World Series 2025: Sportsnet Delivers Made-in-Canada' Moment for a Nation United Behind the Toronto Blue Jays

World Series 2025: Sportsnet Delivers Made-in-Canada' Moment for a Nation U...

27/10/2025

ESPN Extends Partnership With Sony's Beyond Sports To Expand Animated Alternate Telecasts

ESPN Extends Partnership With Sony's Beyond Sports To Expand Animated Altern...