Sony Pixel Power calrec Sony

NVIDIA's Shalini De Mello Talks Self-Supervised AI, NeurIPS Successes

07/04/2021

Shalini De Mello, a principal research scientist at NVIDIA who's made her mark inventing computer vision technology that contributes to driver safety, finished 2020 with a bang - presenting two posters at the prestigious NeurIPS conference in December.

A 10-year NVIDIA veteran, De Mello works on self-supervised and few-shot learning, 3D reconstruction, viewpoint estimation and human-computer interaction.

She told NVIDIA AI Podcast host Noah Kravitz about her NeurIPS submissions on reconstructing 3D meshes and self-learning transformations for improving head and gaze redirection - both significant challenges for computer vision.

The AI Podcast NVIDIA's Shalini De Mello Talks Self-Supervised AI, NeurIPS Successes Ep. 140

De Mello's first poster demonstrates how she and her team successfully manage to recreate 3D models in motion without requiring annotations of 3D mesh, 2D keypoints or camera pose - even on such kinetic figures as animals in the wild.

The second poster takes on the issue of datasets in which large portions are unlabeled - focusing specifically on datasets consisting of images of human faces with many variables, including lighting, reflections and head and gaze orientation. De Mello achieved an architecture that could self-learn these variations and control them.

De Mello intends to continue focusing on creating self-supervising AI systems that require less data to achieve the same quality output, which she envisions ultimately helping to reduce bias in AI algorithms.

Key Points From This Episode:

Early in her career at NVIDIA, De Mello noticed that technologies for looking inside the car cabin weren't as mature as the algorithms for automotive vision outside the car. She focused her research on the former, leading to the creation of NVIDIA's DRIVE IX product for AI-based automotive interfaces in cars.

While science has been a lifelong passion, De Mello discovered an appreciation for art and found the perfect blend of the two in signal and image processing. She could immediately see the effects of AI on visual content.

Tweetables: We as humans are able to learn effectively with less data - how can we make learning systems do the same? This is a fundamental question to answer for the viability of AI [29:29]

Looking back at my career, the one thing I've learned is that it's really important to follow your passion [32:37]

You Might Also Like: Behind the Scenes at NeurIPS with NVIDIA and CalTech's Anima Anandkumar Anima Anandkumar, NVIDIA's director of machine learning research and Bren professor at CalTech's CMS Department, joins AI Podcast host Noah Kravitz to talk about NeurIPS 2020 and to discuss what she sees as the future of AI.

MIT's Jonathan Frankle on The Lottery Hypothesis Jonathan Frankle, a Ph.D. student at MIT, discusses a paper he co-authored focusing on The Lottery Hypothesis, which promises to help advance our understanding of why neural networks, and deep learning, works so well.

NVIDIA's Neda Cvijetic Explains the Science Behind Self-Driving Cars Neda Cvijetic, senior manager of autonomous vehicles at NVIDIA, leads the NVIDIA DRIVE Labs series of videos and blogs that break down the science behind autonomous vehicles. She takes NVIDIA AI Podcast Noah Kravitz behind the wheel of a (metaphorical) self-driving car.

Tune in to the AI Podcast Get the AI Podcast through iTunes, Google Podcasts, Google Play, Castbox, DoggCatcher, Overcast, PlayerFM, Pocket Casts, Podbay, PodBean, PodCruncher, PodKicker, Soundcloud, Spotify, Stitcher and TuneIn. If your favorite isn't listed here, drop us a note.

Make the AI Podcast Better Have a few minutes to spare? Fill out this listener survey. Your answers will help us make a better podcast.
LINK: https://blogs.nvidia.com/blog/2021/04/07/nvidia-research-shalini-de-me...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

09/10/2026

Dolby Expands Dolby OptiView Platform with New Capabilities at IBC 2026

September 10 2026, 06:00 (PDT) Dolby Expands Dolby OptiView Platform with New Capabilities at IBC 2026 New Sports Intelligence helps providers better unders...

07/10/2026

Dalet Flex LTS Delivers Smarter Media Operations from Ingest to Distribution

Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...

10/09/2026

First AI-Generated Golf Announcer To Debut During New Mexico Open

Duff Foreman is an AI-generated announcer who will add color to this month's New Mexico Open...

10/09/2026

IBC 2026: Bitmovin Rolls Out Encoder Version 3

Bitmovin is rolling out Encoder Version 3, the next major release of the technology behind its VOD and Live Encoders. Version 3 is built on a premise every stre...

10/09/2026

IBC 2026: Net Insight Highlights Open Live Media for Controlled Live Services

At IBC2026, on booth 1.B47, Net Insight will showcase Open Live Media, its architecture for delivering resilient live media services across networks, partners, ...

10/09/2026

PWHL, Scripps Sports Sign National Television Deal for 2026-27 Season

The Professional Women's Hockey League (PWHL) and Scripps Sports have announced a national broadcast rights agreement for the 2026-27 season, a landmark par...

10/09/2026

IBC 2026: Trusted Partner Network Debuts Fix It or Risk It to Tackle Everyday Security Risks

The Trusted Partner Network (TPN), the global content security initiative powere...

10/09/2026

NFL Brings Back Creator Programs to Deliver Access, Original Storytelling During the 2026 Season

The NFL is launching its most expansive creator programming yet, bringing togeth...

10/09/2026

Sportsnet Removes 150 Blackouts for More National NHL Games Than Ever in 2026-2027 Season

Sportsnet is set to deliver its biggest hockey season ever with a national sched...

10/09/2026

IBC 2026: LiveU Showcases Starlink for News and Sports Broadcast as Clarus Integrated Reseller

LiveU is now a Clarus Integrated Reseller, bringing Starlink's fast, reliabl...

10/09/2026

IBC 2026: Mimir Develops Single Layer for Content, Metadata, AI Orchestration

Mimir is the cloud-native media production platform built for teams that need to move media fast across live, archive, web, social, and broadcast workflows. At ...

10/09/2026

IBC 2026: ATSC 3.0 To Receive Technology & Engineering Emmy Award for Significant Advancement in Television Broadcasting

ATSC is being honored with a 2026 Technology & Engineering Emmy Award by the Nat...

10/09/2026

Audio-Technica Presents BP880R Contact Transducer for Immersive Sports Broadcast, Production Audio Enhancement

Audio-Technica has introduced the BP880R Contact Transducer, a specialized micro...

10/09/2026

ESPN, ION Team Up to Broadcast WTGL Starting on Nov. 8

TMRW Sports in partnership with the LPGA, today announced multiyear U.S. media rights agreements with ESPN and Scripps Sports/ION to bring WTGL, the new women&#...

10/09/2026

SportsNet Pittsburgh Honors Roberto Clemente Day With Second-Annual Live Spanish-Language Pirates Telecast

SportsNet Pittsburgh (SNP) in partnership with Major League Baseball and the Pit...

10/09/2026

Tennis Channel Gives Fans Options With Premium Subscription on Roku

Tennis Channel announced today its launch as a Premium Subscription on The Roku Channel. Tennis Channel offers viewers a single home for Tennis Channel and Ten...

10/09/2026

IBC 2026: Dolby Expands Dolby OptiView Platform With New Capabilities

Dolby has announced major updates to Dolby OptiView, its live sports platform, ahead of IBC 2026. The updates include new AI-powered intelligence to better unde...

10/09/2026

Dalet Names Brian Doheny as CEO

Dalet has appointed Brian Doheny as CEO. Doheny joined Dalet as President and Chief Revenue Officer in April 2026. Since joining Dalet, Doheny has led the compa...

10/09/2026

IBC 2026: Sony Demonstrates Various Creative Solutions for Attendees at the RAI

Sony, as well as its partner company Nevion, is starting IBC 2026 with a handful of announcements for attendees to see on the show floor. Sony Announces the 4t...

10/09/2026

SoFi Stadium Solidifies Production Output With Multi-Layered Tech Renovation

The six-year-old venue is expanding capabilities for NFL action, Super Bowl LXI, 2028 Summer Olympics SoFi Stadium, as well as the surrounding area known as Ho...

10/09/2026

Acon Digital introduce Acoustica 8

Editing, restoration & mastering suite upgraded Acon Digital Acoustica 8 audio editing restoration mastering software. Acon Digital have just launched the la...

10/09/2026

Readipop & XOX open XOX Studio

Classic synths & drum machines available to play Based in Reading, UK, Readipop are a music and arts charity with a long track record of innovative, partici...

10/09/2026

Neumann launch the KH 310 II & KH 350

Popular model updated & new addition introduced With many of the models in Neumann's KH family now boasting onboard DSP and support for the company'...

10/09/2026

Arturia launch the AudioFuse Studio Rev2

Improved desktop interface announced The latest iteration of Arturia's flagship desktop audio interface has just arrived, introducing improved preamps, ...

10/09/2026

Progress needs proof: Rohde & Schwarz showcases its trailblazing test solutions at EuMW 2026 in London

Progress needs proof: Rohde & Schwarz showcases its trailblazing test solutions ...

10/09/2026

Nielsen launches CTV ad spend data into its French Ad Intel product

France launch follows UK and Germany as Nielsen expands product across EMEA Paris, France, September 10, 2026 - Nielsen, a global leader in audience measuremen...

10/09/2026

Fabric Data, TMT Insights Merge to Create Fabric Insights

Share Copy link Facebook X Linkedin Bluesky Email...

10/09/2026

Leading Audio Manufacturers Join Forces on Dialog Intelli...

Leading professional audio manufacturers NUGEN Audio, RTW, Steinberg and Telos Alliance have joined forces with Fraunhofer IDMT to establish a common approach t...

10/09/2026

Setplex Introduces AI Insider for Faster Smarter Video Se...

Built Into Setplex's Zapflex Platform, AI Insider Turns Video Service Data Into Actionable Insights Setplex today introduced AI Insider, a breakthrough new...

10/09/2026

sync labs to Introduce sync productions at IBC2026 Bringi...

Managed service changes dialogue without actor-specific training or facial rigging while preserving the original performance and fitting established post-produc...

10/09/2026

ACT Pixel Academy Autumn Courses PR

The ACT Entertainment tvONE and Green Hippo Pixel Academy has released its autumn course schedule, with hands-on training dates in September, October and Novemb...

10/09/2026

Orange Polska Reaffirms Its Trust in Viaccess-Orca with M...

Orange Polska continues to Rely on Viaccess-Orca for Secure TV Services and the Next Phase of its Technology Evolution Viaccess-Orca (VO), a global leader in T...

10/09/2026

Generate and create directly in your timeline with new AI-powered innovations in Premiere and After Effects

Generate and create directly in your timeline with new AI-powered innovations in...

10/09/2026

Tedial to introduce Media Business Hub at IBC 2026

Tedial is introducing Media Business Hub (MBH) at IBC 2026, a new business enablement platform designed to help media organizations unlock the full value of the...

10/09/2026

Globecast Unveils Next Phase of Media Orchestration at IB...

Globecast, a leading provider of broadcast, media and entertainment managed services, will unveil the next phase of its transformation at IBC2026 with a preview...

10/09/2026

Fabric Data and TMT Insights Merge to Create Fabric Insig...

Fabric Data and TMT Insights today announced that the two companies are combining to create Fabric Insights, uniting authoritative data, purpose-built software,...

10/09/2026

Operative Launches Unified Platform to Transform Advertis...

Operative, the preferred advertising and broadcast management provider for the world's leading media brands, today announced a comprehensive slate of new pr...

10/09/2026

Leader announces new Sx2 handheld Test and Measurement se...

Test & measurement innovator, Leader Electronics of Europe, has announced the launch of its latest range of handheld signal generation, analysis and monitoring ...

10/09/2026

Kiloview Partners with Zixi to Deliver Reliable IP Video...

The partnership begins with native Zixi protocol support on the Kiloview D350 and will extend to deeper product integration and joint go-to-market initiatives ...

10/09/2026

Avid and FilmLight announce strategic partnership to reimagine the color pipeline for post production

Avid and FilmLight announce strategic partnership to reimagine the color pipelin...

10/09/2026

Maxon Brings Exclusive Preview of Fall Innovations to IBC2026

Maxon Brings Exclusive Preview of Fall Innovations to IBC2026 Brie Clayton September 10, 2026 0 Comments IBC attendees will get the first look at new ...

10/09/2026

Three Boston Conservatory Dance Alums Honored for Their Early-Career Promise

Three Boston Conservatory Dance Alums Honored for Their Early-Career Promise India Hobbs and Demetrius Lee received Princess Grace Awards, while Lilly David t...

10/09/2026

MonoNeon Returns to Berklee to Kick Off Signature Series

MonoNeon Returns to Berklee to Kick Off Signature Series The Grammy-winning bassist and alumnus performs with students and faculty from the Planet MicroJam In...

10/09/2026

Study: NFL Ad Revenue to Hit a Record $6.3 Billion

Share Copy link Facebook X Linkedin Bluesky Email...

10/09/2026

Teradek Unveils Bolt 7 With 900MHz RF Pipeline

Share Copy link Facebook X Linkedin Bluesky Email...

10/09/2026

Survey: Roku Remains Most Popular Streamer

Share Copy link Facebook X Linkedin Bluesky Email...

10/09/2026

Sony Unveils Fourth Generation Of DWX Wireless Mics

Share Copy link Facebook X Linkedin Bluesky Email...

10/09/2026

Scripps Revamps Local Media Regional Leadership Structure

Share Copy link Facebook X Linkedin Bluesky Email...