Sony Pixel Power calrec Sony

NVIDIA's Shalini De Mello Talks Self-Supervised AI, NeurIPS Successes

07/04/2021

Shalini De Mello, a principal research scientist at NVIDIA who's made her mark inventing computer vision technology that contributes to driver safety, finished 2020 with a bang - presenting two posters at the prestigious NeurIPS conference in December.

A 10-year NVIDIA veteran, De Mello works on self-supervised and few-shot learning, 3D reconstruction, viewpoint estimation and human-computer interaction.

She told NVIDIA AI Podcast host Noah Kravitz about her NeurIPS submissions on reconstructing 3D meshes and self-learning transformations for improving head and gaze redirection - both significant challenges for computer vision.

The AI Podcast NVIDIA's Shalini De Mello Talks Self-Supervised AI, NeurIPS Successes Ep. 140

De Mello's first poster demonstrates how she and her team successfully manage to recreate 3D models in motion without requiring annotations of 3D mesh, 2D keypoints or camera pose - even on such kinetic figures as animals in the wild.

The second poster takes on the issue of datasets in which large portions are unlabeled - focusing specifically on datasets consisting of images of human faces with many variables, including lighting, reflections and head and gaze orientation. De Mello achieved an architecture that could self-learn these variations and control them.

De Mello intends to continue focusing on creating self-supervising AI systems that require less data to achieve the same quality output, which she envisions ultimately helping to reduce bias in AI algorithms.

Key Points From This Episode:

Early in her career at NVIDIA, De Mello noticed that technologies for looking inside the car cabin weren't as mature as the algorithms for automotive vision outside the car. She focused her research on the former, leading to the creation of NVIDIA's DRIVE IX product for AI-based automotive interfaces in cars.

While science has been a lifelong passion, De Mello discovered an appreciation for art and found the perfect blend of the two in signal and image processing. She could immediately see the effects of AI on visual content.

Tweetables: We as humans are able to learn effectively with less data - how can we make learning systems do the same? This is a fundamental question to answer for the viability of AI [29:29]

Looking back at my career, the one thing I've learned is that it's really important to follow your passion [32:37]

You Might Also Like: Behind the Scenes at NeurIPS with NVIDIA and CalTech's Anima Anandkumar Anima Anandkumar, NVIDIA's director of machine learning research and Bren professor at CalTech's CMS Department, joins AI Podcast host Noah Kravitz to talk about NeurIPS 2020 and to discuss what she sees as the future of AI.

MIT's Jonathan Frankle on The Lottery Hypothesis Jonathan Frankle, a Ph.D. student at MIT, discusses a paper he co-authored focusing on The Lottery Hypothesis, which promises to help advance our understanding of why neural networks, and deep learning, works so well.

NVIDIA's Neda Cvijetic Explains the Science Behind Self-Driving Cars Neda Cvijetic, senior manager of autonomous vehicles at NVIDIA, leads the NVIDIA DRIVE Labs series of videos and blogs that break down the science behind autonomous vehicles. She takes NVIDIA AI Podcast Noah Kravitz behind the wheel of a (metaphorical) self-driving car.

Tune in to the AI Podcast Get the AI Podcast through iTunes, Google Podcasts, Google Play, Castbox, DoggCatcher, Overcast, PlayerFM, Pocket Casts, Podbay, PodBean, PodCruncher, PodKicker, Soundcloud, Spotify, Stitcher and TuneIn. If your favorite isn't listed here, drop us a note.

Make the AI Podcast Better Have a few minutes to spare? Fill out this listener survey. Your answers will help us make a better podcast.
LINK: https://blogs.nvidia.com/blog/2021/04/07/nvidia-research-shalini-de-me...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

01/06/2026

Dolby Sets the New Standard for Premium Entertainment at CES 2026

January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026 Throughout the week, Dolby brings to life the latest innovatio...

01/05/2026

NBCUniversal's Peacock to Be First Streamer to Integrate Dolby's Full Suite of Premium Picture and Sound Innovations

January 5 2026, 18:30 (PST) NBCUniversal's Peacock to Be First Streamer to ...

01/04/2026

DOLBY AND DOUYIN EMPOWER THE NEXT GENERATON OF CREATORS WITH DOLBY VISION

January 4 2026, 18:00 (PST) DOLBY AND DOUYIN EMPOWER THE NEXT GENERATON OF CREATORS WITH DOLBY VISION Douyin Users Can Now Create And Share Videos With Stun...

17/01/2026

Lightware and Google enhance meeting room flexibility wit...

Lightware, an industry leader in signal management, is helping to elevate the Google Meet experience with the introduction of an integration with Taurus UCX. Th...

17/01/2026

Clear-Com Partners with NETGEAR to Deliver OEM Networking...

Clear-Com announced a strategic partnership with NETGEAR AV to offer four high-performance networking switches as original equipment manufacturer (OEM) solutio...

17/01/2026

QuickLink Expands US Reach With Midwich Distribution

QuickLink, a leading provider of award-winning video production and remote guest contribution solutions, today announced a new U.S. distribution partnership wit...

17/01/2026

NUGEN Audio Launches the Next Evolution of MasterCheck

NUGEN Audio announces the latest evolution of MasterCheck, its industry-trusted optimization plug-in for cross-platform mastering and loudness verification. Des...

17/01/2026

BHV Introduces Pro AV Market to SportsBox at ISE 2026

BHV has announced that it will highlight its new SportsBox remote vision mixer and picture processor at ISE in Booth #4H900 marking its official introduction in...

17/01/2026

Clear-Com Reveals New 4-Channel HelixNet Beltpack and Adv...

Clear-Com will return to ISE 2026 to demonstrate its latest intercom solutions for broadcast, live production, and AV professionals. Exhibiting at Stand #4P700...

17/01/2026

Grass Valley Brings Scalable Creative Freedom to Broadcas...

Grass Valley, a leading provider in live production solutions, will exhibit at ISE 2026 in Barcelona from February 3 6, presenting its vision for how modern Bro...

17/01/2026

Utelogy Advances AI and Cloud-First Innovation at ISE 202...

Utelogy Corporation, the global leader in connected workplace management, monitoring, control, automation and analytics closes out a record-breaking 2025. The c...

17/01/2026

FOR-A Europe to Demonstrate Broadcast and Pro-AV Converge...

FOR-A, a cutting-edge video broadcast technology company backed by more than 50 years experience, will showcase its innovative production solutions at ISE 2026 ...

17/01/2026

Tim Jackson Appointed Sr Director of Sales and Business D...

Techex, the UK-based expert in live video solutions over IP and cloud, today announced that Tim Jackson has joined the company as Senior Director of Sales and B...

17/01/2026

Redflag AI Joins Akamais New ISV Catalyst Program as the...

Redflag AI, an AI-powered content protection platform, and Akamai, the cybersecurity and cloud computing company that powers and protects business online, today...

17/01/2026

Encompass Digital Media Strengthens Global Operations wit...

Encompass Digital Media has today announced the appointment of David Hunter as Chief Operating Officer (COO). As a highly respected technology and operations le...

17/01/2026

Glensound highlights quality practicality and innovation...

Glensound is set to showcase its audio and intercom solutions supporting broadcast, live events and professional AV environments at ISE 2026 (stand 7H800, Fira ...

17/01/2026

Matrox Video Showcases New AV-over-IP Capabilities Drivin...

As Matrox Video marks its 50th year of innovation, the company will use ISE 2026 to showcase the latest advancements across its AV-over-IP ecosystem, highlighti...

17/01/2026

Hollywood Professional Association Unveils 2026 HPA Award...

The Hollywood Professional Association (HPA) today announced the nominees for the 2026 HPA Awards Innovation & Technology, marking an expanded evolution of the ...

17/01/2026

Sinclair Asks FCC to Approve Nexstar/Tegna Deal

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

16/01/2026

From Berlin to London: Amazon Prime Video Delivers NBA Europe Games to Global Audience

From Berlin to London: Amazon delivers NBA Europe games for an international aud...

16/01/2026

How Vizrt, TriCaster Helped Harvard Athletics Embrace Vertical Video and More to Serve Fans

How Vizrt, TriCaster Helped Harvard Athletics Embrace Vertical Video and More to...

16/01/2026

SVG GameDay, Ep. 1: PMY Group's Mike Bonner

SVG GameDay, Ep. 1: PMY Group's Mike BonnerThe longtime industry veteran provides insight into his approach to producing live eventsBy Kristian Hern ndez, S...

16/01/2026

Attacking the Pin: Inside the PGA TOUR's Replay Remodel With Hawk-Eye Innovations

Attacking the Pin: Inside the PGA TOUR's Replay Remodel With Hawk-Eye Innova...

16/01/2026

Back to Unrivaled: TNT Sports Reconnects With Mediapro for the League's Sophomore Season

Back to Unrivaled: TNT Sports Reconnects With Mediapro for the League's Soph...

16/01/2026

FloSports Orchestrates Mega Weekend Spotlighted by Chili Bowl Nationals, UCA & UDA College Nationals

FloSports Orchestrates Mega Weekend Spotlighted by Chili Bowl Nationals, UCA & U...

16/01/2026

Sundance Institute Names 2026 Screenwriters Lab and Screenwriters Intensive Fellows

Eleven Projects to Be Developed at Annual January Screenwriters Lab; Nine Projec...

16/01/2026

5 Audiobooks to Help You Level Up in 2026

The start of a new year brings fresh possibilities. Whether you're diving in with big goals or simply setting new intentions, audiobooks can bring inspirati...

16/01/2026

1 Year In: How Creators Are Growing Their Shows and Connecting With Audiences Through the Spotify Partner Program

In 2025 we launched the Spotify Partner Program to give creators more ways to tu...

16/01/2026

NAB Spokesman Alex Siciliano to Depart

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

16/01/2026

Marshall Electronics Showcases the VMV 402 3GSH Seamless...

Marshall Electronics is showcasing its VMV-402-3GSH Seamless 4X Switch at ISE 2026 (Booth 4N900). Designed for presentation systems, control rooms and remote pr...

16/01/2026

HPA Announces Innovation & Technology Award Nominees

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

16/01/2026

Graduate Spotlight: Nadia Castagna

Graduate Spotlight: Nadia Castagna The educator, who grew up in Rochester, New York, shares how she went from Berklee to collaborating on meaningful programs ...

16/01/2026

Culinary Class Wars' Returns for Season 3, Raising the Stakes With a Team-Based Showdown

Back to All News Culinary Class Wars' Returns for Season 3, Raising the St...

15/01/2026

Milano Cortina 2026: OBS CEO Yiannis Exarchos Previews Production Innovations

Milano Cortina 2026: OBS CEO Yiannis Exarchos Previews Production InnovationsFirst Person View drones, AI-based tech target greater fan engagement, efficiencyBy...

15/01/2026

Clever With Cameras: Bringing the Drama of the 2026 ISU European Figure Skating Championships to Viewers with Sunset+Vine

Clever with cameras: Bringing the drama of the 2026 ISU European Figure Skating ...

15/01/2026

No Stranger to Ice: Host Broadcaster Sunset+Vine on Pressure and Planning for the 2026 ISU European Figure Skating Championships

No stranger to ice: Host broadcaster Sunset Vine on pressure and planning for th...

15/01/2026

SVG Campus Shot Callers: Leah Gill, Associate Athletic Director, Digital Media, University of Tennessee at Chattanooga

SVG Campus Shot Callers: Leah Gill, Associate Athletic Director, Digital Media, ...

15/01/2026

National Sports Broadcaster Perspectives: What to Expect in Production in 2026

National Sports Broadcaster Perspectives: What to Expect in Production in 2026Leaders from ESPN, FOX Sports, Netflix, and Warner Bros. Discovery share their pro...

15/01/2026

From Berlin to London: Amazon Delivers NBA Europe Games for an International Audience

From Berlin to London: Amazon delivers NBA Europe games for an international aud...

15/01/2026

Sundance Institute Appoints David Linde as CEO

LOS ANGELES, CA, January 15, 2026 - The nonprofit Sundance Institute today announced the appointment of David Linde as Chief Executive Officer. Linde will assum...

15/01/2026

Excellent training at SGL Carbons Bonn site

The SGL Carbon site in Bonn has a long tradition of training. For many years, young talent has been successfully trained here, regularly achieving excellent exa...

15/01/2026

SGL Carbon and BMW Group receive JEC Innovation Award for Natural Fiber Composites Project

The JEC Composites Innovation Awards annually honor the most innovative and ambi...

15/01/2026

SGL Carbon signs long-term supply agreement with X-energy

X-energy Reactor Company, LLC ( X-energy ) and SGL Carbon LLC ( SGL ) have signed a 10-year framework agreement to provide graphite for the deployment of X-ener...

15/01/2026

Versant Completes Acquisition Of Free TV Networks

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

15/01/2026

House Oversight Hearing on FCC Puts Chair in Spotlight

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

15/01/2026

Radiant Media Player, Cloud DRM Partner on Integration

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

15/01/2026

Telycam to Showcase New Mix One Video Switcher at ISE 2026

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

15/01/2026

Pliant Names Adam Grede as Regional Sales Manager

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

15/01/2026

NFL Wild Card Games Score With Viewers

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...