Sony Pixel Power calrec Sony

NVIDIA's Shalini De Mello Talks Self-Supervised AI, NeurIPS Successes

07/04/2021

Shalini De Mello, a principal research scientist at NVIDIA who's made her mark inventing computer vision technology that contributes to driver safety, finished 2020 with a bang - presenting two posters at the prestigious NeurIPS conference in December.

A 10-year NVIDIA veteran, De Mello works on self-supervised and few-shot learning, 3D reconstruction, viewpoint estimation and human-computer interaction.

She told NVIDIA AI Podcast host Noah Kravitz about her NeurIPS submissions on reconstructing 3D meshes and self-learning transformations for improving head and gaze redirection - both significant challenges for computer vision.

The AI Podcast NVIDIA's Shalini De Mello Talks Self-Supervised AI, NeurIPS Successes Ep. 140

De Mello's first poster demonstrates how she and her team successfully manage to recreate 3D models in motion without requiring annotations of 3D mesh, 2D keypoints or camera pose - even on such kinetic figures as animals in the wild.

The second poster takes on the issue of datasets in which large portions are unlabeled - focusing specifically on datasets consisting of images of human faces with many variables, including lighting, reflections and head and gaze orientation. De Mello achieved an architecture that could self-learn these variations and control them.

De Mello intends to continue focusing on creating self-supervising AI systems that require less data to achieve the same quality output, which she envisions ultimately helping to reduce bias in AI algorithms.

Key Points From This Episode:

Early in her career at NVIDIA, De Mello noticed that technologies for looking inside the car cabin weren't as mature as the algorithms for automotive vision outside the car. She focused her research on the former, leading to the creation of NVIDIA's DRIVE IX product for AI-based automotive interfaces in cars.

While science has been a lifelong passion, De Mello discovered an appreciation for art and found the perfect blend of the two in signal and image processing. She could immediately see the effects of AI on visual content.

Tweetables: We as humans are able to learn effectively with less data - how can we make learning systems do the same? This is a fundamental question to answer for the viability of AI [29:29]

Looking back at my career, the one thing I've learned is that it's really important to follow your passion [32:37]

You Might Also Like: Behind the Scenes at NeurIPS with NVIDIA and CalTech's Anima Anandkumar Anima Anandkumar, NVIDIA's director of machine learning research and Bren professor at CalTech's CMS Department, joins AI Podcast host Noah Kravitz to talk about NeurIPS 2020 and to discuss what she sees as the future of AI.

MIT's Jonathan Frankle on The Lottery Hypothesis Jonathan Frankle, a Ph.D. student at MIT, discusses a paper he co-authored focusing on The Lottery Hypothesis, which promises to help advance our understanding of why neural networks, and deep learning, works so well.

NVIDIA's Neda Cvijetic Explains the Science Behind Self-Driving Cars Neda Cvijetic, senior manager of autonomous vehicles at NVIDIA, leads the NVIDIA DRIVE Labs series of videos and blogs that break down the science behind autonomous vehicles. She takes NVIDIA AI Podcast Noah Kravitz behind the wheel of a (metaphorical) self-driving car.

Tune in to the AI Podcast Get the AI Podcast through iTunes, Google Podcasts, Google Play, Castbox, DoggCatcher, Overcast, PlayerFM, Pocket Casts, Podbay, PodBean, PodCruncher, PodKicker, Soundcloud, Spotify, Stitcher and TuneIn. If your favorite isn't listed here, drop us a note.

Make the AI Podcast Better Have a few minutes to spare? Fill out this listener survey. Your answers will help us make a better podcast.
LINK: https://blogs.nvidia.com/blog/2021/04/07/nvidia-research-shalini-de-me...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

01/06/2026

Dolby Sets the New Standard for Premium Entertainment at CES 2026

January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026 Throughout the week, Dolby brings to life the latest innovatio...

02/05/2026

Dalet Flex LTS Delivers Smarter Search, Faster Editing, and an AI-Ready Foundation for Modern Media

Dalet, a leading technology and service provider for media-rich organizations, t...

01/05/2026

NBCUniversal's Peacock to Be First Streamer to Integrate Dolby's Full Suite of Premium Picture and Sound Innovations

January 5 2026, 18:30 (PST) NBCUniversal's Peacock to Be First Streamer to ...

01/04/2026

DOLBY AND DOUYIN EMPOWER THE NEXT GENERATON OF CREATORS WITH DOLBY VISION

January 4 2026, 18:00 (PST) DOLBY AND DOUYIN EMPOWER THE NEXT GENERATON OF CREATORS WITH DOLBY VISION Douyin Users Can Now Create And Share Videos With Stun...

12/03/2026

Milano Cortina 2026: Yospace helps ad-funded rights-holders claim advertising gold

Staines-upon-Thames, UK, 11th March, 2026 - Yospace, the trusted leader in Dyna...

12/03/2026

Utah Scientific Expands Technology Partner Program With Integrations From Audinate, Bitfocus, and Skaarhoj

Utah Scientific Expands Technology Partner Program With Integrations From Audina...

12/03/2026

Techex Hires Matt McKee as Senior Director, Sales, Americas

Techex, a global expert in live video solutions over IP and cloud, announces the appointment of Matt McKee as Senior Director, Sales, Americas, further strength...

12/03/2026

KOKUSAI DENKI Electric America Welcomes Mondae Hott as Regional Sales Manager, Northeast

KOKUSAI DENKI Electric America has appointed Mondae Hott as Regional Sales Manag...

12/03/2026

Interra Systems Focuses on Streaming-First QC, Monitoring, and Responsible AI Workflows at 2026 NAB Show

At the 2026 NAB Show, Interra Systems will showcase its latest advancements in a...

12/03/2026

15th National Games of China Features Expansive Unified Broadcast Network

The 15th National Games of China concluded after a two-week celebration of athletic excellence and regional collaboration. Held from Nov. 9-21 across Guangdong,...

12/03/2026

SVG in Indy: Butler University Students Get Live-Sports Experience via On-Campus Studio, Production Truck

Live-production academic program Butler Sports Live produced a total of 40 fall-...

12/03/2026

Lawo Delivers Fully IPBased Video Infrastructure for University of Nebraska's HuskerVision

The University of Nebraska's HuskerVision has completed the second phase of ...

12/03/2026

University of Illinois Upgrades Game-Day Production with New Hybrid IP Control Room

Grass Valley and integration partner Tab M Solutions have completed Phase 1 of a...

12/03/2026

CBS Sports Turns to University of Cincinnati's Control Room and Staff for Two Big 12 Men's Basketball Broadcasts

The broadcaster expands its campus-production model as the university handles tw...

12/03/2026

Disney+ to Stream Men's and Women's NCAA March Madness Across Europe, South Africa

Disney has announced the addition of March Madness - the NCAA Division I Men...

12/03/2026

Apple TV Further Integrating iPhones into Friday Night Baseball' Camera Lineup This Season

Apple TV's Friday Night Baseball MLB doubleheader series returns for its f...

12/03/2026

SVG Students To Watch: Jack Rinaldi, University of Notre Dame

The senior from New Jersey is making his mark in South Bend, both on the mic and behind it...

12/03/2026

Ross Video's Kevin Dresser on Powering Graphics for Major Sporting Events Throughout a Busy February

After a relatively quiet January, the month of February was jammed packed with l...

12/03/2026

X Games Launches New Era With First League Draft at Cosm L.A.

Long-time production partner Echo Entertainment is producing the broadcast, while Cosm played a vital role in the collaboration...

12/03/2026

Film Festival Watch: 24 Sundance Institute-Supported Films to Catch at the SXSW Film Festival

By Jessica Herndon We love kicking off each year by introducing the world to po...

12/03/2026

Didn't Die Brings Improv to the Zombie Apocalypse

Samrat Chakrabarti, George Basil, Kiran Deol, Katie McCuen and Vishal Vijayakumar attend the 2025 Sundance Film Festival premiere of Didn't Die at the Lib...

12/03/2026

Mon Laferte Leads All-Women Spotify Session as EQUAL Celebrations Kick Off in Latin America

In Latin America, women are shaping music and defining its future. To kick off t...

12/03/2026

Mon Laferte lidera la edicin EQUAL de Spotify Sessions, mientras comienzan las celebraciones de EQUAL en Latinoamrica

En Am rica Latina, las mujeres est n moldeando la m sica y definiendo su futuro....

12/03/2026

As Spotify Turns 20, the Most Global and Diverse Music Industry in History Has Taken Shape

Let's turn back the clock 20 years: The music landscape was a world away fro...

12/03/2026

Bad Bunny Brings the Sounds of Puerto Rico to Tokyo for Spotify's Billions Club Live

Bad Bunny is no stranger to Spotify's Billions Club. In fact, he has a whopp...

12/03/2026

At the London Book Fair, Spotify Shares Our Vision for the Future of Reading

Spotify was at the London Book Fair this week, joining conversations across the publishing industry about how people can make reading part of their daily lives....

12/03/2026

Ohlhorst Digital & Tokyo Dawn Labs launch Ancora

Mastering tool improves mono compatibility Tokyo Dawn Labs' Ohlhorst Digital range is a series of mastering-focused plug-ins developed by Jan Ohlhorst, ...

12/03/2026

Lewitt partner with Elgato

Wave FX processor integrated into four products Lewitt have teamed up with Elgato to create a new processor for the company's Wave Next product range, i...

12/03/2026

Mix Notes iOS App by David Thomas

Free tool for annotating audio files Mix Notes is a new, free iOS App that provides users with a simple way to annotate their audio files. It's been cre...

12/03/2026

Duck 2 from Devious Machines

Side-chain ducking tool gets an upgrade Devious Machines' popular side-chaining and envelope-shaping tool has just been kitted out with an improved enve...

12/03/2026

MPG Awards 2026: Shortlist announced

Ceremony to take place on 16 April 2026 The MPG (Music Producers Guild) have revealed the full shortlist for this year's MPG Awards, which will be takin...

12/03/2026

Overloud introduce Gem Comp160

Emulates three classic dbx 160 variants The latest arrival to Overloud's Gem Series plug-in range faithfully recreates not one, but three versions of th...

12/03/2026

Grainferno from Baby Audio

New granular soft synth announced Said to be their most advanced software synthesizer to date, Baby Audio's latest release has been built on a new granu...

12/03/2026

Bitwig Studio 6 launches

Latest version now live! Edit 11 March 2026 - Bitwig Studio 6 is now live, and available for all to download! The latest version of Bitwig's DAW softwa...

12/03/2026

Stereo Miking: The Sound On Sound Guide

Latest free eBook now available! Designed for recording engineers, audio-technology students and technically minded musicians, our latest free eBook deliver...

12/03/2026

AFL and NITV partner to launch new First Nations led program Inside the Huddle'

AFL and NITV partner to launch new First Nations led program Inside the Huddle&...

12/03/2026

Rohde & Schwarz Cybersecurity expands SITLine network encryptor portfolio - more bandwidth, higher port density, future-proof architecture

Rohde & Schwarz Cybersecurity expands SITLine network encryptor portfolio - more...

12/03/2026

Rohde & Schwarz to showcase future-proof EMC testing solutions at EMV 2026

Rohde & Schwarz to showcase future-proof EMC testing solutions at EMV 2026 Rohde & Schwarz will participate in EMV 2026, Europe's premier trade fair and c...

12/03/2026

19TH ANNUAL SOUTH AFRICAN FILM AND TELEVISION AWARDS (SAFTAs19) ANNOUNCES THE HOSTS FOR CRAFT AND MAIN SHOW

Johannesburg, 11 March 2026 - The 19th Annual South African Film and Television ...

12/03/2026

L3Harris and Shield AI Achieve Breakthrough in Autonomous Electronic Warfare

MELBOURNE, Fla., March 11, 2026 - L3Harris Technologies (NYSE: LHX) and Shield AI have successfully demonstrated a first-of-its-kind integration combining L3Har...

12/03/2026

L3Harris Delivering AI-Enabled CJADC2

The incorporation of Artificial Intelligence and Machine Learning into modern, converged all-domain systems is enabling true Joint Electromagnetic Spectrum Oper...

12/03/2026

L3Harris Appoints Sam Mehta President, Space & Mission Systems and Communications & Spectrum Dominance Segments

MELBOURNE, Fla., March 12, 2026 - L3Harris Technologies (NYSE: LHX) today announ...

12/03/2026

Blue Lucy's 6 Key Tenets

Modern media operations demand a platform that unites automation, orchestration, and human oversight without compromise. In this post, we explore the six key te...

12/03/2026

Blue Lucy Technology

A deep dive into the platform Architecture The Blue Lucy platform follows a distributed microservices architecture, meaning the overall operational capability...

12/03/2026

Blue Lucy Brings Order to the AI Wild West at NAB 2026

Orchestration platform enables broadcasters to deploy multiple AI models safely with full auditability, rights protection, and regulatory oversight. LONDON, En...

12/03/2026

Australia's financial sector ad spend surged by 20% in 2025 according to Nielsen

Cost pressures, switching intent and demand for savings and credit products are ...

12/03/2026

Nielsen Launches 2026 Upfront Planning Series With New Data To Help Marketers and Agencies Unlock Growth, Innovation Opportunities

For the first time, Nielsen breaks out demographic information about FAST and AV...

12/03/2026

Disney+ Goes Vertical with Verts

Share Copy link Facebook X Linkedin Bluesky Email...

12/03/2026

LTN and Appear Collaborate to Enable Scalable IP-Native L...

Appear's high-performance, ultra-low latency encoding platform augments LTN's fully managed global IP network and orchestration platform LTN, a leader ...