Sony Pixel Power calrec Sony

NVIDIA's Shalini De Mello Talks Self-Supervised AI, NeurIPS Successes

07/04/2021

Shalini De Mello, a principal research scientist at NVIDIA who's made her mark inventing computer vision technology that contributes to driver safety, finished 2020 with a bang - presenting two posters at the prestigious NeurIPS conference in December.

A 10-year NVIDIA veteran, De Mello works on self-supervised and few-shot learning, 3D reconstruction, viewpoint estimation and human-computer interaction.

She told NVIDIA AI Podcast host Noah Kravitz about her NeurIPS submissions on reconstructing 3D meshes and self-learning transformations for improving head and gaze redirection - both significant challenges for computer vision.

The AI Podcast NVIDIA's Shalini De Mello Talks Self-Supervised AI, NeurIPS Successes Ep. 140

De Mello's first poster demonstrates how she and her team successfully manage to recreate 3D models in motion without requiring annotations of 3D mesh, 2D keypoints or camera pose - even on such kinetic figures as animals in the wild.

The second poster takes on the issue of datasets in which large portions are unlabeled - focusing specifically on datasets consisting of images of human faces with many variables, including lighting, reflections and head and gaze orientation. De Mello achieved an architecture that could self-learn these variations and control them.

De Mello intends to continue focusing on creating self-supervising AI systems that require less data to achieve the same quality output, which she envisions ultimately helping to reduce bias in AI algorithms.

Key Points From This Episode:

Early in her career at NVIDIA, De Mello noticed that technologies for looking inside the car cabin weren't as mature as the algorithms for automotive vision outside the car. She focused her research on the former, leading to the creation of NVIDIA's DRIVE IX product for AI-based automotive interfaces in cars.

While science has been a lifelong passion, De Mello discovered an appreciation for art and found the perfect blend of the two in signal and image processing. She could immediately see the effects of AI on visual content.

Tweetables: We as humans are able to learn effectively with less data - how can we make learning systems do the same? This is a fundamental question to answer for the viability of AI [29:29]

Looking back at my career, the one thing I've learned is that it's really important to follow your passion [32:37]

You Might Also Like: Behind the Scenes at NeurIPS with NVIDIA and CalTech's Anima Anandkumar Anima Anandkumar, NVIDIA's director of machine learning research and Bren professor at CalTech's CMS Department, joins AI Podcast host Noah Kravitz to talk about NeurIPS 2020 and to discuss what she sees as the future of AI.

MIT's Jonathan Frankle on The Lottery Hypothesis Jonathan Frankle, a Ph.D. student at MIT, discusses a paper he co-authored focusing on The Lottery Hypothesis, which promises to help advance our understanding of why neural networks, and deep learning, works so well.

NVIDIA's Neda Cvijetic Explains the Science Behind Self-Driving Cars Neda Cvijetic, senior manager of autonomous vehicles at NVIDIA, leads the NVIDIA DRIVE Labs series of videos and blogs that break down the science behind autonomous vehicles. She takes NVIDIA AI Podcast Noah Kravitz behind the wheel of a (metaphorical) self-driving car.

Tune in to the AI Podcast Get the AI Podcast through iTunes, Google Podcasts, Google Play, Castbox, DoggCatcher, Overcast, PlayerFM, Pocket Casts, Podbay, PodBean, PodCruncher, PodKicker, Soundcloud, Spotify, Stitcher and TuneIn. If your favorite isn't listed here, drop us a note.

Make the AI Podcast Better Have a few minutes to spare? Fill out this listener survey. Your answers will help us make a better podcast.
LINK: https://blogs.nvidia.com/blog/2021/04/07/nvidia-research-shalini-de-me...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

01/06/2026

Dolby Sets the New Standard for Premium Entertainment at CES 2026

January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026 Throughout the week, Dolby brings to life the latest innovatio...

02/05/2026

Dalet Flex LTS Delivers Smarter Search, Faster Editing, and an AI-Ready Foundation for Modern Media

Dalet, a leading technology and service provider for media-rich organizations, t...

01/05/2026

NBCUniversal's Peacock to Be First Streamer to Integrate Dolby's Full Suite of Premium Picture and Sound Innovations

January 5 2026, 18:30 (PST) NBCUniversal's Peacock to Be First Streamer to ...

04/04/2026

Don't Be Lame: Arizona Men's Basketball Social Team Aims To Catch the Attention of Wildcats Fans

The University of Arizona's Men's Basketball team has only loss twice th...

04/04/2026

HDR Makes Its Men's Final Four Debut as CBS Sports and TNT Sports Collaborate on New Camera Tools and an IP-Powered Compound

1080p HDR arrives, a new generation of storytelling tools takes center stage, an...

04/04/2026

Fab Five Reunion Drives TNT and CBS's Experimental Final Four Altcast Built on REMI Workflow

Michigan legends bring a new voice to the broadcast as TNT Sports and CBS Sports...

04/04/2026

Flock Audio's latest Patch App DX update

Faster, cleaner and more intuitive than ever The control software for Flock Audio's digitally controlled patchbay systems has just been treated to an up...

04/04/2026

Sinclair to FCC: Broadcast Sports Drives Investment in Local News

Share Copy link Facebook X Linkedin Bluesky Email...

04/04/2026

Study: Worldwide Telecom Capex to Decline in 2026,

Share Copy link Facebook X Linkedin Bluesky Email...

04/04/2026

Ateme Delivers Full End-to-End Streaming Platform to Moldtelecom

Share Copy link Facebook X Linkedin Bluesky Email...

04/04/2026

FCC Plans Spending, Regulatory Fee Revenue Reductions in FY 2027

Share Copy link Facebook X Linkedin Bluesky Email...

04/04/2026

DHD Introduces AI-Based Audio Noise Reduction to XD3 IP Core

DHD Introduces AI-Based Audio Noise Reduction to XD3 IP Core Brie Clayton April 3, 2026 0 Comments The accompanying image shows the rear panel of the ...

04/04/2026

Macnica Redefines ST 2110 Flexibility with Two Speeds on One Card

Macnica Redefines ST 2110 Flexibility with Two Speeds on One Card Brie Clayton April 3, 2026 0 Comments New for NAB Show 2026, MEP100 SmartNIC now sup...

04/04/2026

Unified Media Workflows for Story-Centric Production

Unified Media Workflows for Story-Centric Production Brie Clayton April 3, 2026 0 Comments Framelight X unifies field capture, editing and publishing ...

03/04/2026

TNT Sports and CBS Sports To Reunite Michigan's Iconic Fab Five' for Special NCAA Men's Final Four Altcast on truTV and HBO Max

Michigan's Fab Five will reunite for an alternate presentation of the Mich...

03/04/2026

NAB 2026: Avid To Showcase Content Core and AI Workflow Innovations

Avid will exhibit at NAB Show 2026 (April 18-22, Booth N2226, Las Vegas Convention Center), demonstrating its Content Core platform and new AI-driven workflow c...

03/04/2026

MRMC Appoints Nick Barthee as Chief Operating Officer

Mark Roberts Motion Control (MRMC) has announced the appointment of Nick Barthee as Chief Operating Officer. The announcement follows MRMC's transition fro...

03/04/2026

Elite Media Technologies Selects Interra Systems' BATON for File-Based QC

Interra Systems has announced that Elite Media Technologies has selected its BATON file-based QC solution for media workflows. Elite Media Technologies speciali...

03/04/2026

Moldtelecom Deploys Ateme Technologies Across Full Streaming Workflow

Ateme has announced that Moldtelecom has deployed Ateme technologies across its streaming workflow, covering encoding, delivery, operations, and analytics. Mol...

03/04/2026

NAB 2026: Grass Valley To Demonstrate Framelight X Content Management

Grass Valley will demonstrate Framelight X, its content management platform, at NAB Show 2026. The platform connects capture, ingest, editing, and publishing in...

03/04/2026

NAB 2026: Encompass Digital Media and Techex Launch Cloud-Based Master Control Service for Live Events

Encompass Digital Media and Techex have announced a cloud-native Master Control ...

03/04/2026

Peacock Debuts Its New Vertical-Video Experience for Live NBA Games on Monday

Live Vertical Video automatically track the action on the court via AI technology and delivers a fully optimized, 9 16 live feed for viewers...

03/04/2026

Illinois Creative Team Captures Men's Final Four Run With Trust, Timing, and a Few Water Guns

As the Illini make their first trip to college basketball's biggest stage si...

03/04/2026

Hook 'Em: University of Texas Athletics Produces Digital Content for a First-Person Experience

After last summer's Softball National Championship victory and last week'...

03/04/2026

Don't Be Lame: Arizona Men's Basketball Social Team Aims To Catch the Attention of Wildcat Fans

The University of Arizona's Men's Basketball team has only loss twice th...

03/04/2026

During Packed Weekend, Van Wagner Covers In-Venue Shows for Championships Across Indianapolis

Eight games across four tournaments will be played in three venues; accommodatio...

03/04/2026

Ottawa Senators and Bell Media Extend Regional Broadcast Rights Agreement

The Ottawa Senators and Bell Media have announced a long-term rights extension for regional Ottawa Senators games on TSN and RDS. TSN Radio 1200 remains the exc...

03/04/2026

ESPN's Women's Final Four Playbook: Bigger Compound, Bigger Trucks, Biggest Production Yet

Massive production in Phoenix is run out of Game Creek Video Flagship mobile uni...

03/04/2026

Electro-Harmonix release EHX Classics Bundle

Iconic guitar pedals now available in plug-in form Guitar effects experts Electro-Harmonix have teamed up with MixWave to turn a collection of their most pr...

03/04/2026

FAC launch Bandit 2

New multi-band AUv3 plug-in announced Fred Anton Corvest (FAC) offer an extensive range of AUv3 plug-ins and iOS/iPadOS Apps, and their multiband effects pr...

03/04/2026

Pulsar-23: 1984 from SOMA Laboratory

Just 84 units to be released in the US Experimental synthesizer and sound-machine extraordinaires SOMA Laboratory have revealed an upcoming special-edition ...

03/04/2026

Iconic Instruments release Model 350 Tube Preamp

Emulates the input section of an Ampex 350 One of the latest arrivals to the Iconic Instruments range delivers a new tube preamp plug-in inspired by the cir...

03/04/2026

TelevisaUnivision and Nielsen Agree to New Media Intelligence Deal Covering Streaming, National and Local TV, and Radio

New York April 2, 2026 TelevisaUnivision, the world's leading Spanish-la...

03/04/2026

2026 NAB Show Exhibitor Insight: Techex

Share Copy link Facebook X Linkedin Bluesky Email...

03/04/2026

TelevisaUnivision Signs New Nielsen Media Intelligence Deal

Share Copy link Facebook X Linkedin Bluesky Email...

03/04/2026

The WNET Group, JIB Launch NHK World-Japan in New York

Share Copy link Facebook X Linkedin Bluesky Email...

03/04/2026

NAB Leadership Foundation Welcomes New Board Members

Share Copy link Facebook X Linkedin Bluesky Email...

03/04/2026

EverPass Media Expands Distribution Deal with Netflix

Share Copy link Facebook X Linkedin Bluesky Email...

03/04/2026

Versant Acquires AI-Data Platform StockStory

Share Copy link Facebook X Linkedin Bluesky Email...

03/04/2026

CVP Grows European Footprint with Strategic Expansion in...

CVP, one of Europe's leading suppliers of professional video and broadcast solutions, today announces the launch of its new German operation and the formati...

03/04/2026

MRMC Announces Appointment of Chief Operating Officer

Mark Roberts Motion Control (MRMC) today announces the appointment of Nick Barthee as Chief Operating Officer, strengthening its leadership as the company conti...

03/04/2026

Net Insight Introduces Programmable Trust Boundaries for...

Net Insight introduces programmable Trust Boundaries that make live media interconnection predictable as traffic moves between facilities, networks and cloud en...

03/04/2026

Winning in the new media economy: Avid showcases AI-powered, connected intelligence to unlock media value at NAB Show 2026

Winning in the new media economy: Avid showcases AI-powered, connected intellige...

03/04/2026

NUGEN Audio CEO Dr. Paul Tapper to Lead Presentation About Dialog Intelligibility and Loudness at NAB 2026

NUGEN Audio CEO Dr. Paul Tapper to Lead Presentation About Dialog Intelligibilit...

03/04/2026

NAB Show 2026: PlayBox Neo Highlights Workflow, Security, and IP Advances

NAB Show 2026: PlayBox Neo Highlights Workflow, Security, and IP Advances Brie Clayton April 2, 2026 0 Comments PlayBox Neo will showcase the latest i...

03/04/2026

For Taku Hirano, Everything Is Connected

For Taku Hirano, Everything Is Connected From touring and composition to teaching and instrument design, the in-demand percussionist sees it all as one body o...

03/04/2026

Berklee Honors Humberto Ramirez with Master of Latin Music Award

Berklee Honors Humberto Ramirez with Master of Latin Music Award The alumnus and acclaimed trumpeter is honored for his influence as a performer, composer, an...

03/04/2026

VIZ Media Lands Rumiko Takahashi's MAO, Sets April 4 Premiere on Hulu in the U.S. and Disney+ in Select International Markets

VIZ Media Lands Rumiko Takahashi's MAO, Sets April 4 Premiere on Hulu in the...

03/04/2026

Competition Heats Up with Intrigue and Spices: Netflix Unveils Trailer for New Drama Made with Love'

Back to All News Competition Heats Up with Intrigue and Spices: Netflix Unveils...