Sony Pixel Power calrec Sony

NVIDIA's Shalini De Mello Talks Self-Supervised AI, NeurIPS Successes

07/04/2021

Shalini De Mello, a principal research scientist at NVIDIA who's made her mark inventing computer vision technology that contributes to driver safety, finished 2020 with a bang - presenting two posters at the prestigious NeurIPS conference in December.

A 10-year NVIDIA veteran, De Mello works on self-supervised and few-shot learning, 3D reconstruction, viewpoint estimation and human-computer interaction.

She told NVIDIA AI Podcast host Noah Kravitz about her NeurIPS submissions on reconstructing 3D meshes and self-learning transformations for improving head and gaze redirection - both significant challenges for computer vision.

The AI Podcast NVIDIA's Shalini De Mello Talks Self-Supervised AI, NeurIPS Successes Ep. 140

De Mello's first poster demonstrates how she and her team successfully manage to recreate 3D models in motion without requiring annotations of 3D mesh, 2D keypoints or camera pose - even on such kinetic figures as animals in the wild.

The second poster takes on the issue of datasets in which large portions are unlabeled - focusing specifically on datasets consisting of images of human faces with many variables, including lighting, reflections and head and gaze orientation. De Mello achieved an architecture that could self-learn these variations and control them.

De Mello intends to continue focusing on creating self-supervising AI systems that require less data to achieve the same quality output, which she envisions ultimately helping to reduce bias in AI algorithms.

Key Points From This Episode:

Early in her career at NVIDIA, De Mello noticed that technologies for looking inside the car cabin weren't as mature as the algorithms for automotive vision outside the car. She focused her research on the former, leading to the creation of NVIDIA's DRIVE IX product for AI-based automotive interfaces in cars.

While science has been a lifelong passion, De Mello discovered an appreciation for art and found the perfect blend of the two in signal and image processing. She could immediately see the effects of AI on visual content.

Tweetables: We as humans are able to learn effectively with less data - how can we make learning systems do the same? This is a fundamental question to answer for the viability of AI [29:29]

Looking back at my career, the one thing I've learned is that it's really important to follow your passion [32:37]

You Might Also Like: Behind the Scenes at NeurIPS with NVIDIA and CalTech's Anima Anandkumar Anima Anandkumar, NVIDIA's director of machine learning research and Bren professor at CalTech's CMS Department, joins AI Podcast host Noah Kravitz to talk about NeurIPS 2020 and to discuss what she sees as the future of AI.

MIT's Jonathan Frankle on The Lottery Hypothesis Jonathan Frankle, a Ph.D. student at MIT, discusses a paper he co-authored focusing on The Lottery Hypothesis, which promises to help advance our understanding of why neural networks, and deep learning, works so well.

NVIDIA's Neda Cvijetic Explains the Science Behind Self-Driving Cars Neda Cvijetic, senior manager of autonomous vehicles at NVIDIA, leads the NVIDIA DRIVE Labs series of videos and blogs that break down the science behind autonomous vehicles. She takes NVIDIA AI Podcast Noah Kravitz behind the wheel of a (metaphorical) self-driving car.

Tune in to the AI Podcast Get the AI Podcast through iTunes, Google Podcasts, Google Play, Castbox, DoggCatcher, Overcast, PlayerFM, Pocket Casts, Podbay, PodBean, PodCruncher, PodKicker, Soundcloud, Spotify, Stitcher and TuneIn. If your favorite isn't listed here, drop us a note.

Make the AI Podcast Better Have a few minutes to spare? Fill out this listener survey. Your answers will help us make a better podcast.
LINK: https://blogs.nvidia.com/blog/2021/04/07/nvidia-research-shalini-de-me...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

01/06/2026

Dolby Sets the New Standard for Premium Entertainment at CES 2026

January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026 Throughout the week, Dolby brings to life the latest innovatio...

01/05/2026

NBCUniversal's Peacock to Be First Streamer to Integrate Dolby's Full Suite of Premium Picture and Sound Innovations

January 5 2026, 18:30 (PST) NBCUniversal's Peacock to Be First Streamer to ...

01/04/2026

DOLBY AND DOUYIN EMPOWER THE NEXT GENERATON OF CREATORS WITH DOLBY VISION

January 4 2026, 18:00 (PST) DOLBY AND DOUYIN EMPOWER THE NEXT GENERATON OF CREATORS WITH DOLBY VISION Douyin Users Can Now Create And Share Videos With Stun...

05/02/2026

NBC Sports Deploys Audio-Technica Microphones for Winter Olympics

Share Copy link Facebook X Linkedin Bluesky Email...

05/02/2026

Hemisphere Media Group, Entravision Launch WAPA Orlando

Share Copy link Facebook X Linkedin Bluesky Email...

05/02/2026

SMT Providing Timing And Production Data Services for Winter Olympics

Share Copy link Facebook X Linkedin Bluesky Email...

04/02/2026

Save the Date: SVG Regional Sports Production Summit Heads to Denver June 29-30

The 11th-annual Summit will not only the unprecedented headwinds facing the business, but also the groundbreaking opportunities for the future....

04/02/2026

2026 Grammy Awards Audio Team Collaborates for Live Broadcast

Just moments before the 2026 Grammy Awards kicked off, members of the event's audio team assembled for a group photo at the base of the stage inside Los Ang...

04/02/2026

Riedel Connects Live Surgery and Medical Professionals at VISAR 2025

At the Vienna Interdisciplinary Symposium on Aortic Repair (VISAR), Riedel Communications' Managed Technology Division delivered a turnkey technical infrast...

04/02/2026

Mountain West Announces New Media Rights Package in Collaboration with CBS Sports, FOX Sports, The CW Network, and Kiswe

The Mountain West Conference announces a new media rights package featuring CBS ...

04/02/2026

NFL 2026 International Games Announced in Madrid, Mexico, and Paris

Earlier this week, the NFL announced it would play regular season games in Madrid, Paris, and Mexico City in 2026 as part of a nine-game international schedule,...

04/02/2026

Super Bowl Halftime Show Preview: PA Speakers on Wheels Return for Football-Meets-Music Event

Custom-built carts carry music speakers for Apple Music Super Bowl LX Halftime S...

04/02/2026

Wireless Audio, Part 1: RF Does More With Less, Because It Has To

In an era of constrained spectrum, two tactics have emerged: work closely with regulatory bodies and utilize engineering chops The Federal Communications Commi...

04/02/2026

Wireless Audio, Part 2: RF Mics Have a Key Role in Sports Broadcasting

Three examples of how wireless microphones are deployed to bring fans in deep and up close Microphone manufacturers have myriad ways to put wireless to work fo...

04/02/2026

Sennheiser Is Moving to Music City

The mic manufacturer will join other suppliers in the new Rock Nashville production campus Sennheiser is relocating its U.S. headquarters from its long-time lo...

04/02/2026

Release Rundown: What to Watch in February, From Jimpa to Queen of Chess

Olivia Colman and John Lithgow appear in Jimpa by Sophie Hyde, an official selection of the 2025 Sundance Film Festival. (Courtesy of Sundance Institute | pho...

04/02/2026

Get More From Lyrics on Spotify With These 3 Upgrades

Lyrics are one of Spotify's most popular features, giving fans a richer way to experience the music and artists they love. They're viewed hundreds of mi...

04/02/2026

Queer Renegades: SBS Audio's new podcast reclaiming Australia's queer history

Queer Renegades: SBS Audio's new podcast reclaiming Australia's queer hi...

04/02/2026

NFVF ANNECY 2026 SOUTH AFRICAN ANIMATION SHOWCASE CALL

The National Film and Video Foundation (NFVF) invites final-year animation students to participate in an exclusive creative showcase at the Annecy International...

04/02/2026

Viper Shield Flight Tests Accelerate Delivery with New Digital Electronic Warfare Capability

Viper Shield's robust phase of flight-testing production representative hard...

04/02/2026

Nielsen launches co-viewing pilot program to further enhance TV measurement

Pilot To Launch with Super Bowl LX on February 8 and Continue with High Profile Live Events, Entertainment and Sports Nielsen to Use State of the Art Wearable...

04/02/2026

Vinten Extends VEGA Platform with VEGA Lite PTZ Control S...

New control solution applies broadcast robotics workflows to PTZ cameras with third-party integration and upgrade paths Vinten, a global leader in robotic cam...

04/02/2026

Vinten Launches Vega Lite PTZ Control System

Share Copy link Facebook X Linkedin Bluesky Email...

04/02/2026

Chyron to Provide Graphics, Virtual Sets for Winter Olympics Coverage

Share Copy link Facebook X Linkedin Bluesky Email...

04/02/2026

NBC Sports Taps Appear for 2026 Winter Olympics Production

Share Copy link Facebook X Linkedin Bluesky Email...

04/02/2026

Katie Vitolins Announced as Vice President of Alumni Products and Services

Katie Vitolins Announced as Vice President of Alumni Products and Services An alumna and former trustee, Vitolins will lead the relaunch of Berklee's alum...

04/02/2026

Full cast announced for Saturday Night Live UK, coming to Sky and NOW 21 March 2026

Wednesday 4 February 2026 Full cast announced for Saturday Night Live UK, comin...

04/02/2026

Fear of running out of mobile data (FORO) is a real issue for UK businesses that lose over 3,400 a year

Wednesday 4 February 2026 Fear of running out of mobile data (FORO) is a real i...

04/02/2026

Rohde & Schwarz powers next generation television in Brazil with DTV+ technology for Globo

Rohde & Schwarz powers next generation television in Brazil with DTV technology...

04/02/2026

Netflix Shares Teaser of the Third and Final Season of 'Knokke Off'

Back to All News Netflix Shares Teaser of the Third and Final Season of Knokke Off Entertainment 04 February 2026 GlobalNetherlands Link copied to clipboar...

04/02/2026

Netflix Premieres 'The TikTok Killer' on March 6

Back to All News Netflix Premieres The TikTok Killer on March 6 Entertainment 04 February 2026 GlobalSpain Link copied to clipboard Download the pictures ...

04/02/2026

Music Is Having a Golden Moment on Netflix as New and Nostalgic Songs Storm the Charts

Back to All News Music Is Having a Golden Moment on Netflix as New and Nostal...

04/02/2026

Fox Corporation Reports Second Quarter Fiscal 2026 Financial Results

Fox Corporation Reports Second Quarter Fiscal 2026 Financial Results NEW YORK, NY, February 4, 2026 - Fox Corporation (Nasdaq: FOXA, FOX; FOX or the Compan...

04/02/2026

Lucas P. Aragn Joins FOX Advertising as Senior Vice President, Creative

Lucas P. Arag n Joins FOX Advertising as Senior Vice President, Creative New York, NY - February 4, 2026 - Accomplished Creative Executive Lucas P. Arag n has...

04/02/2026

RT Statement on Home of the Year and The Great House Revival

Following the passing of our friend and colleague Hugh Wallace, and with the full support of his family, RT will proceed with the broadcast of the new series o...

04/02/2026

Nemotron Labs: How AI Agents Are Turning Documents Into Real-Time Business Intelligence

Editor's note: This post is part of the Nemotron Labs blog series, which exp...

03/02/2026

Tagboard's New Partner Development Kit Turns Complex Third-Party Integrations into Instant Graphics

Tagboard, a modern, interactive graphics system for news, sports, and entertainm...

03/02/2026

SNS Launches New S3-Compatible Cloud Storage Service

Studio Network Solutions (SNS) announces the launch of Trio, a new S3-compatible cloud storage service fully integrated with EVO for media backup, archival, and...

03/02/2026

NEP Group Running at Full-Scale This Month in Support of Major International Events

50 Production Trucks at center of 160 U.S.-based productions...

03/02/2026

Nielsen Launches Co-Viewing Pilot Program to Further Enhance TV Measurement

Nielsen, which specializes in audience measurement, data, and media intelligence, announces that it is piloting a new methodology enhancement to more accurately...

03/02/2026

NBC Sports Relies on Appear X Platform for Winter Games

Appear's X Platform will be used by NBC Sports to deliver video compression, satellite modulation and transport stream aggregation for its production of the...

03/02/2026

Behind The Mic: NBC Sports Unveils Presentation Cast for Super Bowl LX as Part of Legendary February

Behind The Mic provides a roundup of recent news regarding on-air talent, includ...

03/02/2026

NHL Network to Take Fans Rinkside as NHL Players Return to Winter Olympic Games

NHL Network announces its comprehensive programming schedule for the upcoming Winter Olympic Games, underscoring the highly anticipated return of NHL players to...

03/02/2026

Canon Lenses Power NBC Coverage of Milano Cortina Winter Games

NBC Sports has chosen Canon to deliver 115 Canon UHD broadcast lenses for its production of the 2026 Winter Olympics and Paralympics. Canon will also send suppo...

03/02/2026

NBC Sports Selects Audio-Technica for Vital Winter Games Role

Audio-Technica equipment will be used by NBC Sports to deliver much of its audio capture requirements across all sporting venues for its production of the 2026 ...

03/02/2026

Cisco VXLAN Makes Olympic Debut for NBC Sports

NBC Sports will use Cisco to deliver AI networking technology for its all-IP production of the 2026 Winter Olympics and Paralympics, including the deployment of...

03/02/2026

Chyron PRIME CG Drives NBC Sports Winter Games Graphics

NBC Sports will utilize Chyron PRIME CG to produce live broadcast graphics to display names, athlete information, scores, statistics, leaderboards, headshots an...

03/02/2026

NBC Sports Relies on Grass Valley for Winter Games Signal Conversion, Routing, Orchestration

NBC Sports will utilize Grass Valley to deliver advanced signal conversion, rout...

03/02/2026

Planar Supplies LED Wall Technology for NBC Sports Winter Games Coverage

NBC Sports will utilize Planar to deliver leading-edge fine pixel pitch LED video wall technology for its production of the 2026 Winter Olympics and Paralympics...