Sony Pixel Power calrec Sony

NVIDIA's Shalini De Mello Talks Self-Supervised AI, NeurIPS Successes

07/04/2021

Shalini De Mello, a principal research scientist at NVIDIA who's made her mark inventing computer vision technology that contributes to driver safety, finished 2020 with a bang - presenting two posters at the prestigious NeurIPS conference in December.

A 10-year NVIDIA veteran, De Mello works on self-supervised and few-shot learning, 3D reconstruction, viewpoint estimation and human-computer interaction.

She told NVIDIA AI Podcast host Noah Kravitz about her NeurIPS submissions on reconstructing 3D meshes and self-learning transformations for improving head and gaze redirection - both significant challenges for computer vision.

The AI Podcast NVIDIA's Shalini De Mello Talks Self-Supervised AI, NeurIPS Successes Ep. 140

De Mello's first poster demonstrates how she and her team successfully manage to recreate 3D models in motion without requiring annotations of 3D mesh, 2D keypoints or camera pose - even on such kinetic figures as animals in the wild.

The second poster takes on the issue of datasets in which large portions are unlabeled - focusing specifically on datasets consisting of images of human faces with many variables, including lighting, reflections and head and gaze orientation. De Mello achieved an architecture that could self-learn these variations and control them.

De Mello intends to continue focusing on creating self-supervising AI systems that require less data to achieve the same quality output, which she envisions ultimately helping to reduce bias in AI algorithms.

Key Points From This Episode:

Early in her career at NVIDIA, De Mello noticed that technologies for looking inside the car cabin weren't as mature as the algorithms for automotive vision outside the car. She focused her research on the former, leading to the creation of NVIDIA's DRIVE IX product for AI-based automotive interfaces in cars.

While science has been a lifelong passion, De Mello discovered an appreciation for art and found the perfect blend of the two in signal and image processing. She could immediately see the effects of AI on visual content.

Tweetables: We as humans are able to learn effectively with less data - how can we make learning systems do the same? This is a fundamental question to answer for the viability of AI [29:29]

Looking back at my career, the one thing I've learned is that it's really important to follow your passion [32:37]

You Might Also Like: Behind the Scenes at NeurIPS with NVIDIA and CalTech's Anima Anandkumar Anima Anandkumar, NVIDIA's director of machine learning research and Bren professor at CalTech's CMS Department, joins AI Podcast host Noah Kravitz to talk about NeurIPS 2020 and to discuss what she sees as the future of AI.

MIT's Jonathan Frankle on The Lottery Hypothesis Jonathan Frankle, a Ph.D. student at MIT, discusses a paper he co-authored focusing on The Lottery Hypothesis, which promises to help advance our understanding of why neural networks, and deep learning, works so well.

NVIDIA's Neda Cvijetic Explains the Science Behind Self-Driving Cars Neda Cvijetic, senior manager of autonomous vehicles at NVIDIA, leads the NVIDIA DRIVE Labs series of videos and blogs that break down the science behind autonomous vehicles. She takes NVIDIA AI Podcast Noah Kravitz behind the wheel of a (metaphorical) self-driving car.

Tune in to the AI Podcast Get the AI Podcast through iTunes, Google Podcasts, Google Play, Castbox, DoggCatcher, Overcast, PlayerFM, Pocket Casts, Podbay, PodBean, PodCruncher, PodKicker, Soundcloud, Spotify, Stitcher and TuneIn. If your favorite isn't listed here, drop us a note.

Make the AI Podcast Better Have a few minutes to spare? Fill out this listener survey. Your answers will help us make a better podcast.
LINK: https://blogs.nvidia.com/blog/2021/04/07/nvidia-research-shalini-de-me...
See more stories from nvidia

Most recent headlines

22/04/2021

IBC To Consult Industry on 2021 Physical Event Plans

IBC today set out more details around its plans to bring the content and technology industry together again to discover the future of media and do business face...

22/04/2021

Marshall PTZ Cameras Deliver Broadcast Quality UHD Images for Newnan Presbyterian Church and rsquo;s Live Streams

When the coronavirus shut down in-person gatherings, many houses of worship were...

22/04/2021

MITOMO STUDIO SHIBUYA Upgrades 8K Editorial Review Suite with AJA KUMO 3232-12G and SKAARHOJ Rack Fly Duo

Mitomo is a leading Japanese broadcast equipment and service provider, and since...

22/04/2021

Alpha Sound Selects DPA for Famed Cathedral AV Overhaul

St. Mary's Cathedral is one of the most popular and beautiful Catholic churches in the Portland area. It serves as its parish's diocese, hosting weekly ...

22/04/2021

Marc Fennell tackles racism in bold new documentary series

22 04 2021 - Media release Marc Fennell tackles racism in bold new documentary series Marc Fennell Popular media personality and Walkley award-winning journa...

22/04/2021

Barco Announces NEXXIS Partnership with Sigma - Jones AV in India to Accelerate Next-Gen Healthcare Video Integration Solutions

Barco Announces NEXXIS Partnership with Sigma - Jones AV in India to Accelerate ...

22/04/2021

Learning More in PreSonus Sphere with Jacob Lamb

With a PreSonus Sphere membership you get access to exclusive masterclasses in the Learn section. Here you can dive into practical recording topics from indu...

22/04/2021

ES Broadcast acquires archiving solutions specialist Memnon from Sony

ES Broadcast acquires archiving solutions specialist Memnon from Sony posted: 21/04/2021 ES Broadcast, a leading provider of end-to-end solutions to the p...

22/04/2021

Reaching a new galaxy: Lawo HOME revolutionizes management of IP broadcast infrastructures

Reaching a new galaxy: Lawo HOME revolutionizes management of IP broadcast infra...

22/04/2021

Bringing you the expanded Atomos Ninja V Line-up

Bringing you the expanded Atomos Ninja V Line-up data-src=https://creativecow.net/wp-content/uploads/avatars/263018/5fa08c562aaf4-bpthumb.jpg data-srcset=ht...

22/04/2021

Sony Announces Latest IP, Cloud Solutions and Imaging Products for More Flexible and Scalable Productions and Workflows

Sony Announces Latest IP, Cloud Solutions and Imaging Products for More Flexible...

22/04/2021

Viz Artist 4.2 Free Edition and Viz Artist in Residence program debut

Viz Artist 4.2 Free Edition and Viz Artist in Residence program debut data-src=https://creativecow.net/wp-content/uploads/avatars/263018/5fa08c562aaf4-bpthu...

22/04/2021

MITOMO STUDIO SHIBUYA Upgrades 8K Editorial Review Suite with AJA KUMO 3232-12G and SKAARHOJ Rack Fly Duo

MITOMO STUDIO SHIBUYA Upgrades 8K Editorial Review Suite with AJA KUMO 3232-12G ...

22/04/2021

Flanders Scientific Introduces the AM211 and BM211 Monitors

Flanders Scientific Introduces the AM211 and BM211 Monitors data-src=https://creativecow.net/wp-content/uploads/avatars/263018/5fa08c562aaf4-bpthumb.jpg......

22/04/2021

Introducing RDE Connect - Simple, Powerful, Free Software for Podcasting and Streaming with the NT-USB Mini

Introducing R DE Connect - Simple, Powerful, Free Software for Podcasting and St...

22/04/2021

Throwback Thursday: Menconi Delves into the Music Behind WRAL Legend Uncle Paul

David Menconi recently penned a piece about Triangle legend Paul Montgomery, known familiarly as Uncle Paul, for Walter Magazine. Montgomery hosted the belove...

22/04/2021

WO Automation for Radio v5.0 offers fully remote station operations without compromise

The latest version of WO Automation for Radio, version 5.0, includes significant...

21/04/2021

UKTV experiences record Q1 viewing and sees huge uptick in 16-34s tuning in

21 April 2021 Multi-channel broadcaster enjoys highest ever Q1 share of viewing at 4.73% - an 8.6% growth year-on-year UKTVs share of commercial impacts (S...

21/04/2021

Netflix Adds 4M Subscriptions in Q1 2021, Short of Expectations

LOS GATOS, Calif.-Is the streaming boom powered by the pandemic starting to fade? One sign that could point to that idea is Netflix, the largest streaming provi...

21/04/2021

Hulu Strikes Deal to Carry NFL Network, NFL RedZone

NEW YORK-Hulu and NFL Media have come to terms on a multi-year carriage agreement that will bring NFL Network and NFL Redzone to the Hulu + Live TV service in t...

21/04/2021

Dejero Completes $60M Minority Recapitalization to Boost Growth

WATERLOO, Ontario-Dejero has announced a minority recapitalization of its business that totaled $60 million. The recapitalization was led by Vertu Capital, alon...

21/04/2021

ESPN, Fox Lead 42nd Sports Emmy Nominations

NEW YORK-The National Academy of Television Arts and Sciences has announced the nominees for the 42nd Annual Sports Emmy Awards, with ESPN and Fox leading all n...

21/04/2021

APTS, PBS Back FCC's Efforts to Increase False Emergency Alert Reports

WASHINGTON-Citing the goal of quickly and accurately informing the public about safety threats, America's Public Television Stations and PBS (collectively P...

21/04/2021

IBC Set to Go Ahead as Planned in September

LONDON-IBC 2021 is set to go ahead as planned in September, with organizers saying they are focused on delivering a fantastic event at the RAI in Amsterdam....

21/04/2021

Sony Sells Its Memnon Archiving Division to ES Broadcast

LONDON-ES Broadcast announced its acquisition of Sony's Memnon archiving solution arm. Terms of the deal were not disclosed....

21/04/2021

Quibi Content Becomes Roku Originals'

SAN JOSE, Calif.-Roku has driven the final nail in Quibi's coffin, announcing that the short-lived mobile streaming platform's content it acquired in Ja...

21/04/2021

Tightrope's Cablecast Powers Online Video Delivery for Cambridge Public Schools

MINNEAPOLIS-The Cablecast Community Media platform from Tightrope Media Systems ...

21/04/2021

Live Video Game Streaming Hit 8.8B Hours in Q1 2021

LONDON-People aren't just streaming TV shows and movies, live streams of video games grew substantially in 2020, and after the first quarter, 2021 is off to...

21/04/2021

Teradek Joins NDI Ecosystem

IRVINE, Calif.-Teradek is now part of the NDI ecosystem, which it will incorporate with its line of Teradek Cube 700 series encoders. Teradek Cube 705 and Terad...

21/04/2021

SVG Sit-Down: New FOR-A America President Satoshi Kanemura on Company's Role in Sports Production

SVG Sit-Down: New FOR-A America President Satoshi Kanemura on Company's Role...

21/04/2021

SVG SportsTech On Demand: VITEC Mark Robison's on New Venues With IPTV Systems and Enhancing the Fan Experience

SVG SportsTech On Demand: VITEC Mark Robison's on New Venues With IPTV Syste...

21/04/2021

SVG SportsTech On Demand: Haivision's Mark Horchler on Remote Collaboration and Remote Operation Over IP

SVG SportsTech On Demand: Haivision's Mark Horchler on Remote Collaboration ...

21/04/2021

SVG SportsTech On Demand: Spectra Logic's Hossein ZiaShakeri on Evolution of the Storage Industry and the Power of StorCycle

SVG SportsTech On Demand: Spectra Logic's Hossein ZiaShakeri on Evolution of...

21/04/2021

SVG SportsTech On Demand: disguise's Tom Rockhill on the Unlimited Options of xR Technology

SVG SportsTech On Demand: disguise's Tom Rockhill on the Unlimited Options o...

21/04/2021

SVG SportsTech On Demand: BirdDog's Dan Miall on the Power of NDI

SVG SportsTech On Demand: BirdDog's Dan Miall on the Power of NDI By Ken Kerschbaumer, Editorial Director Wednesday, April 21, 2021 - 9:20 am Print Thi...

21/04/2021

SVG SportsTech On Demand: Blackmagic Design's Bob Caniglia Discusses Expanded ATEM Lineup and More

SVG SportsTech On Demand: Blackmagic Design's Bob Caniglia Discusses Expande...

21/04/2021

IBC Still Planning on In-Person September Event But Has Fall-Back Option in December

IBC Still Planning on In-Person September Event But Has Fall-Back Option in Dece...

21/04/2021

At the Rink: Washington Capitals Approach Regular Season With Virtual Gameday Digital Experience, Traditional In-Venue Flair

At the Rink: Washington Capitals Approach Regular Season With Virtual Gameday Di...

21/04/2021

Inside the ESPN's NBA Daily Wager Special: How ESPN Produced Its First Sports-Betting-Driven Broadcast

Inside the ESPN's NBA Daily Wager Special: How ESPN Produced Its First Sport...

21/04/2021

STN IP Protection Suite

Maximize and protect your IP with the STN IP Protection Suite . From new users to expert searchers, at all stages of your innovation journey, STN has the soluti...

21/04/2021

LIVE LIFE LOUD - Sony introduces new X-Series range with 3 new powerful wireless speakers

Get bigger sound with Omnidirectional Party Sound on the SRS-XP700 Experience P...

21/04/2021

Hanging in the Balance: More Research Coordination, Collaboration Needed for AI to Reach Its Potential, Experts Say

As AI is increasingly established as a world-changing field, the U.S. has an opp...

21/04/2021

The Future's So Bright: NVIDIA DRIVE Shines at Auto Shanghai

NVIDIA DRIVE-powered cars electrified the atmosphere this week at Auto Shanghai. The global auto show is the oldest in China and has become the stage to debut ...

21/04/2021

Penta and DADman Ready for Big Sur

Tekst: Penta and DADman Ready for Big Sur Upon thorough testing, we are happy to announce that the most recent DADman version for macOS (v. 5.4.5 build 1) is...

21/04/2021

Etisalat and Nokia provide ultra-fast 5G broadband services in the UAE

Etisalat and Nokia provide ultra-fast 5G broadband services in the UAE Press Release Etisalat and Nokia provide ultra-fast 5G broadband services in the UAE ...

21/04/2021

Ragnarok season 2 is coming to Netflix on May 27

Back to All News Ragnarok season 2 is coming to Netflix on May 27 Entertainment 21 April 2021 GlobalNorwayDenmarkSweden View and download the first look im...

21/04/2021

Sardar Ka Grandson Welcomes You To Their Family!

Back to All News Sardar Ka Grandson Welcomes You To Their Family!Play Video Play Video Entertainment 21 April 2021 GlobalIndia Netflix launches the traile...

21/04/2021

UiPath: The Automation IPO

Our first meeting with Daniel at Fish House in Bucharest. Try the Salt-Crusted Sea Bass! By Eric Liaw, Alex Lim, Jules Maltz, and Jason Kong Today, we are exc...

21/04/2021

ITV named a Top 10 Inclusive Employer by the British LGBT Awards

ITV named a Top 10 Inclusive Employer by the British LGBT Awards ITV has been named as one of the top 10 most inclusive employers by the prestigious British LG...