Robots require huge training leaps in AI to become versatile general helpers, says robotics pioneer Pieter Abbeel, who laid out a vision for such neural network brains of the future.
Home robots are electronically and mechanically possible today, Abbeel said, but they lack the AI know-how to navigate a wide variety of situations.
It's just our software, our AI, that hasn't been good enough to make this a reality in our home, he said.
Abbeel spoke Wednesday at NTECH 2021, an annual internal engineering conference at NVIDIA, drawing hundreds of online viewers.
Abbeel is a professor of electrical engineering and computer science at the University of California, Berkeley. He is also director of the university's Robot Learning Lab and co-director of the Berkeley Artificial Intelligence Research (BAIR) Lab. With all of that going on, the soft-spoken Belgian engineer also hosts The Robot Brains Podcast.
While juggling his roles, Abbeel also spent nearly two years at OpenAI, the nonprofit formed in 2015 by tech luminaries including Ilya Sutskever - who is speaking at GTC 2021 - to develop and release artificial general intelligence aimed at benefiting humanity.
He left OpenAI in 2017 to start Covariant, a developer of AI for robotic automation of warehouses and factories that has attracted $147 million in funding. Before that he co-founded AI-assisted grading startup Gradescope, which was acquired in 2018.
NVIDIA CEO Jensen Huang spoke with Abbeel after the robotics talk, calling him one of the brightest minds on the planet.
Talking Big Robot Brains Abbeel's talk laid out what he called a nice starting point for what could be done to create more capable robots, ones with big brains that could learn new tasks on their own. The talk mentioned the work of many AI researchers, such as Geoffrey Hinton, as stepping stones to get there.
Crediting deep learning pioneer Yann LeCun, he said the idea of training a large neural network for robots with internet videos to do prediction was promising. It would require robots to learn things about the world, offering a big piece in the robot AI puzzle.
Robots might learn entire behavioral representations from videos - a sequence of things to do - versus the limitations of using images alone. Video prediction is possibly the biggest missing piece to have a good pretrained neural network that can be quickly used for other things for real-world robotic tasks, he said
Training on text could be important as well for robots. They might learn an entire story to perform a sequence of events, like delivering a car to an auto mechanic on command from an owner, handling the entire process, including driving and talking to the mechanic for a pickup time, he suggested.
Train Mostly in Simulation' Most robot training should be done in simulation - it's impractical to slowly train robots in the real world, bumping into things to learn by trial and error, said Abbeel.
Only a little bit of training in the real world will be required to make sure robots can also do things in the real world. Millions of scenes become very hard to collect in the real world, he said.
Thousands - even millions - of simulations can be used for training to get results on neural networks in a shorter period of time, he said.
It's more affordable, and you can scale it up and parallelize many simulation runs, he said.
Bridging Research to Commercial In a post-presentation talk with Huang, Abbeel discussed bridging university research to commercial applications.
You both do groundbreaking research in the university, and you are also practicing that art and the industry of robotics - you're putting it to work in a real company (Covariant), Huang said. Solving the 99 percent problem is essential.
Abbeel agreed that it's important to know with confidence that your customer will be happy with your network performance and what you're selling to them. He said it's largely a matter of knowing the network you've developed, running a lot of tests and getting the statistics.
At Covariant, he said, the current applications are pick-and-place use cases in warehouses - for the Covariant Brain - and that hitting the end-to-end performance is what matters.
If you don't make your customers happy, what's the point in selling to them? said Abbeel.
Most recent headlines
04/08/2024
Dalet, a leading technology and service provider for media-rich organizations, is excited to announce Santiago Solanas as its new Chief Executive Officer (CEO)....
03/06/2024
Dalet, a leading technology and service provider for media-rich organizations, a...
08/05/2024
NEEDHAM, Mass. The International Data Corporation is predicting that worldwide spending on telecom services and pay TV services will increase by 1.4% in 2024 to...
08/05/2024
CUPERTINO, Calif. In a notable development for news and live video production, Apple has unveiled a number of significant upgrades to its Final Cut Pro software...
08/05/2024
Pliant Technologies has announced that it will be presenting its new SmartBoom LITE Headset at InfoComm 2024 (Booth C5116). The latest updates include enhanceme...
08/05/2024
SAN FRANCISCO Fox's ad-supported streaming service Tubi has launched Stubios, a fan-fueled studio for aspiring filmmakers and their fans that the company sa...
08/05/2024
SAN ANTONIO, Texas Five more stations have launched NextGen TV service, bringing to nine the number of local TV services on-air with ATSC 3.0....
08/05/2024
TYSONS, Va. Tegna Inc. has announced that Greg Retsinas has been named president and general manager at KGW, Tegna's NBC affiliate serving the Portland area...
08/05/2024
08 05 2024 - Media release Olivia Colman and John Lithgow Star in Sophie Hyde's New Project JIMPA
Olivia Coleman and John Lithgow in JIMPA. Photo credit: ...
08/05/2024
OpenDrives Joins AWS Partner Network
Brie Clayton May 7, 2024
0 Comments
Atlas software-defined platform now available via AWS trusted partner network...
08/05/2024
Animate AI Matte Paintings in After Effects
Graham Quince May 7, 2024
0 Comments
Arguably the best video use for AI generated images is Matte Painting...
08/05/2024
Throw Expression in Adobe After Effects
Andy Ford May 7, 2024
0 Comments
The Throw expression is a time-saver in After Effects. It allows you to mov...
08/05/2024
Join FilmLight in Toronto: Baselight 6.1, Nara and more
Brie Clayton May 7, 2024
0 Comments
Thursday 30th May, from 2:30PM, Hosted by Alter Ego 488 ...
08/05/2024
Gray Television reported a first-quarter profit as advertising revenues rebounded to above pre-COVID-19 levels....
08/05/2024
The Today show shared the performers on its summer concert series, which feature...
08/05/2024
Lewis Dodley, longtime anchor for Spectrum News NY1, will retire at the end of May. He's been on the air at the Charter Communications-owned local news chan...
08/05/2024
Scripps Sports said it plans to air a new studio show when a new season of WNBA Friday Night Spotlight starts May 24....
08/05/2024
Advertisers are looking to reach the right audiences and tell their stories inside compelling content, Karen Kovacs, president of client partnerships at NBCUniv...
08/05/2024
Professor emeritus John (Jack) Johnson elected to the National Academy of Sciences Johnson's multi-disciplinary research has been instrumental in shaping ou...
08/05/2024
zweiB updates to latest version of R&S CLIPSTER Specialist in deliverables for cinema, events and trade shows
Rohde & Schwarz, a global leader in broadcast...
07/05/2024
NAB Show 2024
Utah Scientific rocked the 2024 NAB Show in Las Vegas, unveiling two new game-changers in video signal management.
Our primary focus this yea...
07/05/2024
7th May 2024 The nations favourite comedy channel Gold has teamed up with the ma...
07/05/2024
There's something special about summer. We're not sure whether it's the warmer weather, the longer days, or something else a bit more magical, but s...
07/05/2024
NITV appoints Michael Rennie as Presenter and Senior Producer for NITV News
Media releases
NITV has announced the appointment of Michael Rennie as Presenter...
07/05/2024
The ability for line-of-site tactical voice and data networks to seamlessly traverse over Satellite Communications is an emerging requirement to assure warfight...
07/05/2024
On April 5, 2024, the L3Harris Avionics Products Repair Station (NN2R037L) in Gr...
07/05/2024
eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({ content_source:......
07/05/2024
Share this article
width=32 height=32 loading=lazy data-lazy-src=https://apogeedigital.com/app/themes/juniper-theme/src/img/icons/facebook-purple.svg />
wid...
07/05/2024
BURBANK, Calif. The Walt Disney Company has finally delivered some from profits from its hefty streaming investments, with the second quarter of its fiscal year...
07/05/2024
Bonnie Hammer, vice chair of NBCUniversal, and Jen Psaki, MSNBC host, read from their new books at the 92nd Street Y in Manhattan Wednesday, May 8. Hammer's...
07/05/2024
Paramount Plus has ordered the series Crutch, a comedy that is a spinoff of CBS comedy The Neighborhood. Tracy Morgan stars....
07/05/2024
Edward J. and Melody Thomas Scott and Lidia Bastianich will receive Lifetime Achievement honors at the 51st annual Daytime Emmy Awards in June, the National Aca...
07/05/2024
The 2024 Giants of Broadcasting & Electronic Arts luncheon and awards ceremony happens in New York November 12, and the honorees are Al Roker, weather and featu...
07/05/2024
Dabl Network has added The Wayans Bros., The Jamie Foxx Show, Living Single and Everybody Hates Chris to its weekday and weekend lineups. Those shows join the l...
07/05/2024
After winning a proxy fight, The Walt Disney Co. said its entertainment business turned a profit and added subscribers in its fiscal second quarter....
07/05/2024
NBA Entertainment is closing out the second season of its series Pass the Rock with a look at Victor Wembanyama of the San Antonio Spurs, the league's rooki...
07/05/2024
Syncbak, which provides stations with streaming capabilities, said it is rebranding as Zeam Media....
07/05/2024
Samsung has made a deal with Magnolia Pictures that will bring titles from Magnolia to the Samsung TV Plus free streaming platform....
07/05/2024
Amazon, which has added commercials to Amazon Prime Video, is rolling out new interactive ad formats that will enable advertisers to engage streamers and sell s...
07/05/2024
Syncbak, a 15 year-old provider of streaming tech for local broadcast stations has rebranded itself, adopting the name of its streaming service launched in Febr...
07/05/2024
POST Luxembourgs journey with TAG Video underscores how finding a vendor who und...
07/05/2024
PORTSMOUTH, N.H. New findings from Hub Entertainment Research provides extensive data showing that the majority of consumers will opt for lower cost ad-supporte...
07/05/2024
NEW YORK The Library of American Broadcasting Foundation (LABF) has announced th...
07/05/2024
CBS News has named Lindsey Reiser an anchor and correspondent for CBS News 24/7, the network's live, streaming news service. Reiser, who was most recently a...
07/05/2024
NEEDHAM, Mass. After more than two years of decline, worldwide tablet shipments posted modest year-over-year growth of 0.5% in the first quarter of 2024 (1Q24),...
07/05/2024
ESPN is reporting that April was a record-setting month as the network delivered its best April prime time audience on record, dating back more than 30 years....
07/05/2024
WASHINGTON, D.C. The National Association of Broadcasters (NAB) has announced that Kirsten Donaldson has joined NAB as vice president of public policy. Donaldso...
07/05/2024
The Bulls are back home again this week from May 7-12! Don't miss out on any...
07/05/2024
Tonight on House of Zwide: Mampho cautions Maria against making a move on IsaacDon't miss Tuesday, 7 May's riveting episode of South African soapie Hous...
Robots require huge training leaps in AI to become versatile general helpers, says robotics pioneer Pieter Abbeel, who laid out a vision for such neural network brains of the future.
