How Robots Will Learn: Berkeley's Sergey Levine Coaxes Robots to Enjoy Their Childhood
10/12/2018
If you visited the laboratory of professor Sergey Levine at the University of California at Berkeley, you might see some puzzling scenes.
We want to put our robots into an environment where they can explore, where they can essentially play, says Levine, an assistant professor who runs the Robotic Artificial Intelligence and Learning Lab within the Artificial Intelligence Research Lab at Berkeley, which is a participant in our NVIDIA AI Labs initiative.
Playground: Sergey Levine's robotics lab may one day be home to robots that learn by playing. Why would robots be playing? Because a key to intelligence may be the way that creatures learn about their physical environment by poking at things, pushing things and observing what happens.
The only proof of the existence of intelligence is in humans, and humans exist in a physical world, they're embodied, explains Levine. In fact, all intelligent creatures we know are embodied. Perhaps they don't have to be, but we don't know that.
Hence, I see the robotics as actually a lens on artificial intelligence more broadly, he says.
From the Bottom Up One of the biggest lessons of robotics over many years, says Levine, is that it confirms Moravec's Paradox.
Hans Moravec, a Carnegie Mellon University professor of robotics, wrote about a dichotomy in AI in his 1988 book Mind Children: The Future of Robot and Human Intelligence.
Machines can be taught to do well things humans find hard, such as mastering the game of chess. But machines do poorly at what is easy for us, such as basic motor skills.
If you want a machine to play chess, it is actually comparatively quite easy, observes Levine. If you want a machine to pick up the chess pieces, that is incredibly difficult.
Moravec viewed that dichotomy as a giant clue to the problem of constructing machines that think. He argued for building up intelligence by following the path of Darwinian evolution. That is, the gradual development, from the bottom up, of basic sensorimotor systems and then, much later, higher reasoning.
No Cats There's a parallel to deep learning, such as the breakthroughs in image recognition with convolutional neural networks (CNNs). Neural networks that automatically learn the most basic features in data - edge detectors and corner detectors, say - can then assemble hierarchies of representation.
What we saw was that a method that can figure out those low-level features can then also figure out the higher-level features, says Levine.
Coffee anyone? Teaching machines to learn will be key to creating robots able to live and work alongside humans. Unlike pictures of cats on the internet, however, there isn't a ready supply of data for robots to learn from. Hence his lab's focus on having machines explore the environment for weeks, autonomously pushing things around, manipulating objects and then learning something about their world.
Levine uses a variety of machine learning techniques to train robots, including CNNs but also, especially, reinforcement learning, where a route to a destination is planned by inferring from a current state to a goal state. The policy is then used by the robot at test time to carry out new instances of those tasks.
During the training phase, the play with objects is unsupervised. There is no hand-engineering by humans of the precise movements the robot should make to carry out a task. Nor is the goal even specified.
The neural network figures out what goal it should accomplish, and then figures out what policies, including angles of movement of its appendages, can lead to that goal.
Learning to Learn' Training makes use of clusters of NVIDIA GPUs in an offsite facility. During test time, a single GPU is attached to each robot, which is used to run the policies that have been learned. In some more ambitious tests, such as learning a new policy from watching a video demonstration by a human, a more powerful NVIDIA DGX-1 is attached to each machine.
Says Levine, GPU compute power has brought two benefits to AI. By speeding up training, it allows us to do science faster. Second, during inference, the power of GPUs allows for real-time response, something that is a really big deal for robots.
When the robot is actually in the physical world, if it's doing something dynamic, such as flying at a closed door, as in the case of a drone, it needs to figure out the door's closed before it hits it.
The work of Levine and his staff with reinforcement learning has evolved to greater levels of sophistication. It's one thing to teach a robot to perform a task at test time similar to what it learned in training. More ambitious is for the robot to learn new policies for problem solving at test time on tasks that are novel. The machine is learning to learn, says Levine.
The latter, called meta-learning, is an increasing focus of his lab. In a recent paper, One-shot Hierarchical Imitation Learning of Compound Visuomotor Tasks, a robot first watches a human demonstrate a simple, primitive task, such as dropping an object into a bowl. It develops a policy to imitate that action.
At test time, the robot is shown a compound task, such as dropping the object in the bowl and then moving the bowl along the table. The robot uses its prior experience with the simple tasks to compose a sequence of policies by which to perform actions in succession.
The Artificial Intelligence Research Lab at Berkeley is a participant in our NVIDIA AI Labs initiative. Levine's robots were able to imitate the human's demonstration of the compound task after seeing it demonstrated just one time, what's known as single-sh
LINK: | https://blogs.nvidia.com/blog/2018/12/10/berkeley-sergey-levine-how-ro... |
See more stories from nvidia |
Most recent headlines
04/08/2024
Dalet Appoints Santiago Solanas as CEO to Lead Next Era of Growth and Innovation
Dalet, a leading technology and service provider for media-rich organizations, is excited to announce Santiago Solanas as its new Chief Executive Officer (CEO)....
03/06/2024
Dalet and Veritone Reach Agreement to Distribute, Transact and Monetize Media Archives
Dalet, a leading technology and service provider for media-rich organizations, a...
28/04/2024
Mediahaus delivers the first SRT live-streaming sports production over 5G with URSA Broadcast G2
Mediahaus delivers the first SRT live-streaming sports production over 5G with U...
25/04/2024
Qurate Launches The Big Dish on The Roku Channel
WEST CHESTER, Pa. Video commerce provider Qurate Retail Group has launched The Big Dish, a new culinary-themed FAST channel on The Roku Channel....
25/04/2024
HPA Opens Submissions for 2024 HPA Engineering Excellence Awards
LOS ANGELES The Hollywood Professional Association has announced that submissions for the 2024 HPA Engineering Excellence Awards are now being accepted. This re...
25/04/2024
DV Earns MRC Accreditation for CTV Viewability
NEW YORK The digital media measurement and analytics firm DoubleVerify has announced that it has received Media Rating Council (MRC) accreditation for Video Vie...
25/04/2024
DAZN FAST Channels to Launch on Tubi
SAN FRANCISCO Fox Corp.'s ad-supported streaming service Tubi has announced a licensing agreement with the sports platform DAZN that will see DAZN Ringside ...
25/04/2024
IAB Makes Three Appointments to Its Leadership Team
NEW YORK In the runup to the 2024 IAB NewFronts, the IAB has announced three key appointments to its leadership team....
25/04/2024
Epic Games releases Unreal Engine 5.4 with new Motion Design Mode, Unreal VCam for Android, and more
Epic Games releases Unreal Engine 5.4 with new Motion Design Mode, Unreal VCam f...
25/04/2024
Content Creation, Production, Distribution Is In a State of Flux
Content Creation, Production, Distribution Is In a State of Flux Andy Marken April 24, 2024 0 Comments My empathy is creeping towards what I would de...
25/04/2024
Capitol Broadcasting Company to Air Carolina Panthers Games on Triangle's Strongest Broadcast Signal
The Carolina Panthers and Capitol Broadcasting Company (CBC) announced they have...
25/04/2024
Berklee Student Riko Sasaski Named 2024 Yamaha Young Performing Artist
Berklee Student Riko Sasaski Named 2024 Yamaha Young Performing Artist The accomplished saxophonist secured a spot among the elite winners of this year's ...
25/04/2024
Local News Close-Up: St. Louis Born and Bred
Stations everywhere take pride in having a main anchor who comes from the market they represent. That applies in St. Louis, too, but it also pertains to general...
25/04/2024
Edward Moody Joins WBTW Myrtle Beach Anchor Team
Edward Moody is joining the WBTW Myrtle Beach, South Carolina, anchor crew, and will anchor the 5, 6 and 11 p.m. newscasts alongside Trish Williford. He comes f...
25/04/2024
MTV Moving VMAs To New UBS Arena in New York
MTV said the 2024 Video Music Awards will return to New York and take place at the new UBS Arena....
25/04/2024
Offbeat Comedy The Outlaws' Returns to Prime Video Next Month
Season three of comedy The Outlaws premieres on Prime Video May 31. Stephen Merchant co-created the show, and stars. There are five episodes....
25/04/2024
Bidders Interested in Buying Bounce, Says Scripps CEO Adam Symson
The E.W. Scripps Co. is evaluating offers for Bounce, its multicast channel for African-American viewers, according to a report from CNBC....
25/04/2024
Paramount Plus Renews Dora'
Paramount Plus has ordered a second season for Dora, the animated preschool show based on Dora the Explorer. The show, featuring Dora on a rainforest adventure ...
25/04/2024
AI-assisted optronics: an unprecedented European project to increase combat perception capabilities
Facebook Twitter LinkedIn The European Commission signed the Grant Agreeme...
24/04/2024
UKTV's pay TV channel Alibi joins forces with S4C and All3Media International for new legal crime drama series Mudtown
Cast set to star include Erin Richards and Tom Cullen Wednesday 24 April 2024 ...
24/04/2024
K-Hip-Hop's Biggest Names Take Center Stage on KrOWN X HAN 2024'
This month marked the return of Spotify's HAN, our collaborative program that brings the unique sounds and culture of Korean hip-hop to the world through ex...
24/04/2024
RADAR Italy Returns With 6 Artists Transforming the Country's Music Landscape
As Spotify's program to spotlight rising talent from around the world, RADAR...
24/04/2024
Spotify Partners With Les Flammes Music Awards To Celebrate French Rap
Spotify is once again teaming up with Les Flammes, the only music awards dedicated to rap, R&B, Afrobeats, and popular culture in France. Spotify helped create...
24/04/2024
Taylor Swift's THE TORTURED POETS DEPARTMENT' Becomes Spotify's Most-Streamed Album in One Week
Records smashed. History made. It's been just five days since Taylor Swift u...
24/04/2024
SBS marks Earth Day as The Cook Up with Adam Liaw becomes first Australian show to have its carbon footprint validated through SSA
SBS marks Earth Day as The Cook Up with Adam Liaw becomes first Australian show ...
24/04/2024
Save money every day with SBS's Ricardo Gonalves and Peggy Giakoumelos on new Cost of Living Secrets podcast
Save money every day with SBS's Ricardo Gon alves and Peggy Giakoumelos on n...
24/04/2024
Authentic Perspectives
The first feature film from writer-director Shaun Seneviratne, Ben and Suzanne: A Reunion in 4 Parts depicts the struggle between love and duty as Ben (Sathya S...
24/04/2024
Melanie Georgieva Joins Panalux as Long Form Sales Director
LONDON, England (24 April 2024) Panalux, a leading rental provider of lighting and power solutions for the motion-picture industry and part of Panavision'...
24/04/2024
Deutsche Telekom Powers New MagentaTV Service With Broadpeak's Cloud DVR Solution
April 24, 2024 -- Deutsche Telekom Powers New MagentaTV Service With Broadpea...
24/04/2024
Mundo Hispano Digital Launches MundoNow Connect
ATLANTA Mundo Hispano Digital has launched a new advertising product, MundoNow Connect, that is designed to help advertisers reach Hispanic audiences on connect...
24/04/2024
Epic Games Releases Unreal Engine 5.4
Epic Games has released a major new version of Unreal Engine, which has become a mainstay in virtual production, that includes new features and improvements to ...
24/04/2024
NAB Show Welcomes Creators to Las Vegas
The National Association of Broadcasters welcomed the industry to its annual extravaganza last month in Las Vegas. The sights and sounds were similar to previou...
24/04/2024
Chptr, Gray Television Launch on Video Obituary Platform
NEW YORK Chptr and Gray Television have announced that they are introducing a new video solution for funeral homes and communities that will allow funeral direc...
24/04/2024
Adobe Charts the Future of Creativity and AI at MAX London
Adobe Charts the Future of Creativity and AI at MAX London Brie Clayton April 24, 2024 0 Comments Adobe is taking MAX, the world's largest creativ...
24/04/2024
Curtis LeGeyt, NAB President and CEO, Extends Contract
National Association of Broadcasters president and CEO Curtis LeGeyt has agreed to a contract extension that keeps him at the trade association's helm throu...
24/04/2024
Jo Ann Ross Steps Down as Ad Sales Chairman at Paramount
Jo Ann Ross, the long-running queen of television advertising sales, is stepping down from her role as chairman of Paramount Advertising at the end of the month...
24/04/2024
Scripps Names James Galindo as Station Manager in Bakersfield
E.W. Scripps said it named James Galindo as station manager for KERO, the ABC affiliate in Bakersfield, California....
24/04/2024
Amazon Prime Video's Fallout' Tops TVision Power Score Rankings
Amazon Prime Video's Fallout topped TVision's Power Score rankings of shows on connected TV for the week of April 15....
24/04/2024
DoubleVerify Gets MRC Stamp for CTV Viewability Metrics
DoubleVerify said that it received accreditation from the Media Rating Council for its measurement of video viewable impressions and related metrics for connect...
24/04/2024
PlayBox Neo Highlights Latest Advances in Smart Media Pla...
PlayBox Neo reports a successful and well attended 2024 NAB Show, held in mid April at the Las Vegas Convention Center. Now in its 101st year, the event attract...
24/04/2024
MPEG-5 LCEVC Showcase at NAB 2024 demonstrates ecosystem...
MPEG-5 LCEVC ecosystem support continues to grow and includes TVs and set-top boxes, gearing up for the deployment of TV3.0 in Brazil New, never-before-seen ...
24/04/2024
Black Box and NOVO at Integrate Middle East 2024 Featurin...
At Integrate Middle East 2024 in Booth AR-F45, where the company is exhibiting along with its partner NOVO, Black Box will feature IP-based KVM and AV solution...
24/04/2024
NEP Belgium Taps manifold CLOUD in Virtual OB Setup for Live Sports
FRANKFURT, Germany Software solutions provider manifold technologies has announced that its manifold CLOUD was selected by NEP Belgium to provide a signal proce...
24/04/2024
Integral Ad Science Achieves MRC Accreditation
NEW YORK Integral Ad Science has announced that it has earned Media Rating Council (MRC) accreditation for its sophisticated invalid traffic (SIVT) filtration f...
24/04/2024
Plex Launches NFL Channel
LOS GATOS, Calif. Streaming media company Plex has announced a partnership with the National Football League that will add the NFL Channel, the NFLs 24/7 free l...
24/04/2024
NAB Extends Contract for President & CEO Curtis LeGeyt
WASHINGTON, D.C. NAB President and CEO Curtis LeGeyt has agreed to a contract extension that will keep him at the helm of NAB through 2029, according to NAB Joi...
24/04/2024
GlobalM, scoopa Form Strategic Partnership To Enable Speedy Content Distribution
GENEVA, Switzerland Software-defined video network (SDVN) platform specialist GlobalM and broadcast-quality content distribution expert scoopa have formed a str...
24/04/2024
Screen Australia celebrates Australian projects bound for Cannes Film Festival 2024
24 04 2024 - Media release Screen Australia celebrates Australian projects bound...
24/04/2024
Berklee Online to Hold 2024 Berklee Onsite Music Conference May 31-June 1
Berklee Online to Hold 2024 Berklee Onsite Music Conference May 31-June 1 The in-person conference is open to Berklee Online students and the music community ...
24/04/2024
Kargo Gives Buyers More Detail on CTV Campaigns
Kargo said it has launched a new product that gives advertisers more details about the connected TV campaigns they are buying....