AI Flying Off the Shelves: Restocking Robot Rolls Out to Hundreds of Japanese Convenience Stores
10/08/2022
There are 56,000 convenience stores in Japan - the third-highest density worldwide. Around 16,000 of them are run by FamilyMart. Telexistence aims to save time for these stores by offloading repetitive tasks like refilling shelves of beverages to a robot, allowing retail staff to tackle more complex tasks like interacting with customers.
It's just one example of what can be done by Telexistence's robots, which run on the NVIDIA Jetson edge AI and robotics platform. The company is also developing AI-based systems for warehouse logistics with robots that sort and pick packages.
We want to deploy robots to industries that support humans' everyday life, said Jin Tomioka, CEO of Telexistence. The first space we're tackling this is through convenience stores - a huge network that supports daily life, especially in Japan, but is facing a labor shortage.
The company, founded in 2017, next plans to expand to convenience stores in the U.S., which is also plagued with a labor shortage in the retail industry - and where more than half of consumers say they visit one of the country's 150,000 convenience stores at least once a month.
Telexistence Robots Stock Up at FamilyMart Telexistence will begin deploying its restocking robots, called TX SCARA, to 300 FamilyMart stores in August - and aims to bring the autonomous machines to additional FamilyMart locations, as well as other major convenience store chains, in the coming years.
Staff members spend a lot of time in the back room of the store, restocking shelves, instead of out with customers, said Tomioka. Robotics-as-a-service can allow staff to spend more time with customers.
TX SCARA runs on a track and includes multiple cameras to scan each shelf, using AI to identify drinks that are running low and plan a path to restock them. The AI system can successfully restock beverages automatically more than 98% of the time.
In the rare cases that the robot misjudges the placement of the beverage or a drink topples over, there's no need for the retail staff to drop their task to get the robot back up and running. Instead, Telexistence has remote operators on standby, who can quickly address the situation by taking manual control through a VR system that uses NVIDIA GPUs for video streaming.
Telexistence estimates that a busy convenience store needs to restock more than 1,000 beverages a day. TX SCARA's cloud system maintains a database of product sales based on the name, date, time and number of items stocked by the robots during operation. This allows the AI to prioritize which items to restock first based on past sales data.
Achieving Edge AI With NVIDIA Jetson TX SCARA has multiple AI models under the hood. An object-detection model identifies the types of drinks in a store to determine which one belongs on which shelf. It's combined with another model that helps detect the movement of the robot's arm, so it can pick up a drink and accurately place it on the shelf between other products. A third is for anomaly detection: recognizing if a drink has fallen over or off the shelf. One more detects which drinks are running low in each display area.
The Telexistence team used custom pre-trained neural networks as their base models, adding synthetic and annotated real-world data to fine-tune the neural networks for their application. Using a simulation environment to create more than 80,000 synthetic images helped the team augment their dataset so the robot could learn to detect drinks in any color, texture or lighting environment.
For AI model training, the team relied on an NVIDIA DGX Station. The robot itself uses two NVIDIA Jetson embedded modules: the NVIDIA Jetson AGX Xavier for AI processing at the edge, and the NVIDIA Jetson TX2 module to transmit video streaming data.
On the software side, the team uses the NVIDIA JetPack SDK for edge AI and the NVIDIA TensorRT SDK for high-performance inference.
Without TensorRT, our models wouldn't run fast enough to detect objects in the store efficiently, said Pavel Savkin, chief robotics automation officer at Telexistence.
Telexistence further optimized its AI models using half-precision (FP16) instead of single-precision floating-point format (FP32).
Learn more about the latest in AI and robotics at NVIDIA GTC, running online Sept. 19-22. Registration is free.
LINK: | https://blogs.nvidia.com/blog/2022/08/10/telexistence-convenience-stor... |
See more stories from nvidia |
Most recent headlines
04/08/2024
Dalet Appoints Santiago Solanas as CEO to Lead Next Era of Growth and Innovation
Dalet, a leading technology and service provider for media-rich organizations, is excited to announce Santiago Solanas as its new Chief Executive Officer (CEO)....
03/06/2024
Dalet and Veritone Reach Agreement to Distribute, Transact and Monetize Media Archives
Dalet, a leading technology and service provider for media-rich organizations, a...
20/05/2024
The Vampire Next Door Created with Pocket Cinema Camera 6K and DaVinci Resolve
The Vampire Next Door Created with Pocket Cinema Camera 6K and DaVinci Resolve Brie Clayton May 20, 2024 0 Comments Blackmagic Design today announced ...
20/05/2024
Tom Wills To Retire After Nearly 50 Years at WJXT Jacksonville
Tom Wills, long-running anchor at WJXT Jacksonville, Florida, has announced his retirement. He started at WJXT in 1975 and has anchored early-evening news for o...
20/05/2024
AMC Networks Promotes Emily Gotto to Senior VP at Shudder
AMC Networks said it promoted Emily Gotto to senior VP of acquisition and production for Shudder, the company's horror-themed streaming service....
20/05/2024
Paramount Names Jonathan Bingaman President, Domestic Multi-Platform Licensing & Distribution
Jonathan Bingaman has been named president, domestic multi-platform licensing & ...
20/05/2024
DLT Entertainment Gets FAST Laughs With 80's Sitcom Flashback Channel
Producer and distributor DLT Entertainment said it launched a free ad-supported streaming television (FAST) channel called 80's Sitcom Flashback....
20/05/2024
Zeam Media Names Sandie Trombert CMO
Zeam Media said it hired Sandie Trombert as chief marketing officer....
20/05/2024
Meet the VFX producer
Angus Berryman, VFX producer at UNIT studio tells TVBEurope how perseverance paid off as his career progressed By Matthew Corrigan Published: May 20, 2024 ...
20/05/2024
Sony signs NDA with Paramount Global but is reticent about earlier plan
The New York Times said the move was a significant step forward in their effort to court Paramount By Matthew Corrigan Published: May 20, 2024 The New Yor...
20/05/2024
CBC HR Team Getting Ballpark Staff Ready to Play Ball
A pair of stalwart members of the Capitol Broadcasting's dream team have been getting the company's two Coastal Plain League teams ready to launch their...
20/05/2024
May 17, 2024
Scripps Research chemists develop new method for making gamma chiral centers on simple carboxylic acids C-H activation-based method should speed drug molecule ...
20/05/2024
First European Election Major TV Debate this Monday Night on Upfront with Katie Hannon
As part of RT 's extensive coverage in the run up to the European Parliament...
19/05/2024
TV Techs Weekly Product Wrap-Up
Missed any of our product coverage during your busy week? The TV Tech weekly product and services news wrap-up provides links to all of our coverage from May 13...
19/05/2024
The CW Shares Its 2024-2025 Lineup
LeVar Burton will host the new game show Trivial Pursuit on The CW, while Raven-Symon will host Scrabble....
19/05/2024
Biden, Trump Agree to Debates on CNN, ABC
President Joe Biden and former President Donald Trump have agreed to debates, set for June 27 on CNN and September 10 on ABC....
19/05/2024
End of the Line for Young Sheldon' on May 16
Young Sheldon signs off after seven seasons on CBS, when the series finale airs Thursday, May 18. Jim Parsons and Mayim Bialik reprise their roles as Sheldon Co...
19/05/2024
House of Zwide' June Spoiler: The Zwides recover their millions
House of Zwide' June Spoiler: The Zwides recover their millions The House of Zwide' June teasers reveal that Funani and Nkosi will recover a share of t...
18/05/2024
If Bundling Is Back, What's the Ideal Bundle?
PORTSMOUTH, N.H. Bundling is back in a big way, with all the major streaming companies and many pay TV operators exploring ways to simplify the consumer experie...
18/05/2024
FCC to Vote on LPTV Rules during June Open Meeting
WASHINGTON, D.C. Federal Communications Commission Chairwoman Jessica Rosenworcel has announced a tentative agenda for the June Open Commission Meeting schedule...
18/05/2024
Matthews Launches New Multipurpose Grip Rail Telescopic Grid Pipe Solution
Matthews Studio Equipment has introduced Grip Rail, which the company said offers a better way to mount equipment on location, in the studio, or on the fly....
18/05/2024
IAB Tech Labs, Google Partner on New First Party Data Solution
In a notable development in the industry-wide effort to address privacy concerns while improving efficacy of marketing efforts in a cookieless ad landscape, IAB...
18/05/2024
TV Tech Weekly Product Wrap-Up
Missed any of our product coverage during your busy week? The TV Tech weekly product and services news wrap-up provides links to all of our coverage from May 13...
18/05/2024
DHD Elevates the Art of Podcast Production
DHD Elevates the Art of Podcast Production Brie Clayton May 17, 2024 0 Comments Hero image: the DHD DX2 base and expansion modules Latest-generation ...
18/05/2024
Skeem Saam: Friday's episode, 17 May 2024 [video]
Skeem Saam: Friday's episode, 17 May 2024 [video]Missed an episode of Skeem Saam? No problem! Watch the latest episode of your favourite South African soapi...
18/05/2024
Shaka Ilembe' approved for season three
Shaka Ilembe' approved for season threeMzansi Magic's hit series Shaka Ilembe' which stars Nomzama Mbatha has been commissioned for a third season....
17/05/2024
Aerojet Rocketdyne's Camden Site Leverages Modernization Investments to Accelerate Solid Rocket Motor Production
Aerojet Rocketdyne has worked to modernize facilities at its Camden, Arkansas, l...
17/05/2024
FCC Plans to Revise LPTV Rules
The FCC has issued a Notice of Proposed Rulemaking (NPRM) that would revise rules governing low power TV stations (LPTV) in a number of areas, including online ...
17/05/2024
Demystifying Post-Production: Introducing Cinema 4D Particles Week 4
Demystifying Post-Production: Introducing Cinema 4D Particles Week 4 Brie Clayton May 17, 2024 0 Comments With the spring release of Maxon One, we...
17/05/2024
Takashi Yamazaki Film Godzilla Minus One Graded with DaVinci Resolve Studio
Takashi Yamazaki Film Godzilla Minus One Graded with DaVinci Resolve Studio Brie Clayton May 17, 2024 0 Comments Hero image credit: 2023 TOHO CO., LT...
17/05/2024
Sterling Event Group Streamlines Live Event Productions with AJA
Sterling Event Group Streamlines Live Event Productions with AJA Brie Clayton May 17, 2024 0 Comments Live event productions only happen once, which ...
17/05/2024
Meet the product manager
Muster Ngobi, product manager at LYNX Technik tells TVBEurope how the ever-evolving media industry provides a truly dynamic working environment By Matthew Corr...
17/05/2024
TV, Streaming Schedule for 2024 NFL Regular Season Is Released
NEW YORK As declines in linear TV viewing make the ongoing popularity of live sports, particularly football, central to financial success of the TV industry, th...
17/05/2024
Netflix Ad Tier Hits 40M Monthly Active Users
During Netflixs second Upfront presentation to advertisers, Amy Reinhard, Netflix's president of advertising, walked advertisers through the continued growt...
17/05/2024
Scripps Promotes Jeff Kiernan to VP, Local News
CINCINNATI The E.W. Scripps Company has added to its leadership team for news by promoting Jeff Kiernan a veteran journalist and general manager of Scripps'...
17/05/2024
Survey: New Disney-Fox-WBD Sports Streamer May Hurt Pay TV Sub Counts
Top executives from Disney, Fox and Warner Bros. Discovery have consistently insisted that their joint venture to launch the Venu Sports streaming bundle in the...
17/05/2024
Caitlin Clark's WNBA Debut Set Viewing Records
ESPN has announced that its coverage of Caitlin Clark's WNBA debut in the Indiana Fever versus the Connecticut Sun season opener was the most-watched WNBA g...
17/05/2024
ATEM Mini Extreme ISO switcher and Blackmagic Pocket Cinema Camera 4K
ATEM Mini Extreme ISO switcher and Blackmagic Pocket Cinema Camera 4K Brie Clayton May 16, 2024 0 Comments Blackmagic Design announced today that Yoic...
17/05/2024
Pixomondo's Virtual Production Academy Expands with Programs at Sony PCL, Vook, and Vancouver Film School
Pixomondo's Virtual Production Academy Expands with Programs at Sony PCL, Vo...
17/05/2024
WBD Upfront Show Offers Peeks at House of the Dragon,' White Lotus,' Biden-Trump Debate
The Warner Bros. Discovery upfront presentation took place Wednesday, May 15 at ...
17/05/2024
The Black Keys, Jelly Roll, Kate Hudson Set To Perform on The Voice' Finale
Season 25 of The Voice wraps on NBC Tuesday, May 21, with performances from The Black Keys, Jelly Roll, Kate Hudson, Lainey Wilson, Muni Long, Thomas Rhett and ...
17/05/2024
CNN Boss Mark Thompson's Plan Includes More News in More Categories on More Devices (Upfronts)
New CNN CEO Mark Thompson spelled out his plan for the struggling news network d...
17/05/2024
Netflix To Launch In-House Advertising Tech Platform
Netflix, a newcomer to the advertising business, said it plans to launch an in-house advertising technology platform....
17/05/2024
Netflix Plots TV Takeover at Upfront Presentation
Netflix shared some programming projects at an upfront presentation in New York. Those include the basketball-themed comedy series Running Point, a Mindy Kaling...
17/05/2024
Plex Geek Week Sale Offers 20% Off Plex Lifetime Pass
Plex is offering movie and music collectors a 20% discount off its Lifetime Plex Pass as part of its Geek Week sale....
17/05/2024
GroupM Names Toby Jenner as President, GroupM Clients
Giant media buyer GroupM said it named Toby Jenner as global president, Group M Clients, a new position at the company....
17/05/2024
Clients of Independent Agencies Boost Programmatic Buying
Smaller advertisers are increasingly buying connected TV programmatically, according to a new report from FreeWheel, Comcast's ad-tech unit....
17/05/2024
TCLtvPlus Adds Streaming Music Channels From Vevo
TCLtvPlus, the streaming app on smart TVs made by TCL, has added live linear channel from music-video programmer Vevo....
17/05/2024
StackAdapt Adopts Data From Samba TV for Programmatic Campaigns
StackAdapt said it made a deal to integrate data from Samba TV into its programmatic advertising platform....
17/05/2024
Tonight on Skeem Saam: Lehasa gets a rude awakening when Kgosi blackmails him
Tonight on Skeem Saam: Lehasa gets a rude awakening when Kgosi blackmails himDon't miss Friday, 17 May's riveting episode of South African soapie Skeem ...