NVIDIA Expands Robotics Platform to Meet the Rise of Generative AI
18/10/2023
Generative AI is bringing the power of transformer models and large language models to virtually every industry. That reach now includes areas that touch edge, robotics and logistics systems: defect detection, real-time asset tracking, autonomous planning and navigation, human-robot interactions and more.
NVIDIA today announced major expansions to two frameworks on the NVIDIA Jetson platform for edge AI and robotics: the NVIDIA Isaac ROS robotics framework has entered general availability, and the NVIDIA Metropolis expansion on Jetson is coming next.
To accelerate AI application development and deployments at the edge, NVIDIA has also created a Jetson Generative AI Lab for developers to use with the latest open-source generative AI models.
More than 1.2 million developers and over 10,000 customers have chosen NVIDIA AI and the Jetson platform, including Amazon Web Services, Cisco, John Deere, Medtronic, Pepsico and Siemens.
With the rapidly evolving AI landscape addressing increasingly complicated scenarios, developers are being challenged by longer development cycles to build AI applications for the edge. Reprogramming robots and AI systems on the fly to meet changing environments, manufacturing lines and automation needs of customers is time-consuming and requires expert skills.
Generative AI offers zero-shot learning - the ability for a model to recognize things specifically unseen before in training - with a natural language interface to simplify the development, deployment and management of AI at the edge.
Transforming the AI Landscape Generative AI dramatically improves ease of use by understanding human language prompts to make model changes. Those AI models are more flexible in detecting, segmenting, tracking, searching and even reprogramming - and help outperform traditional convolutional neural network-based models.
Generative AI is expected to add $10.5 billion in revenue for manufacturing operations worldwide by 2033, according to ABI Research.
Generative AI will significantly accelerate deployments of AI at the edge with better generalization, ease of use and higher accuracy than previously possible, said Deepu Talla, vice president of embedded and edge computing at NVIDIA. This largest-ever software expansion of our Metropolis and Isaac frameworks on Jetson, combined with the power of transformer models and generative AI, addresses this need.
Developing With Generative AI at the Edge
The Jetson Generative AI Lab provides developers access to optimized tools and tutorials for deploying open-source LLMs, diffusion models to generate stunning interactive images, vision language models (VLMs) and vision transformers (ViTs) that combine vision AI and natural language processing to provide comprehensive understanding of the scene.
Developers can also use the NVIDIA TAO Toolkit to create efficient and accurate AI models for edge applications. TAO provides a low-code interface to fine-tune and optimize vision AI models, including ViT and vision foundational models. They can also customize and fine-tune foundational models like NVIDIA NV-DINOv2 or public models like OpenCLIP to create highly accurate vision AI models with very little data. TAO additionally now includes VisualChangeNet, a new transformer-based model for defect inspection.
Harnessing New Metropolis and Isaac Frameworks NVIDIA Metropolis makes it easier and more cost-effective for enterprises to embrace world-class, vision AI-enabled solutions to improve critical operational efficiency and safety problems. The platform brings a collection of powerful application programming interfaces and microservices for developers to quickly develop complex vision-based applications.
More than 1,000 companies, including BMW Group, Pepsico, Kroger, Tyson Foods, Infosys and Siemens, are using NVIDIA Metropolis developer tools to solve Internet of Things, sensor processing and operational challenges with vision AI - and the rate of adoption is quickening. The tools have now been downloaded over 1 million times by those looking to build vision AI applications.
To help developers quickly build and deploy scalable vision AI applications, an expanded set of Metropolis APIs and microservices on NVIDIA Jetson will be available by year's end.
Hundreds of customers use the NVIDIA Isaac platform to develop high-performance robotics solutions across diverse domains, including agriculture, warehouse automation, last-mile delivery and service robotics, among others.
At ROSCon 2023, NVIDIA announced major improvements to perception and simulation capabilities with new releases of Isaac ROS and Isaac Sim software. Built on the widely adopted open-source Robot Operating System (ROS), Isaac ROS brings perception to automation, giving eyes and ears to the things that move. By harnessing the power of GPU-accelerated GEMs, including visual odometry, depth perception, 3D scene reconstruction, localization and planning, robotics developers gain the tools needed to swiftly engineer robotic solutions tailored for a diverse range of applications.
With the general availability of the latest Isaac ROS 2.0 release, developers can now create and bring high-performance robotics solutions to market with Jetson.
ROS continues to grow and evolve to provide open-source software for the whole robotics community, said Geoff Biggs, CTO of the Open Source Robotics Foundation. NVIDIA's new prebuilt ROS 2 packages, launched with this release, will accelerate that growth by making ROS 2 readily available to the vast NVIDIA Jetson developer community.
Delivering New Reference AI Workflows Developing a production-ready AI solution entails optimizing the development and training of AI models tailored to specific use cases, implementing robust security
LINK: | https://blogs.nvidia.com/blog/2023/10/18/metropolis-jetson-isaac-robot... |
See more stories from nvidia |
Most recent headlines
04/08/2024
Dalet Appoints Santiago Solanas as CEO to Lead Next Era of Growth and Innovation
Dalet, a leading technology and service provider for media-rich organizations, is excited to announce Santiago Solanas as its new Chief Executive Officer (CEO)....
03/06/2024
Dalet and Veritone Reach Agreement to Distribute, Transact and Monetize Media Archives
Dalet, a leading technology and service provider for media-rich organizations, a...
01/06/2024
TV Tech Weekly Product News Wrap-Up
Busy this week catching up from the Memorial Day holiday? Our TV Tech weekly wrap-up of all our coverage of new products, services and deployments will get you ...
01/06/2024
Guy Ritchie Behind Young Sherlock' Series on Prime Video
Young Sherlock, with Guy Ritchie directing and executive producing, is a go at Prime Video. Hero Fiennes Tiffin plays Sherlock. Prime Video calls it the origin...
01/06/2024
Caitlin Clark-Cameron Brink WNBA Matchup Draws 724,000 Viewers
The Los Angeles Sparks-Indiana Fever game on Friday featuring the top two WNBA draft picks, Caitlin Clark and Cameron Brink, was the most watched WNBA game on I...
01/06/2024
Lionsgate Names Brian Weinstein Co-CEO of 3 Arts Entertainment
Lionsgate, which increased its majority stake in 3 Arts Entertainment in January, said it named Brian Weinstein co-CEO of 3 Arts....
01/06/2024
Netflix to Launch Video Games For Perfect Match', Too Hot to Handle', Other Unscripted Hits
Netflix is launching four video games based on unscripted series this year. They...
01/06/2024
Broadcast Networks Go Live for Donald Trump Verdict
ABC, CBS, NBC and Fox affiliates switched from their regular programming to carry live coverage of the verdicts in the porn star hush-money trial of former Pres...
31/05/2024
Orange County Expansion Helps Aerojet Rocketdyne Boost Solid Rocket Motor Production
A U.S. Marine fires an FIM-92 Stinger missile during a training exercise in Yuma...
31/05/2024
IAB Tech Lab Expands Open Measurement SDK Capabilities to Support Samsung and LG TVs
NEW YORK The global body that sets technical standards for digital advertising h...
31/05/2024
Study: Max, Apple TV+ Have Fewest 'Committed Customers'
In a new analysis of what services might make up a good bundle and what services might benefit the most from bundling, Antenna has released new data that highli...
31/05/2024
Report: Older SVOD Subscribers Unfazed by Price Hikes Will Drive Revenue Growth
Global SVOD revenues will increase by $116.6 billion by 2031, a growth rate of 13.3% per year over the next eight years, according to a new report from MIDiA Re...
31/05/2024
FCC Media Bureau Incorporates 2020 Census Data into TVStudy Software
WASHINGTON, D.C. The FCC Media Bureau has announced that effective August 1, 2024 the Commission's TVStudy software will incorporate the most recent U.S. Ce...
31/05/2024
NBCU's FAST Channel TNBC to Rebrand as NBC Comedy Vault
NBCUniversal has announced that its FAST channel TNBC will be rebranding to NBC Comedy Vault on June 1 and that the free streaming service will officially launc...
31/05/2024
TVRI Taps Ateme for Transition to 4K UHD OTT Streaming
PARIS Ateme has announced that the Indonesian public broadcaster TVRI is making the transition to 4K UHD OTT streaming using Ateme technologies....
31/05/2024
Marlow Film Studios considering next steps' as council blocks plans
The proposal had received support from James Cameron, Andy Serkis, Paul Greengrass, Richard Curtis, and Jeremy Irons By Matthew Corrigan Published: May 31, 2...
31/05/2024
Skydance submits new Paramount Global bid, Sony talks still progressing'
According to multiple reports, the new bid from Skydance offers a better deal to Paramounts Class B shareholders, who were said to be unhappy with the companys ...
31/05/2024
2024 Rise Awards open for entries
The awards recognise women and companies who are stand-out performers, innovators and leaders in the broadcast media technology industry By Matthew Corrigan ...
31/05/2024
Samsung, LG Adopt IAB Software Kit for CTV Ad Measurement
NEW YORK The global body that sets technical standards for digital advertising has expanded the reach of its measurement software development kit to include Sam...
31/05/2024
The Old Investment Cycles of Broadcast Technology are Being Run Over'
The rise of digital platforms is fundamentally changing the broadcast newsroom and its investment in technology according to Jon Roberts, director of technology...
31/05/2024
Study: Max, Apple TV Have Fewest 'Committed Customers'
In a new analysis of what services might make up a good bundle and what services might benefit the most from bundling, Antenna has released new data that highli...
31/05/2024
State Broadcasters Urge Passage of Broadcast VOICES Act
WASHINGTON, D.C. Fifty state broadcasters associations, including the District of Columbia and the Commonwealth of Puerto Rico, have sent a letter to Congressio...
31/05/2024
EVS Names Richard Katz SVP Operations for NALA region
EVS has announced the appointment of Richard Katz as senior vice president of operations for the North and Latin American (NALA) region. This appointment is par...
31/05/2024
CommScope to Buy Cable Business Assets of Casa Systems for $45.1M
CommScope has announced that it was selected by Casa Systems, Inc. as the highest to acquire Casa's cable business assets and that the two companies have en...
31/05/2024
NAB Withdraws De Niro's Service Award
Robert De Niro won't be receiving the Service to America Leadership Award from the NAB Leadership Foundation after all....
31/05/2024
Viant Integrates With Google Cloud's BigQuery Clean Rooms
Viant Technology said it formed an integration with Google Cloud's BigQuery data clean rooms...
31/05/2024
The CW To Broadcast Snoop Dogg Arizona Bowl
The CW said it will broadcast the 2024 Snoop Dogg Arizona Bowl presented by Gin & Juice by Dre and Snoop Last year, The CW aired the game when it was called Bar...
31/05/2024
Allen Media Makes Carriage Deal With Amazon Fire Channels
Allen Media Group said it made a deal with Amazon's Fire TV Channel that will make content from several of Allen's outlet available via Fire TV and Echo...
31/05/2024
Robert De Niro Will Not Receive Service to America Award
Robert De Niro, announced as the winner of the NAB's Leadership Foundation's Service to America Leadership Award on May 28, will not get the award. The ...
31/05/2024
Comcast Technology Solutions To Manage Channels for AccuWeather
Comcast Technology Solutions was selected by AccuWeather to create, manage and distribute linear and over-the-top video channels....
31/05/2024
Attention to Connected TV Ads Grew in Q1, TVision Study Finds
Connected TV is becoming a bigger deal for consumers and advertisers, according to a new report from TVision....
31/05/2024
A Guitar Solo Trick You've Never Heard Before
By Craig Anderton Let's get right to what this sounds like. It's not quite feedback or tape reverse, it's well, listen to what it does in this blue...
31/05/2024
VEON discloses April YTD trading update at its AGM
31 May 2024 VEON discloses April YTD trading update at its AGM Amsterdam, 31 May 2024 07:00 CEST - VEON April YTD 2024 Highlights Total revenue of USD 1,278 ...
31/05/2024
VEON Announces Its New Board, Names Founder Augie Fabela as Chairman
31 May 2024 VEON Announces Its New Board, Names Founder Augie Fabela as Chairman Amsterdam, 31 May 2024, 16.00 CET: VEON Ltd. (NASDAQ: VEON, Euronext Amsterdam...
31/05/2024
Tribeca Festival and Open AI Announce Sora Shorts
May 31st, 2024 TRIBECA FESTIVAL AND OPEN AI ANNOUNCE SORA SHORTS' Five Commissioned Short Films Created Using Sora Debut at 2024 Tribeca Festival New ...
31/05/2024
In-Venue Technology Wrap-Up: How 4K, IP, and More are Changing the Game Pres Game
In-Venue Technology Wrap-Up: How 4K, IP, and More are Changing the Game Pres Gam...
31/05/2024
UEFA Champions League Final 2024: The Facts and Figures Behind This Weekend's Knockout Between Real Madrid CF and Borussia Dortmund
UEFA Champions League Final 2024: The host broadcast facts and figures for Real ...
31/05/2024
UEFA Europa Conference League Final 2024: Bringing the Broadcast to Global TV Screens With the Production Facts
UEFA Europa Conference League Final 2024: Bringing the broadcast to global TV sc...
31/05/2024
Willow Offers Free 2024 ICC T20 Cricket World Cup Preview via DirecTV, Verizon, Optimum
Willow Offers Free 2024 ICC T20 Cricket World Cup Preview via DirecTV, Verizon, ...
31/05/2024
Women's College World Series: ESPN Brings Live Drone, Two-Point Cabled, and Cinematic On-Field Cameras to Oklahoma City
Women's College World Series: ESPN Brings Live Drone, Two-Point Cabled, and ...
31/05/2024
SVG College Summit Brings Video-Production Industry Together in Atlanta in the Midst of Unprecedented Change
SVG College Summit Brings Video-Production Industry Together in Atlanta in the M...
31/05/2024
UEFA Champions League Final 2024: CBS Sports' UCL Today Studio Show Is Pitchside at Wembley Stadium
UEFA Champions League Final 2024: CBS Sports' UCL Today Studio Show Is Pitch...
31/05/2024
Master of the House' Unveils a Scandalous Tale of Power and Greed on July 18
Back to All News Master of the House' Unveils a Scandalous Tale of Power and Greed on July 18 Entertainment 31 May 2024 GlobalThailand Link copied to ...
31/05/2024
JEEtu Bhaiya is Back: Kota Factory' Season 3 Arrives on Netflix June 20
Back to All News JEEtu Bhaiya is Back: Kota Factory' Season 3 Arrives on Netflix June 20 Entertainment 31 May 2024 GlobalIndia Link copied to clipboar...
31/05/2024
Thales has completed the sale of its Ground Transportation Systems business
Facebook Twitter LinkedIn With around 9,000 employees, Ground Transportation Systems is a global leader in Rail Signaling and Train Control Systems, Telec...
31/05/2024
RT 2FM is the home of music this summer
RT 2FM is the home of music this summer, entertaining listeners across the day and night, with the best music, chat and interviews providing the soundtrack to ...
31/05/2024
NVIDIA Grace Hopper Superchip Accelerates Murex MX.3 Analytics Performance, Reduces Power Consumption
After the 2008 financial crisis and increased risk-management regulations that f...
31/05/2024
RT Supporting the Arts: What's On this June
RT Supporting the Arts: What's On this June Watch our promo: RT Supporting the Arts | What's on YouTube This June, RT is delighted to support Lim...
30/05/2024
When to Upgrade Software or Firmware
When to Upgrade Software or Firmware This post is from our blog and news archive. The information may be out of date. Please contact us for further information ...