Sony Pixel Power calrec Sony

Meet the Maker: Robotics Student Rolls Out Autonomous Wheelchair With NVIDIA Jetson

03/10/2023

With the help of AI, robots, tractors and baby strollers - even skate parks - are becoming autonomous. One developer, Kabilan KB, is bringing autonomous-navigation capabilities to wheelchairs, which could help improve mobility for people with disabilities.

The undergraduate from the Karunya Institute of Technology and Sciences in Coimbatore, India, is powering his autonomous wheelchair project using the NVIDIA Jetson platform for edge AI and robotics.

The autonomous motorized wheelchair is connected to depth and lidar sensors - along with USB cameras - which allow it to perceive the environment and plan an obstacle-free path toward a user's desired destination.

A person using the motorized wheelchair could provide the location they need to move to, which would already be programmed in the autonomous navigation system or path-planned with assigned numerical values, KB said. For example, they could press one' for the kitchen or two' for the bedroom, and the autonomous wheelchair will take them there.

An NVIDIA Jetson Nano Developer Kit processes data from the cameras and sensors in real time. It then uses deep learning-based computer vision models to detect obstacles in the environment.

The developer kit acts as the brain of the autonomous system - generating a 2D map of its surroundings to plan a collision-free path to the destination - and sends updated signals to the motorized wheelchair to help ensure safe navigation along the way.

About the Maker KB, who has a background in mechanical engineering, became fascinated with AI and robotics during the pandemic, when he spent his free time searching up educational YouTube videos on the topics.

He's now working toward a bachelor's degree in robotics and automation at the Karunya Institute of Technology and Sciences and aspires to one day launch a robotics startup.

KB, a self-described supporter of self-education, has also received several certifications from the NVIDIA Deep Learning Institute, including Building Video AI Applications at the Edge on Jetson Nano and Develop, Customize and Publish in Omniverse With Extensions.

Once he learned the basics of robotics, he began experimenting with simulation in NVIDIA Omniverse, a platform for building and operating 3D tools and applications based on the OpenUSD framework.

Using Omniverse for simulation, I don't need to invest heavily in prototyping models for my robots, because I can use synthetic data generation instead, he said. It's the software of the future.

His Inspiration With this latest NVIDIA Jetson project, KB aimed to create a device that could be helpful for his cousin, who has a mobility disorder, and other people with disabilities who might not be able to control a manual or motorized wheelchair.

Sometimes, people don't have the money to buy an electric wheelchair, KB said. In India, only upper- and middle-class people can afford them, so I decided to use the most basic type of motorized wheelchair available and connect it to the Jetson to make it autonomous.

The personal project was funded by the Program in Global Surgery and Social Change, which is jointly positioned under the Boston Children's Hospital and Harvard Medical School.

His Jetson Project After purchasing the basic motorized wheelchair, KB connected its motor hub with the NVIDIA Jetson Nano and lidar and depth cameras.

He trained the AI algorithms for the autonomous wheelchair using YOLO object detection on the Jetson Nano, as well as the Robot Operating System, or ROS, a popular software for building robotics applications.

The wheelchair can tap these algorithms to perceive and map its environment and plan a collision-free path.

The NVIDIA Jetson Nano's real-time processing speed prevents delays or lags for the user, said KB, who's been working on the project's prototype since June. The developer dives into the technical components of the autonomous wheelchair on his blog. A demo of the autonomous wheelchair has also been featured on the Karunya Innovation and Design Studio YouTube channel.

Looking forward, he envisions his project could be expanded to allow users to control a wheelchair using brain signals from electroencephalograms, or EEGs, that are connected to machine learning algorithms.

I want to make a product that would let a person with a full mobility disorder control their wheelchair by simply thinking, I want to go there,' KB said.

Learn more about the NVIDIA Jetson platform.
LINK: https://blogs.nvidia.com/blog/2023/10/03/kabilan-kb-autonomous-wheelch...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

09/10/2026

Dolby Expands Dolby OptiView Platform with New Capabilities at IBC 2026

September 10 2026, 06:00 (PDT) Dolby Expands Dolby OptiView Platform with New Capabilities at IBC 2026 New Sports Intelligence helps providers better unders...

07/10/2026

Dalet Flex LTS Delivers Smarter Media Operations from Ingest to Distribution

Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...

11/09/2026

IBC 2026: Calrec Launches Type RT Console and Apex M6 Modular I/O Platform

Calrec will introduce two new products at IBC2026 (Stand 8.C47, RAI Amsterdam, September 11-14): the Type RT broadcast production console and the Apex M6 Modula...

11/09/2026

IBC 2026: Grass Valley Launches AVORA All-in-One Live Production Platform

Grass Valley has announced AVORA, a standalone all-in-one live production solution launching at IBC2026 (Booth 9.A01 and IBC Future Tech Zone, Stand 14.C49, Sep...

11/09/2026

IBC 2026: CAMB.AI Launches Streaming SDK and Dashboard for Multilingual Live Broadcasting

CAMB.AI is introducing its Streaming SDK and Streaming Dashboard at IBC2026, wit...

11/09/2026

IBC 2026: EVS Launches XT-S Software-Defined Multi-Application Server

EVS has announced XT-S, a software-defined server platform that runs multiple live production applications on a common hardware foundation. The platform debuts ...

11/09/2026

IBC 2026: EKT Showcases Linux-Based ATSC 3.0 Converter Box

EKT is demonstrating a new Linux-based ATSC 3.0 set-top box at IBC2026. The second-generation product moves away from Android to reduce memory costs, with Linux...

11/09/2026

IBC 2026: Sennheiser Group to Showcase Wireless, Monitoring, and Broadcast Workflow

The Sennheiser Group will exhibit at IBC2026 (Hall 8, Booth D50, September 11-14...

11/09/2026

Ludacris Joins Chris Stapleton and Cindy Blackman Santana for Monday Night Footballs In the Air Tonight Open

ESPN's Monday Night Football will open its 2026-27 season with a new renditi...

11/09/2026

Dalet Integrates NVIDIA Synthetic Content Detection into Dalet Flex

Dalet has announced an integration of NVIDIA's Synthetic Video Detector AI model into Dalet Flex, enabling media organizations to identify potentially AI-ge...

11/09/2026

IBC 2026: MC-IF Demonstrates VVC Capabilities

The Media Coding Industry Forum (MC-IF) will demonstrate Versatile Video Coding (VVC) capabilities at IBC2026 (Hall 2, Stand 2.B13), as the codec moves toward c...

11/09/2026

IBC 2026: Sony to Demonstrate Live, News, Cinema, and Immersive Production

Sony will exhibit at IBC2026 (Hall 13, September 11-14), demonstrating products across live production, news, cinema, and immersive and spatial content workflow...

11/09/2026

Wave Central Named Recipient of 2026 Technology and Engineering Emmy for FPV Drone Systems

Wave Central, a Domo Broadcast Company, has been named a recipient of a 2026 Tec...

11/09/2026

IBC 2026: SNS Validates EVO Compatibility With Avid Media Composer 2026.8, Adds Browser-Based Upload to Outpost

Studio Network Solutions (SNS) is bringing a pair of workflow updates to IBC2026...

11/09/2026

IBC 2026: iodyne to Demo Pro Mini Smart Drive Across Four Partner Booths

iodyne will co-exhibit with Hedge at IBC2026 (Booth 7.A36, September 11-14) and appear across three additional partner booths, marking the first public demonstr...

11/09/2026

SVG GameDay, Ep. 30: Freelance Graphics Operator Corinne Yamada - Philly-Based Graphics Creation

In-venue and creative video staffers at the professional and collegiate level ha...

11/09/2026

CBS Sports Goes HDR Across Its Entire NFL Package, Heads to Rio in Week 3

The network will phase in HDR crew by crew while expanding Next Gen Stats integration, SkyDry availability, and onsite studio shows...

11/09/2026

IBC 2026: CAMB.AI Unveils the World's First Multilingual Broadcasting Agent Powered by NVIDIA

CAMB.AI is introducing its new Streaming SDK and Streaming Dashboard at IBC2026,...

11/09/2026

Netflix Goes Down Under With NBC Sports, NEP for NFL From Melbourne

Massive host operation at Melbourne Cricket Ground featured 54 cameras, 25,000 ST 2110 flows, REMI studio production in Stamford, and global distribution to mor...

11/09/2026

FOX Sports Homogenizes Coverage With Upscaled Game Tech, Seamless Integration With Studio Shows in L.A.

Production Anywhere Remote Kit (PARK) & AR-fueled Stage B are two key pieces to ...

11/09/2026

Get to Know This Fall and Winter's Filmmakers Through These 36 Sundance Institute-Supported Films

By Ramona Flume and Lucy Spicer There's a particular kind of magic that hap...

11/09/2026

Film Festival Watch: 8 Sundance Institute-Supported Films to See at the 2026 Toronto International Film Festival

By Jessica Herndon The fall film season is kicking off, and Sundance Institute-...

11/09/2026

Positive Grid announce the Spark Pedal

Spark series gains compact modelling stompbox Positive Grid's Spark amps have become a popular part of the company's line-up, offering a convenient ...

11/09/2026

Rapid Flow release omniGRID

New flagship sequencing plug-in revealed Rapid Flow have just launched a new 16-track sequencer plug-in which they say has been designed for total rhythmic...

11/09/2026

Rohde & Schwarz unveils the air-cooled R&STM1 medium-power UHF transmitter at IBC 2026

Rohde & Schwarz unveils the air-cooled R&S TM1 medium-power UHF transmitter at I...

11/09/2026

TV Usage Kicks Usual Summer Slowdown, Fueled by World Cup and Streaming in Nielsen's July Gauge Reports

FIFA World Cup 2026 and Peacock's Love Island USA' Power NBCU-Versant ...

11/09/2026

Atomos Debuts New HDR Monitors at IBC2026

Share Copy link Facebook X Linkedin Bluesky Email...

11/09/2026

Calrec to Unveil Type RT Compact Console at IBC2026

Share Copy link Facebook X Linkedin Bluesky Email...

11/09/2026

Lightware Launches LARA 2 with New Architecture for More...

Lightware has announced the launch of LARA (Lightware Advanced Room Automation) 2.0, a major upgrade to its built-in room automation platform, introducing impro...

11/09/2026

MusiMap launches latest technology unlocking new commerci...

10 September 2026 - MusiMap, the B2B music intelligence company that is transforming how companies can harness the emotional power of music to reach consumers a...

11/09/2026

Matrox Video Integrates Matrox ORIGIN with NVIDIA Holosca...

Matrox Video today announced an integration between Matrox ORIGIN and NVIDIA Holoscan for Media, enabling Matrox ORIGIN media services to be provisioned, config...

11/09/2026

Net Insight brings cloud-native live media orchestration...

Net Insight today announced that its cloud-native live media orchestration is now available through Oracle Cloud Marketplace, providing broadcasters, production...

11/09/2026

Calrec to Unveil Type RT Compact Console at IBC 2026

Share Copy link Facebook X Linkedin Bluesky Email...

11/09/2026

Biggest functionality boost yet makes Buttons the perfect...

Version 1.8 will bring advanced routing control, new workflow tools, boosted control panel flexibility and ease of integration into IP networks...

11/09/2026

Ikegami Announces Four New UNICAM XE Series Cameras

Ikegami announces four additions its UNICAM XE range of 4K-UHD cameras with the introduction of the UHK-X700VN, UHK-X750VN, UHK-X600VN and UHK-X650VN. Developed...

11/09/2026

DHD Launches New MX3 Consoles - Modular to the Core

DHD.audio has chosen IBC2026 as the launch venue for a major new addition to its broadcast sound production platform: the MX3 console range. MX3 retains the mod...

11/09/2026

Sony To Showcase Latest Production Technology At IBC2026

Share Copy link Facebook X Linkedin Bluesky Email...

11/09/2026

EKT To Feature New Linux-Based ATSC 3.0 STB At IBC2026

Share Copy link Facebook X Linkedin Bluesky Email...

11/09/2026

Jimmy Kimmel Shifts Political Interview to YouTube Over FCC Worries

Share Copy link Facebook X Linkedin Bluesky Email...

11/09/2026

Remembering 9/11: 25 Years of TV Tech Coverage

Share Copy link Facebook X Linkedin Bluesky Email...

11/09/2026

Tiger Group To Auction Equipment from a National Broadcasting Studio

Share Copy link Facebook X Linkedin Bluesky Email...

11/09/2026

Grass Valley Launches AVORA at IBC2026

Share Copy link Facebook X Linkedin Bluesky Email...

11/09/2026

Survey: Low Latency for Live Streaming Is Industrys Top Challenge

Share Copy link Facebook X Linkedin Bluesky Email...

11/09/2026

Atomos Debuts New HDR Monitors at 2026 IBC Show

Share Copy link Facebook X Linkedin Bluesky Email...

11/09/2026

Grass Valley Launches AVORA at IBC2026 Bringing All in On...

New standalone solution gives production teams everything they need to create, produce and deliver live content from one flexible system. Grass Valley today an...

11/09/2026

Wave Central a Domo Broadcast Company Named Recipient of...

Recognition honors the development of FPV drone camera systems for live sports broadcast coverage Wave Central, a Domo Broadcast Company that develops advanced...

11/09/2026

Teradek Launches Bolt 7 A Unified Wireless System for Zer...

Teradek, the industry leader in zero-delay wireless video solutions, announced the launch of Bolt 7, which now includes a unified wireless video and data system...

11/09/2026

ACT Pixel Academy Announces Autumn Courses

The ACT Entertainment tvONE and Green Hippo Pixel Academy has released its autumn course schedule, with hands-on training dates in September, October and Novemb...

11/09/2026

Scientists discover a new way that a disease-linked protein comes apart

LA JOLLA, CA-Transthyretin amyloid disease (ATTR) is a progressive, life-threatening condition caused when the protein transthyretin (TTR) breaks apart and aggr...