Sony Pixel Power calrec Sony

Meet the Maker: Robotics Student Rolls Out Autonomous Wheelchair With NVIDIA Jetson

03/10/2023

With the help of AI, robots, tractors and baby strollers - even skate parks - are becoming autonomous. One developer, Kabilan KB, is bringing autonomous-navigation capabilities to wheelchairs, which could help improve mobility for people with disabilities.

The undergraduate from the Karunya Institute of Technology and Sciences in Coimbatore, India, is powering his autonomous wheelchair project using the NVIDIA Jetson platform for edge AI and robotics.

The autonomous motorized wheelchair is connected to depth and lidar sensors - along with USB cameras - which allow it to perceive the environment and plan an obstacle-free path toward a user's desired destination.

A person using the motorized wheelchair could provide the location they need to move to, which would already be programmed in the autonomous navigation system or path-planned with assigned numerical values, KB said. For example, they could press one' for the kitchen or two' for the bedroom, and the autonomous wheelchair will take them there.

An NVIDIA Jetson Nano Developer Kit processes data from the cameras and sensors in real time. It then uses deep learning-based computer vision models to detect obstacles in the environment.

The developer kit acts as the brain of the autonomous system - generating a 2D map of its surroundings to plan a collision-free path to the destination - and sends updated signals to the motorized wheelchair to help ensure safe navigation along the way.

About the Maker KB, who has a background in mechanical engineering, became fascinated with AI and robotics during the pandemic, when he spent his free time searching up educational YouTube videos on the topics.

He's now working toward a bachelor's degree in robotics and automation at the Karunya Institute of Technology and Sciences and aspires to one day launch a robotics startup.

KB, a self-described supporter of self-education, has also received several certifications from the NVIDIA Deep Learning Institute, including Building Video AI Applications at the Edge on Jetson Nano and Develop, Customize and Publish in Omniverse With Extensions.

Once he learned the basics of robotics, he began experimenting with simulation in NVIDIA Omniverse, a platform for building and operating 3D tools and applications based on the OpenUSD framework.

Using Omniverse for simulation, I don't need to invest heavily in prototyping models for my robots, because I can use synthetic data generation instead, he said. It's the software of the future.

His Inspiration With this latest NVIDIA Jetson project, KB aimed to create a device that could be helpful for his cousin, who has a mobility disorder, and other people with disabilities who might not be able to control a manual or motorized wheelchair.

Sometimes, people don't have the money to buy an electric wheelchair, KB said. In India, only upper- and middle-class people can afford them, so I decided to use the most basic type of motorized wheelchair available and connect it to the Jetson to make it autonomous.

The personal project was funded by the Program in Global Surgery and Social Change, which is jointly positioned under the Boston Children's Hospital and Harvard Medical School.

His Jetson Project After purchasing the basic motorized wheelchair, KB connected its motor hub with the NVIDIA Jetson Nano and lidar and depth cameras.

He trained the AI algorithms for the autonomous wheelchair using YOLO object detection on the Jetson Nano, as well as the Robot Operating System, or ROS, a popular software for building robotics applications.

The wheelchair can tap these algorithms to perceive and map its environment and plan a collision-free path.

The NVIDIA Jetson Nano's real-time processing speed prevents delays or lags for the user, said KB, who's been working on the project's prototype since June. The developer dives into the technical components of the autonomous wheelchair on his blog. A demo of the autonomous wheelchair has also been featured on the Karunya Innovation and Design Studio YouTube channel.

Looking forward, he envisions his project could be expanded to allow users to control a wheelchair using brain signals from electroencephalograms, or EEGs, that are connected to machine learning algorithms.

I want to make a product that would let a person with a full mobility disorder control their wheelchair by simply thinking, I want to go there,' KB said.

Learn more about the NVIDIA Jetson platform.
LINK: https://blogs.nvidia.com/blog/2023/10/03/kabilan-kb-autonomous-wheelch...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

09/10/2026

Dolby Expands Dolby OptiView Platform with New Capabilities at IBC 2026

September 10 2026, 06:00 (PDT) Dolby Expands Dolby OptiView Platform with New Capabilities at IBC 2026 New Sports Intelligence helps providers better unders...

07/10/2026

Dalet Flex LTS Delivers Smarter Media Operations from Ingest to Distribution

Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...

12/09/2026

Matrox, NVIDIA Integrate ORIGIN, Holoscan For Media

Share Copy link Facebook X Linkedin Bluesky Email...

12/09/2026

Ross Video Debuts New Live Production Technology at IBC2026

Share Copy link Facebook X Linkedin Bluesky Email...

12/09/2026

FCC Nominee Thumann Severs to Testify in Senate Sept. 17

Share Copy link Facebook X Linkedin Bluesky Email...

12/09/2026

TV Skyline Becomes The World's First Ultrix FR30 Customer

Share Copy link Facebook X Linkedin Bluesky Email...

12/09/2026

Ikegami Introduces VN Versions of Four UNICAM XE Cameras At IBC2026

Share Copy link Facebook X Linkedin Bluesky Email...

12/09/2026

Riedel Technology Powers Record Breaking Esports World Cu...

WUPPERTAL, Germany Sept. 11, 2026 From July 6 to Aug. 23, 2026, Paris hosted the Esports World Cup (EWC), a seven-week live production spanning eight stages...

12/09/2026

Mediacom Deploys Riedel Easy5G for Wireless Camera Covera...

Riedel Communications today announced that Mediacom has purchased and deployed Easy5G , Riedel's Private 5G solution, for live broadcast coverage of La Vuel...

12/09/2026

A Decade of Innovation AMP VISUAL TV Builds on Ten Years...

AMP VISUAL TV is continuing the evolution of its production infrastructure with further investments in Riedel technology across its OB fleet and fixed productio...

12/09/2026

Touring Video Expands Flexible Production Workflows With...

Riedel Communications today announced that Touring Video, a premier entertainment mobile production service company, continues to expand its production workflow...

12/09/2026

Atomos Expands Accessory Ecosystem with New SHAPE and Sma...

Atomos (7.B19) today announced new third-party accessories for Sumo PRO-19 and Shinobi 7 II, developed by SHAPE and SmallRig to give production teams more ways ...

12/09/2026

Deity Microphones Brings PR 2ii, TC-2, and D4RX to IBC2026

Deity Microphones Brings PR 2ii, TC-2, and D4RX to IBC2026 Brie Clayton September 11, 2026 0 Comments The Deity PR-2ii arrives with production firmwar...

12/09/2026

Blackmagic Design Announces Special Pricing for Ultra HD Products

Blackmagic Design Announces Special Pricing for Ultra HD Products Brie Clayton September 11, 2026 0 Comments Now customers can afford to upgrade to Ul...

12/09/2026

Grass Valley EDIUS Future Assurance Program launched at IBC2026

Grass Valley EDIUS Future Assurance Program launched at IBC2026 Brie Clayton September 11, 2026 0 Comments New program gives EDIUS customers access to...

12/09/2026

Berklee Students Develop New Ideas for Live Entertainment and Travel in London

Berklee Students Develop New Ideas for Live Entertainment and Travel in London This summer, a group of music business students collaborated with Heathrow, Bri...

11/09/2026

IBC 2026: Calrec Launches Type RT Console and Apex M6 Modular I/O Platform

Calrec will introduce two new products at IBC2026 (Stand 8.C47, RAI Amsterdam, September 11-14): the Type RT broadcast production console and the Apex M6 Modula...

11/09/2026

IBC 2026: Grass Valley Launches AVORA All-in-One Live Production Platform

Grass Valley has announced AVORA, a standalone all-in-one live production solution launching at IBC2026 (Booth 9.A01 and IBC Future Tech Zone, Stand 14.C49, Sep...

11/09/2026

IBC 2026: CAMB.AI Launches Streaming SDK and Dashboard for Multilingual Live Broadcasting

CAMB.AI is introducing its Streaming SDK and Streaming Dashboard at IBC2026, wit...

11/09/2026

IBC 2026: EVS Launches XT-S Software-Defined Multi-Application Server

EVS has announced XT-S, a software-defined server platform that runs multiple live production applications on a common hardware foundation. The platform debuts ...

11/09/2026

IBC 2026: EKT Showcases Linux-Based ATSC 3.0 Converter Box

EKT is demonstrating a new Linux-based ATSC 3.0 set-top box at IBC2026. The second-generation product moves away from Android to reduce memory costs, with Linux...

11/09/2026

IBC 2026: Sennheiser Group to Showcase Wireless, Monitoring, and Broadcast Workflow

The Sennheiser Group will exhibit at IBC2026 (Hall 8, Booth D50, September 11-14...

11/09/2026

Ludacris Joins Chris Stapleton and Cindy Blackman Santana for Monday Night Footballs In the Air Tonight Open

ESPN's Monday Night Football will open its 2026-27 season with a new renditi...

11/09/2026

Dalet Integrates NVIDIA Synthetic Content Detection into Dalet Flex

Dalet has announced an integration of NVIDIA's Synthetic Video Detector AI model into Dalet Flex, enabling media organizations to identify potentially AI-ge...

11/09/2026

IBC 2026: MC-IF Demonstrates VVC Capabilities

The Media Coding Industry Forum (MC-IF) will demonstrate Versatile Video Coding (VVC) capabilities at IBC2026 (Hall 2, Stand 2.B13), as the codec moves toward c...

11/09/2026

IBC 2026: Sony to Demonstrate Live, News, Cinema, and Immersive Production

Sony will exhibit at IBC2026 (Hall 13, September 11-14), demonstrating products across live production, news, cinema, and immersive and spatial content workflow...

11/09/2026

Wave Central Named Recipient of 2026 Technology and Engineering Emmy for FPV Drone Systems

Wave Central, a Domo Broadcast Company, has been named a recipient of a 2026 Tec...

11/09/2026

IBC 2026: SNS Validates EVO Compatibility With Avid Media Composer 2026.8, Adds Browser-Based Upload to Outpost

Studio Network Solutions (SNS) is bringing a pair of workflow updates to IBC2026...

11/09/2026

IBC 2026: iodyne to Demo Pro Mini Smart Drive Across Four Partner Booths

iodyne will co-exhibit with Hedge at IBC2026 (Booth 7.A36, September 11-14) and appear across three additional partner booths, marking the first public demonstr...

11/09/2026

SVG GameDay, Ep. 30: Freelance Graphics Operator Corinne Yamada - Philly-Based Graphics Creation

In-venue and creative video staffers at the professional and collegiate level ha...

11/09/2026

CBS Sports Goes HDR Across Its Entire NFL Package, Heads to Rio in Week 3

The network will phase in HDR crew by crew while expanding Next Gen Stats integration, SkyDry availability, and onsite studio shows...

11/09/2026

IBC 2026: CAMB.AI Unveils the World's First Multilingual Broadcasting Agent Powered by NVIDIA

CAMB.AI is introducing its new Streaming SDK and Streaming Dashboard at IBC2026,...

11/09/2026

Netflix Goes Down Under With NBC Sports, NEP for NFL From Melbourne

Massive host operation at Melbourne Cricket Ground featured 54 cameras, 25,000 ST 2110 flows, REMI studio production in Stamford, and global distribution to mor...

11/09/2026

FOX Sports Homogenizes Coverage With Upscaled Game Tech, Seamless Integration With Studio Shows in L.A.

Production Anywhere Remote Kit (PARK) & AR-fueled Stage B are two key pieces to ...

11/09/2026

Get to Know This Fall and Winter's Filmmakers Through These 36 Sundance Institute-Supported Films

By Ramona Flume and Lucy Spicer There's a particular kind of magic that hap...

11/09/2026

Film Festival Watch: 8 Sundance Institute-Supported Films to See at the 2026 Toronto International Film Festival

By Jessica Herndon The fall film season is kicking off, and Sundance Institute-...

11/09/2026

Positive Grid announce the Spark Pedal

Spark series gains compact modelling stompbox Positive Grid's Spark amps have become a popular part of the company's line-up, offering a convenient ...

11/09/2026

Rapid Flow release omniGRID

New flagship sequencing plug-in revealed Rapid Flow have just launched a new 16-track sequencer plug-in which they say has been designed for total rhythmic...

11/09/2026

Rohde & Schwarz unveils the air-cooled R&STM1 medium-power UHF transmitter at IBC 2026

Rohde & Schwarz unveils the air-cooled R&S TM1 medium-power UHF transmitter at I...

11/09/2026

TV Usage Kicks Usual Summer Slowdown, Fueled by World Cup and Streaming in Nielsen's July Gauge Reports

FIFA World Cup 2026 and Peacock's Love Island USA' Power NBCU-Versant ...

11/09/2026

Atomos Debuts New HDR Monitors at IBC2026

Share Copy link Facebook X Linkedin Bluesky Email...

11/09/2026

Calrec to Unveil Type RT Compact Console at IBC2026

Share Copy link Facebook X Linkedin Bluesky Email...

11/09/2026

Lightware Launches LARA 2 with New Architecture for More...

Lightware has announced the launch of LARA (Lightware Advanced Room Automation) 2.0, a major upgrade to its built-in room automation platform, introducing impro...

11/09/2026

MusiMap launches latest technology unlocking new commerci...

10 September 2026 - MusiMap, the B2B music intelligence company that is transforming how companies can harness the emotional power of music to reach consumers a...

11/09/2026

Matrox Video Integrates Matrox ORIGIN with NVIDIA Holosca...

Matrox Video today announced an integration between Matrox ORIGIN and NVIDIA Holoscan for Media, enabling Matrox ORIGIN media services to be provisioned, config...

11/09/2026

Net Insight brings cloud-native live media orchestration...

Net Insight today announced that its cloud-native live media orchestration is now available through Oracle Cloud Marketplace, providing broadcasters, production...

11/09/2026

Calrec to Unveil Type RT Compact Console at IBC 2026

Share Copy link Facebook X Linkedin Bluesky Email...

11/09/2026

Biggest functionality boost yet makes Buttons the perfect...

Version 1.8 will bring advanced routing control, new workflow tools, boosted control panel flexibility and ease of integration into IP networks...

11/09/2026

Ikegami Announces Four New UNICAM XE Series Cameras

Ikegami announces four additions its UNICAM XE range of 4K-UHD cameras with the introduction of the UHK-X700VN, UHK-X750VN, UHK-X600VN and UHK-X650VN. Developed...