Sony Pixel Power calrec Sony

AI Training AI: GatorTronGPT at the Forefront of University of Florida's Medical AI Innovations

16/11/2023

How do you train an AI to understand clinical language with less clinical data? Train another AI to synthesize training data.

Artificial intelligence is changing the way medicine is done, and is increasingly being used in all sorts of clinical tasks.

This is fueled by generative AI and models like GatorTronGPT, a generative language model trained on the University of Florida's HiPerGator AI supercomputer and detailed in a paper published in Nature Digital Medicine Thursday.

GatorTronGPT joins a growing number of large language models (LLMs) trained on clinical data. Researchers trained the model using the GPT-3 framework, also used by ChatGPT.

They used a massive corpus of 277 billion words for this purpose. The training corpora included 82 billion words from de-identified clinical notes and 195 billion words from various English texts.

But there's a twist: The research team also used GatorTronGPT to generate a synthetic clinical text corpus with over 20 billion words of synthetic clinical text, with carefully prepared prompts. The synthetic clinical text focuses on clinical factors and reads just like real clinical notes written by doctors.

This synthetic data was then used to train a BERT-based model called GatorTron-S.

In a comparative evaluation, GatorTron-S exhibited remarkable performance on clinical natural language understanding tasks like clinical concept extraction and medical relation extraction, beating the records set by the original BERT-based model, GatorTron-OG, which was trained on the 82-billion-word clinical dataset.

More impressively, it was able to do so using less data.

Both GatorTron-OG and GatorTron-S models were trained on 560 NVIDIA A100 Tensor Core GPUs running NVIDIA's Megatron-LM package on the University of Florida's HiPerGator supercomputer. Technology from the Megatron LM framework used in the project has since been incorporated with the NVIDIA NeMo framework, which has been central to more recent work on GatorTronGPT.

Using synthetic data created by LLMs addresses several challenges. LLMs require vast amounts of data, and there's a limited availability of quality medical data.

In addition, synthetic data allows for model training that complies with medical privacy regulations, such as HIPAA.

The work with GatorTronGPT is just the latest example of how LLMs - which exploded onto the scene last year with the rapid adoption of ChatGPT - can be tailored to assist in a growing number of fields.

It's also an example of the advances made possible by new AI techniques powered by accelerated computing.

The GatorTronGPT effort is the latest result of an ambitious collaboration announced in 2020, when the University of Florida and NVIDIA unveiled plans to erect the world's fastest AI supercomputer in academia.

This initiative was driven by a $50 million gift, a fusion of contributions from NVIDIA founder Chris Malachowsky and NVIDIA itself.

Using AI to train more AI is just one example of HiPerGator's impact, with the supercomputer promising to power more innovations in medical sciences and across disciplines throughout the University of Florida system.
LINK: https://blogs.nvidia.com/blog/gatortrongpt/...
See more stories from nvidia

More from Nvidia

01/03/2024

Live at GTC: Hear From Industry Leaders Using AI to Drive Innovation and Agility

Interest in new AI applications reached a fever pitch last year as business leaders began exploring AI pilot programs. This year, they're focused on strateg...

01/03/2024

What Is Trustworthy AI?

Artificial intelligence, like any transformative technology, is a work in progress - continually growing in its capabilities and its societal impact. Trustworth...

29/02/2024

Battle.net Leaps Into the Cloud With GeForce NOW

GFN Thursday celebrates this leap day with the addition of a popular game store to the cloud. Stream the first titles from Blizzard Entertainment's Battle....

28/02/2024

What Is Sovereign AI?

Nations have long invested in domestic infrastructure to advance their economies, control their own data and take advantage of technology opportunities in areas...

28/02/2024

Time to Skill Up: Game Reviewer Ralph Panebianco Wields NVIDIA RTX for the Win

Editor's note: This post is part of our weekly In the NVIDIA Studio series, which celebrates featured artists, offers creative tips and tricks, and demonstr...

28/02/2024

And Action! Cuebric CEO Provides Insights Into Filmmaking Using AI

These days, just about everyone is a content creator. But can generative AI help make people create high-quality films and other content affordably? Find out fr...

27/02/2024

Meet the Omnivore: Mode Maison Harnesses OpenUSD to Drive Innovations in Retail With High-Fidelity Digital Twins

Editor's note: This post is a part of our Meet the Omnivore series, which fe...

27/02/2024

Rack n' Roll: NVIDIA Grace Hopper Systems Gather at GTC

The spirit of software legend Grace Hopper will live on at NVIDIA GTC. Accelerated systems using powerful processors - named in honor of the pioneer of program...

26/02/2024

NVIDIA RTX 500 and 1000 Professional Ada Generation Laptop GPUs Drive AI-Enhanced Workflows From Anywhere

With generative AI and hybrid work environments becoming the new standard, nearl...

22/02/2024

FOMO Alert: Discover 7 Unmissable Reasons to Attend GTC 2024

I just got back from GTC and . In four weeks, those will be among the most powerful words in your industry. But you won't be able to use them if you have...

22/02/2024

Time to Play: GeForce NOW Now Offers 1,800 Games to Stream

Top-tier games from publishing partners Bandai Namco Entertainment and Inflexion Games are joining GeForce NOW this week as the cloud streaming service's fo...

22/02/2024

Into the Omniverse: Rhino 3D Launches OpenUSD Features to Enhance 3D Modeling and Development

Editor's note: This post is part of Into the Omniverse, a series focused on ...

22/02/2024

Add It to the Toolkit: February Studio Driver and NVIDIA App Beta Now Available

Editor's note: This post is part of our weekly In the NVIDIA Studio series, which celebrates featured artists, offers creative tips and tricks, and demonstr...

21/02/2024

Shining Brighter Together: Google's Gemma Optimized to Run on NVIDIA GPUs

NVIDIA, in collaboration with Google, today launched optimizations across all NVIDIA AI platforms for Gemma - Google's state-of-the-art new lightweight 2 bi...

16/02/2024

AI's Hottest Ticket: NVIDIA GTC Brings Together Automotive Leaders and Visionaries Transforming the Future of Transportation

Generative AI and software-defined computing are transforming the automotive lan...

15/02/2024

The Easiest Upgrade: Play at Ultimate Quality With GeForce NOW

GFN Thursday keeps its fourth anniversary celebrations rolling by bringing Ubisoft's Skull and Bones and Microsoft's Halo Infinite to the cloud this wee...

15/02/2024

NVIDIA Eos Revealed: Peek Into Operations of a Top 10 Supercomputer

Providing a peek at the architecture powering advanced AI factories, NVIDIA Thursday released a video that offers the first public look at Eos, its latest data-...

15/02/2024

Artistry With Adobe: Creator Esteban Toro Delivers Inspirational Master Class Powered by AI and RTX

Adobe is putting generative AI into the hands of creators with Adobe Firefly - p...

15/02/2024

Telco GPT: Survey Shows Scale of Industry's Enthusiasm and Adoption of Generative AI

It's been five years since the telecommunications industry first deployed 5G...

14/02/2024

Digitalization: A Game Changer for the Auto Industry

The fusion of the physical and digital worlds is reshaping the automotive industry. NVIDIA's automotive partners are using digitalization to transform every...

14/02/2024

How the Ohio Supercomputer Center Drives the Future of Computing

NASCAR races are all about speed, but even the fastest cars need to factor in safety, especially as rules and tracks change. The Ohio Supercomputer Center is re...

14/02/2024

Speak Like a Native: NVIDIA Parlays Win in Voice Challenge

Thanks to their work driving AI forward, Akshit Arora and Rafael Valle could someday speak to their spouses' families in their native languages. Arora and ...

13/02/2024

Say What? Chat With RTX Brings Custom Chatbot to NVIDIA RTX AI PCs

Chatbots are used by millions of people around the world every day, powered by NVIDIA GPU-based cloud servers. Now, these groundbreaking tools are coming to Win...

12/02/2024

NVIDIA RTX 2000 Ada Generation GPU Brings Performance, Versatility for Next Era of AI-Accelerated Design and Visualization

Generative AI is driving change across industries - and to take advantage of its...

12/02/2024

NVIDIA CEO: Every Country Needs Sovereign AI

Every country needs to own the production of their own intelligence, NVIDIA founder and CEO Jensen Huang told attendees Monday at the World Governments Summit i...

08/02/2024

National Institute of Standards and Technology Launches Artificial Intelligence Safety Institute Consortium

NVIDIA has joined the National Institute of Standards and Technology's new U...

08/02/2024

Devices for Days: With GeForce NOW, Every Device Is a Dream Gaming PC

The GeForce NOW anniversary celebrations continue with more games and a member-exclusive discount on the Logitech G Cloud. Among the six new titles coming to t...

07/02/2024

Beyond Data-Driven': How Energy-Efficient Computing for AI Is Propelling Innovation and Savings Across Industries

With advances in computing, sophisticated AI models and machine learning are hav...

06/02/2024

Twitch Streamer Mr_Vudoo Supercharges Gaming, Entertaining and Video Editing With RTX This Week In the NVIDIA Studio'

Editor's note: This post is part of our weekly In the NVIDIA Studio series, ...

05/02/2024

Canada Partners With NVIDIA to Supercharge Computing Power

AI is reshaping industries, society and the very fabric of innovation - and Canada is poised to play a key role in this global transformation, said NVIDIA fou...

05/02/2024

New Study Cites AI as Strategic Tool to Combat Climate Change

A new study underscores the potential of AI and accelerated computing to deliver energy efficiency and combat climate change, efforts in which NVIDIA has long b...

01/02/2024

GeForce NOW Leaps Into Its Fourth Year With 27 New Games and More Celebrations All Month Long

GeForce NOW is celebrating its fourth anniversary all month - plus an extra day ...

31/01/2024

Cardiac Clarity: Dr. Keith Channon Talks Revolutionizing Heart Health With AI

Here's some news to still beating hearts: AI is helping bring some clarity to cardiology. Caristo Diagnostics has developed an AI-powered solution for detec...

30/01/2024

Singtel, NVIDIA to Bring Sovereign AI to Southeast Asia

Asia's lion city is roaring ahead in AI. Singtel, a leading communications services provider based in Singapore, will bring the NVIDIA AI platform to busin...

30/01/2024

Behold the Magic Valley': Brandon Tieh's Stunning Scene Showcases Peak Creativity, Powered by RTX and AI

Editor's note: This post is part of our weekly In the NVIDIA Studio series, ...

29/01/2024

Boston Children's Researchers, in Joint Effort, Deploy AI Across Their Hip Clinic to Support Patients, Doctors

Hip disorders, comprising some of the world's most common joint diseases, ar...

25/01/2024

Sharper Image: GeForce NOW Update Delivers Stunning Visuals to Android Devices

This GFN Thursday levels up PC gaming on mobile with higher-resolution support on Android devices. This week also brings 10 new games to the GeForce NOW librar...

24/01/2024

High Can See Clearly Now: AI-Powered NVIDIA RTX Video HDR Transforms Standard Video Into Stunning High Dynamic Range

Editor's note: This post is part of our weekly In the NVIDIA Studio series, ...

24/01/2024

US National Science Foundation Launches National AI Research Resource Pilot

In a major stride toward building a shared national research infrastructure, the U.S. National Science Foundation has launched the National Artificial Intellige...

23/01/2024

NVIDIA DRIVE Partners Showcase Cutting-Edge Innovations in Automated and Autonomous Driving

The automotive industry is being transformed by the integration of cutting-edge ...

23/01/2024

How Amazon and NVIDIA Help Sellers Create Better Product Listings With AI

It's hard to imagine an industry more competitive - or fast-paced - than online retail. Sellers need to create attractive and informative product listings ...

18/01/2024

Dino-Mite: Capcom's Exoprimal' Joins GeForce NOW

Hold on to your seats - this GFN Thursday is unleashing dinosaurs, crowns and more in the cloud. Catch it all on Capcom's Exoprimal and Ubisoft's Princ...

18/01/2024

Buried Treasure: Startup Mines Clean Energy's Prospects With Digital Twins

Mark Swinnerton aims to fight climate change by transforming abandoned mines into storage tanks of renewable energy. The CEO of startup Green Gravity is protot...

17/01/2024

From Embers to Algorithms: How DigitalPath's AI is Revolutionizing Wildfire Detection

The AI Podcast DigitalPath's Ethan Higgins On Using AI to Fight Wildfires ...

16/01/2024

Starstruck: 3D Artist Brellias Brings Curiosity to Light This Week In the NVIDIA Studio'

Editor's note: This post is part of our weekly In the NVIDIA Studio series, ...

16/01/2024

Mori Speech AI Model Helps Preserve and Promote New Zealand Indigenous Language

Indigenous languages are under threat. Some 3,000 - three-quarters of the total - could disappear before the end of the century, or one every two weeks, accordi...

12/01/2024

NVIDIA CEO: This Year, Every Industry Will Become a Technology Industry'

This year, every industry will become a technology industry, NVIDIA founder and CEO Jensen Huang told attendees Wednesday during the annual J.P. Morgan Healthc...

11/01/2024

To the Cloud and Beyond: New Activision and Blizzard Games, Day Passes and G-SYNC Technology Coming to GeForce NOW

GFN Thursday recaps the latest cloud announcements from CES 2024 - Day Pass memb...

11/01/2024

AI Takes Center Stage: Survey Reveals Financial Industry's Top Trends for 2024

The financial services industry is undergoing a significant transformation with ...

10/01/2024

NVIDIA Remains Among Very Best Places to Work in US, Rising to No. 2 on Glassdoor's Annual List

NVIDIA continues to be among America's very best places to work as judged by...