Sony Pixel Power calrec Sony

What Is a Pretrained AI Model?


Imagine trying to teach a toddler what a unicorn is. A good place to start might be by showing the child images of the creature and describing its unique features.

Now imagine trying to teach an artificially intelligent machine what a unicorn is. Where would one even begin?

Pretrained AI models offer a solution.

A pretrained AI model is a deep learning model - an expression of a brain-like neural algorithm that finds patterns or makes predictions based on data - that's trained on large datasets to accomplish a specific task. It can be used as is or further fine-tuned to fit an application's specific needs.

Why Are Pretrained AI Models Used? Instead of building an AI model from scratch, developers can use pretrained models and customize them to meet their requirements.

To build an AI application, developers first need an AI model that can accomplish a particular task, whether that's identifying a mythical horse, detecting a safety hazard for an autonomous vehicle or diagnosing a cancer based on medical imaging. That model needs a lot of representative data to learn from.

This learning process entails going through several layers of incoming data and emphasizing goals-relevant characteristics at each layer.

To create a model that can recognize a unicorn, for example, one might first feed it images of unicorns, horses, cats, tigers and other animals. This is the incoming data.

Then, layers of representative data traits are constructed, beginning with the simple - like lines and colors - and advancing to complex structural features. These characteristics are assigned varying degrees of relevance by calculating probabilities.

As opposed to a cat or tiger, for example, the more like a horse a creature appears, the greater the likelihood that it is a unicorn. Such probabilistic values are stored at each neural network layer in the AI model, and as layers are added, its understanding of the representation improves.

To create such a model from scratch, developers require enormous datasets, often with billions of rows of data. These can be pricey and challenging to obtain, but compromising on data can lead to poor performance of the model.

Precomputed probabilistic representations - known as weights - save time, money and effort. A pretrained model is already built and trained with these weights.

Using a high-quality pretrained model with a large number of accurate representative weights leads to higher chances of success for AI deployment. Weights can be modified, and more data can be added to the model to further customize or fine-tune it.

Developers building on pretrained models can create AI applications faster, without having to worry about handling mountains of input data or computing probabilities for dense layers.

In other words, using a pretrained AI model is like getting a dress or a shirt and then tailoring it to fit your needs, rather than starting with fabric, thread and needle.

Pretrained AI models are often used for transfer learning and can be based on several model architecture types. One popular architecture type is the transformer model, a neural network that learns context and meaning by tracking relationships in sequential data.

According to Alfredo Ramos, senior vice president of platform at AI company Clarifai - a Premier partner in the NVIDIA Inception program for startups - pretrained models can cut AI application development time by up to a year and lead to cost savings of hundreds of thousands of dollars.

How Are Pretrained Models Advancing AI? Since pretrained models simplify and quicken AI development, many developers and companies use them to accelerate various AI use cases.

Top areas in which pretrained models are advancing AI include:

Natural language processing. Pretrained models are used for translation, chatbots and other natural language processing applications. Large language models, often based on the transformer model architecture, are an extension of pretrained models. One example of a pretrained LLM is NVIDIA NeMo Megatron, one of the world's largest AI models.

Speech AI. Pretrained models can help speech AI applications plug and play across different languages. Use cases include call center automation, AI assistants and voice-recognition technologies.

Computer vision. Like in the unicorn example above, pretrained models can help AI quickly recognize creatures - or objects, places and people. In this way, pretrained models accelerate computer vision, giving applications human-like vision capabilities across sports, smart cities and more.

Healthcare. For healthcare applications, pretrained AI models like MegaMolBART - part of the NVIDIA BioNeMo service and framework - can understand the language of chemistry and learn the relationships between atoms in real-world molecules, giving the scientific community a powerful tool for faster drug discovery.

Cybersecurity. Pretrained models provide a starting point to implement AI-based cybersecurity solutions and extend the capabilities of human security analysts to detect threats faster. Examples include digital fingerprinting of humans and machines, and detection of anomalies, sensitive information and phishing.

Art and creative workflows. Bolstering the recent wave of AI art, pretrained models can help accelerate creative workflows through tools like GauGAN and NVIDIA Canvas.

Pretrained AI models can be applied across industries beyond these, as their customization and fine-tuning can lead to infinite possibilities for use cases.

Where to Find Pretrained AI Models Companies like Google, Meta, Microsoft and NVIDIA are inventing cutting-edge model architectures and frameworks to build AI models.

These are sometimes released on model hubs or as open source, enabling developers to fine-tune pretrained AI models, improve their accuracy and expand model repositories.

See more stories from nvidia

North America Stories


What to Watch: Four Sundance Fest Films That Embody the Immigrant Experience

By Murtada Elfadl Memory is a tricky beast. Often what we remember or what we try to forget rules our emotional lives. Immigrants, who leave behind people they...


L3Harris Selected to Train All Pilots for Japan's Leading Airline

All Nippon Airlines students will train on aircraft like the Diamond DA42 at L3Harris' Cranfield Training Center in England for the 60-week, single-engine a...


LIVE! Tips + Tricks for the HERO11 Black + Mini Million Dollar Challenge

The HERO11 Black + Mini Million Dollar Challenge is underway, and we want to help your submissions catch the attention of our editors and ultimately earn you an...


ATSC Seeks to Converge Global DTT Standards

With worldwide broadcast standards now combining traditional over-the-air terrestrial television with Internet Protocol, the ATSC is working on ensuring ATSC 3....


Ant Media Integrates Zixi For Real-Time Live Streaming

WALTHAM, Mass. Zixi has announced a partnership with Ant Media, and an integration with the Ant Media Server (AMS), which provides ready-to-use, scalable real-t...


Online Weather Segments for KABB Fox San Antonio Rely on Ultimatte 12 4K

Online Weather Segments for KABB Fox San Antonio Rely on Ultimatte 12 4K Brie Clayton February 7, 2023 0 Comments Blackmagic Design today announced tha...


VStream Media optimizes cloud-based remote production with AJA Ki Pro GO

VStream Media optimizes cloud-based remote production with AJA Ki Pro GO Brie Clayton February 7, 2023 0 Comments Founded in 2019, Singapore-based VStr...


Racoon kits new in-house colour suite with Baselight TWO and Blackboard

Racoon kits new in-house colour suite with Baselight TWO and Blackboard Brie Clayton February 7, 2023 0 Comments New senior colourist, Enge Gray, selec...


Samsung TV Plus Adds Romance Movies Channel For Valentine's Day

In time for Valentine's Day, Samsung TV Plus is adding a Romance Movie channel to its 250-channel lineup....


Local News Close-Up: Columbus Offers Cosmopolitan Vibe in Heartland

For decades, WBNS was the ratings colossus in Columbus. The station shifted from Dispatch Broadcast Group to Tegna in 2019, in a $535 million deal for it and WT...


Touchdown: Fox Sells Out In-Game Super Bowl Commercials

Fox said it has sold out all of the in-game commercials available during Super Bowl LVII, overcoming a slow economy and the collapse of the crypto market....


Analyst Sees Disney Cutting $1.3 Billion in Linear Costs

As The Walt Disney Co. gets closer to announcing earnings on Wednesday and holding Bob Iger's first call with analysts since his return to the company, pred...


Sinclair Says Its Digital Networks Will Add 2.4 Million Homes This Year

Sinclair Broadcast Group said its free, over-the-air multicast networks Comet, Charge! and TBD have made deals that will add 2.4 million TV households to their ...


Work It Out Wombats!' Rolls on PBS Kids

Work It Out Wombats!, an animated series about a trio of marsupial siblings, premieres on PBS Kids February 6. The show targets kids ages 3-6....


Netflix Thriller You' Heads to London

Season four of psychological thriller series You premieres on Netflix February 9. Based on Caroline Kepnes's novel of the same name, the show looks at a man...


How to Watch President Biden's State of the Union

President Joe Biden delivers his second State of the Union address at the Capitol Tuesday, February 7 at 9 p.m. ET. ABC, CNN, CBS, Fox, Fox News Channel, MSNBC ...


Great American Family Plans Live Pup-A-Thon' on Super Sunday

Great American Family and the producers of To The Rescue will present the To The Rescue Pup-A-Thon 2023 live at noon on Super Bowl Sunday (February 12) to raise...


Major League Baseball Reportedly Mulls Taking Back Bally Sports TV Rights

Taking back Bally Sports' local TV rights to teams' games is one of the options being explored by Major League Baseball, according to a published report...


No Laughing Matter: Comedy Is the Most Pirated Genre

LONDON Video software provider Synamedia has unveiled research on piracy covering seven countries that found comedy is the most pirated entertainment genre....


Sinclair's Multicast Nets to Add 2.4M Homes

BALTIMORE Sinclair Broadcast Group is reporting that its free over-the-air, multicast television networks Comet, Charge!, and TBD will expand their nationwide c...


Diversity in Video Games Shows Some Improvement

NEW YORK Video games released by the top U.S.-focused console publishers over the past two years suggests that the industry has increased space for diversity wi...


New Virtual Production Studio Brings Latest Real-World Tech To Webster University Students

WEBSTER GROVES, Mo. Webster University recently completed a $7 million renovatio...


Camp Lucky Welcomes Producer Alex Bronner

Camp Lucky Welcomes Producer Alex Bronner Brie Clayton February 6, 2023 0 Comments Camp Lucky gives a warm welcome to producer Alex Bronner, a longtime...


Digital Domain's Wakanda Forever VFX reel: Behind the Final Battle and 4 New MCU Heroes

Digital Domain's Wakanda Forever VFX reel: Behind the Final Battle and 4 New...


Wool E. Bull Teases Appearance in WRAL Super Bowl Commercial

Wool E. Bull gave up no details about WRAL's Super Bowl ad in which he appears when interviewed by WRAL-TV Anchor Ken Smith on WRAL's Morning News on FO...


Berklee Alumni and Faculty Win at the 2023 Grammy Awards

Berklee Alumni and Faculty Win at the 2023 Grammy Awards Terri Lyne Carrington, Molly Tuttle & Golden Highway, and Steven Feifke were among the winners on mus...


Student Spotlight: Stephanie Coraci

Student Spotlight: Stephanie Coraci The vocalist and dancer talks about balancing her interest in music business with her own artistry, going to major festiva...


New Sponsor Spotlight: Comprimato's Ji Matela on Powering JPEG2000 Video Compression with GPU's

New Sponsor Spotlight: Comprimato's Ji Matela on Powering JPEG2000 Video C...


Acoustics Were Deliberately Designed Into Ancient Arenas

Acoustics Were Deliberately Designed Into Ancient Arenas Studies of Mayan venues suggest the importance of sports sound By Dan Daley, Audio Editor Tuesday, F...


Super Bowl LVII: FOX Sports Lead Director Rich Russo Previews Calling the Shots on the Biggest Show of the Year

Super Bowl LVII: FOX Sports Lead Director Rich Russo Previews Calling the Shots ...


BT Sport's Matt Stagg: The Metaverse is Gaining Momentum in Sports Broadcasting

BT Sport's Matt Stagg: The metaverse is gaining momentum in sports broadcast...


Top 10 Week of January 30: You People' Is the Most Viewed Title This Week; Ginny & Georgia' Enters the Most Popular List

Back to All News Top 10 Week of January 30: You People' Is the Most Viewed...


NAB 2023: FOR-A Builds Out Live, Remote Production Ecosystem with NDI Connectivity

New One M/E Video Switcher, HVS-190, Features Flexible Configuration and NDI Su...


Nielsen launches Total Ad Ratings in South Korea measuring audiences across TV and Digital platforms

Empowering advertisers and agencies to optimise their campaign investments and R...


Nielsen announces pricing of upsized $650 million add-on offering of senior secured notes by its affiliate

New York - February 6, 2023 - Neptune BidCo US Inc. (the Issuer ), an affiliate...


Ateme is now available on AWS Marketplace

Ateme's innovative video processing and delivery solutions can now be purchased via the AWS Marketplace, further strengthening Ateme's global partnershi...



Zixi, the industry leader for enabling dependable, live broadcast-quality video over any IP network, and provider of the award-winning Software-Defined Video Pl...


TPN Launches Upgraded Program and New TPN+ Platform to Advance Entertainment Content Security

The Trusted Partner Network (TPN), the leading global film and television conten...


Vietnam's VinBrain Deploys Healthcare AI Models to 100+ Hospitals

Doctors rarely make diagnoses based on a single factor - they look at a mix of data types, such as a patient's symptoms, laboratory and radiology reports, a...


TinkerList and OOONA Join Forces

OOONA, a global provider of professional management and production tools for the media localization industry, today announced that it has formed a strategic par...


Racoon kits new in-house colour suite with Baselight TWO and Blackboard

Racoon, one of London's leading creative studios, has hired well-known senior colourist, Enge Gray, to join its in-house team. To support the move, Racoon h...


New Libec HS-150C

After the successful launch of the HS Series of tripods during 2022, by customer demand Libec have introduced two New Models which are perfect for Mirrorless ca...


Minari, Mississippi Masala Among Films Celebrating February Anniversaries

Steven Yeun and Yeri Han star in Minari....


Blackmagic Fusion Tutorial: Sine Visualiser Part Two

Blackmagic Fusion Tutorial: Sine Visualiser Part Two Simon Ubsdell February 6, 2023 0 Comments In this second part, we'll take a look a making our ...


How The Finish Line Delivered Post on Netflix's I Am A Killer

How The Finish Line Delivered Post on Netflix's I Am A Killer Brie Clayton February 6, 2023 0 Comments Behind the edit, grade, and HDR delivery of ...


Media First Launches ONNJ Streaming Channel

FAIRFIELD, N.J. The Media First Group has launched a new local streaming TV channel, On New Jersey (ONNJ), a New Jersey-based channel featuring news, talk, and ...


Veset Acquired by PLAY Japan

RIGA & TOKYO Veset has announced it has been acquired by the Japanese media technology company, PLAY, Inc....


That Station Turns 5! Tickets on Sale Now for May Celebration Concert

That Station is turning 5 and wants to celebrate with you! Join us on Friday, May 12, at the Lincoln Theatre in downtown Raleigh for an incredible show with Th...


Improve efficiency with automated scheduling templates in WO Automation for Radio

Scheduling templates in WO Automation for Radio offer improved efficiency to sui...


Nielsen announces proposed $500 million add-on offering of senior secured notes by its affiliate

New York - February 6, 2023 - Neptune BidCo US Inc. (the Issuer ), an affiliate...