
Imagine trying to teach a toddler what a unicorn is. A good place to start might be by showing the child images of the creature and describing its unique features.
Now imagine trying to teach an artificially intelligent machine what a unicorn is. Where would one even begin?
Pretrained AI models offer a solution.
A pretrained AI model is a deep learning model - an expression of a brain-like neural algorithm that finds patterns or makes predictions based on data - that's trained on large datasets to accomplish a specific task. It can be used as is or further fine-tuned to fit an application's specific needs.
Why Are Pretrained AI Models Used? Instead of building an AI model from scratch, developers can use pretrained models and customize them to meet their requirements.
To build an AI application, developers first need an AI model that can accomplish a particular task, whether that's identifying a mythical horse, detecting a safety hazard for an autonomous vehicle or diagnosing a cancer based on medical imaging. That model needs a lot of representative data to learn from.
This learning process entails going through several layers of incoming data and emphasizing goals-relevant characteristics at each layer.
To create a model that can recognize a unicorn, for example, one might first feed it images of unicorns, horses, cats, tigers and other animals. This is the incoming data.
Then, layers of representative data traits are constructed, beginning with the simple - like lines and colors - and advancing to complex structural features. These characteristics are assigned varying degrees of relevance by calculating probabilities.
As opposed to a cat or tiger, for example, the more like a horse a creature appears, the greater the likelihood that it is a unicorn. Such probabilistic values are stored at each neural network layer in the AI model, and as layers are added, its understanding of the representation improves.
To create such a model from scratch, developers require enormous datasets, often with billions of rows of data. These can be pricey and challenging to obtain, but compromising on data can lead to poor performance of the model.
Precomputed probabilistic representations - known as weights - save time, money and effort. A pretrained model is already built and trained with these weights.
Using a high-quality pretrained model with a large number of accurate representative weights leads to higher chances of success for AI deployment. Weights can be modified, and more data can be added to the model to further customize or fine-tune it.
Developers building on pretrained models can create AI applications faster, without having to worry about handling mountains of input data or computing probabilities for dense layers.
In other words, using a pretrained AI model is like getting a dress or a shirt and then tailoring it to fit your needs, rather than starting with fabric, thread and needle.
Pretrained AI models are often used for transfer learning and can be based on several model architecture types. One popular architecture type is the transformer model, a neural network that learns context and meaning by tracking relationships in sequential data.
According to Alfredo Ramos, senior vice president of platform at AI company Clarifai - a Premier partner in the NVIDIA Inception program for startups - pretrained models can cut AI application development time by up to a year and lead to cost savings of hundreds of thousands of dollars.
How Are Pretrained Models Advancing AI? Since pretrained models simplify and quicken AI development, many developers and companies use them to accelerate various AI use cases.
Top areas in which pretrained models are advancing AI include:
Natural language processing. Pretrained models are used for translation, chatbots and other natural language processing applications. Large language models, often based on the transformer model architecture, are an extension of pretrained models. One example of a pretrained LLM is NVIDIA NeMo Megatron, one of the world's largest AI models.
Speech AI. Pretrained models can help speech AI applications plug and play across different languages. Use cases include call center automation, AI assistants and voice-recognition technologies.
Computer vision. Like in the unicorn example above, pretrained models can help AI quickly recognize creatures - or objects, places and people. In this way, pretrained models accelerate computer vision, giving applications human-like vision capabilities across sports, smart cities and more.
Healthcare. For healthcare applications, pretrained AI models like MegaMolBART - part of the NVIDIA BioNeMo service and framework - can understand the language of chemistry and learn the relationships between atoms in real-world molecules, giving the scientific community a powerful tool for faster drug discovery.
Cybersecurity. Pretrained models provide a starting point to implement AI-based cybersecurity solutions and extend the capabilities of human security analysts to detect threats faster. Examples include digital fingerprinting of humans and machines, and detection of anomalies, sensitive information and phishing.
Art and creative workflows. Bolstering the recent wave of AI art, pretrained models can help accelerate creative workflows through tools like GauGAN and NVIDIA Canvas.
Pretrained AI models can be applied across industries beyond these, as their customization and fine-tuning can lead to infinite possibilities for use cases.
Where to Find Pretrained AI Models Companies like Google, Meta, Microsoft and NVIDIA are inventing cutting-edge model architectures and frameworks to build AI models.
These are sometimes released on model hubs or as open source, enabling developers to fine-tune pretrained AI models, improve their accuracy and expand model repositories.
NVIDIA NGC
North America Stories
07/02/2023
By Murtada Elfadl
Memory is a tricky beast. Often what we remember or what we try to forget rules our emotional lives. Immigrants, who leave behind people they...
07/02/2023
All Nippon Airlines students will train on aircraft like the Diamond DA42 at L3Harris' Cranfield Training Center in England for the 60-week, single-engine a...
07/02/2023
The HERO11 Black + Mini Million Dollar Challenge is underway, and we want to help your submissions catch the attention of our editors and ultimately earn you an...
07/02/2023
With worldwide broadcast standards now combining traditional over-the-air terrestrial television with Internet Protocol, the ATSC is working on ensuring ATSC 3....
07/02/2023
WALTHAM, Mass. Zixi has announced a partnership with Ant Media, and an integration with the Ant Media Server (AMS), which provides ready-to-use, scalable real-t...
07/02/2023
Online Weather Segments for KABB Fox San Antonio Rely on Ultimatte 12 4K
Brie Clayton February 7, 2023
0 Comments
Blackmagic Design today announced tha...
07/02/2023
VStream Media optimizes cloud-based remote production with AJA Ki Pro GO
Brie Clayton February 7, 2023
0 Comments
Founded in 2019, Singapore-based VStr...
07/02/2023
Racoon kits new in-house colour suite with Baselight TWO and Blackboard
Brie Clayton February 7, 2023
0 Comments
New senior colourist, Enge Gray, selec...
07/02/2023
In time for Valentine's Day, Samsung TV Plus is adding a Romance Movie channel to its 250-channel lineup....
07/02/2023
For decades, WBNS was the ratings colossus in Columbus. The station shifted from Dispatch Broadcast Group to Tegna in 2019, in a $535 million deal for it and WT...
07/02/2023
Fox said it has sold out all of the in-game commercials available during Super Bowl LVII, overcoming a slow economy and the collapse of the crypto market....
07/02/2023
As The Walt Disney Co. gets closer to announcing earnings on Wednesday and holding Bob Iger's first call with analysts since his return to the company, pred...
07/02/2023
Sinclair Broadcast Group said its free, over-the-air multicast networks Comet, Charge! and TBD have made deals that will add 2.4 million TV households to their ...
07/02/2023
Work It Out Wombats!, an animated series about a trio of marsupial siblings, premieres on PBS Kids February 6. The show targets kids ages 3-6....
07/02/2023
Season four of psychological thriller series You premieres on Netflix February 9. Based on Caroline Kepnes's novel of the same name, the show looks at a man...
07/02/2023
President Joe Biden delivers his second State of the Union address at the Capitol Tuesday, February 7 at 9 p.m. ET. ABC, CNN, CBS, Fox, Fox News Channel, MSNBC ...
07/02/2023
Great American Family and the producers of To The Rescue will present the To The Rescue Pup-A-Thon 2023 live at noon on Super Bowl Sunday (February 12) to raise...
07/02/2023
Taking back Bally Sports' local TV rights to teams' games is one of the options being explored by Major League Baseball, according to a published report...
07/02/2023
LONDON Video software provider Synamedia has unveiled research on piracy covering seven countries that found comedy is the most pirated entertainment genre....
07/02/2023
BALTIMORE Sinclair Broadcast Group is reporting that its free over-the-air, multicast television networks Comet, Charge!, and TBD will expand their nationwide c...
07/02/2023
NEW YORK Video games released by the top U.S.-focused console publishers over the past two years suggests that the industry has increased space for diversity wi...
07/02/2023
WEBSTER GROVES, Mo. Webster University recently completed a $7 million renovatio...
07/02/2023
Camp Lucky Welcomes Producer Alex Bronner
Brie Clayton February 6, 2023
0 Comments
Camp Lucky gives a warm welcome to producer Alex Bronner, a longtime...
07/02/2023
Digital Domain's Wakanda Forever VFX reel: Behind the Final Battle and 4 New...
07/02/2023
Wool E. Bull gave up no details about WRAL's Super Bowl ad in which he appears when interviewed by WRAL-TV Anchor Ken Smith on WRAL's Morning News on FO...
07/02/2023
Berklee Alumni and Faculty Win at the 2023 Grammy Awards Terri Lyne Carrington, Molly Tuttle & Golden Highway, and Steven Feifke were among the winners on mus...
07/02/2023
Student Spotlight: Stephanie Coraci The vocalist and dancer talks about balancing her interest in music business with her own artistry, going to major festiva...
07/02/2023
New Sponsor Spotlight: Comprimato's Ji Matela on Powering JPEG2000 Video C...
07/02/2023
Acoustics Were Deliberately Designed Into Ancient Arenas Studies of Mayan venues suggest the importance of sports sound By Dan Daley, Audio Editor
Tuesday, F...
07/02/2023
Super Bowl LVII: FOX Sports Lead Director Rich Russo Previews Calling the Shots ...
07/02/2023
BT Sport's Matt Stagg: The metaverse is gaining momentum in sports broadcast...
07/02/2023
Back to All News
Top 10 Week of January 30: You People' Is the Most Viewed...
07/02/2023
New One M/E Video Switcher, HVS-190, Features Flexible Configuration and NDI Su...
07/02/2023
Empowering advertisers and agencies to optimise their campaign investments and R...
07/02/2023
New York - February 6, 2023 - Neptune BidCo US Inc. (the Issuer ), an affiliate...
07/02/2023
Ateme's innovative video processing and delivery solutions can now be purchased via the AWS Marketplace, further strengthening Ateme's global partnershi...
07/02/2023
Zixi, the industry leader for enabling dependable, live broadcast-quality video over any IP network, and provider of the award-winning Software-Defined Video Pl...
07/02/2023
The Trusted Partner Network (TPN), the leading global film and television conten...
07/02/2023
Doctors rarely make diagnoses based on a single factor - they look at a mix of data types, such as a patient's symptoms, laboratory and radiology reports, a...
07/02/2023
OOONA, a global provider of professional management and production tools for the media localization industry, today announced that it has formed a strategic par...
07/02/2023
Racoon, one of London's leading creative studios, has hired well-known senior colourist, Enge Gray, to join its in-house team. To support the move, Racoon h...
07/02/2023
After the successful launch of the HS Series of tripods during 2022, by customer demand Libec have introduced two New Models which are perfect for Mirrorless ca...
06/02/2023
Steven Yeun and Yeri Han star in Minari....
06/02/2023
Blackmagic Fusion Tutorial: Sine Visualiser Part Two
Simon Ubsdell February 6, 2023
0 Comments
In this second part, we'll take a look a making our ...
06/02/2023
How The Finish Line Delivered Post on Netflix's I Am A Killer
Brie Clayton February 6, 2023
0 Comments
Behind the edit, grade, and HDR delivery of ...
06/02/2023
FAIRFIELD, N.J. The Media First Group has launched a new local streaming TV channel, On New Jersey (ONNJ), a New Jersey-based channel featuring news, talk, and ...
06/02/2023
RIGA & TOKYO Veset has announced it has been acquired by the Japanese media technology company, PLAY, Inc....
06/02/2023
That Station is turning 5 and wants to celebrate with you! Join us on Friday, May 12, at the Lincoln Theatre in downtown Raleigh for an incredible show with Th...
06/02/2023
Scheduling templates in WO Automation for Radio offer improved efficiency to sui...
06/02/2023
New York - February 6, 2023 - Neptune BidCo US Inc. (the Issuer ), an affiliate...