What Is a Pretrained AI Model?
08/12/2022
Now imagine trying to teach an artificially intelligent machine what a unicorn is. Where would one even begin?
Pretrained AI models offer a solution.
A pretrained AI model is a deep learning model - an expression of a brain-like neural algorithm that finds patterns or makes predictions based on data - that's trained on large datasets to accomplish a specific task. It can be used as is or further fine-tuned to fit an application's specific needs.
Why Are Pretrained AI Models Used? Instead of building an AI model from scratch, developers can use pretrained models and customize them to meet their requirements.
To build an AI application, developers first need an AI model that can accomplish a particular task, whether that's identifying a mythical horse, detecting a safety hazard for an autonomous vehicle or diagnosing a cancer based on medical imaging. That model needs a lot of representative data to learn from.
This learning process entails going through several layers of incoming data and emphasizing goals-relevant characteristics at each layer.
To create a model that can recognize a unicorn, for example, one might first feed it images of unicorns, horses, cats, tigers and other animals. This is the incoming data.
Then, layers of representative data traits are constructed, beginning with the simple - like lines and colors - and advancing to complex structural features. These characteristics are assigned varying degrees of relevance by calculating probabilities.
As opposed to a cat or tiger, for example, the more like a horse a creature appears, the greater the likelihood that it is a unicorn. Such probabilistic values are stored at each neural network layer in the AI model, and as layers are added, its understanding of the representation improves.
To create such a model from scratch, developers require enormous datasets, often with billions of rows of data. These can be pricey and challenging to obtain, but compromising on data can lead to poor performance of the model.
Precomputed probabilistic representations - known as weights - save time, money and effort. A pretrained model is already built and trained with these weights.
Using a high-quality pretrained model with a large number of accurate representative weights leads to higher chances of success for AI deployment. Weights can be modified, and more data can be added to the model to further customize or fine-tune it.
Developers building on pretrained models can create AI applications faster, without having to worry about handling mountains of input data or computing probabilities for dense layers.
In other words, using a pretrained AI model is like getting a dress or a shirt and then tailoring it to fit your needs, rather than starting with fabric, thread and needle.
Pretrained AI models are often used for transfer learning and can be based on several model architecture types. One popular architecture type is the transformer model, a neural network that learns context and meaning by tracking relationships in sequential data.
According to Alfredo Ramos, senior vice president of platform at AI company Clarifai - a Premier partner in the NVIDIA Inception program for startups - pretrained models can cut AI application development time by up to a year and lead to cost savings of hundreds of thousands of dollars.
How Are Pretrained Models Advancing AI? Since pretrained models simplify and quicken AI development, many developers and companies use them to accelerate various AI use cases.
Top areas in which pretrained models are advancing AI include:
Natural language processing. Pretrained models are used for translation, chatbots and other natural language processing applications. Large language models, often based on the transformer model architecture, are an extension of pretrained models. One example of a pretrained LLM is NVIDIA NeMo Megatron, one of the world's largest AI models.
Speech AI. Pretrained models can help speech AI applications plug and play across different languages. Use cases include call center automation, AI assistants and voice-recognition technologies.
Computer vision. Like in the unicorn example above, pretrained models can help AI quickly recognize creatures - or objects, places and people. In this way, pretrained models accelerate computer vision, giving applications human-like vision capabilities across sports, smart cities and more.
Healthcare. For healthcare applications, pretrained AI models like MegaMolBART - part of the NVIDIA BioNeMo service and framework - can understand the language of chemistry and learn the relationships between atoms in real-world molecules, giving the scientific community a powerful tool for faster drug discovery.
Cybersecurity. Pretrained models provide a starting point to implement AI-based cybersecurity solutions and extend the capabilities of human security analysts to detect threats faster. Examples include digital fingerprinting of humans and machines, and detection of anomalies, sensitive information and phishing.
Art and creative workflows. Bolstering the recent wave of AI art, pretrained models can help accelerate creative workflows through tools like GauGAN and NVIDIA Canvas.
Pretrained AI models can be applied across industries beyond these, as their customization and fine-tuning can lead to infinite possibilities for use cases.
Where to Find Pretrained AI Models Companies like Google, Meta, Microsoft and NVIDIA are inventing cutting-edge model architectures and frameworks to build AI models.
These are sometimes released on model hubs or as open source, enabling developers to fine-tune pretrained AI models, improve their accuracy and expand model repositories.
NVIDIA NGC
LINK: | https://blogs.nvidia.com/blog/2022/12/08/what-is-a-pretrained-ai-model... |
See more stories from nvidia |
Most recent headlines
04/08/2024
Dalet Appoints Santiago Solanas as CEO to Lead Next Era of Growth and Innovation
Dalet, a leading technology and service provider for media-rich organizations, is excited to announce Santiago Solanas as its new Chief Executive Officer (CEO)....
03/06/2024
Dalet and Veritone Reach Agreement to Distribute, Transact and Monetize Media Archives
Dalet, a leading technology and service provider for media-rich organizations, a...
28/04/2024
Mediahaus delivers the first SRT live-streaming sports production over 5G with URSA Broadcast G2
Mediahaus delivers the first SRT live-streaming sports production over 5G with U...
26/04/2024
Amagi Names Richard Perkett Chief Product Officer
NEW YORK Amagi has appointed Richard Perkett chief product officer (CPO)....
26/04/2024
NAB Board Election Results Announced
WASHINGTON, D.C. The National Association of Broadcasters (NAB) has announced the results of the 2024 NAB Radio and Television Board of Directors elections. The...
26/04/2024
Mattel to Launch First FAST Channels on Samsung TV Plus
EL SEGUNDO, Calif. & NEW YORK Mattel has announced a deal to launch its first three 24/7 free ad supported streaming (FAST) channels on Samsung TV Plus, Samsung...
26/04/2024
NextGen TV Launches In Portland, Maine
PORTLAND, Maine Viewers here can now receive the NextGen TV signals of five local stations with the launch of ATSC 3.0 service from host station WPFO, which is ...
26/04/2024
Rogers Inks Agreement to Deploy Comcast's Products and Technologies
TORONTO Rogers Communications has signed a 10-year agreement with Comcast to bring the latest Xfinity products and technology to Canadians....
26/04/2024
Calrec scoops third Argo win with NAB Show Product of the...
Calrec is very pleased to announce the benefits of its highly flexible approach to customer service has been recognized with a third award for the Argo range. T...
26/04/2024
New Adobe Photoshop with Advanced Generative Fill and Generate Image Brings New Superpowers to All
New Adobe Photoshop with Advanced Generative Fill and Generate Image Brings New ...
26/04/2024
Trends And Takeaways From NAB Show 2024
Trends And Takeaways From NAB Show 2024 Melanie Ciotti April 25, 2024 0 Comments NAB's Eric Trabb (right) awards SNS with two NAB Show Product of ...
26/04/2024
Sony's Ci Media Cloud Keeps NHRA Moving
Sony's Ci Media Cloud Keeps NHRA Moving Brie Clayton April 25, 2024 0 Comments Cloud-Based Media Asset Management and Collaboration Platform Accel...
26/04/2024
2024 Emerging Leaders Internship Program Open for Applications, Deadline May 31st
Capitol Broadcasting & Leadership Triangle Collaborate for Third Year Capitol B...
26/04/2024
MIX 101.5 Launches New YouTube Shows
The staff at CBC Radio have been hard at work creating several new features for listeners and viewers. Several debuts are taking place this spring. I have nev...
25/04/2024
Inside the Archives: Highlighting the Importance of Preservation for the Festival's 40th Edition
Sundance Institute Founder Robert Redford during a press conference at the 1996 ...
25/04/2024
SNS Dealer Of The Year Awards: See The Full List Of Winners
alt= class=wp-image-12361 data-lazy-src=/wp-content/uploads/2024/04/NAB-booth-2024-960x540-1.jpg/> Set against a vibrant backdrop of innovation and collaboratio...
25/04/2024
Trends And Takeaways From NAB Show 2024
alt= class=wp-image-12356 data-lazy-src=/wp-content/uploads/2024/04/NAB-mod-win-960x540-1.jpg/>NAB's Eric Trabb (right) awards SNS with two NAB Show Product...
25/04/2024
Peacock Subs Jump 55% YoY to 34M in Q1 2024
PHILADELPHIA Comcast beat earnings estimates in its Q1 2024 financial report, as streaming losses continued to decline and Peacock's paid subscribers spiked...
25/04/2024
Seattle Kraken Inks Deals with Tegna and Prime Video
SEATTLE The Seattle Kraken have inked new multi-year agreements with Tegna and Prime Video that will expand access to their games over broadcast stations and st...
25/04/2024
Opinion: charting a cloud driven future
M2A Medias Matt Hughes asks, is it time for news broadcasting to shift to the cloud? By Contributor Published: April 25, 2024 M2A Media's Matt Hughes ...
25/04/2024
Cintel Scanner G3 HDR+ Restores Egypt's Cinema Treasures to Their Former Glory
Cintel Scanner G3 HDR Restores Egypt's Cinema Treasures to Their Former Glo...
25/04/2024
Sinclair Names Kevin Coskren Chief Meteorologist at KTUL Tulsa
Sinclair Broadcast Group said it named Kevin Coskren chief meteorologist at KTUL, its ABC affiliate in Tulsa, Oklahoma....
25/04/2024
Attend The Business of TV News Event in D.C. on May 2
The Business of TV News, a new one-day event featuring Martha Raddatz, Shannon Bream, Glenn Kirschner and other major figures in television news, happens at Hot...
25/04/2024
Problematic FCC Conditions On Station Sale Could Create Detroit Drama
Conditions put on the proposed sale of WADL Detroit, to Mission Broadcasting have created a potential drama in the Motor City....
25/04/2024
TelevisaUnivision 1Q Loss Widens But DTC Business Expected To Turn Profit in Second Half
TelevisaUnivision reported a $52 million loss in the first quarter, up from $3 m...
25/04/2024
Comcast Earnings Flat As Video, Broadband Sub Losses Continue
Comcast reported flat first-quarter earnings as it reduced the red ink at Peacock but continued to lose video and broadband customers....
25/04/2024
Vevo Brings Music Videos To Telly's Dual Screen TVs
Music-video network Vevo said it launched its app on Telly, the company offering consumers free dual-screen TVs in return for data about what they're watchi...
25/04/2024
Future Today Redesigns Streaming App Interfaces
Future Today said it has introduced a redesigned user interface for about half of its 300 streaming apps, including Fawesome, HappyKids and iFood.TV....
25/04/2024
Czech mates
The writer and director of a hit Czech series tell Robert Shepherd about their approach to portraying real-life Pakistani kidnappings on the small screen, while...
25/04/2024
Molinaire Creative Group opens new Liverpool facility
Notorious DIT will work with the Liverpool Film Office to increase opportunities for regional talent By Matthew Corrigan Published: April 25, 2024 Notorio...
25/04/2024
Deutsche Telekom Powers New MagentaTV Service With Broadp...
Broadpeak , a leading provider of content delivery network (CDN) and video streaming solutions for content providers and pay-TV operators worldwide, announced t...
25/04/2024
Lightware Enhances Microsoft Teams Rooms with Powerful BY...
Lightware Visual Engineering, a leading manufacturer of connectivity solutions for the professional integrated systems market and a pioneer in signal management...
25/04/2024
Net Insight secures collaboration with DMC Production to...
Net Insight has entered into a collaboration with DMC Production that positions Net Insight at the forefront of sports broadcasting in the Nordics. Net Insight ...
25/04/2024
GlobalM and scoopa announce strategic partnership to faci...
GlobalM has announced a strategic partnership with scoopa, the specialists in broadcast-quality content distribution, offering a complementary service for live ...
25/04/2024
DDish TV LLC Chooses PlayBox Neo Channel-in-a-Box for Bro...
PlayBox Neo announces the completion of a new multichannel playout system for the DDish direct-to-home satellite television network in Mongolia. Based in the na...
25/04/2024
Legendary Producer Garth Richardson Chooses PMC Monitors...
Canadian music producer and engineer Garth Richardson also known as Gggarth due to his stutter - has embraced immersive audio by installing a PMC monitoring s...
25/04/2024
Televisa transforms its broadcast ecosystem with proven t...
Leading video software provider Synamedia today announced that Televisa, the Mexican telecommunications and broadcasting company, has chosen Synamedia as its pa...
25/04/2024
OTTera partners with ThinkAnalytics to enhance personaliz...
OTTera, a leading provider of end-to-end OTT and FAST channel solutions, proudly announces its strategic partnership with ThinkAnalytics, a global leader in adv...
25/04/2024
Perfect Weather Forecast for American Tobacco Events Tonight and Saturday
The American Tobacco Campus will be hopping with activity tonight and this weekend with two fun events! Durham Night Market At last! The Durham Night Market i...
25/04/2024
Qurate Launches The Big Dish on The Roku Channel
WEST CHESTER, Pa. Video commerce provider Qurate Retail Group has launched The Big Dish, a new culinary-themed FAST channel on The Roku Channel....
25/04/2024
HPA Opens Submissions for 2024 HPA Engineering Excellence Awards
LOS ANGELES The Hollywood Professional Association has announced that submissions for the 2024 HPA Engineering Excellence Awards are now being accepted. This re...
25/04/2024
DV Earns MRC Accreditation for CTV Viewability
NEW YORK The digital media measurement and analytics firm DoubleVerify has announced that it has received Media Rating Council (MRC) accreditation for Video Vie...
25/04/2024
DAZN FAST Channels to Launch on Tubi
SAN FRANCISCO Fox Corp.'s ad-supported streaming service Tubi has announced a licensing agreement with the sports platform DAZN that will see DAZN Ringside ...
25/04/2024
IAB Makes Three Appointments to Its Leadership Team
NEW YORK In the runup to the 2024 IAB NewFronts, the IAB has announced three key appointments to its leadership team....
25/04/2024
Epic Games releases Unreal Engine 5.4 with new Motion Design Mode, Unreal VCam for Android, and more
Epic Games releases Unreal Engine 5.4 with new Motion Design Mode, Unreal VCam f...
25/04/2024
Content Creation, Production, Distribution Is In a State of Flux
Content Creation, Production, Distribution Is In a State of Flux Andy Marken April 24, 2024 0 Comments My empathy is creeping towards what I would de...
25/04/2024
Capitol Broadcasting Company to Air Carolina Panthers Games on Triangle's Strongest Broadcast Signal
The Carolina Panthers and Capitol Broadcasting Company (CBC) announced they have...
25/04/2024
Berklee Student Riko Sasaski Named 2024 Yamaha Young Performing Artist
Berklee Student Riko Sasaski Named 2024 Yamaha Young Performing Artist The accomplished saxophonist secured a spot among the elite winners of this year's ...
25/04/2024
Local News Close-Up: St. Louis Born and Bred
Stations everywhere take pride in having a main anchor who comes from the market they represent. That applies in St. Louis, too, but it also pertains to general...
25/04/2024
Edward Moody Joins WBTW Myrtle Beach Anchor Team
Edward Moody is joining the WBTW Myrtle Beach, South Carolina, anchor crew, and will anchor the 5, 6 and 11 p.m. newscasts alongside Trish Williford. He comes f...