South Korea's most popular AI voice assistant, GiGA Genie, has conversed with 8 million people.
The AI-powered speaker from telecom company KT can control TVs, offer real-time traffic updates and complete a slew of other home-assistance tasks based on voice commands. It has mastered its conversational skills in the highly complex Korean language thanks to large language models (LLMs) - machine learning algorithms that can recognize, understand, predict and generate human languages based on huge text datasets.
The company's models are built using the NVIDIA DGX SuperPOD data center infrastructure platform and the NeMo Megatron framework for training and deploying LLMs with billions of parameters.
The Korean language, known as Hangul, reliably shows up in lists of the world's most challenging languages. It includes four types of compound verbs, and words are often composed of two or more roots.
KT - South Korea's leading mobile operator with over 22 million subscribers - improved the smart speaker's understanding of such words by developing LLMs. And through integration with Amazon Alexa, GiGA Genie can converse with users in English, too.
With transformer-based models, we've achieved significant quality improvements for the GiGA Genie smart speaker, as well as our customer services platform AI Contact Center, or AICC, said Hwijung Ryu, LLM development team lead at KT.
AICC is an all-in-one, cloud-based platform that offers AI voice agents and other customer service-related applications.
It can receive calls and provide requested information - or quickly connect customers to human agents for answers to more detailed inquiries. AICC without human intervention manages more than 100,000 calls daily across Korea, according to Ryu.
LLMs enable GiGA Genie to gain better language understanding and generate more human-like sentences, and AICC to reduce consultation times by 15 seconds as it summarizes and classifies inquiry types more quickly, he added.
Training Large Language Models Developing LLMs can be an expensive, time-consuming process that requires deep technical expertise and full-stack technology investments.
The NVIDIA AI platform simplified and sped up this process for KT.
We trained our LLM models more effectively with NVIDIA DGX SuperPOD's powerful performance - as well as NeMo Megatron's optimized algorithms and 3D parallelism techniques, Ryu said. NeMo Megatron is continuously adopting new features, which is the biggest advantage we think it offers in improving our model accuracy.
3D parallelism - a distributed training method in which an extremely large-scale deep learning model is partitioned across multiple devices - was crucial for training KT's LLMs. NeMo Megatron enabled the team to easily accomplish this task with the highest throughput, according to Ryu.
We considered using other platforms, but it was difficult to find an alternative that provides full-stack environments - from the hardware level to the inference level, he added. NVIDIA also provides exceptional expertise from product, engineering teams and more, so we easily solved several technical issues.
Using hyperparameter optimization tools in NeMo Megatron, KT trained its LLMs 2x faster than with other frameworks, Ryu said. These tools allow users to automatically find the best configurations for LLM training and inference, easing and speeding the development and deployment process.
KT is also planning to use the NVIDIA Triton Inference Server to provide an optimized real-time inference service, as well as NVIDIA Base Command Manager to easily monitor and manage hundreds of nodes in its AI cluster.
Thanks to LLMs, KT can release competitive products faster than ever, Ryu said. We also believe that our technology can drive innovation from other companies, as it can be used to improve their value and create innovative products.
KT plans to release more than 20 natural language understanding and natural language generation APIs for developers in November. The application programming interfaces can be used for tasks including document summarization and classification, emotion recognition, and filtering of potentially inappropriate content.
Learn more about breakthrough technologies for the era of AI and the metaverse at NVIDIA GTC, running online through Thursday, Sept. 22.
Watch NVIDIA founder and CEO Jensen Huang's keynote address in replay below:
Most recent headlines
04/08/2024
Dalet, a leading technology and service provider for media-rich organizations, is excited to announce Santiago Solanas as its new Chief Executive Officer (CEO)....
03/06/2024
Dalet, a leading technology and service provider for media-rich organizations, a...
31/05/2024
A U.S. Marine fires an FIM-92 Stinger missile during a training exercise in Yuma...
31/05/2024
NEW YORK The global body that sets technical standards for digital advertising h...
31/05/2024
In a new analysis of what services might make up a good bundle and what services might benefit the most from bundling, Antenna has released new data that highli...
31/05/2024
Global SVOD revenues will increase by $116.6 billion by 2031, a growth rate of 13.3% per year over the next eight years, according to a new report from MIDiA Re...
31/05/2024
WASHINGTON, D.C. The FCC Media Bureau has announced that effective August 1, 2024 the Commission's TVStudy software will incorporate the most recent U.S. Ce...
31/05/2024
NBCUniversal has announced that its FAST channel TNBC will be rebranding to NBC Comedy Vault on June 1 and that the free streaming service will officially launc...
31/05/2024
PARIS Ateme has announced that the Indonesian public broadcaster TVRI is making the transition to 4K UHD OTT streaming using Ateme technologies....
31/05/2024
The proposal had received support from James Cameron, Andy Serkis, Paul Greengrass, Richard Curtis, and Jeremy Irons
By Matthew Corrigan
Published: May 31, 2...
31/05/2024
According to multiple reports, the new bid from Skydance offers a better deal to Paramounts Class B shareholders, who were said to be unhappy with the companys ...
31/05/2024
The awards recognise women and companies who are stand-out performers, innovators and leaders in the broadcast media technology industry
By Matthew Corrigan
...
31/05/2024
NEW YORK The global body that sets technical standards for digital advertising has expanded the reach of its measurement software development kit to include Sam...
31/05/2024
The rise of digital platforms is fundamentally changing the broadcast newsroom and its investment in technology according to Jon Roberts, director of technology...
31/05/2024
In a new analysis of what services might make up a good bundle and what services might benefit the most from bundling, Antenna has released new data that highli...
31/05/2024
WASHINGTON, D.C. Fifty state broadcasters associations, including the District of Columbia and the Commonwealth of Puerto Rico, have sent a letter to Congressio...
31/05/2024
EVS has announced the appointment of Richard Katz as senior vice president of operations for the North and Latin American (NALA) region. This appointment is par...
31/05/2024
CommScope has announced that it was selected by Casa Systems, Inc. as the highest to acquire Casa's cable business assets and that the two companies have en...
31/05/2024
Robert De Niro won't be receiving the Service to America Leadership Award from the NAB Leadership Foundation after all....
31/05/2024
Viant Technology said it formed an integration with Google Cloud's BigQuery data clean rooms...
31/05/2024
The CW said it will broadcast the 2024 Snoop Dogg Arizona Bowl presented by Gin & Juice by Dre and Snoop Last year, The CW aired the game when it was called Bar...
31/05/2024
Allen Media Group said it made a deal with Amazon's Fire TV Channel that will make content from several of Allen's outlet available via Fire TV and Echo...
31/05/2024
Robert De Niro, announced as the winner of the NAB's Leadership Foundation's Service to America Leadership Award on May 28, will not get the award. The ...
31/05/2024
Comcast Technology Solutions was selected by AccuWeather to create, manage and distribute linear and over-the-top video channels....
31/05/2024
Connected TV is becoming a bigger deal for consumers and advertisers, according to a new report from TVision....
31/05/2024
31 May 2024
VEON discloses April YTD trading update at its AGM Amsterdam, 31 May 2024 07:00 CEST -
VEON April YTD 2024 Highlights
Total revenue of USD 1,278 ...
31/05/2024
31 May 2024
VEON Announces Its New Board, Names Founder Augie Fabela as Chairman Amsterdam, 31 May 2024, 16.00 CET: VEON Ltd. (NASDAQ: VEON, Euronext Amsterdam...
31/05/2024
May 31st, 2024
TRIBECA FESTIVAL AND OPEN AI ANNOUNCE SORA SHORTS'
Five Commissioned Short Films Created Using Sora Debut at 2024 Tribeca Festival
New ...
31/05/2024
In-Venue Technology Wrap-Up: How 4K, IP, and More are Changing the Game Pres Gam...
31/05/2024
UEFA Champions League Final 2024: The host broadcast facts and figures for Real ...
31/05/2024
UEFA Europa Conference League Final 2024: Bringing the broadcast to global TV sc...
31/05/2024
Willow Offers Free 2024 ICC T20 Cricket World Cup Preview via DirecTV, Verizon, ...
31/05/2024
Women's College World Series: ESPN Brings Live Drone, Two-Point Cabled, and ...
31/05/2024
SVG College Summit Brings Video-Production Industry Together in Atlanta in the M...
31/05/2024
UEFA Champions League Final 2024: CBS Sports' UCL Today Studio Show Is Pitch...
31/05/2024
Back to All News
Master of the House' Unveils a Scandalous Tale of Power and Greed on July 18
Entertainment
31 May 2024
GlobalThailand
Link copied to ...
31/05/2024
Back to All News
JEEtu Bhaiya is Back: Kota Factory' Season 3 Arrives on Netflix June 20
Entertainment
31 May 2024
GlobalIndia
Link copied to clipboar...
31/05/2024
Facebook
Twitter
LinkedIn
With around 9,000 employees, Ground Transportation Systems is a global leader in Rail Signaling and Train Control Systems, Telec...
31/05/2024
RT 2FM is the home of music this summer, entertaining listeners across the day and night, with the best music, chat and interviews providing the soundtrack to ...
31/05/2024
After the 2008 financial crisis and increased risk-management regulations that f...
31/05/2024
RT Supporting the Arts: What's On this June
Watch our promo: RT Supporting the Arts | What's on YouTube
This June, RT is delighted to support Lim...
30/05/2024
When to Upgrade Software or Firmware This post is from our blog and news archive. The information may be out of date. Please contact us for further information ...
30/05/2024
The City of San Jose Chooses Utah Scientific Again! This post is from our blog and news archive. The information may be out of date. Please contact us for furth...
30/05/2024
Navigating Strategy, Ethics, and Innovation in the evolving European media lands...
30/05/2024
By Bailey Pennick
One of the most exciting things about the Sundance Film Festi...
30/05/2024
Tickets are now available for the first-of-its-kind event in the United States f...
30/05/2024
Mental health and well-being are fundamental components of a child's healthy...
30/05/2024
After 64 days, the winner of Alone Australia has been revealed
29 May, 2024
Media releases
*Contains Spoilers*
After 64 days alone in the extreme and wild...
30/05/2024
Alone Australia finale delivers strongly as SBS confirms it will join VOZ stream...
South Korea's most popular AI voice assistant, GiGA Genie, has conversed with 8 million people.
