Sony Pixel Power calrec Sony

U and Google's Gemini model to Provide Generative AI Services for Everyday Use

21/02/2024

KDDI CORPORATION

February 21,2024

-- Tokyo, February 21, 2024 From February 26, 2024, KDDI will launch an initiative toward providing services that enrich the lives of customers by enabling them to experience generative AI in their daily lives. To this aim, KDDI will combine its metaverse and Web3 service U (Alpha-U) with generative AI, such as Googles high-performance generative AI model Gemini Pro model [

1].

As U is boosting the creator economy, it is accelerating further support for creatives through generative AI.

The first services to be engaged will be shopping and entertainment. The former allows users to just take a picture of clothing and then check how clothes would appear without the users having to visit physical stores, by generating a try-on image. The latter allows users to generate live music scene in real-time. These services will be on show at MWC Barcelona 2024, with official launch planned for 2024 onward. Generative AI quickly creates wide-ranging creatives, which will allow customers to enjoy a personally optimized experience. To further broaden the use of AI, KDDI will open these AI functions to outside companies and provide development support.

In March 2023, KDDI and Google Cloud Japan partnered to co-create business by leveraging XR technology. Since then, Google Clouds and KDDIs technical teams have been working together to create and disseminate new XR experiences. This time, the parties are extending the areas covered by this initiative to include the use of generative AI. As part of the development, KDDI will collaborate with the Google Partner Innovation Team, which conducts experiments using Googles state-of-the-art technologies to create innovative experiences based on generative AI.

If you have difficulty to view the movie, please click the link below.

U(Alpha-U) and Googles Gemini model to Provide Generative AI Services

Initiative detail 1. Enhancing U with generative AI

KDDI operates the metaverse and Web3 service U, including the metaverse, live streaming and virtual shopping, for new generations that sees no boundaries between reality and virtual space.

By linking U, and generative AI such as Gemini Pro model, KDDI will support creatives and drive the creator economy.

Creative tasks will be made more easily, thereby allowing U customers to experience more content and more enriching experiences.

Example use cases will be exhibited during MWC Barcelona 2024 at KDDIs booth. Official service launch is planned for 2024 onward.



Shopping:

Clothes fitting and customer service

Implemented in U place, a shopping service that reproduces physical stores in virtual space.

From just one image of clothing, users can generate try-on images according to various body shapes. They can check how clothes would appear on themselves without visiting the store.

The AI chat service proposes items that are fit for the season and scene.

Live music streaming:

Venue in virtual space

Implemented in U live, a 360-degree live music streaming service that can be viewed from any angle.

The live music venue switches to a forest, ocean, city, and other places in real-time according to the settings the customer enters by text.

Live music directors can quickly create a unique digital space.

Entertainment experiences can be customized according to each viewer.

Metaverse:

Creative Production

Implemented in a photographic Shibuya metaverse that is easily accessible with a Web browser through cloud rendering.

From just one creative graphic, countless digital townscape visions and posters in town can be automatically generated.

Creators can automatically generate consistent-looking creatives for any size and aspect ratio to effortlessly hijack the town, allowing customers to enjoy an immersive world-view experience in digital space.

Generative AI mascot:

Conversation engine

Implemented in generative AI mascot

Ubicot, which was announced as a prototype in October 2023.

Unlike smart speakers, it can talk emotively with generative AI.

2. Supporting companies by opening generative AI functions

KDDI will provide companies with functions that combine generative AI, such as Gemini Pro model with KDDIs technologies under the name of U on cloud.

Through Google Cloud Marketplace, companies can incorporate and enhance U on clouds generative AI functions in their products and services.

For startups, KDDI will offer additional support, such as matching them with major firms and offering development support, through KDDIs business co-creation platform KDDI Labo.

KDDI plans to start accepting applications from spring 2024.

[1]

Gemini Pro model will be used at the MWC exhibit. Gemini Ultra model is to be supported when it becomes available in the future.

The information contained in the news releases is current at the time of publication. Products, service fees,service content and specifications, contact information, and other details are subject to change without notice.
LINK: https://news.kddi.com/kddi/corporate/english/newsrelease/2024/02/21/72...
See more stories from kddi

Asia, Australia & Oceanic Stories

11/09/2025

SBS shares Australian National Anthem in over 60 languages to foster belonging and connection

SBS shares Australian National Anthem in over 60 languages to foster belonging a...

05/09/2025

Today's Historic Settlement Underscores SBS's Powerful New Series The People v Robodebt

Today's Historic Settlement Underscores SBS's Powerful New Series The Pe...

04/09/2025

Watch the Record-breaking Koori Knockout 2025 LIVE and EXCLUSIVE on NITV and SBS On Demand

Watch the Record-breaking Koori Knockout 2025 LIVE and EXCLUSIVE on NITV and SBS...

03/09/2025

World-first opt-out function to become full feature on SBS On Demand

World-first opt-out function to become full feature on SBS On Demand 3 September, 2025 Media releases National broadcaster SBS will elevate the world-class...

03/09/2025

SBS On Demand to take consumer experience to next level with introduction of restart, pause and rewind functions

SBS On Demand to take consumer experience to next level with introduction of res...

03/09/2025

SBS highlights effectiveness of advertising in uncluttered environments

SBS highlights effectiveness of advertising in uncluttered environments 3 September, 2025 Media releases New market-first research, done in conjunction wit...

03/09/2025

SBS extends exclusive Tour de France Femmes Avec Zwift free-to-air broadcast deal to 2030

SBS extends exclusive Tour de France Femmes Avec Zwift free-to-air broadcast dea...

03/09/2025

Record number of brands driving investment in NITV and First Nations media

Record number of brands driving investment in NITV and First Nations media 3 September, 2025 Media releases Beyond 3% continues to support the growth of Na...

03/09/2025

SBS declares FIFA World Cup 2026 Will be biggest TV audience event of 2026'

SBS declares FIFA World Cup 2026 Will be biggest TV audience event of 2026' 3 September, 2025 FIFA World Cup SBS names Hyundai, Macca's, Rexona, ...

03/09/2025

SBS continues to lead Australian media in sustainability with launch of SBS Brief Green

SBS continues to lead Australian media in sustainability with launch of SBS Brie...

03/09/2025

SBS unifies data offering with launch of SBS Data Lab

SBS unifies data offering with launch of SBS Data Lab 3 September, 2025 Media releases SBS brings together multiple audience initiatives together in one un...

03/09/2025

Turbulence, Heart and Humanity: SBS Unveils High-Flying New Airport Drama The Chaplain

Turbulence, Heart and Humanity: SBS Unveils High-Flying New Airport Drama The Ch...

29/08/2025

Australian Red Cross and SBS launch training to help workplaces in the fight against Modern Slavery

Australian Red Cross and SBS launch training to help workplaces in the fight aga...

27/08/2025

ABC, Screen Australia and ACTF unveil two new original children's series

27 08 2025 - Media release ABC, Screen Australia and ACTF unveil two new original children's series Happy House. The ABC, Screen Australia and the Austra...

25/08/2025

Watch SBS as 49 World Champions are crowned in nine days at the World Athletics Championships Tokyo 2025

Watch SBS as 49 World Champions are crowned in nine days at the World Athletics ...

25/08/2025

Got a podcast idea? SBS Audio opens annual pitch season

Got a podcast idea? SBS Audio opens annual pitch season 25 August, 2025 Media releases Three-time Australian Podcast Publisher of the Year, SBS, invites th...

21/08/2025

Statement on Acting Managing Director arrangements at SBS

Statement on Acting Managing Director arrangements at SBS 21 August, 2025 Insights & articles The SBS Board of Directors has today confirmed it will appoin...

20/08/2025

SBS unleashes landmark docu-drama The People vs Robodebt

SBS unleashes landmark docu-drama The People vs Robodebt 20 August, 2025 Media releases Our Government. Half a Million Victims [1]. Zero Accountability Un...

20/08/2025

Dan Bourchier appointed General Manager of NITV

Dan Bourchier appointed General Manager of NITV 20 August, 2025 Media releases The respected journalist, presenter and accomplished leader will join Nation...

14/08/2025

Statement on the passing of David Stratton

Statement on the passing of David Stratton 14 August, 2025 Insights & articles Statement by SBS Managing Director, James Taylor SBS is deeply saddened by...

12/08/2025

SBS Managing Director James Taylor steps down

SBS Managing Director James Taylor steps down 12 August, 2025 Media releases SBS Managing Director will depart the organisation later this year SBS Managi...

12/08/2025

Millions join SBS for a month of Tour de France and Tour de France Femmes action

Millions join SBS for a month of Tour de France and Tour de France Femmes action 12 August, 2025 Media releases Total TV Reach of 5.57 million, including 1...

11/08/2025

Screen Australia celebrates emerging creatives and cultural icons in documentary funding slate

11 08 2025 - Media release Screen Australia celebrates emerging creatives and cu...

07/08/2025

A bold new sporting documentary series celebrating First Nations athletes, culture, and the power of sport

A bold new sporting documentary series celebrating First Nations athletes, cultu...

06/08/2025

SBS heralds sweeping historical drama King & Conqueror coming soon

SBS heralds sweeping historical drama King & Conqueror coming soon 5 August, 2025 Media releases James Norton and Nikolaj Coster-Waldau star as the rivals ...

31/07/2025

The Creators 2025 Participants Announced

31 07 2025 - Media release The Creators 2025 Participants Announced Top (L-R): Tamara Asmar, Anna Barnes and Sarah Bassiuoni. Bottom (L-R): Glen Dolman, Mich...

24/07/2025

NITV and SBS to celebrate the significance and spectacle of the 25th Garma Festival

NITV and SBS to celebrate the significance and spectacle of the 25th Garma Festi...

24/07/2025

Pure Drama continues with the Tour de France Femmes avec Zwift hot on the wheels of the Tour de France

Pure Drama continues with the Tour de France Femmes avec Zwift hot on the wheels...

23/07/2025

SBS shortlists proponents to proceed to next stage for Western Sydney production hub location

SBS shortlists proponents to proceed to next stage for Western Sydney production...

21/07/2025

SBS reveals expert commentary team for the World Athletics Championships in Tokyo in September

SBS reveals expert commentary team for the World Athletics Championships in Toky...

21/07/2025

Australian gamemakers level-up with major funding from Screen Australia

21 07 2025 - Media release Australian gamemakers level-up with major funding from Screen Australia Retopia New games capture distinctive stories, landscapes ...

09/07/2025

Explore Love Without Limits in a bold, funny and unapologetic SBS Audio podcast about love, intimacy and disability

Explore Love Without Limits in a bold, funny and unapologetic SBS Audio podcast ...

08/07/2025

SBS strengthens commitment to inclusion with new commissioning guidelines

SBS strengthens commitment to inclusion with new commissioning guidelines 8 July, 2025 Media releases SBS has launched new Commissioning Inclusion Guidelin...

08/07/2025

Secrets, Spies and Sabotage: 40 years on, SBS podcast investigates historic bombing of Greenpeace's Rainbow Warrior

Secrets, Spies and Sabotage: 40 years on, SBS podcast investigates historic bomb...

07/07/2025

SBS Farewells Chair George Savvides AM

SBS Farewells Chair George Savvides AM 7 July, 2025 Media releases Born of Greek Cypriot parents, Mr Savvides joined the SBS Board as Deputy Chair in Febru...

30/06/2025

SBS On Demand boosts global news offering with launch of France 24 FAST Channel

SBS On Demand boosts global news offering with launch of France 24 FAST Channel 30 June, 2025 Media releases SBS is expanding its international news offeri...

27/06/2025

Game, set, action! Screen Australia and ABC announce new mini-series Goolagong

27 06 2025 - Media release Game, set, action! Screen Australia and ABC announce new mini-series Goolagong Marton Csokas and Lila McGuire of Goolagong. Image c...

26/06/2025

Buckle up for Great Australian Road Trips launching 31 July on SBS and SBS On Demand

Buckle up for Great Australian Road Trips launching 31 July on SBS and SBS On De...

20/06/2025

Hit, run, oh sh#t: NITV and SBS get RECKLESS with filming underway in Western Australia

Hit, run, oh sh#t: NITV and SBS get RECKLESS with filming underway in Western Au...

13/06/2025

Pure Drama and Fierce Rivalries set to dominate the world's most iconic sporting event

Pure Drama and Fierce Rivalries set to dominate the world's most iconic spor...

12/06/2025

50 Years Strong: SBS and NITV Supercharge NAIDOC Week 2025 in a joint 50th celebration

50 Years Strong: SBS and NITV Supercharge NAIDOC Week 2025 in a joint 50th celeb...

06/06/2025

Award-Winning TV Creators Richard Gadd, Sally Wainwright and Soo Hugh Headline Future Vision 2025

06 06 2025 - Media release Award-Winning TV Creators Richard Gadd, Sally Wainwri...

03/06/2025

Stories of love, loyalty and self-discovery among six shortlisted Digital Originals, as applications open for 2025

Stories of love, loyalty and self-discovery among six shortlisted Digital Origin...

28/05/2025

SBS celebrates 50 years of reflecting a diverse and contemporary Australia

SBS celebrates 50 years of reflecting a diverse and contemporary Australia 28 May, 2025 Media releases Marking 50 years of broadcasting on 9 June 2025, SBS...

28/05/2025

ABS and Verticloud announce a Strategic Partnership to accelerate Digital Transformation through Salesforce Communications Cloud

ABS and Verticloud announce a Strategic Partnership to accelerate Digital Transf...

22/05/2025

SBS and Screen Australia showcase the next wave of Australian storytellers with Digital Originals

SBS and Screen Australia showcase the next wave of Australian storytellers with ...

22/05/2025

Rune Pedersen unpacks How Humans Talk in new SBS Audio podcast

Rune Pedersen unpacks How Humans Talk in new SBS Audio podcast 22 May, 2025 Media releases Ever caught yourself using baby talk with your pet and wondered ...