U and Google's Gemini model to Provide Generative AI Services for Everyday Use

KDDI CORPORATION

February 21,2024

-- Tokyo, February 21, 2024 From February 26, 2024, KDDI will launch an initiative toward providing services that enrich the lives of customers by enabling them to experience generative AI in their daily lives. To this aim, KDDI will combine its metaverse and Web3 service U (Alpha-U) with generative AI, such as Googles high-performance generative AI model Gemini Pro model [

1].

As U is boosting the creator economy, it is accelerating further support for creatives through generative AI.

The first services to be engaged will be shopping and entertainment. The former allows users to just take a picture of clothing and then check how clothes would appear without the users having to visit physical stores, by generating a try-on image. The latter allows users to generate live music scene in real-time. These services will be on show at MWC Barcelona 2024, with official launch planned for 2024 onward. Generative AI quickly creates wide-ranging creatives, which will allow customers to enjoy a personally optimized experience. To further broaden the use of AI, KDDI will open these AI functions to outside companies and provide development support.

In March 2023, KDDI and Google Cloud Japan partnered to co-create business by leveraging XR technology. Since then, Google Clouds and KDDIs technical teams have been working together to create and disseminate new XR experiences. This time, the parties are extending the areas covered by this initiative to include the use of generative AI. As part of the development, KDDI will collaborate with the Google Partner Innovation Team, which conducts experiments using Googles state-of-the-art technologies to create innovative experiences based on generative AI.

If you have difficulty to view the movie, please click the link below.

U(Alpha-U) and Googles Gemini model to Provide Generative AI Services

Initiative detail 1. Enhancing U with generative AI

KDDI operates the metaverse and Web3 service U, including the metaverse, live streaming and virtual shopping, for new generations that sees no boundaries between reality and virtual space.

By linking U, and generative AI such as Gemini Pro model, KDDI will support creatives and drive the creator economy.

Creative tasks will be made more easily, thereby allowing U customers to experience more content and more enriching experiences.

Example use cases will be exhibited during MWC Barcelona 2024 at KDDIs booth. Official service launch is planned for 2024 onward.



Shopping:

Clothes fitting and customer service

Implemented in U place, a shopping service that reproduces physical stores in virtual space.

From just one image of clothing, users can generate try-on images according to various body shapes. They can check how clothes would appear on themselves without visiting the store.

The AI chat service proposes items that are fit for the season and scene.

Live music streaming:

Venue in virtual space

Implemented in U live, a 360-degree live music streaming service that can be viewed from any angle.

The live music venue switches to a forest, ocean, city, and other places in real-time according to the settings the customer enters by text.

Live music directors can quickly create a unique digital space.

Entertainment experiences can be customized according to each viewer.

Metaverse:

Creative Production

Implemented in a photographic Shibuya metaverse that is easily accessible with a Web browser through cloud rendering.

From just one creative graphic, countless digital townscape visions and posters in town can be automatically generated.

Creators can automatically generate consistent-looking creatives for any size and aspect ratio to effortlessly hijack the town, allowing customers to enjoy an immersive world-view experience in digital space.

Generative AI mascot:

Conversation engine

Implemented in generative AI mascot

Ubicot, which was announced as a prototype in October 2023.

Unlike smart speakers, it can talk emotively with generative AI.

2. Supporting companies by opening generative AI functions

KDDI will provide companies with functions that combine generative AI, such as Gemini Pro model with KDDIs technologies under the name of U on cloud.

Through Google Cloud Marketplace, companies can incorporate and enhance U on clouds generative AI functions in their products and services.

For startups, KDDI will offer additional support, such as matching them with major firms and offering development support, through KDDIs business co-creation platform KDDI Labo.

KDDI plans to start accepting applications from spring 2024.

[1]

Gemini Pro model will be used at the MWC exhibit. Gemini Ultra model is to be supported when it becomes available in the future.

The information contained in the news releases is current at the time of publication. Products, service fees,service content and specifications, contact information, and other details are subject to change without notice.

LINK:	https://news.kddi.com/kddi/corporate/english/newsrelease/2024/02/21/72...
	See more stories from kddi

Most recent headlines