Editor's note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible, and showcases new hardware, software, tools and accelerations for RTX PC users.
Content generators - whether producing language, 2D images, 3D models or videos - are giving the creative community tools that bring visions to life faster.
To help developers build these new generative AI tools, NVIDIA has set up NVIDIA AI Foundry. It helps companies train generative AI models on their own licensed data using NVIDIA Edify, a multimodal AI architecture that can use simple text prompts to generate images, videos, 3D assets, 360-degree high-dynamic-range imaging and physically based rendering (PBR) materials. Using AI Foundry, companies can train bespoke AI models to generate any of these assets.
Key elements of Edify include its ability to generate multiple types of content, its superior training efficiency, which allows it to produce high-quality content while trained on fewer images, and its ability to fine-tune models to style-match or learn characters or objects.
One of the best examples of services built on NVIDIA AI Foundry and Edify is Generative AI by Getty Images, a commercially safe generative photography service. The combination of AI Foundry and Edify allows users to control their training datasets, so they can create models that fit their need.
To avoid copyright issues, Getty Images used Edify to train the service on its own licensed content, ensuring that no famous characters or products are in the dataset. The company also shares part of the profits with the contributors, driving a new revenue stream for creators who contribute to the model.
Asset Generation With Edify Edify can be trained to generate a variety of image types, including images, 3D assets and 360-degree HDRi environment maps.
Edify Image can generate four high-quality 1K images in around six seconds, doubling the performance of the previous model. Images can also be converted to 4K with a generative upscaler that adds additional details.
Getty Images 4K image generation trained on NVIDIA Edify using commercially safe creative libraries. Images are highly controllable thanks to advanced prompt adherence, camera controls to specify focal length or depth of field, and ControlNets to guide the generation. The ControlNets include Sketch, which allows users to provide a sketch to follow or copy the composition of an image, and Depth, to copy the composition of an image.
Images can also be edited with Edify Image. InPaint allows users to add or modify content in an image. Replace - a strict InPaint - can change details such as clothing. And OutPaint can expand an image to match different aspect ratios. And all of this is simplified with Segment, a feature that can mask objects with just a text prompt.
Edify can also create artist-ready 3D meshes. The meshes come with clean quads-based topology, up to 4K PBR materials and automatic UV mapping for easier texture editing. A fast preview mode provides results in as few as 10 seconds, which can then be turned into a full 3D mesh.
Meshes are perfect for prototyping scenes, generating background objects for set decoration or as a head start for 3D sculpting.
Edify 360 HDRi generates environment maps of natural landscapes that can be used to light a scene, for reflections and even as a background. The model can generate up to 16K HDRi images from text or image prompts. With a desired backplate in hand, users can create a custom HDRi to match instead of spending hours looking for one.
High dynamic range, 360-degree panoramas from text prompts. Edify's multimodal capability is unique, enabling advanced workflows that combine different asset types. Used together with an agent, for instance, Edify allows users to prototype a full scene in a couple of minutes with a simple text prompt - like in the NVIDIA Research SIGGRAPH demo that showcased the assistive 3D world-building capabilities of NVIDIA Edify-powered models and the NVIDIA Omniverse platform.
Another use case is to combine Edify 3D and 360 HDRi with Image to give users full control of image generation. By generating the scene in 3D, artists can move objects around and frame their desired shot - and then use Edify Image to turn the prototype into a photorealistic image.
Generative AI by Getty Images Getty Images is one of the largest content service providers and suppliers of creative visuals, editorial photography, video and music - and is the one of the first places people turn to discover, purchase and share powerful visual content from the world's best photographers and videographers.
Getty Images used NVIDIA AI Foundry to train an NVIDIA Edify Image model to power its generative AI service. Available through Generative AI by Getty Images for enterprises and Generative AI by iStock for small businesses and amateur creators, the service allows users to generate and modify images using models powered by NVIDIA Edify.
Generative AI by Getty Images (or iStock) offers a variety of licensed content. Getty Images and iStock recently updated to the latest version of Edify Image, enabling faster generations and higher prompt adherence and exposing Camera Controls.
Updated camera controls in Generative AI by Getty Images. Users can now also use the generative AI tools on preshot creative content, allowing them to edit and modify iStock's library of visuals to rapidly iterate and perfect content. Those same capabilities will be soon available on Gettyimages.com.
Test drive Generative AI by Getty Images on ai.nvidia.com.
Generative AI is transforming gaming, videoconferencing and interactive experiences of all kinds. Make sense of what's new and what's next by subscribing to the AI Decoded newsletter.
More from Nvidia
08/10/2024
A recently released joint research paper by NVIDIA, Moderna and Yale reviews how techniques from quantum machine learning (QML) may enhance drug discovery metho...
08/10/2024
Serving as a bridge for academia, industry and public-sector groups to partner on artificial intelligence innovation, NVIDIA is launching its inaugural AI Tech ...
08/10/2024
TSMC, the world leader in semiconductor manufacturing, is moving to production with NVIDIA's computational lithography platform, called cuLitho, to accelera...
08/10/2024
This summer, scientists supercharged their tools in the hunt for signs of life b...
08/10/2024
Artificial intelligence is transforming cybersecurity with new generative AI tools and capabilities that were once the stuff of science fiction. And like many o...
08/10/2024
The U.S. healthcare system is adopting digital health agents to harness AI across the board, from research laboratories to clinical settings.
The latest AI-acc...
07/10/2024
NVIDIA and Foxconn are building Taiwan's largest supercomputer, marking a milestone in the island's AI advancement.
The project, Hon Hai Kaohsiung Supe...
03/10/2024
The air is crisp, the pumpkins are waiting to be carved, and GFN Thursday is ready to deliver some gaming thrills.
GeForce NOW is unleashing a monster mash of ...
03/10/2024
AI isn't just about building smarter machines. It's about building a greener world.
From optimizing energy use to reducing emissions, AI and accelerate...
02/10/2024
Editor's note: This post is part of the AI Decoded series, which demystifies...
01/10/2024
Washington, D.C., is where possibility has always met policy, and AI presents un...
27/09/2024
NIO's smart EV brand, ONVO, has unveiled the L60 flagship mid-size family SUV, built on the NVIDIA DRIVE Orin system-on-a-chip.
Earlier this year, the auto...
26/09/2024
Whether looking for a time-traveling adventure, strategic roleplay or epic action, anyone can find something to play on GeForce NOW, with over 2,000 games in th...
25/09/2024
Editor's note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible, and showcases new hardware, softwa...
23/09/2024
The Wellcome Sanger Institute, a key contributor to the international Human Geno...
23/09/2024
NVIDIA is joining the U.S. government's launch of the Partnership for Global Inclusivity on AI (PGIAI), providing Deep Learning Institute training, GPU cred...
23/09/2024
Hitachi Rail, a global transportation company powering railway systems in over 5...
20/09/2024
A committee of experts from top U.S. medical centers and research institutes is harnessing NVIDIA-powered federated learning to evaluate the impact of federated...
19/09/2024
In a surprise appearance at T-Mobile's Capital Markets Day, NVIDIA founder a...
19/09/2024
All the electricity that powers NVIDIA's global operations will come from renewable sources by the end of January.
It's the right fuel for the company&...
19/09/2024
GeForce NOW makes gamers' fantasies a reality by bringing top titles to the cloud. This week, the award-winning FINAL FANTASY XVI is available for members t...
18/09/2024
Telecommunications providers are transforming beyond voice and data services wit...
18/09/2024
Companies in the US spend $15bn annually on talent acquisition. The most important metric in recruitment advertising is the conversion from the paid click on th...
17/09/2024
A new AI innovation hub for developers across Tunisia launched today in Novation City, a technology park that's designed to cultivate a vibrant, innovation ...
17/09/2024
At TwitchCon - a global convention for the Twitch livestreaming platform-livestreamers and content creators this week can experience the latest technologies for...
12/09/2024
Rise and shine - Capcom's latest action-adventure game, Dead Rising Deluxe Remaster, heads to the cloud at launch next week.
It's part of nine new titl...
11/09/2024
AI is transforming the broadcast industry by enhancing the way content is created, distributed and consumed - but integrating the technology can be challenging....
11/09/2024
Enterprises are looking for increasingly powerful compute to support their AI workloads and accelerate data processing. The efficiency gained can translate to b...
11/09/2024
To accelerate autonomous vehicle development and deployment timelines, Nuro announced today it will license its Nuro Driver autonomous driving system directly t...
09/09/2024
Companies in broadcast, sports and streaming are transitioning to software-defined infrastructure to benefit from flexible deployment and to more easily adopt t...
06/09/2024
Customer service departments across industries are facing increased call volumes, high customer service agent turnover, talent shortages and shifting customer e...
05/09/2024
Fall will be here soon, so leaf it to GeForce NOW to bring the games, with 19 joining the cloud in September.
Get started with the seven games available to str...
05/09/2024
The business transformations that generative AI brings come with risks that AI itself can help secure in a kind of flywheel of progress.
Companies who were qui...
04/09/2024
Volvo Cars' new, fully electric EX90 is making its way from the automaker's assembly line in Charleston, South Carolina, to dealerships around the U.S.
...
04/09/2024
Editor's note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible, and showcases new hardware, softwa...
04/09/2024
Edward Mehr works where AI meets the anvil. The company he cofounded, Machina L...
04/09/2024
It all started at Berlin's Merantix venture studio in 2022, when Silviu Homo...
29/08/2024
Well before OpenAI upended the technology industry with its release of ChatGPT i...
29/08/2024
It's time to mana-fest the spirit of adventure with Square Enix's highly anticipated action role-playing game, Visions of Mana, launching today in the c...
28/08/2024
As enterprises race to adopt generative AI and bring new services to market, the demands on data center infrastructure have never been greater. Training large l...
28/08/2024
Editor's note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible, and showcases new hardware, softwa...
27/08/2024
The initial wave of generative AI was driven by its use in internet services tha...
27/08/2024
Aiming at making the process faster and smarter, NVIDIA on Wednesday released th...
26/08/2024
Nations around the world are pursuing sovereign AI to produce artificial intelligence using their own computing infrastructure, data, workforce and business net...
23/08/2024
A deep technology conference for processor and system architects from industry a...
22/08/2024
Straight out of Gamescom, NVIDIA introduced GeForce NOW support for Xbox automat...
21/08/2024
Snowflake is using AI to help enterprises transform data into insights and applications. In this episode of NVIDIA's AI Podcast, host Noah Kravitz and Baris...
21/08/2024
Developers of generative AI typically face a tradeoff between model size and acc...
21/08/2024
Editor's note: This post is part of the AI Decoded series, which demystifies...
Editor's note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible, and showcases new hardware, software, tools and accelerations for RTX PC users.
