Setting AIs on SIGGRAPH: Top Academic Researchers Collaborate With NVIDIA to Tackle Graphics' Greatest Challenges
04/05/2022
These projects - and over a dozen more - will be on display at SIGGRAPH 2022, taking place Aug. 8-11 in Vancouver and online. NVIDIA researchers have 16 technical papers accepted at the conference, representing work with 14 universities including Dartmouth College, Stanford University, the Swiss Federal Institute of Technology Lausanne and Tel Aviv University.
The papers span the breadth of graphics research, with advancements in neural content creation tools, display and human perception, the mathematical foundations of computer graphics and neural rendering.
Neural Tool for Multi-Skilled Simulated Characters When a reinforcement learning model is used to develop a physics-based animated character, the AI typically learns just one skill at a time: walking, running or perhaps cartwheeling. But researchers from UC Berkeley, the University of Toronto and NVIDIA have created a framework that enables AI to learn a whole repertoire of skills - demonstrated above with a warrior character who can wield a sword, use a shield and get back up after a fall.
Achieving these smooth, life-like motions for animated characters is usually tedious and labor intensive, with developers starting from scratch to train the AI for each new task. As outlined in this paper, the research team allowed the reinforcement learning AI to reuse previously learned skills to respond to new scenarios, improving efficiency and reducing the need for additional motion data.
Tools like this one can be used by creators in animation, robotics, gaming and therapeutics. At SIGGRAPH, NVIDIA researchers will also present papers about 3D neural tools for surface reconstruction from point clouds and interactive shape editing, plus 2D tools for AI to better understand gaps in vector sketches and improve the visual quality of time-lapse videos.
Bringing Virtual Reality to Lightweight Glasses Most virtual reality users access 3D digital worlds by putting on bulky head-mounted displays, but researchers are working on lightweight alternatives that resemble standard eyeglasses.
A collaboration between NVIDIA and Stanford researchers has packed the technology needed for 3D holographic images into a wearable display just a couple millimeters thick. The 2.5-millimeter display is less than half the size of other thin VR displays, known as pancake lenses, which use a technique called folded optics that can only support 2D images.
The researchers accomplished this feat by approaching display quality and display size as a computational problem, and co-designing the optics with an AI-powered algorithm.
While prior VR displays require distance between a magnifying eyepiece and a display panel to create a hologram, this new design uses a spatial light modulator, a tool that can create holograms right in front of the user's eyes, without needing this gap. Additional components - a pupil-replicating waveguide and geometric phase lens - further reduce the device's bulkiness.
It's one of two VR collaborations between Stanford and NVIDIA at the conference, with another paper proposing a new computer-generated holography framework that improves image quality while optimizing bandwidth usage. A third paper in this field of display and perception research, co-authored with New York University and Princeton University scientists, measures how rendering quality affects the speed at which users react to on-screen information.
Lightbulb Moment: New Levels of Real-Time Lighting Complexity Accurately simulating the pathways of light in a scene in real time has always been considered the holy grail of graphics. Work detailed in a paper by the University of Utah's School of Computing and NVIDIA is raising the bar, introducing a path resampling algorithm that enables real-time rendering of scenes with complex lighting, including hidden light sources.
Think of walking into a dim room, with a glass vase on a table illuminated indirectly by a street lamp located outside. The glossy surface creates a long light path, with rays bouncing many times between the light source and the viewer's eye. Computing these light paths is usually too complex for real-time applications like games, so it's mostly done for films or other offline rendering applications.
This paper highlights the use of statistical resampling techniques - where the algorithm reuses computations thousands of times while tracing these complex light paths - during rendering to approximate the light paths efficiently in real time. The researchers applied the algorithm to a classic challenging scene in computer graphics, pictured below: an indirectly lit set of teapots made of metal, ceramic and glass.
Related NVIDIA-authored papers at SIGGRAPH include a new sampling strategy for inverse volume rendering, a novel mathematical representation for 2D shape manipulation, software to create samplers with improved uniformity for rendering and other applications, and a way to turn biased rendering algorithms into more efficient unbiased ones.
Neural Rendering: NeRFs, GANs Power Synthetic Scenes Neural rendering algorithms learn from real-world data to create synthetic images - and NVIDIA research projects are developing state-of-the-art tools to do so in 2D and 3D.
In 2D, the StyleGAN-NADA model, developed in collaboration with Tel Aviv University, generates images with specific styles based on a user's text prompts, without requiring example images for reference. For instance, a user could generate vintage car images, turn their dog into a painting or transform houses to huts:
And in 3D, rese
LINK: | https://blogs.nvidia.com/blog/2022/05/04/siggraph-ai-graphics-research... |
See more stories from nvidia |
Most recent headlines
04/08/2024
Dalet Appoints Santiago Solanas as CEO to Lead Next Era of Growth and Innovation
Dalet, a leading technology and service provider for media-rich organizations, is excited to announce Santiago Solanas as its new Chief Executive Officer (CEO)....
03/06/2024
Dalet and Veritone Reach Agreement to Distribute, Transact and Monetize Media Archives
Dalet, a leading technology and service provider for media-rich organizations, a...
02/05/2024
Diamond Sports RSNs Go Dark On Comcast Systems
Bally Sports Regional Networks were taken off Comcast's systems on April 30 when their existing distribution agreement expired and Diamond Sports Group was ...
02/05/2024
Diamond Sports Group, DirecTV Renew Distribution Deal
SOUTHPORT, Conn. and EL SEGUNDO, Calif. Diamond Sports Group ( Diamond or the Company ) and DirecTV have announced that they have reached a multi-year renewal...
02/05/2024
Three Nexstar Stations to Become CW Affiliates
IRVING, Texas Nexstar Media Group has announced that its owned and operated television stations in Chicago, Illinois (DMA #3), Norfolk, Virginia (DMA #43), and ...
02/05/2024
FCC, FTC Ink Agreement to Cooperate on Net Neutrality Enforcement
WASHINGTON, D.C. The Federal Communications Commission and Federal Trade Commission have signed a Memorandum of Understanding to coordinate consumer protection ...
02/05/2024
Haivision Celebrates 20th Anniversary
MONTREAL Haivision Systems Inc. is marking its 20th anniversary by detailing some of the accomplishments and developments that have helped the company become a ...
02/05/2024
Agora Introduces Adaptive Video Optimization Technology
SANTA CLARA, Calif. Agora today unveiled its Adaptive Video Optimization (AVO) technology that uses machine learning to adjust parameters dynamically at every s...
02/05/2024
Study: Streaming Market Is Saturated But Subscriptions Continue to Grow
NEW YORK Kantar has released a new study showing the U.S. streaming market has hit a saturation point, with the household penetration rate stagnating and at nea...
02/05/2024
Samba TV To Spotlight New Capabilities For Generative AI Ad Solution
NEW YORK Samba TV is debuting new capabilities for Samba AI, the company's suite of generative AI technologies, at the 2024 IAB (Interactive Advertising Bur...
02/05/2024
GSTV Pumps Up Research, Programming at NewFront
GSTV, the network that programs screens at gas stations, will be talking about new research and new programming at its NewFront presentation Wednesday....
02/05/2024
May 01, 2024
New technique improves T cell-based immunotherapies for solid tumors Scripps Research scientists help T cells more effectively kill solid tumors cells in vitro ...
01/05/2024
Release Rundown: What to Watch in May, From I Saw the TV Glow to Power
Owen (Justice Smith) and Maddy (Brigette Lundy-Paine) develop an eerie connection to a supernatural TV show in Jane Schoebrun's I Saw the TV Glow....
01/05/2024
Celebrate May the 4th With Special Star Wars' Playlists, Audiobooks, and More
Spotify's Star Wars celebrations are in full Force starting today, and this ...
01/05/2024
Spotify's New Hardcore Gardening Playlist and Brain Dead Collab Will Rattle Greenhouses Everywhere
All around the world, millions of Spotify fans love listening to hardcore punk m...
01/05/2024
THE CALL FOR THE FIFTH PRESIDENTIAL EMPLOYMENT STIMULUS PROGRAMME (PESP5) FOCUSED ON THE AUDIO-VISUAL INDUSTRY, IS OPEN.
THE CALL FOR THE FIFTH PRESIDENTIAL EMPLOYMENT STIMULUS PROGRAMME (PESP5) FOCUSE...
01/05/2024
QTAKE Pioneers Live 3D Stream to Apple Vision Pro
QTAKE, the leading video assist and on-set collaboration software trusted by professional filmmakers worldwide, launched a new cutting-edge feature at NAB 2024....
01/05/2024
LA County Opens Entertainment Business Interruption Fund Grant Program for Small Business, LAEDC Offers Updates
In HPA's ongoing focus on providing input and insight from city and county g...
01/05/2024
Trailblazing AI Storytelling by Empowering Storytellers: Curious Refuge
HPA Newsline had the opportunity to speak with Caleb and Shelby Ward, founders of Curious Refuge. Caleb and Shelby were participants in the 2024 HPA Tech Retrea...
01/05/2024
Supporting Global Air Traffic Modernization through Managed Services Infrastructure
L3Harris works with air navigation service providers who efficiently manage air ...
01/05/2024
Q&A with Scott Alexander, Aerojet Rocketdyne's new Missile Solutions President
Scott Alexander, Missile Solutions President, Aerojet Rocketdyne...
01/05/2024
Comcast: More Than Half of Viewers Frustrated About Finding Content
NEW YORK Just over half of U.S. viewers are frustrated over their ability to be able to find content to watch on TV according to Comcast....
01/05/2024
Bally RSNs Go Dark On Comcast Systems
Bally Sports Regional Networks were taken off Comcast's systems on April 30 when their existing distribution agreement expired and Diamond Sports Group was ...
01/05/2024
NXTGENbps powers Molinare's Notorious DIT
NXTGENbps battery solutions are designed to replace diesel generators and offer silent, emission-free power for various applications in film, TV, outside broadc...
01/05/2024
Elodie Ichter Joins Light Iron as Senior Colorist
Light Iron, the post-production creative-services division of Panavision, is excited to announce that lodie Ichter has joined the company's artist roster a...
01/05/2024
CJP presents live mo-cap demos at MPTS
CJP Broadcast Service Solutions, systems integration, production and content digitisation specialist, will feature live motion capture demonstrations at the 202...
01/05/2024
Media Links Partners with Sunteq for Representation in S...
Media Links, manufacturer and pioneer in Media over IP transport technology, has partnered with Sunteq spol s.r.o., a leading reseller located in Slovakia to st...
01/05/2024
Dot Group Showcases Enhanced Data Management and Sustaina...
Dot Group, a leader in cutting-edge data management solutions and the premier European reseller of critical Broadcast supporting IBM technologies, will demonstr...
01/05/2024
Glensound shows the latest in IP audio at MPTS
Glensound, industry leader in high quality audio systems, is showcasing the latest additions to its extensive portfolio of networked audio products at MPTS. Aud...
01/05/2024
Hitomi Broadcast to demonstrate ST2110 MatchBox at MPTS
Hitomi Broadcast, a leader in audio/video alignment and latency solutions, will be demonstrating advancements in SMPTE ST2110 workflows ensuring broadcasters ha...
01/05/2024
Leading UK vendors join in the CABSAT 30th anniversary ce...
Taking a leading role in the 30th anniversary CABSAT exposition (Dubai World Trade Centre, 21 23 May), the GREAT Britain and Northern Ireland pavilion will fe...
01/05/2024
NXTGENbps Powers Notorious DITs Green Energy Initiative w...
NXTGENbps, a pioneer in green energy solutions, proudly announces its partnership with Notorious DIT, a leading provider of digital imaging technology services ...
01/05/2024
Videosys Broadcast Brings Pan and Tilt To Coverage Of The...
As Cambridge celebrated its double win over Oxford in the 2024 Boat Race, behind the scenes celebrations were also taking place at Videosys Broadcast to mark th...
01/05/2024
Live After 5' summer concert series returns to downtown Raleigh
A popular - and free - summer concert series is coming back to downtown Raleigh! WRAL is proudly partnering with Downtown Raleigh Alliance for its Live After ...
01/05/2024
Cadent Launches Performance TV To Boost Omnichannel Ad Results
Cadent said it launched Performance TV, designed to increase the effectiveness of campaign by combining the reach of traditional linear TV with the targeting of...
01/05/2024
Eric Johnson, KOMO Seattle Anchor, Sets Retirement
Eric Johnson, anchor at KOMO Seattle, will retire as of June 6. Johnson anchors the 5 and 6 p.m. weekday newscasts and writes/produces/hosts Eric's Heroes,...
01/05/2024
T-Mobile Dials Deeper Into Ad Business With Retail Network (NewFronts)
T-Mobile said it is expanding its advertising business, creating an in-store retail media network and adding Plex, the video streaming platform for its footprin...
01/05/2024
Samsung Ads Expands AI Tools To Target Streaming Viewers (NewFronts)
Samsung Ads said it was introducing new opportunities for advertisers to use data about its viewers to target viewers across the full marketing funnel at its Ne...
01/05/2024
Samsung TV Plus Swings for the Fences With Streaming Sports Channels (NewFronts)
Samsung's ad-supported streaming platform Samsung TV Plus is putting more sports in its lineup with free channels about baseball, golf, hockey, auto racing ...
01/05/2024
Dan Rather Documentary Offers Open-Book' Look at Newsman
Rather, a documentary about famed newsman Dan Rather, premieres on Netflix May 1. The film looks at his rise to prominence in TV news, including his work coveri...
01/05/2024
Ken Wayne, KRON San Francisco Anchor, Retires Next Month
Ken Wayne, evening anchor at KRON San Francisco, is retiring after 33 years in Bay Area television. He was born in Marin County, started his journalism career a...
01/05/2024
Jeff Blaszak Promoted To Senior VP at ShowSeeker
ShowSeeker, the company behind the Pilot cloud-based order management system, said it promoted Jeff Blaszak to senior VP of business operations and strategy....
01/05/2024
Great American Media Picks VideoAmp As Ad Currency
Great American Media said it reached an agreement with VideoAmp that will enable clients to use VideoAmp's ad buying measurement and data capabilities when ...
01/05/2024
NXTGENbps powers Molinaire's Notorious DIT
NXTGENbps battery solutions are designed to replace diesel generators and offer silent, emission-free power for various applications in film, TV, outside broadc...
01/05/2024
Amazon CEO: AWS has multi-billion dollar revenue run rate in AI already
Sales rose to $25bn during the first three months of 2024, up 17 per cent year-on-year By Matthew Corrigan Published: May 1, 2024 Sales rose to $25bn duri...
01/05/2024
Roku to Offer NBC Olympics Zone
NEW YORK NBCUniversal and Roku are teaming up to offer the NBC Olympic Zone on Roku, a new destination on the Roku Home Screen Menu. The dedicated channel wil...
01/05/2024
U.K.'s Freely Officially Launches
Freely the new streaming service backed by Britain's leading broadcasters BBC, ITV, Channel 4 and Channel 5 is now available through the next generation of ...
01/05/2024
Study: FAST Channel Growth Accelerates
NEW YORK A new report on free, ad-supported streaming channels indicates that their growth continues to accelerate, with the number of channels hours views and ...
01/05/2024
VuWall Unveils New Capabilities For VuStream 150 Video Encoder
MONTREAL VuWall has enhanced its VuStream 150 H.264 video encoder with new features and capabilities, including support for HDMI signals at resolutions up to 38...
01/05/2024
Samsung TV Plus Announces New High-Profile FAST Channels for Sports
NEW YORK At the IAB NewFronts 2024, Samsung Ads announced a new lineup of premium sports, music, family and entertainment content on its leading FAST service Sa...