Sony Pixel Power calrec Sony

Startup Helps Surgeons Target Breast Cancers With AI-Powered 3D Visualizations

31/10/2024

A new AI-powered, imaging-based technology that creates accurate three-dimensional models of tumors, veins and other soft tissue offers a promising new method to help surgeons operate on, and better treat, breast cancers.

The technology, from Illinois-based startup SimBioSys, converts routine black-and-white MRI images into spatially accurate, volumetric images of a patient's breasts. It then illuminates different parts of the breast with distinct colors - the vascular system, or veins, may be red; tumors are shown in blue; surrounding tissue is gray.

Surgeons can then easily manipulate the 3D visualization on a computer screen, gaining important insight to help guide surgeries and influence treatment plans. The technology, called TumorSight Viz, calculates key surgery-related measurements, including a tumor's volume and how far tumors are from the chest wall and nipple.

It also provides key data about a tumor's volume in relation to a breast's overall volume, which can help determine - before a procedure begins - whether surgeons should try to preserve a breast or choose a mastectomy, which often presents cosmetic and painful side effects. Last year, TumorSight received FDA clearance.

Across the world, nearly 2.3 million women are diagnosed with breast cancer each year, according to the World Health Organization. Every year, breast cancer is responsible for the deaths of more than 500,000 women. Around 100,000 women in the U.S. annually undergo some form of mastectomy, according to the Brigham and Women's Hospital.

According to Jyoti Palaniappan, chief commercial officer at SimBioSys, the company's visualization technology offers a step-change improvement over the kind of data surgeons typically see before they begin surgery.

Typically, surgeons will get a radiology report, which tells them, Here's the size and location of the tumor,' and they'll get one or two pictures of the patient's tumor, said Palaniappan. If the surgeon wants to get more information, they'll need to find the radiologist and have a conversation with them - which doesn't always happen - and go through the case with them.

Dr. Barry Rosen, the company's chief medical officer, said one of the technology's primary goals is to uplevel and standardize presurgical imaging, which he believes can have broad positive impacts on outcomes.

We're trying to move the surgical process from an art to a science by harnessing the power of AI to improve surgical planning, Dr. Rosen said.

SimBioSys uses NVIDIA A100 Tensor Core GPUs in the cloud for pretraining its models. It also uses NVIDIA MONAI for training and validation data, and NVIDIA CUDA-X libraries including cuBLAS and MONAI Deploy to run its imaging technology. SimBioSys is part of the NVIDIA Inception program for startups.

SimBioSys is already working on additional AI use cases it hopes can improve breast cancer survival rates.

It has developed a novel technique to reconcile MRI images of a patient's breasts, taken when the patient is lying face down, and converts those images into virtual, realistic 3D visualizations that show how the tumor and surrounding tissue will appear during surgery - when a patient is lying face up.

This 3D visualization is especially relevant for surgeons so they can visualize what a breast and any tumors will look like once surgery begins.

To create this imagery, the technology calculates gravity's impact on different kinds of breast tissue and accounts for how different kinds of skin elasticity impact a breast's shape when a patient is lying on the operating table.

The startup is also working on a new strategy that also relies on AI to quickly provide insights that can help determine the risk of recurrence to support providers in determining the best treatment to avoid cancer recurrence.

Currently, hospital labs run pathology tests on tumors that surgeons have removed. The biopsies are then sent to a different outside lab, which conducts a more comprehensive molecular analysis.

This process routinely takes up to six weeks. Without knowing how aggressive a cancer in the removed tumor is, or how that type of cancer might respond to different treatments, patients and doctors are unable to quickly chart out treatment plans to avoid recurrence.

SimBioSys's new technology uses an AI model to analyze the 3D volumetric features of the just-removed tumor, the hospital's initial tumor pathology report and a patient's demographic data. From that information, SimBioSys generates - in a matter of hours - a risk analysis for that patient's cancer, which can help doctors quickly determine the best treatment to avoid recurrence.

According to SimBioSys's Palaniappan, the startup's new method matches or exceeds the risk of recurrence scoring ability of more traditional methodologies, based upon its internal studies. It also takes a fraction of the time of these other methods while costing far less money.
LINK: https://blogs.nvidia.com/blog/simbiosys-3d-visualizations-breast-cance...
See more stories from nvidia

More from Nvidia

24/09/2026

How Open Science Can Help Researchers Prepare for the Next Pandemic

When COVID-19 emerged, scientists had a crucial advantage: Decades of prior research on coronaviruses meant they understood the virus' key proteins well eno...

24/09/2026

Contain the Chaos: CONTROL Resonant' Launches on GeForce NOW

A warped Manhattan is waiting in the cloud this week. Remedy Entertainment's CONTROL Resonant brings Dylan Faden's extraordinary abilities and a paranat...

23/09/2026

Sakeena Fiza Helps NVIDIA Hardware Succeed at Scale

When Sakeena Fiza describes her work as a validation engineer at NVIDIA, she does so in terms more befitting a detective story than a world-class engineering la...

22/09/2026

At AI Day Singapore, NVIDIA and Partners Showcase AI Advancements Across Southeast Asia

NVIDIA AI Day Singapore, which takes place Sept. 22-23 at the Raffles City Conve...

22/09/2026

NVIDIA Isaac ROS 5.0 Advances Agentic, Open Source Robotics Development

To build and deploy sophisticated robotics applications that can perceive, reason and act in dynamic environments, developers need new physical AI models and to...

21/09/2026

Why Deploying Physical AI at Scale Demands Safety at Every Layer

Physical AI is moving rapidly from research to large-scale deployment. By 2035, ABI Research projects an installed base of 49 million level 3-5 autonomous vehic...

21/09/2026

From Enablement to Execution, Egypt's AI Ecosystem Reaches Production Scale

Today, Egypt's AI builders gathered in the Grand Egyptian Museum for a reception that highlighted the nation's rapidly growing AI ecosystem - spanning A...

21/09/2026

NVIDIA Launches DSX Ready to Qualify Power and Cooling Products for AI Factories

Every AI factory needs power and cooling that fit its computing architecture. As AI infrastructure expands, power, cooling, water, site and grid constraints are...

21/09/2026

AI Security Is an Engineering Problem - How to Solve It at Every Layer of the Agent Stack

AI security is an engineering problem. That means defined security requirements,...

21/09/2026

5 Companies Using NVIDIA AI for Clean Energy

Clean energy isn't hard to come by, but the pace of large-scale adoption has historically been slow due to bottlenecks - including out-of-date infrastructur...

17/09/2026

Cute Critters Come to the Cloud: Aniimo' Launches on GeForce NOW

A new creature-catching adventure is ready to stream from the cloud this week. Pawprint Studio's Aniimo arrives on GeForce NOW at launch, inviting gamers to...

16/09/2026

NVIDIA Vera Rubin NVL72 Delivers Leading Performance in MLPerf Inference v6.1 Debut

System performance, efficient infrastructure scaling and continuous software opt...

16/09/2026

Emerald AI, Google and NVIDIA Launch Alliance to Advance Flexible AI Data Centers

AI factories are the infrastructure of the intelligence era. Scaling them respon...

15/09/2026

From Megawatts to Tokens: How NVIDIA Maximizes AI Factory Production

On a sweltering August evening in Silicon Valley, as the sun dropped and air conditioning loads spiked, Silicon Valley Power sent a signal to an AI factory to a...

15/09/2026

Now We Can Know Everything and Do Anything,' Jensen Huang Says at Dreamforce

Know everything. Do anything. That was the message NVIDIA founder and CEO Jensen Huang brought to Salesforce Dreamforce Tuesday, joining CEO Marc Benioff onsta...

15/09/2026

University of Manchester Uses NVIDIA Earth-2 to Forecast Air Pollution Across the UK

Air pollution is a serious public health risk, contributing to an estimated 30,0...

14/09/2026

Perplexity Portable Computer Is Now Available on Windows, Powered by NVIDIA RTX

As local models become more capable, AI agents can handle more work directly on a PC while keeping sensitive information on the device. Portable Computer is a ...

10/09/2026

Physical AI Takes the Wheel: How the World's Robotaxi Leaders Are Building With NVIDIA Technologies

The global robotaxi market - physical AI's first commercial breakthrough - i...

10/09/2026

Skild AI Taps NVIDIA Physical AI to Teach Robots New Tasks From a Single Video

Manufacturing floors, warehouses and production lines rarely stay fixed - tasks change, layouts shift and new products arrive, and most robots can't keep up...

10/09/2026

Boots on the Ground: WARDOGS' Goes All Out on GeForce NOW at Early-Access Launch

Gear up: The latest PC games and major updates are ready to play on GeForce NOW ...

10/09/2026

d-Matrix Adopts NVIDIA NVLink Fusion for Rack-Scale XPU Deployment

AI inference chipmaker d-Matrix today announced it will use NVLink Fusion to connect its next-generation Raptor XPUs to NVIDIA's AI infrastructure platform ...

09/09/2026

NVIDIA Brings Real-Time AI to Broadcast, Sports and Global Streaming at IBC

At the IBC conference, running Sept. 11-14 in Amsterdam, the creative, technology and business communities are coming together to turn ideas into action and dis...

03/09/2026

Sparks Fly: NVIDIA Accelerates Local AI at IFA 2026

Frontier intelligence is going local. At IFA 2026, NVIDIA, Microsoft and its partners are teaming up to provide faster inference and new tools that make agents ...

03/09/2026

NBA 2K27' With NVIDIA DLSS 5 Leads 26 New Games Coming to GeForce NOW

September is here with 28 more games streaming on GeForce NOW this month, led by a slam dunk: NBA 2K27 with the NVIDIA DLSS 5 3D-Guided Neural Rendering feature...

01/09/2026

NVIDIA and CrowdStrike Strengthen Agentic Cybersecurity Frontier

We're at an inflection point in cybersecurity, Jensen Huang told a sold-out crowd at CrowdStrike's Fal.Con 2026 in Las Vegas Tuesday. Attacks are now a...

27/08/2026

GeForce NOW Gives Gamers More Ways to Play at Gamescom 2026

NVIDIA's Gamescom announcements are revealing what's next for GeForce NOW, with new ways to play, more supported devices and platforms, and even more bi...

26/08/2026

NVIDIA NVLink Fusion Expands With NVHBM Custom High-Bandwidth Memory

The next wave of AI is placing new demands on infrastructure. As AI agents and trillion-parameter workloads become mainstream, the performance of AI infrastru...

25/08/2026

Leading Publishers Bring Blockbuster PC Games and Technology to NVIDIA RTX Spark

NVIDIA is bringing the next wave of RTX gaming to the Gamescom conference running this week in Cologne, Germany, with support for new games, anti-cheat technolo...

24/08/2026

Up to 30x More Work Per Watt: NVIDIA Vera Rubin NVL72 Sets a New Efficiency Standard for AI Agents

According to OpenRouter data, agentic AI workloads consume 15x more tokens than ...

24/08/2026

With Groq 3 LPX in Full Production, NVIDIA Extends Vera Rubin Inference for Agents

The next era of AI inference won't be defined by a single breakthrough chip,...

24/08/2026

How XPUs Meet a World-Class AI Factory

To generate intelligence at scale, AI factories run continuously, and their economics are defined by delivered output: tokens per second, tokens per watt, cost ...

20/08/2026

Bring the Fire: Play Games on GeForce NOW With New Firefox Browser Support

It's a new way into the cloud. GeForce NOW welcomes Firefox support to the cloud, opening up another way to jump into high-performance PC gaming straight ...

14/08/2026

Universitas Gadjah Mada, Indosat and NVIDIA Open Indonesia's First University AI Center to Develop Local AI Talent

Indonesia is taking charge of its AI future. This week, the Ministry of Communi...

13/08/2026

Class Is in Session: GeForce NOW Levels Up Linux, Chromebooks and More

GeForce NOW is giving cloud gaming an extra-credit upgrade just in time for back-to-school season. The native Linux app for GeForce NOW is officially out of be...

12/08/2026

NVIDIA CEO Tops Glassdoor's 2026 List of Best CEOs

NVIDIA founder and CEO Jensen Huang is ranked No. 1 on Glassdoor's Best CEOs list for 2026. In the just-released ranking, recognition is earned directly fr...

11/08/2026

NVIDIA AI Factory Compute Is Becoming an Investable Asset Class

We announced partnerships with Apollo, BlackRock, Blackstone, Brookfield, Goldman Sachs and KKR to establish independent financing platforms designed to mobiliz...

11/08/2026

Why Scaling AI Compute Performance Requires a New Power Architecture

Every new generation of accelerated computing demands more from the infrastructure underneath it - more compute performance, higher rack density and more effici...

11/08/2026

NVIDIA Nemotron 3.5 Lightning and NeMo Switchyard Deliver Faster, Smarter, More Efficient Agentic AI

As AI shifts from chatbots to autonomous agents, open models are serving market ...

11/08/2026

NVIDIA and Local AI Community Fuel Open Source Models and Intelligent Agents

The open source ecosystem is making it easier for AI enthusiasts and developers to build, customize and run increasingly capable agents locally. Throughout Au...

08/08/2026

Firebird Launches CIS Region's Largest AI Factory in Armenia

The global buildout of AI infrastructure reached a new milestone today - Firebird, an emerging AI cloud, launched the CIS region's largest AI factory in Arm...

06/08/2026

Into the Omniverse: How Open World Models Push the Frontier of Physical AI

Editor's note: This post is part of Into the Omniverse, a series focused on how developers, 3D practitioners and enterprises can transform their workflows u...

06/08/2026

GeForce NOW Shakes Up August With 26 New Games

August is here, bringing 26 new games for GeForce NOW members. Command the seas in World of Warships: Legends and discover what's next in the GeForce NOW ...

04/08/2026

As AI Increases Demands on Memory, Storage Steps Up

Surging AI demands are driving the need for massive datasets and context windows that burst past the confines of system memory. But rising needs aren't me...

04/08/2026

NVIDIA Alpamayo 2 Super, the Frontier Open Model for Robotaxis and Autonomous Vehicles, Now Available for Commercial Use

For robotaxis and other autonomous vehicles (AVs), the hardest problems aren'...

04/08/2026

AI Leaders Propose SAFE Guidelines for Cybersecurity Transparency

Members of the Open Secure AI Alliance - now more than 120 organizations strong - are developing new guidelines to strengthen agentic AI cybersecurity as the an...

30/07/2026

Best in Class: Stream PC Games and Study on the Same Laptop With GeForce NOW

Back to school means balancing assignments, deadlines and downtime. GeForce NOW makes it easy to have it all. With cloud gaming, everyday laptops used for clas...

28/07/2026

Powerful Compute So Compact, It's Clutch - Build AI in Your Hand With NVIDIA Jetson

As a discerning AI investor who values style and substance, Sarah Guo knows this...

27/07/2026

Industry Leaders Unite in Open Secure AI Alliance for AI Safety and Security

Open source software is a critical pillar of the global economy. It underpins cloud computing, financial services, manufacturing, telecommunications, government...

26/07/2026

NVIDIA Harnesses Vera CPU to Speed Up Design of Next-Generation CPUs and GPUs

The complexity of modern chip design continues to grow as engineering teams work to develop increasingly sophisticated CPUs, GPUs and AI systems. To help meet t...