Sony Pixel Power calrec Sony

Startup Helps Surgeons Target Breast Cancers With AI-Powered 3D Visualizations

31/10/2024

A new AI-powered, imaging-based technology that creates accurate three-dimensional models of tumors, veins and other soft tissue offers a promising new method to help surgeons operate on, and better treat, breast cancers.

The technology, from Illinois-based startup SimBioSys, converts routine black-and-white MRI images into spatially accurate, volumetric images of a patient's breasts. It then illuminates different parts of the breast with distinct colors - the vascular system, or veins, may be red; tumors are shown in blue; surrounding tissue is gray.

Surgeons can then easily manipulate the 3D visualization on a computer screen, gaining important insight to help guide surgeries and influence treatment plans. The technology, called TumorSight Viz, calculates key surgery-related measurements, including a tumor's volume and how far tumors are from the chest wall and nipple.

It also provides key data about a tumor's volume in relation to a breast's overall volume, which can help determine - before a procedure begins - whether surgeons should try to preserve a breast or choose a mastectomy, which often presents cosmetic and painful side effects. Last year, TumorSight received FDA clearance.

Across the world, nearly 2.3 million women are diagnosed with breast cancer each year, according to the World Health Organization. Every year, breast cancer is responsible for the deaths of more than 500,000 women. Around 100,000 women in the U.S. annually undergo some form of mastectomy, according to the Brigham and Women's Hospital.

According to Jyoti Palaniappan, chief commercial officer at SimBioSys, the company's visualization technology offers a step-change improvement over the kind of data surgeons typically see before they begin surgery.

Typically, surgeons will get a radiology report, which tells them, Here's the size and location of the tumor,' and they'll get one or two pictures of the patient's tumor, said Palaniappan. If the surgeon wants to get more information, they'll need to find the radiologist and have a conversation with them - which doesn't always happen - and go through the case with them.

Dr. Barry Rosen, the company's chief medical officer, said one of the technology's primary goals is to uplevel and standardize presurgical imaging, which he believes can have broad positive impacts on outcomes.

We're trying to move the surgical process from an art to a science by harnessing the power of AI to improve surgical planning, Dr. Rosen said.

SimBioSys uses NVIDIA A100 Tensor Core GPUs in the cloud for pretraining its models. It also uses NVIDIA MONAI for training and validation data, and NVIDIA CUDA-X libraries including cuBLAS and MONAI Deploy to run its imaging technology. SimBioSys is part of the NVIDIA Inception program for startups.

SimBioSys is already working on additional AI use cases it hopes can improve breast cancer survival rates.

It has developed a novel technique to reconcile MRI images of a patient's breasts, taken when the patient is lying face down, and converts those images into virtual, realistic 3D visualizations that show how the tumor and surrounding tissue will appear during surgery - when a patient is lying face up.

This 3D visualization is especially relevant for surgeons so they can visualize what a breast and any tumors will look like once surgery begins.

To create this imagery, the technology calculates gravity's impact on different kinds of breast tissue and accounts for how different kinds of skin elasticity impact a breast's shape when a patient is lying on the operating table.

The startup is also working on a new strategy that also relies on AI to quickly provide insights that can help determine the risk of recurrence to support providers in determining the best treatment to avoid cancer recurrence.

Currently, hospital labs run pathology tests on tumors that surgeons have removed. The biopsies are then sent to a different outside lab, which conducts a more comprehensive molecular analysis.

This process routinely takes up to six weeks. Without knowing how aggressive a cancer in the removed tumor is, or how that type of cancer might respond to different treatments, patients and doctors are unable to quickly chart out treatment plans to avoid recurrence.

SimBioSys's new technology uses an AI model to analyze the 3D volumetric features of the just-removed tumor, the hospital's initial tumor pathology report and a patient's demographic data. From that information, SimBioSys generates - in a matter of hours - a risk analysis for that patient's cancer, which can help doctors quickly determine the best treatment to avoid recurrence.

According to SimBioSys's Palaniappan, the startup's new method matches or exceeds the risk of recurrence scoring ability of more traditional methodologies, based upon its internal studies. It also takes a fraction of the time of these other methods while costing far less money.
LINK: https://blogs.nvidia.com/blog/simbiosys-3d-visualizations-breast-cance...
See more stories from nvidia

More from Nvidia

30/04/2026

It's Gonna Be May: 16 Games Hit the Cloud This Month, With More NVIDIA GeForce RTX 5080 Power

It's gonna be May - and the cloud's in full festival mode. 16 games ar...

28/04/2026

Into the Omniverse: Manufacturing's Simulation-First Era Has Arrived

Editor's note: This post is part of Into the Omniverse, a series focused on how developers, 3D practitioners, and enterprises can transform their workflows ...

28/04/2026

NVIDIA Launches Nemotron 3 Nano Omni Model, Unifying Vision, Audio and Language for up to 9x More Efficient AI Agents

AI agent systems today juggle separate models for vision, speech and language - ...

23/04/2026

OpenAI's New GPT-5.5 Powers Codex on NVIDIA Infrastructure - and NVIDIA Is Already Putting It to Work

AI agents have revolutionized developer workflows, and their next frontier is kn...

23/04/2026

Tag, You're It: GeForce NOW Levels Up Game Discovery With Xbox Game Pass and Ubisoft+ Labels

GeForce NOW is doubling down on what matters most: gamers. This week's upgra...

22/04/2026

NVIDIA and Google Cloud Collaborate to Advance Agentic and Physical AI

NVIDIA and Google Cloud have collaborated for more than a decade, co engineering a full stack AI platform that spans every technology layer - from performance o...

20/04/2026

NVIDIA and Partners Showcase the Future of AI-Driven Manufacturing at Hannover Messe 2026

Manufacturing is at an inflection point. Across every major industrial economy, ...

20/04/2026

Autonomous AI at Scale: Adobe Agents Unlock Breakthrough Creative Intelligence With NVIDIA and WPP

AI agents are transforming how work gets done across all industries, acceleratin...

16/04/2026

No Need for Space Gear - Capcom's PRAGMATA' Joins GeForce NOW on Launch Day

Head straight for orbit with GeForce NOW - no space helmet required. PRAGMATA,...

15/04/2026

Rethinking AI TCO: Why Cost per Token Is the Only Metric That Matters

Traditional data centers only stored, retrieved and processed data. In the generative and agentic AI era, these facilities have evolved into AI token factories....

15/04/2026

New Adobe Premiere Color Grading Mode Accelerated on NVIDIA GPUs

The NAB Show 2026 trade show, running April 18-22 in Las Vegas, is set to showcase a wave of new features and optimizations for top video editing applications. ...

09/04/2026

Strength and Destiny Collide: Samson: A Tyndalston Story' Arrives in the Cloud

A timeless story of grit, faith and rebellion takes center stage as Samson: A Ty...

02/04/2026

From RTX to Spark: NVIDIA Accelerates Gemma 4 for Local Agentic AI

Open models are driving a new wave of on-device AI, extending innovation beyond the cloud to everyday devices. As these models advance, their value increasingly...

02/04/2026

Press Start on April: GeForce NOW Brings 10 Games to the Cloud

No joke - GFN Thursday is skipping the tricks and heading straight into the games. April kicks off with ten new titles, bringing fresh adventures to GeForce NOW...

31/03/2026

Efficiency at Scale: NVIDIA, Energy Leaders Accelerating PowerFlexible AI Factories to Fortify the Grid

CERAWeek - dubbed the Davos of energy - is where policymakers, producers, techno...

26/03/2026

Into the Omniverse: NVIDIA GTC Showcases Virtual Worlds Powering the Physical AI Era

Editor's note: This post is part of Into the Omniverse, a series focused on ...

26/03/2026

Game On: Five New Titles Now Streaming on GeForce NOW

That gaming backlog won't clear itself - GeForce NOW is here to help. Stream the latest titles straight from the cloud across a variety of devices. This we...

25/03/2026

The Future of AI Is Open and Proprietary

AI is the defining technology of our time, quickly becoming core business infrastructure. It's fueled by a diverse ecosystem of models: large and small, ope...

25/03/2026

Blowing Off Steam: How Power-Flexible AI Factories Can Stabilize the Global Energy Grid

At the half-time whistle of the UEFA EURO 2020 round of 16 football match betwee...

24/03/2026

Advancing Open Source AI, NVIDIA Donates Dynamic Resource Allocation Driver for GPUs to Kubernetes Community

Artificial intelligence has rapidly emerged as one of the most critical workload...

23/03/2026

How Autonomous AI Agents Become Secure by Design With NVIDIA OpenShell

Autonomous agents mark a new inflection point in AI. Systems are no longer limited to generating responses or reasoning through tasks. They can take action: Age...

19/03/2026

Smooth Moves: 90 Frames-Per-Second Virtual Reality Arrives on GeForce NOW

It's a double feature on GFN Thursday. This week, GeForce NOW offers smoother sights in virtual reality (VR) and a sprawling new land to conquer. Streaming...

17/03/2026

NVIDIA, Telecom Leaders Build AI Grids to Optimize Inference on Distributed Networks

As AI native applications scale to more users, agents and devices, the telecommu...

17/03/2026

Snap Decisions: How Open Libraries for Accelerated Data Processing Boost A/B Testing for Snapchat

The features on social media apps like Snapchat evolve nearly as fast as what...

17/03/2026

GTC Spotlights NVIDIA RTX PCs and DGX Sparks Running Latest Open Models and AI Agents Locally

The paradigm of consumer computing has revolved around the concept of a personal...

12/03/2026

Into the Omniverse: How Industrial AI and Digital Twins Accelerate Design, Engineering and Manufacturing Across Industries

Editor's note: This post is part of Into the Omniverse, a series focused on ...

12/03/2026

GeForce NOW Raises the Game at the Game Developers Conference

GeForce NOW is bringing the game to the Game Developers Conference (GDC), running this week in San Francisco. While developers build the future of gaming, GeFor...

11/03/2026

New NVIDIA Nemotron 3 Super Delivers 5x Higher Throughput for Agentic AI

Launched today, NVIDIA Nemotron 3 Super is a 120 billion parameter open model with 12 billion active parameters designed to run complex agentic AI systems at sc...

10/03/2026

NVIDIA and ComfyUI Streamline Local AI Video Generation for Game Developers and Creators at GDC

Game developers and artists are building cinematic worlds and iconic characters ...

10/03/2026

NVIDIA Virtualizes Game Development With RTX PRO Server

Game development teams are working across larger worlds, more complex pipelines and more distributed teams than ever. At the same time, many studios still rely ...

10/03/2026

As Open Models Spark AI Boom, NVIDIA Jetson Brings It to Life at the Edge

The Cat 306 CR mini-excavator weighs just under eight tons and fits inside a standard shipping container. It's the machine a contractor rents when the job s...

10/03/2026

NVIDIA and Thinking Machines Lab Announce Long-Term Gigawatt-Scale Strategic Partnership

NVIDIA and Thinking Machines Lab announced today a multiyear strategic partnersh...

09/03/2026

How AI Is Driving Revenue, Cutting Costs and Boosting Productivity for Every Industry in 2026

AI is everywhere and accelerating everything - becoming essential infrastructure...

09/03/2026

ABB Robotics Taps NVIDIA Omniverse to Deliver IndustrialGrade Physical AI at Scale

ABB Robotics and NVIDIA today announced a breakthrough partnership that brings i...

05/03/2026

March Into the Cloud With 15 New Games Coming to GeForce NOW

March is in full bloom, and that means a fresh wave of games heading to the cloud. 15 new titles are joining the GeForce NOW library this month. Leading the Ma...

28/02/2026

NVIDIA and Partners Show That Software-Defined AI-RAN Is the Next Wireless Generation

AI-RAN is moving from lab to field, showing that a software-defined approach is ...

28/02/2026

NVIDIA Advances Autonomous Networks With Agentic AI Blueprints and Telco Reasoning Models

Autonomous networks - intelligent, self-managing telecommunications operations -...

26/02/2026

The Nightmare Returns in the Cloud: GeForce NOW Unleashes Capcom's Resident Evil Requiem'

GeForce NOW's anniversary celebration reaches a chilling crescendo as Capcom...

26/02/2026

Horror Awakens in the Cloud: GeForce NOW Unleashes Capcom's Resident Evil: Requiem'

GeForce NOW's anniversary celebration reaches a chilling crescendo as Capcom...

24/02/2026

From Radiology to Drug Discovery, Survey Reveals AI Is Delivering Clear Return on Investment in Healthcare

AI is accelerating every aspect of healthcare - from radiology and drug discover...

23/02/2026

NVIDIA Brings AI-Powered Cybersecurity to World's Critical Infrastructure

As technologies and systems become more digitalized and connected across the world, operational technology (OT) environments and industrial control systems (ICS...

19/02/2026

All About the Games: Play Over 4,500 Titles With GeForce NOW

The GeForce NOW anniversary celebration keeps on rolling, and this week is all about the games that make it possible. With more than 4,500 titles supported in t...

19/02/2026

Survey Reveals AI Advances in Telecom: Networks and Automation in Driver's Seat as Return on Investment Climbs

AI is accelerating the telecommunications industry's transformation, becomin...

17/02/2026

NVIDIA and Global Industrial Software Leaders Partner With India's Largest Manufacturers to Drive AI Boom

India is entering a new age of industrialization, as AI transforms how the world...

17/02/2026

India Fuels Its AI Mission With NVIDIA

India is the nexus of AI innovation this week as the host of the AI Impact Summit, which brings together global heads of state and industry to chart the future ...

16/02/2026

New Data Shows NVIDIA Blackwell Ultra Delivers up to 50x Better Performance and 35x Lower Costs for Agentic AI

The NVIDIA Blackwell platform has been widely adopted by leading inference provi...

12/02/2026

NVIDIA DGX Spark Powers Big Projects in Higher Education

At leading institutions across the globe, the NVIDIA DGX Spark desktop supercomputer is bringing data center class AI to lab benches, faculty offices and studen...

12/02/2026

Leading Inference Providers Cut AI Costs by up to 10x With Open Source Models on NVIDIA Blackwell

A diagnostic insight in healthcare. A character's dialogue in an interactive...

12/02/2026

GeForce NOW Turns Screens Into a Gaming Machine

The GeForce NOW sixth-anniversary festivities roll on this February, continuing a monthlong celebration of NVIDIA's cloud gaming service. This week brings ...