Sony Pixel Power calrec Sony

Startup Helps Surgeons Target Breast Cancers With AI-Powered 3D Visualizations

31/10/2024

A new AI-powered, imaging-based technology that creates accurate three-dimensional models of tumors, veins and other soft tissue offers a promising new method to help surgeons operate on, and better treat, breast cancers.

The technology, from Illinois-based startup SimBioSys, converts routine black-and-white MRI images into spatially accurate, volumetric images of a patient's breasts. It then illuminates different parts of the breast with distinct colors - the vascular system, or veins, may be red; tumors are shown in blue; surrounding tissue is gray.

Surgeons can then easily manipulate the 3D visualization on a computer screen, gaining important insight to help guide surgeries and influence treatment plans. The technology, called TumorSight Viz, calculates key surgery-related measurements, including a tumor's volume and how far tumors are from the chest wall and nipple.

It also provides key data about a tumor's volume in relation to a breast's overall volume, which can help determine - before a procedure begins - whether surgeons should try to preserve a breast or choose a mastectomy, which often presents cosmetic and painful side effects. Last year, TumorSight received FDA clearance.

Across the world, nearly 2.3 million women are diagnosed with breast cancer each year, according to the World Health Organization. Every year, breast cancer is responsible for the deaths of more than 500,000 women. Around 100,000 women in the U.S. annually undergo some form of mastectomy, according to the Brigham and Women's Hospital.

According to Jyoti Palaniappan, chief commercial officer at SimBioSys, the company's visualization technology offers a step-change improvement over the kind of data surgeons typically see before they begin surgery.

Typically, surgeons will get a radiology report, which tells them, Here's the size and location of the tumor,' and they'll get one or two pictures of the patient's tumor, said Palaniappan. If the surgeon wants to get more information, they'll need to find the radiologist and have a conversation with them - which doesn't always happen - and go through the case with them.

Dr. Barry Rosen, the company's chief medical officer, said one of the technology's primary goals is to uplevel and standardize presurgical imaging, which he believes can have broad positive impacts on outcomes.

We're trying to move the surgical process from an art to a science by harnessing the power of AI to improve surgical planning, Dr. Rosen said.

SimBioSys uses NVIDIA A100 Tensor Core GPUs in the cloud for pretraining its models. It also uses NVIDIA MONAI for training and validation data, and NVIDIA CUDA-X libraries including cuBLAS and MONAI Deploy to run its imaging technology. SimBioSys is part of the NVIDIA Inception program for startups.

SimBioSys is already working on additional AI use cases it hopes can improve breast cancer survival rates.

It has developed a novel technique to reconcile MRI images of a patient's breasts, taken when the patient is lying face down, and converts those images into virtual, realistic 3D visualizations that show how the tumor and surrounding tissue will appear during surgery - when a patient is lying face up.

This 3D visualization is especially relevant for surgeons so they can visualize what a breast and any tumors will look like once surgery begins.

To create this imagery, the technology calculates gravity's impact on different kinds of breast tissue and accounts for how different kinds of skin elasticity impact a breast's shape when a patient is lying on the operating table.

The startup is also working on a new strategy that also relies on AI to quickly provide insights that can help determine the risk of recurrence to support providers in determining the best treatment to avoid cancer recurrence.

Currently, hospital labs run pathology tests on tumors that surgeons have removed. The biopsies are then sent to a different outside lab, which conducts a more comprehensive molecular analysis.

This process routinely takes up to six weeks. Without knowing how aggressive a cancer in the removed tumor is, or how that type of cancer might respond to different treatments, patients and doctors are unable to quickly chart out treatment plans to avoid recurrence.

SimBioSys's new technology uses an AI model to analyze the 3D volumetric features of the just-removed tumor, the hospital's initial tumor pathology report and a patient's demographic data. From that information, SimBioSys generates - in a matter of hours - a risk analysis for that patient's cancer, which can help doctors quickly determine the best treatment to avoid recurrence.

According to SimBioSys's Palaniappan, the startup's new method matches or exceeds the risk of recurrence scoring ability of more traditional methodologies, based upon its internal studies. It also takes a fraction of the time of these other methods while costing far less money.
LINK: https://blogs.nvidia.com/blog/simbiosys-3d-visualizations-breast-cance...
See more stories from nvidia

More from Nvidia

04/11/2025

Deutsche Telekom and NVIDIA Launch Industrial AI Cloud - a New Era' for Germany's Industrial Transformation

In Berlin on Tuesday, Deutsche Telekom and NVIDIA unveiled the world's first...

04/11/2025

How NVIDIA GeForce RTX GPUs Power Modern Creative Workflows

When inspiration strikes, nothing kills momentum faster than a slow tool or a frozen timeline. Creative apps should feel fast and fluid - an extension of imagin...

03/11/2025

NVIDIA Partners Bring Physical AI, New Smart City Technologies to Dublin, Ho Chi Minh City, Raleigh and More

Two out of every three people are likely to be living in cities or other urban c...

31/10/2025

Korea Joins AI Industrial Revolution: NVIDIA CEO Jensen Huang Unveils Historic Partnership at APEC Summit

Amidst Gyeongju, South Korea's ancient temples and modern skylines, Jensen H...

30/10/2025

AI-Powered Mobile Clinics Deliver Breast Cancer Screening to India's Rural Communities

An unassuming van driving around rural India uses powerful AI technology that...

30/10/2025

Join the Resistance: ARC Raiders' Launches in the Cloud

Get ready, raiders - the wait is over. ARC Raiders is dropping onto GeForce NOW and bringing the fight from orbit to the screen. To celebrate the launch, gamer...

29/10/2025

Into the Omniverse: Open World Foundation Models Generate Synthetic Worlds for Physical AI Development

Editor's note: This post is part of Into the Omniverse, a series focused on ...

28/10/2025

NVIDIA and US Technology Leaders Unveil AI Factory Design to Modernize Government and Secure the Nation

Governments everywhere are racing to harness the power of AI - but legacy infras...

28/10/2025

NVIDIA IGX Thor Robotics Processor Brings Real-Time Physical AI to the Industrial and Medical Edge

AI is moving from the digital world into the physical one. Across factory floors...

28/10/2025

NVIDIA Open Sources Aerial Software to Accelerate AI-Native 6G

NVIDIA is delivering the telecom industry a major boost in open-source software for building AI-native 5G and 6G networks. NVIDIA Aerial software will soon be ...

28/10/2025

NVIDIA and General Atomics Advance Commercial Fusion Energy

The race to bottle a star now runs on AI. NVIDIA, General Atomics and a team of international partners have built a high-fidelity, AI-enabled digital twin for ...

28/10/2025

NVIDIA, NPS Commission the Navy's AI Flagship for Training Tomorrow's Leaders

Along the Pacific Ocean in Monterey, California, the Naval Postgraduate School (...

28/10/2025

Fueling Economic Development Across the US: How NVIDIA Is Empowering States, Municipalities and Universities to Drive Innovation

To democratize access to AI technology nationwide, AI education and deployment c...

28/10/2025

NVIDIA AI Physics Transforms Aerospace and Automotive Design, Accelerating Engineering by 500x

Leading technology companies in aerospace and automotive are accelerating their ...

26/10/2025

NVIDIA Contributes to Open Frameworks for Next-Generation Robotics Development

This year's ROSCon conference heads to Singapore, bringing together the global robotics developer community behind Robot Operating System (ROS) - the world&...

24/10/2025

NVIDIA GTC DC: Live Updates on What's Next in AI

Monday, Oct. 27, 12:30 p.m. How Medium-Sized Cities Are Tackling AI Readiness L to R: Mark Muro, senior fellow at Brookings Metro; Micah Runner, city manag...

23/10/2025

Fangs Out, Frames Up: Vampire: The Masquerade - Bloodlines 2' Leads a Killer GFN Thursday

The nights grow longer and the shadows get bolder with Vampire The Masquerade: B...

21/10/2025

UC Santa Cruz Maps Coastal Flooding With NVIDIA Accelerated Computing

Coastal communities in the U.S. have a 26% chance of flooding within a 30-year period. This percentage is expected to increase due to climate-change-driven sea-...

20/10/2025

NVIDIA and Google Cloud Accelerate Enterprise AI and Industrial Digitalization

NVIDIA and Google Cloud are expanding access to accelerated computing to transform the full spectrum of enterprise workloads, from visual computing to agentic a...

17/10/2025

Open Source AI Week - How Developers and Contributors Are Advancing AI Innovation

As Open Source AI Week comes to a close, we're celebrating the innovation, c...

17/10/2025

The Engines of American-Made Intelligence: NVIDIA and TSMC Celebrate First NVIDIA Blackwell Wafer Produced in the US

AI has ignited a new industrial revolution. NVIDIA and TSMC are working togethe...

16/10/2025

Ready, Set, Reward - GeForce NOW Membership Rewards Await

GeForce NOW is more than just a platform to stream fresh games every week - it offers celebrations for the gamers who make it epic, with member rewards to sweet...

14/10/2025

NVIDIA and Oracle to Accelerate Enterprise AI and Data Processing

AI is transforming the way enterprises build, deploy and scale intelligent applications. As demand surges for enterprise-grade AI applications that offer speed,...

14/10/2025

Oracle and NVIDIA Accelerate Sovereign AI, Enabling Abu Dhabi's AI-Native Government Transformation

At Oracle AI World, NVIDIA and Oracle announced they are deepening their collabo...

13/10/2025

Elon Musk Gets Just-Launched NVIDIA DGX Spark: Petaflop AI Supercomputer Lands at SpaceX

The future of AI took flight at Starbase, Texas - where NVIDIA CEO Jensen Huang ...

13/10/2025

NVIDIA, Partners Drive Next-Gen Efficient Gigawatt AI Factories in Buildup for Vera Rubin

At the OCP Global Summit, NVIDIA is offering a glimpse into the future of gigawa...

09/10/2025

NVIDIA Blackwell Raises Bar in New InferenceMAX Benchmarks, Delivering Unmatched Performance and Efficiency

NVIDIA Blackwell swept the new SemiAnalysis InferenceMAX v1 benchmarks, deliveri...

09/10/2025

Microsoft Azure Unveils World's First NVIDIA GB300 NVL72 Supercomputing Cluster for OpenAI

Microsoft Azure today announced the new NDv6 GB300 VM series, delivering the ind...

09/10/2025

Incoming: Battlefield 6' Lands on GeForce NOW at Launch

Lock, load and stream - the battle is just beginning. EA's highly anticipated Battlefield 6 is set to storm the cloud when it launches tomorrow with GeForce...

08/10/2025

How AI-Powered Wireless Networks Will Revitalize US Global Leadership in Communications

Telecommunication networks are critical infrastructure for every nation, underpi...

02/10/2025

GeForce NOW Brings 17 Games to the Cloud in October for a Spooky Good Time

Editor's note: This blog has been updated to include an additional game for October, The Outer Worlds 2. October is creeping in with plenty of gaming treat...

01/10/2025

How to Get Started With Large Language Models on NVIDIA RTX PCs

Many users want to run large language models (LLMs) locally for more privacy and control, and without subscriptions, but until recently, this meant a trade-off ...

30/09/2025

How Quantum Computing's Biggest Challenges Are Being Solved With Accelerated Computing

Quantum computing promises to reshape industries - but progress hinges on solvin...

30/09/2025

Into the Omniverse: Open-Source Physics Engine and OpenUSD Advance Robot Learning

Editor's note: This blog is a part of Into the Omniverse, a series focused o...

25/09/2025

Pilots Wanted: Stream Mecha BREAK' on GeForce NOW

Suit up and head for the cloud. Mecha BREAK, the popular third-person shooter, is now available to stream on GeForce NOW with NVIDIA DLSS 4 technology. Catch i...

24/09/2025

Canada Goes All In on AI: NVIDIA Joins Nations' Technology Leaders in Montreal to Shape Sovereign AI Strategy

Canada's role as a leader in artificial intelligence was on full display at ...

24/09/2025

Open Secret: How NVIDIA Nemotron Models, Datasets and Techniques Fuel AI Development

Open technologies - made available to developers and businesses to adopt, modify...

23/09/2025

At Climate Week NYC, NVIDIA Details AI's Key Role in the Sustainable Energy Transition

Energy efficiency in large language model inference has improved 100,000x in the...

22/09/2025

NVIDIA, OpenAI Announce the Biggest AI Infrastructure Deployment in History'

OpenAI and NVIDIA just announced a landmark AI infrastructure partnership - an initiative that will scale OpenAI's compute with multi-gigawatt data centers ...

19/09/2025

AI On: How Onboarding Teams of AI Agents Drives Productivity and Revenue for Businesses

AI is no longer solely a back-office tool. It's a strategic partner that can...

18/09/2025

The UK's Goldilocks Moment for AI': NVIDIA, UK and US Leaders Highlight AI Infrastructure Investments

The U.K. was the center of the AI world this week as NVIDIA, U.K. and U.S. leade...

18/09/2025

GeForce NOW Unleashes Dying Light: The Beast' in the Cloud

GeForce NOW is packing a monstrous punch this week. Dying Light: The Beast, the latest adrenaline fueled chapter in Techland's parkour meets survival horror...

17/09/2025

Meet the Streamlabs Streaming Assistant, Accelerated by NVIDIA RTX

Today's creators are equal parts entertainer, producer and gamer, juggling game commentary, scene changes, replay clips, chat moderation and technical troub...

16/09/2025

The AI Makers: NVIDIA Partners in UK Advance Physical and Agentic AI, Robotics, Life Sciences and More

The U.K. is driving investments in sovereign AI, using the technology to advance...

13/09/2025

Reaching Across the Isles: UK-LLM Brings AI to UK Languages With NVIDIA Nemotron

Celtic languages - including Cornish, Irish, Scottish Gaelic and Welsh - are the U.K.'s oldest living languages. To empower their speakers, the UK-LLM sover...

10/09/2025

Paint It Blackwell: GeForce RTX 5080 SuperPOD Rollout Begins

GeForce NOW Blackwell RTX 5080-class SuperPODs are now rolling out, unlocking a new level of ultra high-performance, cinematic cloud gaming. GeForce NOW Ultima...

09/09/2025

NVIDIA Rubin CPX Accelerates Inference Performance and Efficiency for 1M+ Token Context Workloads

Inference has emerged as the new frontier of complexity in AI. Modern models are...

09/09/2025

NVIDIA Blackwell Ultra Sets New Inference Records in MLPerf Debut

As large language models (LLMs) grow larger, they get smarter, with open models from leading developers now featuring hundreds of billions of parameters. At the...

09/09/2025

NVIDIA Partners With AI Infrastructure Ecosystem to Unveil Reference Design for Giga-Scale AI Factories

At this week's AI Infrastructure Summit in Silicon Valley, NVIDIA's VP o...

09/09/2025

NVIDIA Blackwell Ultra Sets the Bar in New MLPerf Inference Benchmark

Inference performance is critical, as it directly influences the economics of an AI factory. The higher the throughput of AI factory infrastructure, the more to...