
NVIDIA A100 Tensor Core GPUs running on Supermicro servers have captured leading results for inference in the latest STAC-ML Markets benchmark, a key technology performance gauge for the financial services industry.
The results show NVIDIA demonstrating unrivaled throughput - serving up thousands of inferences per second on the most demanding models - and top latency on the latest STAC-ML inference standard.
The results are closely followed by financial institutions, three-quarters of which rely on machine learning, deep learning or high performance computing, according to a recent survey.
NVIDIA A100: Top Latency Results The STAC-ML inference benchmark is designed to measure the latency of long short-term memory (LSTM) model inference - the time from receiving new input data until the model output is computed. LSTM is a key model approach used to discover financial time-series data like asset prices.
The benchmark includes three LSTM models of increasing complexity. NVIDIA A100 GPUs, running in a Supermicro Ultra SuperServer, demonstrated low latencies in the 99th percentile.
Accelerated Computing for STAC-ML and STAC-A2, STAC-A3 Benchmarks Considering the A100 performance on STAC-ML for inference - in addition to its record-setting performance in the STAC-A2 benchmark for option price discovery and the STAC-A3 benchmark for model backtesting - provides a glimpse at how NVIDIA AI computing can accelerate a pipeline of modern trading environments.
It also shows A100 GPUs deliver leading performance and workload versatility for financial institutions.
Predictable Performance for Consistent Low Latency Predictable performance is crucial for low-latency environments in finance, as extreme outliers can cause substantial losses during fast market moves.
Notably, there were no large outliers in NVIDIA's latency, as the maximum latency was no more than 2.3x the median latency across all LSTMs and the number of model instances, ranging up to 32 concurrent instances.1
NVIDIA is the first to submit performance results for what's known as the Tacana Suite of the benchmark. Tacana is for inference performed on a sliding window, where a new timestep is added and the oldest removed for each inference operation. This is helpful for high-frequency trading, where inference needs to be performed on every market data update.
A second suite, Sumaco, performs inference on an entirely new set of data, which reflects the use case where an event prompts inference based on recent history.
Leading Throughput in Benchmark Results NVIDIA also submitted a throughput-optimized configuration on the same hardware for the Sumaco Suite in FP16 precision.2
On the least complex LSTM in the benchmark, A100 GPUs on Supermicro servers helped serve up more than 1.7 million inferences per second.3
For the most complex LSTM, these systems handled as many as 12,800 inferences per second.4
NVIDIA A100: Performance and Versatility NVIDIA GPUs offer multiple advantages that lower the total cost of ownership for electronic trading stacks.
For one, NVIDIA AI provides a single platform for training and inference. Whether developing, backtesting or deploying an AI model, NVIDIA AI delivers leading performance - and developers don't need to learn different programming languages and frameworks for research and trading.
Moreover, the NVIDIA CUDA programming model enables development, optimization and deployment of applications across GPU-accelerated embedded systems, desktop workstations, enterprise data centers, cloud-based platforms and HPC supercomputers.
Efficiencies for Reduced Operating Expenses The financial services industry stands to benefit from not only data throughput advances but also improved operational efficiencies.
Reduced energy and square footage usage for systems in data centers can make a big difference in operating expenses. That's especially pressing as IT organizations make the case for budgetary outlays to cover new high-performance systems.
On the most demanding LSTM model, NVIDIA A100 exceeded 17,700 inferences per second per kilowatt while consuming 722 watts, offering leading energy efficiency.5
The benchmark results confirm that NVIDIA GPUs are unrivaled in terms of throughput and energy efficiency for workloads like backtesting and simulation.
Learn about NVIDIA delivering smarter, more secure financial services.
[1] SUT ID NVDA221118b, max of STAC-ML.Markets.Inf.T.LSTM_A.2.LAT.v1
[2] SUT ID NVDA221118a
[3] STAC-ML.Markets.Inf.S.LSTM_A.4.TPUT.v1
[4] STAC-ML.Markets.Inf.S.LSTM_C.[1,2,4].TPUT.v1
[5] SUT ID NVDA221118a, STAC-ML.Markets.Inf.S.LSTM_C.[1,2,4].ENERG_EFF.v1
Most recent headlines
05/01/2027
Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...
07/10/2026
Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...
06/09/2026
June 9 2026, 23:00 (PDT) Dolby and MagentaTV Bring Fans Closer to the FIFA Worl...
04/08/2026
Live production in the cloud is a growing trend across the industry, and Major L...
04/08/2026
LAFC co-managing owner will succeed Don Garber on Jan. 1, 2027, as league prepar...
04/08/2026
In 2022, when the PGA TOUR was breaking ground on its new, state-of-the-art broa...
04/08/2026
Provided by POVORA, the new camera angle offers a dealer's-eye view of the c...
04/08/2026
Spiideo will provide the camera setup, with NEP handling broadcast integration and off-site video operations...
04/08/2026
Production team streamed more than 750 youth rugby matches using ATEM switchers,...
04/08/2026
Agreement gives KTC early access to NDI's Advanced SDK for integration across commercial displays, digital signage, and interactive panels...
04/08/2026
Twelve projects across four categories recognize collaborative work in productio...
04/08/2026
Multi-year agreement will introduce SkeleTRACK, semi-automated offside, automate...
04/08/2026
Three mc 56 consoles, dual A__UHD Core engines, RAVENNA networking, and HOME management supported live sound, monitoring, and international broadcast production...
04/08/2026
New contribution products support ultra-low-latency video transport across fixed, remote, and mobile production environments...
04/08/2026
Company will showcase updates across PRIME, Chyron LIVE, Paint, virtual production, newsroom workflows, and venue control...
04/08/2026
Exhibit will feature SilverBack, VersaBrix, VersaFrame, VF-9100, and FiberSaver-10G platforms...
04/08/2026
Platform updates target cloud-based production, high-density ST 2110 monitoring,...
04/08/2026
LMG will take control of Gravity Media's U.S. mobile-unit fleet as the compa...
04/08/2026
Amp-modelling rigs get major upgrade
HeadRush have recently released a major firmware update that brings some powerful new features to their Prime, Core and...
04/08/2026
Generate a choir from a single voice track
Following years of development, Am I Audio have just officially launched their debut plug-in. Created in collabor...
04/08/2026
Official EMT-endorsed reverbs now available to all
Two more of Universal Audio's renowned UAD plug-ins have just gained new native versions that can be ...
04/08/2026
SBS helps Australians understand why every Census counts
Media releases
As Australia prepares for the 2026 Census on Tuesday 11 August, SBS is helping ensur...
04/08/2026
Canada invests in the future of HF communications with Rohde & Schwarz solutions After selection by the Canadian Department of National Defence (DND) as the p...
04/08/2026
Blendkit Expands Beyond Blender
Brie Clayton August 4, 2026
0 Comments
Popular 3D Asset Library Launches Alpha Plugins for Maya, Godot, and Rhino
Blend...
04/08/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
04/08/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
04/08/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
04/08/2026
Ikegami has chosen the 11-14 September 2026 International Broadcasting Convention in Amsterdam as the European market launch venue for additions to its UNICAM p...
04/08/2026
Appear (IBC2026 booth 1.C61) will showcase new X & VX Platform capabilities that extend broadcast-grade performance from venue to cloud
Appear ASA (OSE: APR), ...
04/08/2026
LiveU, the global leader in live IP-video solutions, today highlighted the crucial role its EcoSystem played in Broadcast Management Group's (BMG) successfu...
04/08/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
04/08/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
04/08/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
04/08/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
04/08/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
04/08/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
04/08/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
04/08/2026
Homecoming Artist Spotlight: Dreion The singer, songwriter, and producer talks about finding his village at Berklee ahead of his Homecoming performance on Sep...
04/08/2026
Tuesday 4 August 2026
Sky Sports agrees deal with SANZAAR for international rugby rights 2026 - 2030
The deal means Sky will have exclusive rights to the inau...
04/08/2026
Kill Tony Launches on Supercast, Giving Fans Premium & Ad-Free Access to Comedy&...
04/08/2026
More details coming soon....
04/08/2026
More details coming soon....
04/08/2026
More details coming soon....
04/08/2026
Surging AI demands are driving the need for massive datasets and context windows that burst past the confines of system memory.
But rising needs aren't me...
04/08/2026
For robotaxis and other autonomous vehicles (AVs), the hardest problems aren'...
04/08/2026
Members of the Open Secure AI Alliance - now more than 120 organizations strong - are developing new guidelines to strengthen agentic AI cybersecurity as the an...
04/08/2026
Dalet, a leading technology and service provider for media-rich organizations, t...
03/08/2026
SVG's annual TranSPORT conference returns to New York City for a full day of sessions focused on the current state of live-sports-transmission technology. S...
03/08/2026
A five-time Emmy winner, this esports vet has built a production career on live storytelling, audience connection, and meeting viewers wherever they are
The sp...
03/08/2026
Live production in the cloud is a growing trend across the industry and Major Le...