
NVIDIA A100 Tensor Core GPUs running on Supermicro servers have captured leading results for inference in the latest STAC-ML Markets benchmark, a key technology performance gauge for the financial services industry.
The results show NVIDIA demonstrating unrivaled throughput - serving up thousands of inferences per second on the most demanding models - and top latency on the latest STAC-ML inference standard.
The results are closely followed by financial institutions, three-quarters of which rely on machine learning, deep learning or high performance computing, according to a recent survey.
NVIDIA A100: Top Latency Results The STAC-ML inference benchmark is designed to measure the latency of long short-term memory (LSTM) model inference - the time from receiving new input data until the model output is computed. LSTM is a key model approach used to discover financial time-series data like asset prices.
The benchmark includes three LSTM models of increasing complexity. NVIDIA A100 GPUs, running in a Supermicro Ultra SuperServer, demonstrated low latencies in the 99th percentile.
Accelerated Computing for STAC-ML and STAC-A2, STAC-A3 Benchmarks Considering the A100 performance on STAC-ML for inference - in addition to its record-setting performance in the STAC-A2 benchmark for option price discovery and the STAC-A3 benchmark for model backtesting - provides a glimpse at how NVIDIA AI computing can accelerate a pipeline of modern trading environments.
It also shows A100 GPUs deliver leading performance and workload versatility for financial institutions.
Predictable Performance for Consistent Low Latency Predictable performance is crucial for low-latency environments in finance, as extreme outliers can cause substantial losses during fast market moves.
Notably, there were no large outliers in NVIDIA's latency, as the maximum latency was no more than 2.3x the median latency across all LSTMs and the number of model instances, ranging up to 32 concurrent instances.1
NVIDIA is the first to submit performance results for what's known as the Tacana Suite of the benchmark. Tacana is for inference performed on a sliding window, where a new timestep is added and the oldest removed for each inference operation. This is helpful for high-frequency trading, where inference needs to be performed on every market data update.
A second suite, Sumaco, performs inference on an entirely new set of data, which reflects the use case where an event prompts inference based on recent history.
Leading Throughput in Benchmark Results NVIDIA also submitted a throughput-optimized configuration on the same hardware for the Sumaco Suite in FP16 precision.2
On the least complex LSTM in the benchmark, A100 GPUs on Supermicro servers helped serve up more than 1.7 million inferences per second.3
For the most complex LSTM, these systems handled as many as 12,800 inferences per second.4
NVIDIA A100: Performance and Versatility NVIDIA GPUs offer multiple advantages that lower the total cost of ownership for electronic trading stacks.
For one, NVIDIA AI provides a single platform for training and inference. Whether developing, backtesting or deploying an AI model, NVIDIA AI delivers leading performance - and developers don't need to learn different programming languages and frameworks for research and trading.
Moreover, the NVIDIA CUDA programming model enables development, optimization and deployment of applications across GPU-accelerated embedded systems, desktop workstations, enterprise data centers, cloud-based platforms and HPC supercomputers.
Efficiencies for Reduced Operating Expenses The financial services industry stands to benefit from not only data throughput advances but also improved operational efficiencies.
Reduced energy and square footage usage for systems in data centers can make a big difference in operating expenses. That's especially pressing as IT organizations make the case for budgetary outlays to cover new high-performance systems.
On the most demanding LSTM model, NVIDIA A100 exceeded 17,700 inferences per second per kilowatt while consuming 722 watts, offering leading energy efficiency.5
The benchmark results confirm that NVIDIA GPUs are unrivaled in terms of throughput and energy efficiency for workloads like backtesting and simulation.
Learn about NVIDIA delivering smarter, more secure financial services.
[1] SUT ID NVDA221118b, max of STAC-ML.Markets.Inf.T.LSTM_A.2.LAT.v1
[2] SUT ID NVDA221118a
[3] STAC-ML.Markets.Inf.S.LSTM_A.4.TPUT.v1
[4] STAC-ML.Markets.Inf.S.LSTM_C.[1,2,4].TPUT.v1
[5] SUT ID NVDA221118a, STAC-ML.Markets.Inf.S.LSTM_C.[1,2,4].ENERG_EFF.v1
Most recent headlines
02/07/2023
Our robust, comparable data provides trusted insights and gives media owners, buyers and planners the power to trade confidently.
ABC members and data subscrib...
02/07/2023
We'll be releasing The next set of ABC audited consumer media data covering the period January to December 2022 on Tuesday 21st February at noon.
When rele...
02/07/2023
We'll be releasing The next set of ABC audited consumer media data covering the period January to December 2022 on Tuesday 21st February at noon.
When rele...
01/05/2023
Our Chief Executive Simon Redlich was recently invited by Alliance for Audited Media (AAM) to share his views on what 2023 might hold. Read what Simon and other...
29/03/2023
This Friday, March 31 is Trans Day of Visibility, a day to honor the contributions and existence of our trans community - from artists to colleagues to friends ...
29/03/2023
As Latin rap's global influence grows, the release of Myke Towers' highl...
29/03/2023
Tras el xito de su primera temporada, la audio serie original de Spotify Quema...
29/03/2023
Following the success of its first season, the Spotify Original scripted audio s...
29/03/2023
This week, American Vice President Kamala Harris visits Ghana, Tanzania, and Zam...
29/03/2023
SGL Carbon will present a new 50k carbon fiber at JEC World 2023. The new SIGRAF...
29/03/2023
Includes new Centra platform for broadcasters
Sioux Falls, USA - 29 March 2023
Sencore a leading broadcast equipment supplier and platform developer will ...
29/03/2023
TORONTO, Can. (March 29, 2023) Panavision, the entertainment industry's leading designer, manufacturer and rental provider of high precision optics and ca...
29/03/2023
The feature Soft follows three adolescent queer friends as they navigate the pardons and perils of summer break in the streets of Toronto. Written and directed ...
29/03/2023
Written and directed by Zach Braff, A Good Person tells the story of Allison (Florence Pugh), who unexpectedly befriends an elder gentleman named Daniel (Morgan...
29/03/2023
Sound Director Tadeusz Mieczkowski Selects DPA for Durability, Reliability and S...
29/03/2023
Newest solutions offer precise sound reproduction for the live stage.
DPA Microphones, the leading manufacturer of high-quality microphone solutions, unveils i...
29/03/2023
Avid_NEXIS_F2-SSD_1...
29/03/2023
RESTON Va. Comscore has announced that it is speeding up the delivery of TV viewing data to more local markets by expanding the availability of 48-hour TV measu...
29/03/2023
TV TECH: What do you anticipate will be the most significant technology trends at the 2023 NAB Show?...
29/03/2023
Contrast and Ratios The Key to Image Depth Colour Theory in DaVinci Resolve
Riccardo Luppi March 29, 2023
0 Comments
In this series, we go through ...
29/03/2023
Filmmaker Agos Bruera Brings Female Gaze to REVERSE
Brie Clayton March 29, 2023
0 Comments
Commercial production company REVERSE welcomes Agos Bruera t...
29/03/2023
Creative COW Job Listing: On-Location Video Editor in Newport, Wales
Brie Clayton March 29, 2023
0 Comments
On-location Video Editor
Looking for work...
29/03/2023
Creative COW Job Listing: Adobe After Effects Designer & Scripting Lead, London
Brie Clayton March 29, 2023
0 Comments
Adobe After Effects designer/scr...
29/03/2023
Spring 2023 Maxon One Release Adds Extraordinary Value
Brie Clayton March 29, 2023
0 Comments
Enhancements across the entire product line including Cin...
29/03/2023
A Remedy for Cancel Culture MacArthur Fellow Loretta J. Ross spoke about toxic internet culture and the virtues of calling in instead of calling out at a rece...
29/03/2023
The global streamers could face fines of up to £250,000 or be restricted in the UK entirely if they are found to have broken rules around harmful material
By J...
29/03/2023
ARRI Solutions designs, engineers, builds, and operates virtual production environments of all sizes
By Jenny Priestley
Published: March 29, 2023
ARRI Sol...
29/03/2023
The appointments follow Riedels recent acquisitions of Simplylive and SDNsquare
By Jenny Priestley
Published: March 29, 2023
The appointments follow Riede...
29/03/2023
NEW YORK Media SaaS provider Amagi has announced that Canela Media will be using the Amagi CONNECT free ad-supported streaming (FAST) marketplace to help it imp...
29/03/2023
NORWALK, Conn. In another example of how telcos and cable operators are working to attract cord-cutters by bunding streaming services with their broadband offer...
29/03/2023
New survey data from Parks Associates shows that subscription video services are nearly ubiquitous in U.S. homes, with 87% of US internet households having at l...
29/03/2023
Ross Video Makes it Real at NAB Show 2023
Brie Clayton March 28, 2023
0 Comments
Company Unlocks Video Production Innovation through Hyperconverged P...
29/03/2023
Job Listing: St. Louis CITY SC Summer Internship Opportunity
Brie Clayton March 28, 2023
0 Comments
St. Louis CITY SC Summer Internship Opportunity
L...
29/03/2023
WRAL-TV's Elizabeth Gardner is honored by Raleigh Magazine as one of the Women Shaping Raleigh 2023 at an event at One Glenwood on Monday, March 27.
Raleig...
29/03/2023
110 Years of Durham Bulls Baseball Celebration & Kids Run The Bases complete Opening Weekend 2023
The Back-to-Back Triple-A National Champion Durham Bulls begi...
29/03/2023
Embrace Spring with Boston Conservatory Orchestra at Groton Hill Music Center On April 8, the orchestra celebrates the changing seasons at an exciting new con...
29/03/2023
Bernice Chan on How Berklee Helped Jumpstart Her Career as a Publicist A panelist at Career Jam 2023, the recent alum discusses landing her current position a...
29/03/2023
It turns out there are secret ways to search for content to watch on Netflix....
29/03/2023
Standard General said it filed a lawsuit asking a U.S. Appeals Court to order th...
29/03/2023
At a time when retail networks are growing in dollar volume and sophistication, Dollar General worked with LiveRamp to strengthen its connection with its custom...
29/03/2023
The season two premiere of Showtime's Yellowjackets drew nearly 2 million viewers across platforms, the best second-season debut for the premium channel in ...
29/03/2023
Comscore said that it has expanded its Pulse measurement service which provides local viewership data within 48 hours to all 210 U.S. markets....
29/03/2023
Sinclair Broadcast Group's NewsON free streaming service said it added Capitol Broadcasting's new streaming channel WRAL News Plus to NewsON's chann...
29/03/2023
Amazon said the Yankees are coming back to Prime Video....
29/03/2023
The season four debut of HBO's Succession on Sunday drew 2.3 million viewers across HBO Max and the HBO linear channels, a high for the series....
29/03/2023
As part of its upfront pitch, Sony's Game Show Network said it has greenlit four new daily series....
29/03/2023
Unstable, with Rob Lowe as a biotech entrepreneur and his son John Owen Lowe portraying his son, premieres on Netflix March 30. There are eight episodes....
29/03/2023
Tech Focus: Intercoms, Part 2 - Growth in REMI Production Spurs Product Growth Flexibility, multifunctionality mark offerings in a highly competitive market By...
29/03/2023
Tech Focus: Intercoms, Part 1 - Dynamic Technology Adjusts to Whatever Comes Nex...
29/03/2023
Wuppertal March 29, 2023
Riedel Strengthens Product Division Management Team W...