Sony Pixel Power calrec Sony

Physical hacking: Thales warns of new challenge to AI systems

30/11/2023

Facebook

Twitter

LinkedIn

At the 30th edition of the ACM Conference on Computer and Communications Security, which took place in Copenhagen from 27-30 November 2023 and included a daylong workshop on artificial intelligence and security (AISec), Thales made a world-premiere presentation of a technique for carrying out a physical attack on an AI system.

Companies and organisations are now well aware of the risk of software attacks on their AI models, but less information is available about potential attacks on AI hardware.

With the increasing use of AI in defence systems (drones, vehicles, fighter aircraft, etc.), the security of these highly critical assets needs to be taken into account from the earliest design stage in order to protect the intellectual property they contain and safeguard national security interests.

Side-channel attack on an embedded AI system by Thales ThalesIn an AI system, software is embedded in physical hardware components. Physical attacks known as side-channel attacks attempt to gain access to sensitive information by observing indirect signals generated by physical components of the system. Thaless demonstration of a side-channel attack during the AISec workshop was intended to raise awareness of this new type of threat among members of the scientific and technical community and encourage them to take this potential vulnerability into account when developing their systems. The heat, power consumption or electromagnetic radiation generated by a system can be a valuable source of information for hackers. They can use this information to exploit the physical characteristics of a systems electronic components, understand how the embedded software functions, access its sensitive data and compromise the confidentiality of the parameters influencing the decisions made by the AI.

Joan Mazenc, Director of the Thales ITSEF1, said: The risk of side-channel attacks on AI systems has not been fully addressed, and specific developments are needed to guarantee their reliability and resilience and to protect the intellectual property they contain. By presenting this new threat to the international scientific and technical community at the AISec conference, Thales seeks to alert industry to this emerging risk and the advanced solutions and techniques required to build a trusted AI system.

The attack presented at the AISec conference was conducted in two steps:

1 . Attack by observation, in which the physical behaviour of the system was analysed during operation to reveal the secret parameters used by the targeted AI for classifying images.

Conventional laboratory techniques can measure the electromagnetic radiation generated by a systems electronic components. By reproducing this process thousands of times in a variety of conditions, an attack AI can be trained to recognise the observed radiation patterns and thereby identify the secret parameters of the target AI with no prior knowledge of the system being observed.

2 . Active attack, in which the parameters influencing the target AIs decisions were exploited in order to deceive the model by creating adversarial examples.

Here, the operator forces the AI to identify the figure 7 as a 5. ThalesThis attack used scripts capable of exploiting the secret parameters revealed in the first step in order to create an image that would be incorrectly classified by the AI.

In addition, a hacker with physical access to the target system could achieve the same objective by physically disturbing the component while the AI is running. Creating a quick disturbance in the electronic components power supply or exposing a circuit to a strong electromagnetic pulse could alter the AIs decisions, causing it to misclassify images. This type of fault injection attack also needs to be taken into consideration by embedded system designers in order to build a trusted AI.

Thales and AI

To counter these threats, Thales runs security evaluations at its ITSEF laboratory, which is accredited by the French National Cybersecurity Agency ANSSI, and draws on the Groups extensive expertise to propose customised solutions to mitigate any vulnerabilities that are detected.

As the Groups defence and security businesses address critical requirements, often with safety-of-life implications, Thales has developed an ethical and scientific framework for the development of trusted AI based on the four strategic pillars of validity, security, explainability and responsibility. Thales solutions combine the know-how of over 300 senior AI experts and more than 4,500 cybersecurity specialists with the operational expertise of the Groups aerospace, land defence, naval defence, space and other defence and security businesses.

About Thales

Thales (Euronext Paris: HO) is a global leader in advanced technologies within three domains: Defence & Security, Aeronautics & Space, and Digital Identity & Security. It develops products and solutions that help make the world safer, greener and more inclusive.

The Group invests close to 4 billion a year in Research & Development, particularly in key areas such as quantum technologies, Edge computing, 6G and cybersecurity.

Thales has 77,000 employees in 68 countries. In 2022, the Group generated sales of 17.6 billion.

1Information Technology Security Evaluation Facility

Documents

Physical hacking - Thales warns of new challenge to AI systems.pdf

Contact

Marion Bonnet, Press and social media manager, Security and Cyber

+33 (0)6 60 38 48 92 marion.bonnet@thalesgroup.com

15 Dec 2023

Thales Alenia Space has selected the UK's National Satellite Test Facility for FLEX satellite first test campaign

Read more

13 Dec 2023

Thales delivers the new integrated surveillance system to Melillas Command Headquarters

Read more

13 Dec 2023

Trust Bank and Thales Launch Singapore's First O
LINK: https://www.thalesgroup.com/en/worldwide/security/press_release/physic...
See more stories from thales

Europe Stories

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

07/10/2026

Dalet Flex LTS Delivers Smarter Media Operations from Ingest to Distribution

Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...

06/09/2026

Dolby and MagentaTV Bring Fans Closer to the FIFA World Cup 2026 in Germany with Dolby Vision and Dolby Atmos

June 9 2026, 23:00 (PDT) Dolby and MagentaTV Bring Fans Closer to the FIFA Worl...

21/08/2026

Rapid Flow release miniGRID

Hardware-style timing shifts for software instruments Following on from the release of Omniclock, Rapid Flow have launched a new sequencer plug-in that can ...

21/08/2026

Love Synthesizers announce First Love pre-orders

Highly anticipated synthesizer ships in October 2026 Iceland-based Love Synthesizers have announced that their highly anticipated synthesizer is now availab...

21/08/2026

The Forsytes' Adds Gregg Sulkin & Gabriel Antunes As PBS Masterpiece Series Starts Filming Season 3

Masterpiece PBS The Forsytes has expanded its cast as its begins production in ...

21/08/2026

BBC reveals haunting first look and further casting for The Witch Farm

The BBC has unveiled first-look pictures from The Witch Farm, a new ghost story and mystery set in the Welsh countryside, coming soon to BBC iPlayer and BBC One...

21/08/2026

A first look at Edward Bluemel as Hercule Poirot.

The BBC and BritBox have revealed the first look of Edward Bluemel as Hercule Poirot in the forthcoming six-part series Hercule from Mammoth Screen and Agatha C...

21/08/2026

Clear-Com Appoints Venuetech as its Main Partner for the Middle East

eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({ content_source:......

21/08/2026

Take five with Sophie

Tell us a little bit about your job I'm a Marketing Manager and work across a mix of clients and projects. No two days are ever quite the same, which defini...

21/08/2026

Irish Lottery heist documentary to air on RT

Beat The Lotto dives into the plot behind the 1980s National Lottery scandal 24 August 2026 at 9:35pm on RT One and RT Player Beat The Lotto is the story o...

21/08/2026

The Late Late Toy Show kicks off search for this year's stars

The countdown to the most wonderful night of the year has officially begun! Host Patrick Kielty is gearing up for another unforgettable Late Late Toy Show nig...

21/08/2026

New children's series Bellie and Whizz at Big School set to air on RT KIDSjr & RT Player from Monday, 24th August

Meet puppet duo Bellie and Whizz, who are about to explore all the big feelings ...

20/08/2026

SoundBridges TURN server tutorial

Set up your own private remote collaboration infrastructure SoundBridge have recently put together a tutorial video that provides users with a step-by-step ...

20/08/2026

Neyrinck revive Avid D-Control surfaces

New V-Control Pro features restore basic functionality Neyrinck's V-Control software has long been keeping older Avid control surfaces compatible with n...

20/08/2026

ROSE AYLING-ELLIS BEGINS FILMING SERIES TWO OF ITVS BAFTA-WINNING THRILLER CODE OF SILENCE

TV, BritBox and Mammoth Screen have announced that filming is now underway on th...

20/08/2026

Transformation Church Elevates Production Communications With Riedel Artist and Bolero

Wuppertal August 20, 2026 Transformation Church Elevates Production Communicat...

20/08/2026

The music between the notes

The music between the notes Coming together In the middle of 2026, as conversations around artificial intelligence continue to raise questions about how musi...

20/08/2026

Arvato Systems brings together digital transformation leaders in the manufacturing industry

Arvato Systems Brings Together Digital Transformation Leaders in the Manufacturi...

19/08/2026

MPG launch Save Our Studios survey

Studio owners invited to have their say on rates cuts The Music Producers Guild (MPG) are inviting UK-based studios to take part in an in-depth survey that ...

19/08/2026

Harrison unveil the Flex-10

Vintage-inspired desktop interface revealed Harrison's latest hardware offering sees them head into the world of audio interfaces, delivering a 10-in/12...

19/08/2026

Minimal Audio release Lucid

Granular effect remains locked to scale and tempo Described as your dream granular effect , Minimal Audio's latest creation is capable of turning any s...

19/08/2026

Audio Modeling open PolySWAM pre-orders

First polyphonic SWAM instrument incoming Audio Modeling's latest physical-modelling orchestral instrument is just around the corner, and is now availab...

19/08/2026

U&alibi re-commissions Bookish for Christmas Special and Series 3

There's an early Christmas gift for Bookish fans, as UKTV confirms the re-commission of the hit U&alibi drama, created by and starring Mark Gatiss. Viewers ...

19/08/2026

Sky gives sports fans the chance to watch multiple live sports events simultaneously on the big screen for the first time

Wednesday 19 August 2026 Sky gives sports fans the chance to watch multiple liv...

19/08/2026

RT TO AIR HISTORIC KATIE TAYLOR FIGHT IN CROKE PARK

On Saturday September 5 Katie Taylor will step into the ring for the fight of her life against Flora Pili in front of 80,000 fans in Croke Park. A legendary fig...

18/08/2026

Panoramic from Panorama Labs

Company launch with stereo-imaging tool Panoramic is the debut release from Panorama Labs, a new company formed by mastering engineer Nicholas Di Lorenzo. C...

18/08/2026

Focusrite extend Control 2 support

Control software now available for older interfaces Focusrite have just announced the launch of an update that extends Control 2 software support for their ...

18/08/2026

Sky Sports and The Fast and the Curious announce new partnership

Tuesday 18 August 2026 Sky Sports and The Fast and the Curious announce new partnership Sky Sports and The Fast and the Curious have announced a new long-term...

18/08/2026

Riedel Brings Professional Live Production Into the Classrooms of ECU

Wuppertal August 18, 2026 Riedel Brings Professional Live Production Into the Classrooms of ECURiedel Communications today announced that Edith Cowan Universi...

18/08/2026

Apple announces changes for apps in the European Union - UPDATE - Posted on 18 August 2026

Apple today announced changes to its business terms for apps in the European Uni...

18/08/2026

RT TO AIR NEW DOCUMENTARY THAT LIFTS THE LID ON THE HEALY RAE DYNASTY

THE HEALY RAES: BLOOD, SWEAT & TEARS AIRS WEDNESDAY AUGUST 19 ON RT ONE AT 9:35PM A new documentary The Healy-Raes: Blood, Sweat & Tears airs on RT One and ...

18/08/2026

Stunning Irish performances at European Athletics and Swimming Championships reach almost 1.7 million viewers

Stunning Irish performances at European Athletics and Swimming Championships rea...

18/08/2026

An Irish Atlantic Rainforest: The Story of a West Cork Rainforest on the edges of the Beara Peninsula

The two-part series begins Sunday 23 August at 6.30pm on RT One and RT Player ...

17/08/2026

SHIK open S32 pre-orders

New MIDI processor & macro controller revealed SHIK have announced that they have opened pre-orders for the S32, a standalone MIDI processor and macro contr...

17/08/2026

Melbourne Instruments introduce 10-year motor warranty

Cover extended on innovative motorised pot system Melbourne Instruments have just revealed that the innovative motorised pot system used in their synths and...

17/08/2026

1010music update the Bluebox

Latest firmware version now available 1010music have just released a free firmware update that brings some nice new features to their renowned Bluebox digit...

17/08/2026

Rohde & Schwarz showcases integrated defense and test solutions at DALO Industry Days 2026

Rohde & Schwarz showcases integrated defense and test solutions at DALO Industry...

17/08/2026

Calrec Integrates ImPulseV with NEP Platform

Calrec's ImPulseV Virtualised Audio Mixing Engine joins NEP Platform, the industry's largest ecosystem of trusted production software, bringing scalable...

17/08/2026

FilmLight Showcases Workflow Automation, Advanced Media Collaboration, and Baselight v8 Preview at IBC 2026

Visitors to IBC 2026 will see how FilmLight is reshaping the modern post pipelin...

17/08/2026

Arqiva x IBC 2026 - Simplify Complexity and Unlock Greater Value

Visitors to Stand 1.C41 can explore innovations in areas such as addressable advertising, hybrid distribution, managed services and operational simplification. ...

16/08/2026

Gospel Musicians release Gospel Drums

Virtual drummer joins line-up The latest release from Gospel Musicians adds a virtual drummer to the company's line-up, combining a pair of meticulously...

15/08/2026

JH Audio expand Universal-Fit range

In-ear monitoring line-up gains new universal models In-ear monitoring experts JH Audio have just announced a significant expansion of their Universal-Fit r...

14/08/2026

UJAM introduce Virtual Drummer Neon

Latest instalment delivers disco-inspired grooves The latest addition to UJAM's virtual drum line-up has been designed with contemporary pop, disco, dan...

14/08/2026

Yorkville launch the EL24S

Elite range gains giant 24-inch powered sub The latest expansion of Yorkville's Elite range introduces what the company say is the world's first act...

14/08/2026

Breaking news! Sky releases trailer for The Paper, returning this September for a second season

Friday 14 August 2026 Breaking news! Sky releases trailer for The Paper, return...

14/08/2026

Cotswolds Designer Outlet, one year on

It's been one year since our client, Cotswolds Designer Outlet, opened its doors and we've loved seeing the scheme come to life. Together, we've hel...

13/08/2026

VAEMI announce the Synterra

Company preview bio-interactive' synthesizer VAEMI have announced the upcoming launch of a new standalone bio-interactive' generative synthesizer....