Sony Pixel Power calrec Sony

Physical hacking: Thales warns of new challenge to AI systems

30/11/2023

Facebook

Twitter

LinkedIn

At the 30th edition of the ACM Conference on Computer and Communications Security, which took place in Copenhagen from 27-30 November 2023 and included a daylong workshop on artificial intelligence and security (AISec), Thales made a world-premiere presentation of a technique for carrying out a physical attack on an AI system.

Companies and organisations are now well aware of the risk of software attacks on their AI models, but less information is available about potential attacks on AI hardware.

With the increasing use of AI in defence systems (drones, vehicles, fighter aircraft, etc.), the security of these highly critical assets needs to be taken into account from the earliest design stage in order to protect the intellectual property they contain and safeguard national security interests.

Side-channel attack on an embedded AI system by Thales ThalesIn an AI system, software is embedded in physical hardware components. Physical attacks known as side-channel attacks attempt to gain access to sensitive information by observing indirect signals generated by physical components of the system. Thaless demonstration of a side-channel attack during the AISec workshop was intended to raise awareness of this new type of threat among members of the scientific and technical community and encourage them to take this potential vulnerability into account when developing their systems. The heat, power consumption or electromagnetic radiation generated by a system can be a valuable source of information for hackers. They can use this information to exploit the physical characteristics of a systems electronic components, understand how the embedded software functions, access its sensitive data and compromise the confidentiality of the parameters influencing the decisions made by the AI.

Joan Mazenc, Director of the Thales ITSEF1, said: The risk of side-channel attacks on AI systems has not been fully addressed, and specific developments are needed to guarantee their reliability and resilience and to protect the intellectual property they contain. By presenting this new threat to the international scientific and technical community at the AISec conference, Thales seeks to alert industry to this emerging risk and the advanced solutions and techniques required to build a trusted AI system.

The attack presented at the AISec conference was conducted in two steps:

1 . Attack by observation, in which the physical behaviour of the system was analysed during operation to reveal the secret parameters used by the targeted AI for classifying images.

Conventional laboratory techniques can measure the electromagnetic radiation generated by a systems electronic components. By reproducing this process thousands of times in a variety of conditions, an attack AI can be trained to recognise the observed radiation patterns and thereby identify the secret parameters of the target AI with no prior knowledge of the system being observed.

2 . Active attack, in which the parameters influencing the target AIs decisions were exploited in order to deceive the model by creating adversarial examples.

Here, the operator forces the AI to identify the figure 7 as a 5. ThalesThis attack used scripts capable of exploiting the secret parameters revealed in the first step in order to create an image that would be incorrectly classified by the AI.

In addition, a hacker with physical access to the target system could achieve the same objective by physically disturbing the component while the AI is running. Creating a quick disturbance in the electronic components power supply or exposing a circuit to a strong electromagnetic pulse could alter the AIs decisions, causing it to misclassify images. This type of fault injection attack also needs to be taken into consideration by embedded system designers in order to build a trusted AI.

Thales and AI

To counter these threats, Thales runs security evaluations at its ITSEF laboratory, which is accredited by the French National Cybersecurity Agency ANSSI, and draws on the Groups extensive expertise to propose customised solutions to mitigate any vulnerabilities that are detected.

As the Groups defence and security businesses address critical requirements, often with safety-of-life implications, Thales has developed an ethical and scientific framework for the development of trusted AI based on the four strategic pillars of validity, security, explainability and responsibility. Thales solutions combine the know-how of over 300 senior AI experts and more than 4,500 cybersecurity specialists with the operational expertise of the Groups aerospace, land defence, naval defence, space and other defence and security businesses.

About Thales

Thales (Euronext Paris: HO) is a global leader in advanced technologies within three domains: Defence & Security, Aeronautics & Space, and Digital Identity & Security. It develops products and solutions that help make the world safer, greener and more inclusive.

The Group invests close to 4 billion a year in Research & Development, particularly in key areas such as quantum technologies, Edge computing, 6G and cybersecurity.

Thales has 77,000 employees in 68 countries. In 2022, the Group generated sales of 17.6 billion.

1Information Technology Security Evaluation Facility

Documents

Physical hacking - Thales warns of new challenge to AI systems.pdf

Contact

Marion Bonnet, Press and social media manager, Security and Cyber

+33 (0)6 60 38 48 92 marion.bonnet@thalesgroup.com

15 Dec 2023

Thales Alenia Space has selected the UK's National Satellite Test Facility for FLEX satellite first test campaign

Read more

13 Dec 2023

Thales delivers the new integrated surveillance system to Melillas Command Headquarters

Read more

13 Dec 2023

Trust Bank and Thales Launch Singapore's First O
LINK: https://www.thalesgroup.com/en/worldwide/security/press_release/physic...
See more stories from thales

More from Thales

10/04/2024

Thales and Intel enable advanced protection for the Google Cloud ecosystem

Facebook Twitter LinkedIn Enables persistent protection of the most sensitive enterprise workloads in the cloud through customer-controlled data security,...

09/04/2024

The search for life on Mars goes on with ExoMars 2028

Facebook Twitter LinkedIn Thales Alenia Space has signed a contract with the European Space Agency to continue work to take a European rover to search for...

03/04/2024

Thales, Presagis, Universit Laval combine their expertise to increase autonomy in advanced air mobility solutions

Facebook Twitter LinkedIn Meudon, 3 April 2024 The Consortium for Researc...

29/03/2024

Thales Announces Partnership with Saporo in Belgium to Empower Organizations with Enhanced Cybersecurity Resilience

Facebook Twitter LinkedIn This collaboration brings together Thales' e...

28/03/2024

Thales speeds up its development of AI for defence

Facebook Twitter LinkedIn Thales, Europe's leading high-tech company in the civil and defence fields, has announced the creation of cortAIx, which bri...

27/03/2024

PERCEVAL: Thales and partners reshape the future of airline pilot training

Facebook Twitter LinkedIn Thales has formed a consortium with ENAC, lENS Paris-Saclay, Simaero, AviaSim and Corsair to develop a tooled methodology for ev...

21/03/2024

Thales and Skyguide partner to bring open architecture and best-of-class 3rd party system integration to the ATM industry

Facebook Twitter LinkedIn Thales and Skyguide signed a Memorandum of Under...

20/03/2024

2024 Thales Data Threat Report Reveals Rise in Ransomware Attacks, as Compliance Failings Leave Businesses Vulnerable to Breaches

Facebook Twitter LinkedIn 27% increase in companies that fell victim to a ...

20/03/2024

Thales and DGAC operate the world's first solar-powered Air Traffic Control radar station in Calama, Chile

Facebook Twitter LinkedIn The world's first Air Traffic Control radar ...

20/03/2024

Thales offers an upgraded product model for air traffic management with an upgrade of TopSky - ATC

Facebook Twitter LinkedIn TopSky - ATC works together with key stakeholder...

19/03/2024

Thales Alenia Space won European Space Agency's one of two LEO-PNT Orbit Demonstrators

Facebook Twitter LinkedIn A new satnav layer to complement the European Ga...

18/03/2024

Thales to modernize Montreal Mtro blue Line,improving passengers' punctuality and train reliability

Facebook Twitter LinkedIn Following a call for tenders, the Soci t de tra...

18/03/2024

Cyberani and Thales enter a strategic alliance to strengthen the Kingdom's cybersecurity

Facebook Twitter LinkedIn Mr. Saeed Al Saeed, CEO of Cyberani, and Mr. Pie...

18/03/2024

Thales to equip Cibao International Airport in Dominican Republic with new Air Traffic Control Radar System

Facebook Twitter LinkedIn Instituto Dominicano de Aviaci n Civil (IDAC) se...

15/03/2024

Post-quantum cryptography: six French cyber players join forces to design the secure communication networks of tomorrow

Facebook Twitter LinkedIn The RESQUE consortium brings together six French...

14/03/2024

Thales Alenia Space will develop the radar instrument for ESA's 10th Earth Explorer Harmony exciting new mission

Facebook Twitter LinkedIn Thales Alenia Space has been selected by ESA to ...

13/03/2024

Thales Partners with Neural Labs to Support AI-Powered Smart Cities

Facebook Twitter LinkedIn Partnership spanning two decades expands to incorporate cloud licensing SaaS capabilities will enable Neural Labs to deploy an...

12/03/2024

GCAA, Etihad Airways and Thales set a collaborative framework for optimising flight operations

Facebook Twitter LinkedIn On March 8th, the General Civil Aviation Authori...

11/03/2024

Thales provides expeditionary operations centre demonstrator to French Navy for drone-based mine countermeasures missions

Facebook Twitter LinkedIn Thales took less than six months to develop the ...

06/03/2024

Thales Earns Top Equity, Diversity and Inclusion Accreditation in the United Kingdom

Facebook Twitter LinkedIn Thales Transport in the UK has achieved the EW G...

05/03/2024

Thales reports its 2023 full-year results

Facebook Twitter LinkedIn Order intake1: 23.1 billion, slightly down 2% ( 0.2% on an organic basis2) Sales: 18.4 billion, up 4.9% ( 7.9% on an organic ...

04/03/2024

Thales collaborative cloud solution certified to European Restricted level

Facebook Twitter LinkedIn In 2021, TrustNest R-Cloud became the first cloud solution certified for use with information classified as Restricted Distribut...

29/02/2024

Thales successfully delivers the first CAPTAS-4 sonar for the US Navy

Facebook Twitter LinkedIn Advanced Acoustic Concepts (AAC), a subsidiary of Thales, has delivered the first CAPTAS-4 sonar for the U.S. Navys Constellatio...

28/02/2024

Eseye selects Thales to streamline IoT deployments with seamless connectivity management

Facebook Twitter LinkedIn Eseye, a global IoT connectivity solutions provi...

28/02/2024

Thales to supply 8 Full Flight Simulators to Airbus Helicopters to train Bundeswehr's H145M pilots

Facebook Twitter LinkedIn Thales has signed a historic contract with Airbu...

27/02/2024

Telit Cinterion partners with Thales to enhance its IoT eSIM provisioning services

Facebook Twitter LinkedIn Telit Cinterion, an end-to-end IoT solutions ena...

26/02/2024

Thales and Google scale eSIM across Android Ecosystem

Facebook Twitter LinkedIn Thales eSIM Discovery solution will run Google Discovery Service for seamless activation of Android devices. With 300+ eSIM pla...

22/02/2024

Thales and Thaicom establish the foundation to lead the Unmanned Traffic Management deployment in Thailand

Facebook Twitter LinkedIn Thales and Thaicom, through Thaicom's subsid...

21/02/2024

From post-quantum cryptography to seamless connectivity and 5G security, find out how Thales enables a secure connected world

Facebook Twitter LinkedIn Thales actively contributes to making the world ...

21/02/2024

Saab and Thales sign ATM MoU for Singapore

Facebook Twitter LinkedIn Saab and Thales announced today at Singapore Airshow 2024 the signature of a Memorandum of Understanding (MoU) to support the lo...

21/02/2024

Merah Putih-2 telecommunications satellite successfully launched

Facebook Twitter LinkedIn Set to provide more capacity over the Indonesian archipelago Cape Canaveral, Florida, February 21, 2024 - Merah Putih-2 telecom...

21/02/2024

Malaysia Airlines Partners with Thales to Optimize Flight Management and Surveillance Solutions

Facebook Twitter LinkedIn 20 Airbus A330neo aircraft in Malaysia Airlines&...

20/02/2024

Thales Alenia Space launches MARSBalloon to offer students the chance to fly experiments and test technologies that could one day be destined for Mars

Facebook Twitter LinkedIn Bristol, February 20th, 2024 - Thales Alenia Space, a joint-venture between Thales (67%) and Leonardo (33%), harness students...

20/02/2024

Thales Strengthens Avionics and Digital Capabilities in Singapore

Facebook Twitter LinkedIn Thales reinforces its Avionics industrial base in Singapore, through a Centre of Excellence that will work on industrialising ne...

19/02/2024

Air India selects Thales' AVANT Up In-Flight Entertainment to Elevate Experience for its Passengers

Facebook Twitter LinkedIn Air India will equip 51 of its aircraft with Tha...

19/02/2024

Thales supplies SurfSAT-L satellite communication solution for F126 German frigates

Facebook Twitter LinkedIn The German Navy will be equipped with SurfSAT-L ...

14/02/2024

Thales to equip Swiss rail operator BLS with a lower power consumption electronic interlockings

Facebook Twitter LinkedIn Thales has been awarded a frame contract to equi...

13/02/2024

Thales Alenia Space will provide communication equipment to NASA's NEO Surveyor mission

Facebook Twitter LinkedIn The equipment produced at Thales Alenia Space si...

06/02/2024

123 GRIFFON and 22 JAGUAR: 2023 DGA scheduled delivery successfully completed by Nexter, a KNDS company, Arquus and Thales

Facebook Twitter LinkedIn The temporary company grouping (Groupement Momen...

02/02/2024

Thales wins 1.8 Billion contract to maximise the days-at-sea for the Royal Navy'

Facebook Twitter LinkedIn The UK Ministry of Defence has today announced a...

01/02/2024

Cubris to provide new energy saving system for London's Elizabeth line

Facebook Twitter LinkedIn Alstom has chosen to implement Cubris' driver advisory system on Transport for London's Elizabeth line. TheGreenSpee...

29/01/2024

Korea's KASS satellite navigation system certified by national authorities and enters operational service

Facebook Twitter LinkedIn The KASS regional system was developed by Thales...

29/01/2024

Thales air data solution to enable the smooth and safe flight of Eve Air Mobility's eVTOL aircraft

Facebook Twitter LinkedIn The strategic partnership between Thales and Eve...

29/01/2024

Thales updates its financial agenda

Facebook Twitter LinkedIn Thales (Euronext Paris: HO) updates its financial agenda for 2024. Date Event Release 5 March 2024 Full Year 2023 results ...