Physical hacking: Thales warns of new challenge to AI systems
30/11/2023
At the 30th edition of the ACM Conference on Computer and Communications Security, which took place in Copenhagen from 27-30 November 2023 and included a daylong workshop on artificial intelligence and security (AISec), Thales made a world-premiere presentation of a technique for carrying out a physical attack on an AI system.
Companies and organisations are now well aware of the risk of software attacks on their AI models, but less information is available about potential attacks on AI hardware.
With the increasing use of AI in defence systems (drones, vehicles, fighter aircraft, etc.), the security of these highly critical assets needs to be taken into account from the earliest design stage in order to protect the intellectual property they contain and safeguard national security interests.
Side-channel attack on an embedded AI system by Thales ThalesIn an AI system, software is embedded in physical hardware components. Physical attacks known as side-channel attacks attempt to gain access to sensitive information by observing indirect signals generated by physical components of the system. Thaless demonstration of a side-channel attack during the AISec workshop was intended to raise awareness of this new type of threat among members of the scientific and technical community and encourage them to take this potential vulnerability into account when developing their systems. The heat, power consumption or electromagnetic radiation generated by a system can be a valuable source of information for hackers. They can use this information to exploit the physical characteristics of a systems electronic components, understand how the embedded software functions, access its sensitive data and compromise the confidentiality of the parameters influencing the decisions made by the AI.
Joan Mazenc, Director of the Thales ITSEF1, said: The risk of side-channel attacks on AI systems has not been fully addressed, and specific developments are needed to guarantee their reliability and resilience and to protect the intellectual property they contain. By presenting this new threat to the international scientific and technical community at the AISec conference, Thales seeks to alert industry to this emerging risk and the advanced solutions and techniques required to build a trusted AI system.
The attack presented at the AISec conference was conducted in two steps:
1 . Attack by observation, in which the physical behaviour of the system was analysed during operation to reveal the secret parameters used by the targeted AI for classifying images.
Conventional laboratory techniques can measure the electromagnetic radiation generated by a systems electronic components. By reproducing this process thousands of times in a variety of conditions, an attack AI can be trained to recognise the observed radiation patterns and thereby identify the secret parameters of the target AI with no prior knowledge of the system being observed.
2 . Active attack, in which the parameters influencing the target AIs decisions were exploited in order to deceive the model by creating adversarial examples.
Here, the operator forces the AI to identify the figure 7 as a 5. ThalesThis attack used scripts capable of exploiting the secret parameters revealed in the first step in order to create an image that would be incorrectly classified by the AI.
In addition, a hacker with physical access to the target system could achieve the same objective by physically disturbing the component while the AI is running. Creating a quick disturbance in the electronic components power supply or exposing a circuit to a strong electromagnetic pulse could alter the AIs decisions, causing it to misclassify images. This type of fault injection attack also needs to be taken into consideration by embedded system designers in order to build a trusted AI.
Thales and AI
To counter these threats, Thales runs security evaluations at its ITSEF laboratory, which is accredited by the French National Cybersecurity Agency ANSSI, and draws on the Groups extensive expertise to propose customised solutions to mitigate any vulnerabilities that are detected.
As the Groups defence and security businesses address critical requirements, often with safety-of-life implications, Thales has developed an ethical and scientific framework for the development of trusted AI based on the four strategic pillars of validity, security, explainability and responsibility. Thales solutions combine the know-how of over 300 senior AI experts and more than 4,500 cybersecurity specialists with the operational expertise of the Groups aerospace, land defence, naval defence, space and other defence and security businesses.
About Thales
Thales (Euronext Paris: HO) is a global leader in advanced technologies within three domains: Defence & Security, Aeronautics & Space, and Digital Identity & Security. It develops products and solutions that help make the world safer, greener and more inclusive.
The Group invests close to 4 billion a year in Research & Development, particularly in key areas such as quantum technologies, Edge computing, 6G and cybersecurity.
Thales has 77,000 employees in 68 countries. In 2022, the Group generated sales of 17.6 billion.
1Information Technology Security Evaluation Facility
Documents
Physical hacking - Thales warns of new challenge to AI systems.pdf
Contact
Marion Bonnet, Press and social media manager, Security and Cyber
+33 (0)6 60 38 48 92 marion.bonnet@thalesgroup.com
15 Dec 2023
Thales Alenia Space has selected the UK's National Satellite Test Facility for FLEX satellite first test campaign
Read more
13 Dec 2023
Thales delivers the new integrated surveillance system to Melillas Command Headquarters
Read more
13 Dec 2023
Trust Bank and Thales Launch Singapore's First O
LINK: | https://www.thalesgroup.com/en/worldwide/security/press_release/physic... |
See more stories from thales |
Most recent headlines
04/08/2024
Dalet Appoints Santiago Solanas as CEO to Lead Next Era of Growth and Innovation
Dalet, a leading technology and service provider for media-rich organizations, is excited to announce Santiago Solanas as its new Chief Executive Officer (CEO)....
03/06/2024
Dalet and Veritone Reach Agreement to Distribute, Transact and Monetize Media Archives
Dalet, a leading technology and service provider for media-rich organizations, a...
19/05/2024
TV Techs Weekly Product Wrap-Up
Missed any of our product coverage during your busy week? The TV Tech weekly product and services news wrap-up provides links to all of our coverage from May 13...
19/05/2024
The CW Shares Its 2024-2025 Lineup
LeVar Burton will host the new game show Trivial Pursuit on The CW, while Raven-Symon will host Scrabble....
19/05/2024
Biden, Trump Agree to Debates on CNN, ABC
President Joe Biden and former President Donald Trump have agreed to debates, set for June 27 on CNN and September 10 on ABC....
19/05/2024
End of the Line for Young Sheldon' on May 16
Young Sheldon signs off after seven seasons on CBS, when the series finale airs Thursday, May 18. Jim Parsons and Mayim Bialik reprise their roles as Sheldon Co...
18/05/2024
If Bundling Is Back, What's the Ideal Bundle?
PORTSMOUTH, N.H. Bundling is back in a big way, with all the major streaming companies and many pay TV operators exploring ways to simplify the consumer experie...
18/05/2024
FCC to Vote on LPTV Rules during June Open Meeting
WASHINGTON, D.C. Federal Communications Commission Chairwoman Jessica Rosenworcel has announced a tentative agenda for the June Open Commission Meeting schedule...
18/05/2024
Matthews Launches New Multipurpose Grip Rail Telescopic Grid Pipe Solution
Matthews Studio Equipment has introduced Grip Rail, which the company said offers a better way to mount equipment on location, in the studio, or on the fly....
18/05/2024
IAB Tech Labs, Google Partner on New First Party Data Solution
In a notable development in the industry-wide effort to address privacy concerns while improving efficacy of marketing efforts in a cookieless ad landscape, IAB...
18/05/2024
TV Tech Weekly Product Wrap-Up
Missed any of our product coverage during your busy week? The TV Tech weekly product and services news wrap-up provides links to all of our coverage from May 13...
18/05/2024
DHD Elevates the Art of Podcast Production
DHD Elevates the Art of Podcast Production Brie Clayton May 17, 2024 0 Comments Hero image: the DHD DX2 base and expansion modules Latest-generation ...
17/05/2024
Aerojet Rocketdyne's Camden Site Leverages Modernization Investments to Accelerate Solid Rocket Motor Production
Aerojet Rocketdyne has worked to modernize facilities at its Camden, Arkansas, l...
17/05/2024
FCC Plans to Revise LPTV Rules
The FCC has issued a Notice of Proposed Rulemaking (NPRM) that would revise rules governing low power TV stations (LPTV) in a number of areas, including online ...
17/05/2024
Demystifying Post-Production: Introducing Cinema 4D Particles Week 4
Demystifying Post-Production: Introducing Cinema 4D Particles Week 4 Brie Clayton May 17, 2024 0 Comments With the spring release of Maxon One, we...
17/05/2024
Takashi Yamazaki Film Godzilla Minus One Graded with DaVinci Resolve Studio
Takashi Yamazaki Film Godzilla Minus One Graded with DaVinci Resolve Studio Brie Clayton May 17, 2024 0 Comments Hero image credit: 2023 TOHO CO., LT...
17/05/2024
Sterling Event Group Streamlines Live Event Productions with AJA
Sterling Event Group Streamlines Live Event Productions with AJA Brie Clayton May 17, 2024 0 Comments Live event productions only happen once, which ...
17/05/2024
Meet the product manager
Muster Ngobi, product manager at LYNX Technik tells TVBEurope how the ever-evolving media industry provides a truly dynamic working environment By Matthew Corr...
17/05/2024
TV, Streaming Schedule for 2024 NFL Regular Season Is Released
NEW YORK As declines in linear TV viewing make the ongoing popularity of live sports, particularly football, central to financial success of the TV industry, th...
17/05/2024
Netflix Ad Tier Hits 40M Monthly Active Users
During Netflixs second Upfront presentation to advertisers, Amy Reinhard, Netflix's president of advertising, walked advertisers through the continued growt...
17/05/2024
Scripps Promotes Jeff Kiernan to VP, Local News
CINCINNATI The E.W. Scripps Company has added to its leadership team for news by promoting Jeff Kiernan a veteran journalist and general manager of Scripps'...
17/05/2024
Survey: New Disney-Fox-WBD Sports Streamer May Hurt Pay TV Sub Counts
Top executives from Disney, Fox and Warner Bros. Discovery have consistently insisted that their joint venture to launch the Venu Sports streaming bundle in the...
17/05/2024
Caitlin Clark's WNBA Debut Set Viewing Records
ESPN has announced that its coverage of Caitlin Clark's WNBA debut in the Indiana Fever versus the Connecticut Sun season opener was the most-watched WNBA g...
17/05/2024
ATEM Mini Extreme ISO switcher and Blackmagic Pocket Cinema Camera 4K
ATEM Mini Extreme ISO switcher and Blackmagic Pocket Cinema Camera 4K Brie Clayton May 16, 2024 0 Comments Blackmagic Design announced today that Yoic...
17/05/2024
Pixomondo's Virtual Production Academy Expands with Programs at Sony PCL, Vook, and Vancouver Film School
Pixomondo's Virtual Production Academy Expands with Programs at Sony PCL, Vo...
17/05/2024
WBD Upfront Show Offers Peeks at House of the Dragon,' White Lotus,' Biden-Trump Debate
The Warner Bros. Discovery upfront presentation took place Wednesday, May 15 at ...
17/05/2024
The Black Keys, Jelly Roll, Kate Hudson Set To Perform on The Voice' Finale
Season 25 of The Voice wraps on NBC Tuesday, May 21, with performances from The Black Keys, Jelly Roll, Kate Hudson, Lainey Wilson, Muni Long, Thomas Rhett and ...
17/05/2024
CNN Boss Mark Thompson's Plan Includes More News in More Categories on More Devices (Upfronts)
New CNN CEO Mark Thompson spelled out his plan for the struggling news network d...
17/05/2024
Netflix To Launch In-House Advertising Tech Platform
Netflix, a newcomer to the advertising business, said it plans to launch an in-house advertising technology platform....
17/05/2024
Netflix Plots TV Takeover at Upfront Presentation
Netflix shared some programming projects at an upfront presentation in New York. Those include the basketball-themed comedy series Running Point, a Mindy Kaling...
17/05/2024
Plex Geek Week Sale Offers 20% Off Plex Lifetime Pass
Plex is offering movie and music collectors a 20% discount off its Lifetime Plex Pass as part of its Geek Week sale....
17/05/2024
GroupM Names Toby Jenner as President, GroupM Clients
Giant media buyer GroupM said it named Toby Jenner as global president, Group M Clients, a new position at the company....
17/05/2024
Clients of Independent Agencies Boost Programmatic Buying
Smaller advertisers are increasingly buying connected TV programmatically, according to a new report from FreeWheel, Comcast's ad-tech unit....
17/05/2024
TCLtvPlus Adds Streaming Music Channels From Vevo
TCLtvPlus, the streaming app on smart TVs made by TCL, has added live linear channel from music-video programmer Vevo....
17/05/2024
StackAdapt Adopts Data From Samba TV for Programmatic Campaigns
StackAdapt said it made a deal to integrate data from Samba TV into its programmatic advertising platform....
17/05/2024
Tonight on Skeem Saam: Lehasa gets a rude awakening when Kgosi blackmails him
Tonight on Skeem Saam: Lehasa gets a rude awakening when Kgosi blackmails himDon't miss Friday, 17 May's riveting episode of South African soapie Skeem ...
17/05/2024
Tonight on House of Zwide: Dorothy is blown away by Ona's sketches for her wedding dress
Tonight on House of Zwide: Dorothy is blown away by Ona's sketches for her w...
17/05/2024
Tonight on Scandal: Dintle has a visit from her past that leaves her very unsettled
Tonight on Scandal: Dintle has a visit from her past that leaves her very unsett...
17/05/2024
Save Time and Money with WO Traffic v24.0
WO Traffic provides a solid foundation from which stations can manage, execute, and scale end-to-end ad trafficking and sales, both today and into the future. W...
17/05/2024
Broadcast Innovation in India: How AI and Automated Production Helps Smaller Sports Grow
Broadcast Innovation in India: How AI and Automated Production Helps Smaller Spo...
17/05/2024
SVG Sports Cloud Production Forum Gives Refresher Course on Cloud-Based Tools, Ecosystem
SVG Sports Cloud Production Forum Gives Refresher Course on Cloud-Based Tools, E...
17/05/2024
WNBA Tip-Off 2024: Scripps Sports Constructs New Studio for Second Season of WNBA Friday Night Spotlight on ION
WNBA Tip-Off 2024: Scripps Sports Constructs New Studio for Second Season of WNB...
17/05/2024
SVG College Summit 2024: Auburn's War Eagle Productions Breaks Down How They Produce Live Gymnastics Broadcasts
SVG College Summit 2024: Auburn's War Eagle Productions Breaks Down How They...
17/05/2024
Netflix & Shondaland Announce the Song List and Soundtrack for 'Bridgerton' Season 3: Part 1
Back to All News Netflix & Shondaland Announce the Song List and Soundtrack for...
17/05/2024
Skeem Saam: Thursday's episode, 16 May 2024 [video]
Skeem Saam: Thursday's episode, 16 May 2024 [video]Missed an episode of Skeem Saam? No problem! Watch the latest episode of your favourite South African soa...
17/05/2024
Prison Journalism: Letter to my mothers
Prison Journalism: Letter to my mothersThabo Mthembu was incarcerated in Pollsmoor Prison from 2014 to 2019. Read Thabo's story by Thabo Mthembu 17-05-20...
17/05/2024
Paul McCartney becomes UK's first billionaire musician
Paul McCartney becomes UK's first billionaire musicianMusic icon Paul McCartney has become the UK's first billionaire musician, according to the Sunday ...
17/05/2024
Tonight on Smoke and Mirrors: Sakhile advises Tiny against sabotaging Petunia
Tonight on Smoke and Mirrors: Sakhile advises Tiny against sabotaging PetuniaDon't miss Friday, 17 May's riveting episode of South African soapie Smoke ...
17/05/2024
RT'S Operation Transformation comes to a close after 17 seasons
RT has today announced that Operation Transformation (OT) is to end after 17 seasons. As series come to an end each year, RT undertakes an editorial review to...
17/05/2024
Studio One: Your Binaural Beats Lab
By Craig Anderton When I heard about binaural beats, I was interested-I like beats, and I'm into binaural audio. But this has nothing to do with either o...