Facebook
Twitter
LinkedIn
The Friendly Hackers team from Thales, a world leader in data protection and cybersecurity, has won the CAID[1] challenge organised by the French Ministry of Defence2 during the fifth edition of European Cyber Week in France (November 21 - 23, 2023).
The challenge, the first of its kind to be organised by the French Ministry of Defence, was designed to evaluate the extent to which teams of hackers could exploit certain intrinsic vulnerabilities of AI models.
Thaless work on AI security and trust is aligned with the requirements of both the defence community and civilian organisations such as critical infrastructure providers, which all face the same challenges of protecting their training datasets and intellectual property, and guaranteeing that AI-generated results can be trusted for critical decision-making.
Rodolphe LAMPE, Senior Data Scientist in the Thales team, with Alice H liou, Vincent Thouvenot, Cong-Bang Huynh and Baptiste MorisseThe French Ministry of Defences AI security challenge
Participants in the CAID challenge had to perform two tasks:
In a given set of images, determine which images were used to train the AI algorithm and which were used for the test.
An AI-based image recognition application learns from large numbers of training images. By studying the inner workings of the AI model, Thaless Friendly Hackers team successfully determined some of the images that had been used to create the application, gaining valuable information about the training methods used and the quality of the model.
2. Find the images of aircrafts used by a AI algorithm that had been protected using unlearning techniques.
An unlearning technique consists of deleting the data used to train a model, such as images, in order to preserve their confidentiality. This technique can be used, for example, to protect the sovereignty of an algorithm in the event of its export, theft or loss. For example, a drone equipped with AI must be able to recognise any enemy aircraft as a potential threat. On the other hand, models of aircraft from its own army would have to be learned to be identified as friendly, then erased by a technique known as unlearning. In this way, even if the drone was stolen or lost, the sensitive aircraft data contained in the AI model could not be extracted for malicious purposes. However, the Friendly Hackers team from Thales managed to re-identify the data that was supposed to have been erased from the model, thereby overriding the unlearning process.
Exercises like this help to assess the vulnerability of training data and trained models, which are valuable tools and can deliver outstanding performance but also represent new attack vectors for the armed forces. An attack on training data or trained models could have significant consequences in a military context, where this type of information could give an adversary the upper hand. Risks include model theft, theft of the data used to recognise military hardware or other features in a theatre of operations, and backdoors to impair the operation of the system using the AI. While AI in general, and generative AI in particular, offers significant operational benefits and provides military personnel with intensively trained decision support tools to reduce their cognitive burden, the national defence community needs to address new threats to this technology as a matter of priority.
The Thales BattleBox approach to tackle AI vulnerabilities
The protection of training data and trained models is critical in the defence sector. AI cybersecurity is becoming more and more crucial, and needs to be autonomous to thwart the many new opportunities that the world of AI is opening up to malicious actors. Responding to the risks and threats involved in the use of artificial intelligence, Thales has developed a set of countermeasures called the BattleBox to provide enhanced protection against potential breaches.
BattleBox Training provides protection from training-data poisoning, preventing hackers from introducing a backdoor.
BattleBox IP digitally watermarks the AI model to guarantee authenticity and reliability.
BattleBox Evade aims to protect models from prompt injection attacks, which can manipulate prompts to bypass the safety measures of chatbots using Large Language Models (LLMs), and to counter adversarial attacks on images, such as adding a patch to deceive the detection process in a classification model.
BattleBox Privacy provides a framework for training machine learning algorithms, using advanced cryptography and secure secret-sharing protocols to guarantee high levels of confidentiality.
To prevent AI hacking in the case of CAID challenge tasks, countermeasures such as encryption of the AI model could be one of the solutions to be implemented.
AI provides considerable operational benefits, but it requires high levels of security and cybersecurity protection to prevent data breaches and misuse. Thales implements a large range of AI-based solutions for all types of civil and military use cases. Intended to be explainable, embeddable and integrated within robust critical systems, they are also designed to be sovereign, frugal and reliable thanks to advanced methods and tools used for qualification and validation. Thales has the dual AI and line-of-business expertise needed to incorporate these solutions into its systems to significantly improve their operational capabilities, said David Sadek, Thales VP Research, Technology & Innovation in charge of Artificial Intelligence.
Thales and AI
As the Groups defence and security businesses address critical requirements, often with safety-of-life implications, Thales has developed an ethical and scientific framework for the development of trusted AI based on the four strategic pillars of validity, security, explainability and resp
Europe Stories
04/09/2025
Monumental Sports & Entertainment (MSE), in collaboration with Dalet, has been a...
08/05/2025
As expected, continued weak demand from key sales markets and declining economic...
08/05/2025
A new three-part series is coming to BBC iPlayer and BBC One
(Image: The Christie Archive Trust)
The BBC has announced Agatha Christie's Endless Night, a...
08/05/2025
08 May 2025
VEON Shareholders Re-elect Board at 2025 AGM, Founder Augie Fabela ...
08/05/2025
Comedy and entertainment channel U&Dave bring back their #1 ranked programme of ...
08/05/2025
Expect even more chaos this July with Harriet Webb leading the returning cast, p...
08/05/2025
TenneT relies on Arvato Systems for market communication
Energy industry: Impressive market communication know-how and system integration expertise
G tersloh...
08/05/2025
When Taiki Hamamoto, 22, came across a Hanafuda deck at his local game shop, he was intrigued. He had grown up playing the traditional Japanese card game with f...
08/05/2025
The Liveline is now open , said Joe Duffy earlier today, as he previewed this af...
08/05/2025
RT , in association with the BBC, Screen Ireland and Cineflix Rights has reveale...
07/05/2025
Discovering music should feel effortless and fun. That's why Spotify continu...
07/05/2025
FOX Doubles Down on the Laughs Renewing Comedies Animal Control, Starring Joel M...
07/05/2025
07 May 2025
VEON's QazCode Signs MoU with Seekr to Develop AI-Powered Solut...
07/05/2025
UKTV has ordered a feature length documentary celebrating the life of Britain...
07/05/2025
Wednesday 7 May 2025
Shaun the Sheep fans are in for a baaaarilliant treat in 2...
07/05/2025
Rohde & Schwarz to highlight innovative broadcast technologies at CABSAT 2025 Rohde & Schwarz will showcase its latest energy-efficient transmitters and 5G Br...
07/05/2025
The Importance of Workflow Efficiencies in Post-Production Wednesday, 14 May
14:40
FilmLight sits down with Sam Lempp, head of business development for Nara, ...
07/05/2025
RT News is pleased to announce the appointment of RT journalist, Fergal O'Brien, as its new Business Correspondent.
In his new role, Fergal will be repor...
06/05/2025
In Colombia, music isn't just background noise-it's center stage. It'...
06/05/2025
En Colombia, la m sica no suena de fondo: es el centro del escenario. Es el cora...
06/05/2025
At Spotify, we always seek ways to connect users with their next favorite podcas...
06/05/2025
Since Spotify's 2019 launch in India, the growth of the country's local ...
06/05/2025
eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({...
06/05/2025
Comscore Reports First Quarter 2025 ResultsRESTON, Va., May 6, 2025 Comscore, Inc. (Nasdaq: SCOR), a trusted partner for planning, transacting and evaluating ...
06/05/2025
Live from Studio 1 at 7pm, Tuesday May 6
Iconic trad-fusion group K LA will be ...
06/05/2025
Rohde & Schwarz hosts RF Testing Innovations Forum 2025, helping design engineer...
06/05/2025
LONDON, UK, May 6, 2025 /PRNewswire/ -- Today at the company s annual THINK event, IBM (NYSE: IBM) is unveiling new hybrid technologies that break down the long...
06/05/2025
Apple today introduced Tap to Pay on iPhone in Bulgaria, Finland, Hungary, Liechtenstein, Poland, Portugal, Slovakia, Slovenia, and Switzerland, enabling millio...
06/05/2025
Ahead of Pride Month, Apple is introducing a new Apple Watch Pride Edition Sport Band, watch face, and iPhone and iPad wallpaper to celebrate the strength and b...
06/05/2025
First episode airs this Friday at 8pm on RT One and RT Player with Doireann N Ghlac in presenting
Guests include Barry Murphy, Brooke Scullion, Bryan Dobso...
05/05/2025
As Europe gears up for the Eurovision Song Contest 2025, Spotify is celebrating the spirit of unity and musical legacy with a new series of Spotify Singles. Fiv...
05/05/2025
As part of the restructuring of its loss-making Carbon Fibers business unit, SGL Carbon has decided to close its production site in Lavradio (Portugal). Lavradi...
05/05/2025
Comscore Launches Certified Deal IDs in Magnite's SSP, Bringing Trusted Cont...
02/05/2025
Updated May 2: In a victory for consumers, artists, creators, and authors, Apple...
02/05/2025
Since 2022, Spotify and FC Barcelona have brought the worlds of music and footba...
02/05/2025
With more than 678 million users worldwide tuned in to Spotify, we're at the heart of music and culture. Our unrivaled global community of artists, songwrit...
02/05/2025
Data Communications Company has announced its partnership with IBM to modernise ...
02/05/2025
Comscore at the 20th Annual Needham Technology, Media, & Consumer Conference RESTON, Va., May 2 2025: Comscore (Nasdaq: SCOR), a trusted partner for planning, t...
02/05/2025
02 May 2025
VEON to release 1Q25 trading update on May 15, 2025 Dubai, May 2, 2025 - VEON Ltd. (NASDAQ: VEON), a global digital operator, today confirms that t...
02/05/2025
CUPERTINO, CALIFORNIA Apple today announced financial results for its fiscal 2025 second quarter ended March 29, 2025. The Company posted quarterly revenue of $...
02/05/2025
Well-known faces pushed to their limits in Uncharted with Ray Goggins...
01/05/2025
As Tanzania approaches a pivotal election year marked by both promise and concern over the impact of artificial intelligence (AI) on media, more than 300 journa...
01/05/2025
After four years of lectures, study sessions, exams, and parties, college senior...
01/05/2025
Prochazka knows the power of relationships, so it has always been important to him that ATEC Pro be renowned for more than just supplying great equipment. Becom...
01/05/2025
Munster and Connacht Football Finals onThe Sunday Game Live
Final two days of t...
01/05/2025
Voice actor and producer Mark Yoshimoto Nemcoff shares his first impressions of the DPA 2017 Shotgun Microphone, from real-world auditions to side-by-side compa...
01/05/2025
With my previous console, Freeman recalls, I always had to run a Waves server for EQ and compression, but when I switched to DiGiCo, I found it was such an op...
01/05/2025
Stream all episodes ofLook Who's Hangry from April 29
An RT Player Original in partnership with Heinz...
01/05/2025
Here is your host, Patrick Kielty!
T naiste, Minister for Foreign Affairs and T...
Facebook 
