Facebook
Twitter
LinkedIn
The Friendly Hackers team from Thales, a world leader in data protection and cybersecurity, has won the CAID[1] challenge organised by the French Ministry of Defence2 during the fifth edition of European Cyber Week in France (November 21 - 23, 2023).
The challenge, the first of its kind to be organised by the French Ministry of Defence, was designed to evaluate the extent to which teams of hackers could exploit certain intrinsic vulnerabilities of AI models.
Thaless work on AI security and trust is aligned with the requirements of both the defence community and civilian organisations such as critical infrastructure providers, which all face the same challenges of protecting their training datasets and intellectual property, and guaranteeing that AI-generated results can be trusted for critical decision-making.
Rodolphe LAMPE, Senior Data Scientist in the Thales team, with Alice H liou, Vincent Thouvenot, Cong-Bang Huynh and Baptiste MorisseThe French Ministry of Defences AI security challenge
Participants in the CAID challenge had to perform two tasks:
In a given set of images, determine which images were used to train the AI algorithm and which were used for the test.
An AI-based image recognition application learns from large numbers of training images. By studying the inner workings of the AI model, Thaless Friendly Hackers team successfully determined some of the images that had been used to create the application, gaining valuable information about the training methods used and the quality of the model.
2. Find the images of aircrafts used by a AI algorithm that had been protected using unlearning techniques.
An unlearning technique consists of deleting the data used to train a model, such as images, in order to preserve their confidentiality. This technique can be used, for example, to protect the sovereignty of an algorithm in the event of its export, theft or loss. For example, a drone equipped with AI must be able to recognise any enemy aircraft as a potential threat. On the other hand, models of aircraft from its own army would have to be learned to be identified as friendly, then erased by a technique known as unlearning. In this way, even if the drone was stolen or lost, the sensitive aircraft data contained in the AI model could not be extracted for malicious purposes. However, the Friendly Hackers team from Thales managed to re-identify the data that was supposed to have been erased from the model, thereby overriding the unlearning process.
Exercises like this help to assess the vulnerability of training data and trained models, which are valuable tools and can deliver outstanding performance but also represent new attack vectors for the armed forces. An attack on training data or trained models could have significant consequences in a military context, where this type of information could give an adversary the upper hand. Risks include model theft, theft of the data used to recognise military hardware or other features in a theatre of operations, and backdoors to impair the operation of the system using the AI. While AI in general, and generative AI in particular, offers significant operational benefits and provides military personnel with intensively trained decision support tools to reduce their cognitive burden, the national defence community needs to address new threats to this technology as a matter of priority.
The Thales BattleBox approach to tackle AI vulnerabilities
The protection of training data and trained models is critical in the defence sector. AI cybersecurity is becoming more and more crucial, and needs to be autonomous to thwart the many new opportunities that the world of AI is opening up to malicious actors. Responding to the risks and threats involved in the use of artificial intelligence, Thales has developed a set of countermeasures called the BattleBox to provide enhanced protection against potential breaches.
BattleBox Training provides protection from training-data poisoning, preventing hackers from introducing a backdoor.
BattleBox IP digitally watermarks the AI model to guarantee authenticity and reliability.
BattleBox Evade aims to protect models from prompt injection attacks, which can manipulate prompts to bypass the safety measures of chatbots using Large Language Models (LLMs), and to counter adversarial attacks on images, such as adding a patch to deceive the detection process in a classification model.
BattleBox Privacy provides a framework for training machine learning algorithms, using advanced cryptography and secure secret-sharing protocols to guarantee high levels of confidentiality.
To prevent AI hacking in the case of CAID challenge tasks, countermeasures such as encryption of the AI model could be one of the solutions to be implemented.
AI provides considerable operational benefits, but it requires high levels of security and cybersecurity protection to prevent data breaches and misuse. Thales implements a large range of AI-based solutions for all types of civil and military use cases. Intended to be explainable, embeddable and integrated within robust critical systems, they are also designed to be sovereign, frugal and reliable thanks to advanced methods and tools used for qualification and validation. Thales has the dual AI and line-of-business expertise needed to incorporate these solutions into its systems to significantly improve their operational capabilities, said David Sadek, Thales VP Research, Technology & Innovation in charge of Artificial Intelligence.
Thales and AI
As the Groups defence and security businesses address critical requirements, often with safety-of-life implications, Thales has developed an ethical and scientific framework for the development of trusted AI based on the four strategic pillars of validity, security, explainability and resp
Europe Stories
06/10/2025
France T l visions, France's leading broadcaster, has received the 2025 EBU ...
04/09/2025
Monumental Sports & Entertainment (MSE), in collaboration with Dalet, has been a...
07/08/2025
July 8 2025, 22:30 (PDT) Tata Motors & Dolby Bring Dolby Atmos to Harrier.ev, R...
14/07/2025
Enhancing Public Service Broadcasting with
Innovation, Accuracy & Sustainability
New regional detail and local towns featured...
11/07/2025
If you've ever wondered what might be playing in Clark Kent's headphones...
11/07/2025
AI and Multimedia Authenticity Standards Collaboration launches two papers to guide the future of AI integration, today at the AI for Good Global Summit
The...
10/07/2025
The current holder of the prestigious Thomson Foundation Young Journalist of the Year Award has been forced to stop reporting over fears for her safety in Afgha...
10/07/2025
Spotify is turning up the volume on Australian music with a multipronged initiative designed to highlight the dominance of Australian artists on the global stag...
10/07/2025
This is not a drill: Oasis is back on the road-marking its first live performanc...
10/07/2025
The music industry depends on fresh ideas, bold voices, and emerging talent. Yet across the U.K., too many young musicians lack the space to develop their craft...
10/07/2025
10 Jul 2025
VEON and Cohen Circle Secure Investor Commitments for Kyivstar Listing Kyiv, New York, Dubai, and Philadelphia - July 10, 2025 - VEON Ltd. (Nasdaq:...
10/07/2025
Thursday 10 July 2025
The Very Small Creatures
Jaime's Treetop Tales
Emerald
BooSnoo! Christmas Mashup
Pip & Posy's Spooktacular Party
The Very Sm...
10/07/2025
Thursday 10 July 2025
Brand new rewards are coming to Sky customers, with free ...
10/07/2025
Comscore Achieves Full JIC Certification for National TV Measurement Including...
09/07/2025
Wednesday 9 July 2025
Sky Broadband now has the UK's fastest broadband spee...
09/07/2025
CUPERTINO, CALIFORNIA Apple today announced Jeff Williams will transition his role as chief operating officer later this month to Sabih Khan, Apple's senior...
08/07/2025
In an era where digital threats to journalists are becoming increasingly aggressive and widespread, MediaSafe Africa launches as a vital online resource to help...
08/07/2025
This summer, as the energy builds for one of the biggest moments in women's ...
08/07/2025
UKTV today announces that Richard Watsham, Chief Creative Officer at UKTV and Global Director of Acquisitions for BBC Studios/UKTV, has decided to step down fro...
08/07/2025
SAN JOSE, Calif. - July 8, 2025 - Harmonic (NASDAQ: HLIT) today announced a reco...
08/07/2025
Arvato Systems Optimizes Customer Communication with AOK Niedersachsen
New project in the statutory health insurance sector
Arvato Systems and AOK Niedersach...
08/07/2025
On August 7, Apple Arcade is adding four exclusive games to its diverse catalogue of more than 200 fun games for players to enjoy, all free from ads and in-app ...
07/07/2025
** MEDIA ALERT **
VIZ Media Ignites AX 2025 with Star-Studded Panels, Exclus...
07/07/2025
CULVER CITY, CALIFORNIA As Apple Music marks its 10th anniversary this year, Apple unveils its most ambitious creative project to date: a brand-new state-of-the...
07/07/2025
RT has announced that Mark Bignell has been appointed Commissioning Editor for Comedy following a public competition. This senior editorial position will drive...
04/07/2025
The Summer Reading Challenge has inspired children across the U.K. to embrace a ...
04/07/2025
Friday 4 July 2025
Watch the trailer here https://youtu.be/Od5WpvWmDr8
Further...
04/07/2025
The Pitch comes to RT Radio 1 airwaves this Sunday at 7pm. The Pitch is a brand...
03/07/2025
For our Vario-Jib, as well as for a repertoire of weights, we now have carts that make transport easier...
03/07/2025
One of our latest innovations: Slider Drive Unit!
Our Vario Slider not only comes with improvements and new features, but also with its own drive unit!
Our i...
03/07/2025
The 360 EVO lives up to its name: 360-degree rotation not only on the pan axis, but also on the roll axis, enables filmmakers to take their creative visions eve...
03/07/2025
What a buzzing few days at BSCExpo in London!
We were thrilled to connect with so many talented professionals from the world of cinematography.
A huge thank ...
03/07/2025
ADOLESCENCE - Shot with Panther Tower"The whole rig had to be detachable mid-episode
Netflix limited drama series Adolescence has been gaining attentio...
03/07/2025
** MEDIA ALERT ** Shonen Jump Store Hosting Los Angeles Pop-up During Anime Exp...
03/07/2025
Thursday 3 July 2025
David Harewood and Matthew Broome in Mozart: Genius for Hi...
03/07/2025
The Sky WNT Fund supports Womens National Team players with a 30,000 bursaryThursday 3 July 2025
Sky Ireland has announced the four recipients of the 2025 Sky...
02/07/2025
Calrec expands ecosystem at NAB 2025 giving broadcasters access to dynamic workflows and ultimate flexibility Helping broadcasters meet the shifting needs of me...
02/07/2025
02 Jul 2025
VEON Raises USD 200 Million in Private Bond Placement Dubai, July 1, 2025: VEON Ltd. (Nasdaq: VEON), a global digital operator ( VEON ), announces ...
02/07/2025
Brand new factual series follows mechanic and self-taught engineer Dom Chinea as he makes the move of his life to the far west of Cornwall
UKTV today announces...
02/07/2025
Rohde & Schwarz acquires ZES ZIMMER Electronic Systems GmbH and expands its T&M ...
02/07/2025
Wuppertal July 2, 2025
Riedel Communications Launches RefSuite Ecosystem for S...
02/07/2025
Andrew will serve as Chair of ABC alongside his role at NED, APL Media, where he supports the executive team with strategic insight and global expansion plans. ...
01/07/2025
The launch of Code of Silence, coupled with the Britains Got Talent semi final, gave ITV its best Sunday night of 2025.
The first episode of the new crime dr...
01/07/2025
ITV and Mammoth Screen have announced the start of filming for Betrayal, a gripp...
01/07/2025
eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({ content_source:......
01/07/2025
Vocal-processing plug-in joins NOIZ Hub series
Launched in 2024, KIT Plugins' NOIZ Hub series was created with the aim of providing a range of professio...
01/07/2025
New self-paced learning programme announced
Mastering.com have announced the availability of a new online course designed to cover the fundamentals of maste...
01/07/2025
The Traitors are coming: Get your first taste of the global hit as Season 1 of T...
Facebook 
