Facebook
Twitter
LinkedIn
The Friendly Hackers team from Thales, a world leader in data protection and cybersecurity, has won the CAID[1] challenge organised by the French Ministry of Defence2 during the fifth edition of European Cyber Week in France (November 21 - 23, 2023).
The challenge, the first of its kind to be organised by the French Ministry of Defence, was designed to evaluate the extent to which teams of hackers could exploit certain intrinsic vulnerabilities of AI models.
Thaless work on AI security and trust is aligned with the requirements of both the defence community and civilian organisations such as critical infrastructure providers, which all face the same challenges of protecting their training datasets and intellectual property, and guaranteeing that AI-generated results can be trusted for critical decision-making.
Rodolphe LAMPE, Senior Data Scientist in the Thales team, with Alice H liou, Vincent Thouvenot, Cong-Bang Huynh and Baptiste MorisseThe French Ministry of Defences AI security challenge
Participants in the CAID challenge had to perform two tasks:
In a given set of images, determine which images were used to train the AI algorithm and which were used for the test.
An AI-based image recognition application learns from large numbers of training images. By studying the inner workings of the AI model, Thaless Friendly Hackers team successfully determined some of the images that had been used to create the application, gaining valuable information about the training methods used and the quality of the model.
2. Find the images of aircrafts used by a AI algorithm that had been protected using unlearning techniques.
An unlearning technique consists of deleting the data used to train a model, such as images, in order to preserve their confidentiality. This technique can be used, for example, to protect the sovereignty of an algorithm in the event of its export, theft or loss. For example, a drone equipped with AI must be able to recognise any enemy aircraft as a potential threat. On the other hand, models of aircraft from its own army would have to be learned to be identified as friendly, then erased by a technique known as unlearning. In this way, even if the drone was stolen or lost, the sensitive aircraft data contained in the AI model could not be extracted for malicious purposes. However, the Friendly Hackers team from Thales managed to re-identify the data that was supposed to have been erased from the model, thereby overriding the unlearning process.
Exercises like this help to assess the vulnerability of training data and trained models, which are valuable tools and can deliver outstanding performance but also represent new attack vectors for the armed forces. An attack on training data or trained models could have significant consequences in a military context, where this type of information could give an adversary the upper hand. Risks include model theft, theft of the data used to recognise military hardware or other features in a theatre of operations, and backdoors to impair the operation of the system using the AI. While AI in general, and generative AI in particular, offers significant operational benefits and provides military personnel with intensively trained decision support tools to reduce their cognitive burden, the national defence community needs to address new threats to this technology as a matter of priority.
The Thales BattleBox approach to tackle AI vulnerabilities
The protection of training data and trained models is critical in the defence sector. AI cybersecurity is becoming more and more crucial, and needs to be autonomous to thwart the many new opportunities that the world of AI is opening up to malicious actors. Responding to the risks and threats involved in the use of artificial intelligence, Thales has developed a set of countermeasures called the BattleBox to provide enhanced protection against potential breaches.
BattleBox Training provides protection from training-data poisoning, preventing hackers from introducing a backdoor.
BattleBox IP digitally watermarks the AI model to guarantee authenticity and reliability.
BattleBox Evade aims to protect models from prompt injection attacks, which can manipulate prompts to bypass the safety measures of chatbots using Large Language Models (LLMs), and to counter adversarial attacks on images, such as adding a patch to deceive the detection process in a classification model.
BattleBox Privacy provides a framework for training machine learning algorithms, using advanced cryptography and secure secret-sharing protocols to guarantee high levels of confidentiality.
To prevent AI hacking in the case of CAID challenge tasks, countermeasures such as encryption of the AI model could be one of the solutions to be implemented.
AI provides considerable operational benefits, but it requires high levels of security and cybersecurity protection to prevent data breaches and misuse. Thales implements a large range of AI-based solutions for all types of civil and military use cases. Intended to be explainable, embeddable and integrated within robust critical systems, they are also designed to be sovereign, frugal and reliable thanks to advanced methods and tools used for qualification and validation. Thales has the dual AI and line-of-business expertise needed to incorporate these solutions into its systems to significantly improve their operational capabilities, said David Sadek, Thales VP Research, Technology & Innovation in charge of Artificial Intelligence.
Thales and AI
As the Groups defence and security businesses address critical requirements, often with safety-of-life implications, Thales has developed an ethical and scientific framework for the development of trusted AI based on the four strategic pillars of validity, security, explainability and resp
Europe Stories
05/01/2027
Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...
07/10/2026
Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...
06/09/2026
June 9 2026, 23:00 (PDT) Dolby and MagentaTV Bring Fans Closer to the FIFA Worl...
19/08/2026
Studio owners invited to have their say on rates cuts
The Music Producers Guild (MPG) are inviting UK-based studios to take part in an in-depth survey that ...
19/08/2026
Vintage-inspired desktop interface revealed
Harrison's latest hardware offering sees them head into the world of audio interfaces, delivering a 10-in/12...
19/08/2026
Granular effect remains locked to scale and tempo
Described as your dream granular effect , Minimal Audio's latest creation is capable of turning any s...
19/08/2026
First polyphonic SWAM instrument incoming
Audio Modeling's latest physical-modelling orchestral instrument is just around the corner, and is now availab...
19/08/2026
There's an early Christmas gift for Bookish fans, as UKTV confirms the re-commission of the hit U&alibi drama, created by and starring Mark Gatiss. Viewers ...
19/08/2026
Wednesday 19 August 2026
Sky gives sports fans the chance to watch multiple liv...
19/08/2026
On Saturday September 5 Katie Taylor will step into the ring for the fight of her life against Flora Pili in front of 80,000 fans in Croke Park. A legendary fig...
18/08/2026
Company launch with stereo-imaging tool
Panoramic is the debut release from Panorama Labs, a new company formed by mastering engineer Nicholas Di Lorenzo. C...
18/08/2026
Control software now available for older interfaces
Focusrite have just announced the launch of an update that extends Control 2 software support their Scar...
18/08/2026
Tuesday 18 August 2026
Sky Sports and The Fast and the Curious announce new partnership
Sky Sports and The Fast and the Curious have announced a new long-term...
18/08/2026
Wuppertal August 18, 2026
Riedel Brings Professional Live Production Into the Classrooms of ECURiedel Communications today announced that Edith Cowan Universi...
18/08/2026
Apple today announced changes to its business terms for apps in the European Uni...
18/08/2026
THE HEALY RAES: BLOOD, SWEAT & TEARS AIRS WEDNESDAY AUGUST 19 ON RT ONE AT 9:35PM
A new documentary The Healy-Raes: Blood, Sweat & Tears airs on RT One and ...
18/08/2026
Stunning Irish performances at European Athletics and Swimming Championships rea...
18/08/2026
The two-part series begins Sunday 23 August at 6.30pm on RT One and RT Player
...
17/08/2026
New MIDI processor & macro controller revealed
SHIK have announced that they have opened pre-orders for the S32, a standalone MIDI processor and macro contr...
17/08/2026
Cover extended on innovative motorised pot system
Melbourne Instruments have just revealed that the innovative motorised pot system used in their synths and...
17/08/2026
Latest firmware version now available
1010music have just released a free firmware update that brings some nice new features to their renowned Bluebox digit...
17/08/2026
Rohde & Schwarz showcases integrated defense and test solutions at DALO Industry...
17/08/2026
Calrec's ImPulseV Virtualised Audio Mixing Engine joins NEP Platform, the industry's largest ecosystem of trusted production software, bringing scalable...
17/08/2026
Visitors to IBC 2026 will see how FilmLight is reshaping the modern post pipelin...
17/08/2026
Visitors to Stand 1.C41 can explore innovations in areas such as addressable advertising, hybrid distribution, managed services and operational simplification.
...
16/08/2026
Virtual drummer joins line-up
The latest release from Gospel Musicians adds a virtual drummer to the company's line-up, combining a pair of meticulously...
15/08/2026
In-ear monitoring line-up gains new universal models
In-ear monitoring experts JH Audio have just announced a significant expansion of their Universal-Fit r...
14/08/2026
Latest instalment delivers disco-inspired grooves
The latest addition to UJAM's virtual drum line-up has been designed with contemporary pop, disco, dan...
14/08/2026
Elite range gains giant 24-inch powered sub
The latest expansion of Yorkville's Elite range introduces what the company say is the world's first act...
14/08/2026
Friday 14 August 2026
Breaking news! Sky releases trailer for The Paper, return...
14/08/2026
It's been one year since our client, Cotswolds Designer Outlet, opened its doors and we've loved seeing the scheme come to life. Together, we've hel...
13/08/2026
Company preview bio-interactive' synthesizer
VAEMI have announced the upcoming launch of a new standalone bio-interactive' generative synthesizer....
13/08/2026
Plug-in host gains new Slot Scenes feature
Ravine DSP have recently updated their innovative plug-in host, kitting it out with a new feature that brings yet...
13/08/2026
New U and U&W Documentary Features Kathleen Richards, One of the Last Surviving Witnesses to Fred and Rose West
Kathleen is Reunited with Childhood Friend and ...
13/08/2026
Thursday 13 August 2026
Official trailer released for the return of Tea with Ju...
13/08/2026
Dalet, a leading technology and service provider for media-rich organizations, t...
13/08/2026
Wenvoe serves over 1 million people across South Wales
13 August 2026, Winchester, UK - Vale of Glamorgan MP, Kanishka Narayan, has praised the engineering exp...
13/08/2026
RT 's Miriam O'Callaghan welcomed a range of specially invited guests to the National Concert Hall last week for a unique event to mark a new season wit...
13/08/2026
August 13 2026, 06:00 (PDT) Seattle Seahawks Become First Team to Bring Dolby O...
12/08/2026
Enhanced DAW & plug-in control for the UC1, UF8 and UF1
The software that powers SSL's range of control surfaces has just received a major update that d...
12/08/2026
In-line preamp features one-knob EQ
In addition to their range of in-line preamps, Triton Audio recently managed to squeeze a compressor into an enclosure t...
12/08/2026
Captures system audio with or without a DAW
Depending on your setup, capturing system audio in a DAW can be a tedious process, so much so that Arvital Audio...
12/08/2026
Comscore Reports Second Quarter 2026 ResultsRESTON, Va., August 12, 2026 Comscore, Inc. (Nasdaq: SCOR), a trusted partner for planning, transacting and evalu...
12/08/2026
NEW BOOKSHOP OPENING IN LONDON THAT OFFERS NEW IDENTITIES, NOT BOOKS, WITH FREE ...
12/08/2026
Brand-new trailer unveiled as Sky announces SNL UK ticket ballot will open on 14...
12/08/2026
Wednesday 12 August 2026
Sky Sports agrees deal to show Laver Cup from London's O2
Sky Sports has agreed a deal with Trident8 to show all three days of th...
12/08/2026
Wednesday 12 August 2026
Pre-order the new Google Pixel 11 range from today and...
11/08/2026
Free library captures pro classical string section
There's no shortage of freebies in The Crow Hill Company's line-up, with their Vaults series offe...
11/08/2026
Percussion instrument introduces all-new engine
Emergence Audio have just introduced an instrument that brings together a vast collection of percussive anal...
Facebook 
