Facebook
Twitter
LinkedIn
The Friendly Hackers team from Thales, a world leader in data protection and cybersecurity, has won the CAID[1] challenge organised by the French Ministry of Defence2 during the fifth edition of European Cyber Week in France (November 21 - 23, 2023).
The challenge, the first of its kind to be organised by the French Ministry of Defence, was designed to evaluate the extent to which teams of hackers could exploit certain intrinsic vulnerabilities of AI models.
Thaless work on AI security and trust is aligned with the requirements of both the defence community and civilian organisations such as critical infrastructure providers, which all face the same challenges of protecting their training datasets and intellectual property, and guaranteeing that AI-generated results can be trusted for critical decision-making.
Rodolphe LAMPE, Senior Data Scientist in the Thales team, with Alice H liou, Vincent Thouvenot, Cong-Bang Huynh and Baptiste MorisseThe French Ministry of Defences AI security challenge
Participants in the CAID challenge had to perform two tasks:
In a given set of images, determine which images were used to train the AI algorithm and which were used for the test.
An AI-based image recognition application learns from large numbers of training images. By studying the inner workings of the AI model, Thaless Friendly Hackers team successfully determined some of the images that had been used to create the application, gaining valuable information about the training methods used and the quality of the model.
2. Find the images of aircrafts used by a AI algorithm that had been protected using unlearning techniques.
An unlearning technique consists of deleting the data used to train a model, such as images, in order to preserve their confidentiality. This technique can be used, for example, to protect the sovereignty of an algorithm in the event of its export, theft or loss. For example, a drone equipped with AI must be able to recognise any enemy aircraft as a potential threat. On the other hand, models of aircraft from its own army would have to be learned to be identified as friendly, then erased by a technique known as unlearning. In this way, even if the drone was stolen or lost, the sensitive aircraft data contained in the AI model could not be extracted for malicious purposes. However, the Friendly Hackers team from Thales managed to re-identify the data that was supposed to have been erased from the model, thereby overriding the unlearning process.
Exercises like this help to assess the vulnerability of training data and trained models, which are valuable tools and can deliver outstanding performance but also represent new attack vectors for the armed forces. An attack on training data or trained models could have significant consequences in a military context, where this type of information could give an adversary the upper hand. Risks include model theft, theft of the data used to recognise military hardware or other features in a theatre of operations, and backdoors to impair the operation of the system using the AI. While AI in general, and generative AI in particular, offers significant operational benefits and provides military personnel with intensively trained decision support tools to reduce their cognitive burden, the national defence community needs to address new threats to this technology as a matter of priority.
The Thales BattleBox approach to tackle AI vulnerabilities
The protection of training data and trained models is critical in the defence sector. AI cybersecurity is becoming more and more crucial, and needs to be autonomous to thwart the many new opportunities that the world of AI is opening up to malicious actors. Responding to the risks and threats involved in the use of artificial intelligence, Thales has developed a set of countermeasures called the BattleBox to provide enhanced protection against potential breaches.
BattleBox Training provides protection from training-data poisoning, preventing hackers from introducing a backdoor.
BattleBox IP digitally watermarks the AI model to guarantee authenticity and reliability.
BattleBox Evade aims to protect models from prompt injection attacks, which can manipulate prompts to bypass the safety measures of chatbots using Large Language Models (LLMs), and to counter adversarial attacks on images, such as adding a patch to deceive the detection process in a classification model.
BattleBox Privacy provides a framework for training machine learning algorithms, using advanced cryptography and secure secret-sharing protocols to guarantee high levels of confidentiality.
To prevent AI hacking in the case of CAID challenge tasks, countermeasures such as encryption of the AI model could be one of the solutions to be implemented.
AI provides considerable operational benefits, but it requires high levels of security and cybersecurity protection to prevent data breaches and misuse. Thales implements a large range of AI-based solutions for all types of civil and military use cases. Intended to be explainable, embeddable and integrated within robust critical systems, they are also designed to be sovereign, frugal and reliable thanks to advanced methods and tools used for qualification and validation. Thales has the dual AI and line-of-business expertise needed to incorporate these solutions into its systems to significantly improve their operational capabilities, said David Sadek, Thales VP Research, Technology & Innovation in charge of Artificial Intelligence.
Thales and AI
As the Groups defence and security businesses address critical requirements, often with safety-of-life implications, Thales has developed an ethical and scientific framework for the development of trusted AI based on the four strategic pillars of validity, security, explainability and resp
Most recent headlines
06/10/2025
France T l visions, France's leading broadcaster, has received the 2025 EBU ...
04/09/2025
Monumental Sports & Entertainment (MSE), in collaboration with Dalet, has been a...
07/08/2025
July 8 2025, 22:30 (PDT) Tata Motors & Dolby Bring Dolby Atmos to Harrier.ev, R...
15/07/2025
Independent media outlets in Brazil and Colombia are invited to apply for a new programme aimed at strengthening the long-term resilience of journalism in the f...
15/07/2025
By Lucy Spicer
One of the most exciting things about the Sundance Film Festival...
15/07/2025
Spotify une fuerzas con DiDi, la app l der en servicios de movilidad, delivery y...
15/07/2025
The National Film and Video Foundation (NFVF), an agency of the Department of Sp...
15/07/2025
L3Harris put its CORVUS-RAVEN counter-small UAS capability into the hands of soldiers at VANAHEIM, showcasing its ability to provide passive signal detect, enha...
15/07/2025
Netflix Viewing Up 13.5% vs. May, Represents 42% of Monthly Gain for Streaming
...
15/07/2025
SAN FRANCISCO and BENGALARU, India Sangeeta Chakraborty has been named chief revenue officer at Amagi, a cloud-based software-as-a-service (SaaS) technology pro...
15/07/2025
As part of its mandate, the Advanced Television Systems Committee the U.S. organization tasked with developing advanced broadcast TV standards promotes ATSC 3.0...
15/07/2025
QuickLink, the leading global provider of multi-camera video productions and remote contributions, announces the launch of two innovative control panels Studi...
15/07/2025
Chris Kontopanos has joined leading high-quality microphone solutions manufacturer, DPA Microphones, as the company's new Regional Sales Manager for the Mid...
15/07/2025
Magnifi by VideoVerse, a global leader in AI-powered video automation, has launched a major platform upgrade built to simplify live and archival video editing f...
15/07/2025
Telestream, a global leader in media workflow technologies, will preview its latest innovations at IBC2025, Stand 7.B21. This year's showcase highlights how...
15/07/2025
IBC2025 is set to transform the onsite experience for its global attendees with the launch of a pioneering new feature: full integration of Amsterdam's GVB ...
15/07/2025
Music, sport and technology collided in spectacular fashion as ASB GlassFloor powered the debut of Beats N Buckets, Germany's first Basketball meets Hip-Ho...
15/07/2025
The Collectv, the Emmy award-winning broadcast solutions and workflows consultancy - and winner of Broadcast Tech's Team of the Year is delighted to announc...
15/07/2025
SipRadius, the expert in secure, low latency media transport, will showcase how broadcasters and media companies can take control of fragmented IP workflows at ...
15/07/2025
Appear, the global leader in live production technology, today announced its strategic partnership with beIN ASIA PACIFIC, a leading multi-platform sports media...
15/07/2025
Company marks 15 years of innovation at the show
Broadpeak, a leader in streaming and monetization at scale, will return to IBC (Hall 1, Stand F83. RAI, Amster...
15/07/2025
New software solutions extend trusted timing measurement across broadcast, venue, and professional AV applications
Hitomi Broadcast, the market leader in audi...
15/07/2025
SHENZHEN, China Telycam has added control options for its portfolio of pan-tilt-zoom (PTZ) cameras with a new plug-in for Elgato's Stream Deck family of con...
15/07/2025
MELVILLE, N.Y. Chyron said its Chyron LIVE cloud-native live production solution has successfully completed the Amazon Web Services (AWS) Foundational Technical...
15/07/2025
PHILADELPHIA The Xumo streaming platform joint venture between Comcast and Charter has announced the nationwide launch of a new line of Xumo TVs from Westinghou...
15/07/2025
LONGMONT, Colo. DPA Microphones said Chris Kontopanos has joined the microphone solutions provider as its new regional sales manager, Mid-Atlantic....
15/07/2025
NOT FOR DISTRIBUTION IN OR INTO OR TO ANY PERSON LOCATED OR RESIDENT IN THE UNIT...
15/07/2025
Audiences and ad dollars are moving to streaming - media organizations are evolving to meet them there....
15/07/2025
U&GOLD has acquired the broadcast rights for Fawlty Towers: The Play (1x120'). Recorded during the show's run at the West End with its original cast, Fa...
15/07/2025
Live From MLB All-Star 2025: FOX Sports Aims To Capture Chatty Players on the Fi...
15/07/2025
Live From MLB All-Star 2025: From Live Event Coverage to Studio Shows, MLB Netwo...
15/07/2025
Live From MLB All-Star 2025: FOX Sports' Francisco Contreras and Tom Lynch o...
15/07/2025
Live From MLB All-Star: FOX Sports' Production Is Bigger Than Ever in Steamy...
15/07/2025
Live From MLB All-Star: FOX Sports Director Matt Gangl and Producer Pete Machesk...
15/07/2025
TV SIM builds for the future with high efficiency transmitter from Rohde & Schwa...
15/07/2025
News Corp Authorizes New $1 Billion Stock Repurchase Program and Intends to Acce...
15/07/2025
Back to All News
Netflix Announces the Start of Production of Los secretos de l...
15/07/2025
Harmonic's Hybrid, AI-Powered and Live Sports Streaming Innovations are Key ...
15/07/2025
The well-known and well-loved 4099 has been completely revamped. It features amazing CORE+ technology, which eliminates distortion and extends dynamic range, a ...
15/07/2025
Comscore Partners with HyphaMetrics to Launch Advanced Person-Level Audience Mea...
15/07/2025
Peak audiences of over half a million tune into both Kerry v Tyrone and Donegal ...
15/07/2025
PROTON Announces Production Facility Expansion Ahead of IBC2025 posted: 15/07/2025
Proton Announces Production Facility Expansion Ahead of IBC2025
Alongs...
15/07/2025
Submissions for NVIDIA's Plug and Play: Project G-Assist Plug-In Hackathon a...
14/07/2025
The Royal Moroccan Air Force hosted a C-130 award ceremony with L3Harris Technologies President of Intelligence, Surveillance and Reconnaissance Jason Lambert a...
14/07/2025
UK launch set for September, following on from recent US and Germany releases
London - UK, July 14, 2025 - Nielsen, a global leader in audience measurement, da...
14/07/2025
SHENZHEN, China Telycam has added control options for its portfolio of pan-tilt-zoom (PTZ) cameras with a new plug-in for Elgato's Stream Deck family of con...
14/07/2025
The awards are open to IBC2025 show exhibitors and offer a valuable platform for companies to raise awareness for the new products and solutions they will be la...
14/07/2025
Clear-Com is excited to announce a significant expansion of the award-winning Arcadia Central Station with new software updates. Together, these releases dram...
Facebook 
