Sony Pixel Power calrec Sony

French MoD challenge : Thales performs a successful sovereign AI hack and presents enhanced security solutions for military and civil AI

23/11/2023

Facebook

Twitter

LinkedIn

The Friendly Hackers team from Thales, a world leader in data protection and cybersecurity, has won the CAID[1] challenge organised by the French Ministry of Defence2 during the fifth edition of European Cyber Week in France (November 21 - 23, 2023).

The challenge, the first of its kind to be organised by the French Ministry of Defence, was designed to evaluate the extent to which teams of hackers could exploit certain intrinsic vulnerabilities of AI models.

Thaless work on AI security and trust is aligned with the requirements of both the defence community and civilian organisations such as critical infrastructure providers, which all face the same challenges of protecting their training datasets and intellectual property, and guaranteeing that AI-generated results can be trusted for critical decision-making.

Rodolphe LAMPE, Senior Data Scientist in the Thales team, with Alice H liou, Vincent Thouvenot, Cong-Bang Huynh and Baptiste MorisseThe French Ministry of Defences AI security challenge

Participants in the CAID challenge had to perform two tasks:

In a given set of images, determine which images were used to train the AI algorithm and which were used for the test.

An AI-based image recognition application learns from large numbers of training images. By studying the inner workings of the AI model, Thaless Friendly Hackers team successfully determined some of the images that had been used to create the application, gaining valuable information about the training methods used and the quality of the model.

2. Find the images of aircrafts used by a AI algorithm that had been protected using unlearning techniques.

An unlearning technique consists of deleting the data used to train a model, such as images, in order to preserve their confidentiality. This technique can be used, for example, to protect the sovereignty of an algorithm in the event of its export, theft or loss. For example, a drone equipped with AI must be able to recognise any enemy aircraft as a potential threat. On the other hand, models of aircraft from its own army would have to be learned to be identified as friendly, then erased by a technique known as unlearning. In this way, even if the drone was stolen or lost, the sensitive aircraft data contained in the AI model could not be extracted for malicious purposes. However, the Friendly Hackers team from Thales managed to re-identify the data that was supposed to have been erased from the model, thereby overriding the unlearning process.

Exercises like this help to assess the vulnerability of training data and trained models, which are valuable tools and can deliver outstanding performance but also represent new attack vectors for the armed forces. An attack on training data or trained models could have significant consequences in a military context, where this type of information could give an adversary the upper hand. Risks include model theft, theft of the data used to recognise military hardware or other features in a theatre of operations, and backdoors to impair the operation of the system using the AI. While AI in general, and generative AI in particular, offers significant operational benefits and provides military personnel with intensively trained decision support tools to reduce their cognitive burden, the national defence community needs to address new threats to this technology as a matter of priority.

The Thales BattleBox approach to tackle AI vulnerabilities

The protection of training data and trained models is critical in the defence sector. AI cybersecurity is becoming more and more crucial, and needs to be autonomous to thwart the many new opportunities that the world of AI is opening up to malicious actors. Responding to the risks and threats involved in the use of artificial intelligence, Thales has developed a set of countermeasures called the BattleBox to provide enhanced protection against potential breaches.

BattleBox Training provides protection from training-data poisoning, preventing hackers from introducing a backdoor.

BattleBox IP digitally watermarks the AI model to guarantee authenticity and reliability.

BattleBox Evade aims to protect models from prompt injection attacks, which can manipulate prompts to bypass the safety measures of chatbots using Large Language Models (LLMs), and to counter adversarial attacks on images, such as adding a patch to deceive the detection process in a classification model.

BattleBox Privacy provides a framework for training machine learning algorithms, using advanced cryptography and secure secret-sharing protocols to guarantee high levels of confidentiality.

To prevent AI hacking in the case of CAID challenge tasks, countermeasures such as encryption of the AI model could be one of the solutions to be implemented.

AI provides considerable operational benefits, but it requires high levels of security and cybersecurity protection to prevent data breaches and misuse. Thales implements a large range of AI-based solutions for all types of civil and military use cases. Intended to be explainable, embeddable and integrated within robust critical systems, they are also designed to be sovereign, frugal and reliable thanks to advanced methods and tools used for qualification and validation. Thales has the dual AI and line-of-business expertise needed to incorporate these solutions into its systems to significantly improve their operational capabilities, said David Sadek, Thales VP Research, Technology & Innovation in charge of Artificial Intelligence.

Thales and AI

As the Groups defence and security businesses address critical requirements, often with safety-of-life implications, Thales has developed an ethical and scientific framework for the development of trusted AI based on the four strategic pillars of validity, security, explainability and resp
LINK: https://www.thalesgroup.com/en/worldwide/security/press_release/french...
See more stories from thales

Europe Stories

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

01/06/2026

Dolby Sets the New Standard for Premium Entertainment at CES 2026

January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026 Throughout the week, Dolby brings to life the latest innovatio...

02/05/2026

Dalet Flex LTS Delivers Smarter Search, Faster Editing, and an AI-Ready Foundation for Modern Media

Dalet, a leading technology and service provider for media-rich organizations, t...

01/05/2026

NBCUniversal's Peacock to Be First Streamer to Integrate Dolby's Full Suite of Premium Picture and Sound Innovations

January 5 2026, 18:30 (PST) NBCUniversal's Peacock to Be First Streamer to ...

01/04/2026

DOLBY AND DOUYIN EMPOWER THE NEXT GENERATON OF CREATORS WITH DOLBY VISION

January 4 2026, 18:00 (PST) DOLBY AND DOUYIN EMPOWER THE NEXT GENERATON OF CREATORS WITH DOLBY VISION Douyin Users Can Now Create And Share Videos With Stun...

05/03/2026

Spotify's Creator Milestone Awards Honor the Latest Slate of Record-Breaking Podcasts

A little over a year ago, Spotify introduced the quarterly Creator Milestone Awa...

05/03/2026

Rohde & Schwarz enables rapid validation of next-gen Wi-Fi 8 networking platforms, including 5x5 MIMO capabilities

Rohde & Schwarz enables rapid validation of next-gen Wi-Fi 8 networking platform...

05/03/2026

Rohde & Schwarz acquires Software Radio Systems (SRS), specialists in software defined mobile communications solutions

Rohde & Schwarz acquires Software Radio Systems (SRS), specialists in software d...

05/03/2026

Sky News secures ninth News Channel of the Year award as Yalda Hakim, Yousra Elbagir and Mollie Malone honoured at RTS Awards

Thursday 5 March 2026 Sky News secures ninth News Channel of the Year award as ...

05/03/2026

Sky Sports launches first ever nationwide creator competition to find a Grid Insider for the 2026 Formula 1 season

Thursday 5 March 2026 Sky Sports launches first ever nationwide creator competi...

05/03/2026

Harmonic Accelerates Streaming and Broadcast Transformations at the 2026 NAB Show

SAN JOSE, Calif. - March 5, 2026 - At the 2026 NAB Show, Harmonic (NASDAQ: HLIT)...

05/03/2026

Comscore and Yahoo DSP Partner to Advance CTV Political Advertising with Proximic Political Audiences

Comscore and Yahoo DSP Partner to Advance CTV Political Advertising with Proximi...

04/03/2026

Spotify A/Presenta Brings Fans Closer to Artists' Creative Process in Latin America, Starting With ROSALA

For many fans, a song's backstory can be just as compelling as the final pro...

04/03/2026

Spotify Kicks Off Our 20th Anniversary at SXSW With a Celebration of Artists, Creators, and Fans

In 2006, Spotify was founded on the belief that technology could bring artists a...

04/03/2026

Spotify and Coca-Cola Saddle Up for a Rhinestone Cowboy Experience at the Houston Rodeo

Spotify is back on the ground for the Houston Livestock Show and Rodeo, and we&#...

04/03/2026

Spotify Doubles Down on Investments in Australian Fan Discovery of Homegrown Aussie Talent

Spotify had an energizing week in Sydney, Australia, filled with powerful conver...

04/03/2026

FKA twigs and Jordan Hemingway Explore the Making of HARD' in Episode Two of Directed By'

Earlier this year, we launched Directed By, a documentary-style series that pull...

04/03/2026

KT and Rohde & Schwarz to showcase AI-enhanced radio transmission performance

KT and Rohde & Schwarz to showcase AI-enhanced radio transmission performance In a joint 6G AI proof-of-concept demonstration, the CMX500 one-box tester from ...

04/03/2026

SES publishes 2025 Annual Report

Luxembourg, 3 March 2026 - SES S.A. has today published its 2025 Annual Report, following the announcement of the company's full year financial results for ...

04/03/2026

Transforming Africa's Future Farmers: Satellite-Enabled IoT Powers Data-Driven Agribusinesses

Luxembourg, March 3, 2026 - SES, a leading space solutions company, along with I...

04/03/2026

VEON Partners with GSMA Innovation Fund to Accelerate Digital Innovation in Pakistan and Bangladesh

04 Mar 2026 VEON Partners with GSMA Innovation Fund to Accelerate Digital Innov...

04/03/2026

VEON's Beeline Uzbekistan and Rakuten Symphony Partner for Open RAN, AI Collaboration

04 Mar 2026 VEON's Beeline Uzbekistan and Rakuten Symphony Partner for Open...

04/03/2026

Sky Sports unveils plans for 2026 Formula 1 coverage

Wednesday 4 March 2026 Sky Sports unveils plans for 2026 Formula 1 coverage Sky Sports is preparing for one of the most highly anticipated F1 seasons in recen...

03/03/2026

How Multi-Format Readers' Are Redefining Reading in the UK's National Year of Reading

For many, finding time or headspace to pick up a book can feel out of reach, but...

03/03/2026

Rohde & Schwarz and Realtek demonstrate first test solution for Bluetooth LE High Data Throughput (HDT)

Rohde & Schwarz and Realtek demonstrate first test solution for Bluetooth LE Hi...

03/03/2026

Clear-Com Supplies Cloud-based Communications System for SaxaVord Spaceport

eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({ content_source:......

03/03/2026

Full Year 2025 Results

Luxembourg, 2 March 2026 -- SES S.A. fully consolidates Intelsat from 17 July 2025 and announces financial results for the year ended 31 December 2025 FY25 Pe...

03/03/2026

RT is Supporting 20 Arts and Cultural Events all over Ireland this March

RT is proud to support a rich and diverse programme of arts and cultural events taking place across Ireland throughout March 2026. This month brings a remarkab...

03/03/2026

VEON and MeetKai Expand Collaboration to Explore Sovereign AI Infrastructure Partnerships

03 Mar 2026 VEON and MeetKai Expand Collaboration to Explore Sovereign AI Infra...

03/03/2026

Ryan Reynolds and Rob Mac land first ever live commentary gig exclusively on Sky Sports for Wrexham vs Swansea

Tuesday 3 March 2026 Ryan Reynolds and Rob Mac land first ever live commentary ...

03/03/2026

The Dyers Caravan Park reopens for a second season after a hit launch on Sky

Tuesday 3 March 2026 The Dyers' Caravan Park reopens for a second season after a hit launch on Sky The Dyers' Caravan Park JPEG (510KB) Sky books a ...

03/03/2026

Vyve Broadband Selects Harmonic for Network Modernization

Harmonic's cOS Virtualized Broadband Platform Simplifies Network Operations, Lowers Hardware Dependency and Enables Seamless DOCSIS and Fiber Growth SAN JO...

03/03/2026

Comscore to Announce Fourth Quarter and Full Year 2025 Financial Results

Comscore to Announce Fourth Quarter and Full Year 2025 Financial ResultsRESTON, VA, March 3, 2026 Comscore, Inc. (Nasdaq: SCOR), a trusted partner for plannin...

03/03/2026

2026-01-30

Self-taught on iMovie, Hanagami transitioned to Final Cut Pro in 2009, discovering that professional tools could give him full creative control over how his wor...

03/03/2026

RT Media Sales: Spry Finance renews Marty In The Morning lyric fm sponsorship for a fourth year

RT Media Sales has announced Spry Finance has renewed it's sponsorship of M...

02/03/2026

Rohde & Schwarz demonstrates FR1-FR3 carrier aggregation, advancing 6G readiness

Rohde & Schwarz demonstrates FR1-FR3 carrier aggregation, advancing 6G readiness Rohde & Schwarz and Qualcomm Technologies, Inc. have reached another pivotal ...

02/03/2026

aconnic and Arqit join forces to present the first quantum-safe industrial OT security gateway firewall at Mobile World Congress 2026

aconnic AG (ISIN: DE000A0LBKW6), Munich, and Arqit Quantum Inc. (Nasdaq: ARQQ, A...

02/03/2026

SES and Africa Mobile Network Reach Milestone: Connecting 5.8 Million in DRC, Expanding Rural Coverage

Luxembourg, February 26, 2026 - SES and Africa Mobile Network (AMN) have expande...

02/03/2026

Saturday Night Live UK announces writing team

Monday 2 March 2026 Saturday Night Live UK announces writing team L-R: Jonno Johnson; Charlie Skelton; Celya AB; Omar Badawy; Gr inne Maguire; Laura Claxton; ...

27/02/2026

Gorillaz Invites Fans Into Its World With Exclusive Spotify Experience and London Mural Quest

Since its inception, Gorillaz has been known for blending art with genre-bending...

27/02/2026

Find Your Next Great Listen With Spotify's New Audiobook Charts

This week, Spotify introduced Audiobook Charts for the U.S. and U.K. The charts make it easy to discover your next favorite book by showing what's popular a...

27/02/2026

Rohde & Schwarz and Viasat to collaborate on NB-NTN IoT test plan for connectivity via satellite

Rohde & Schwarz and Viasat to collaborate on NB-NTN IoT test plan for connectivi...

27/02/2026

Designing AI based features in the MSC

In media technology, big features often steal the spotlight - AI integrations, cloud transformations, automation frameworks. But for the people who use these to...

27/02/2026

Has Video outgrown your DAM?

Digital Asset Management systems sit at the heart of most marcoms operations. They centralise content, organise it, and make it discoverable. Integrated with th...

27/02/2026

NAB

The AI Wild West comes to NAB 2026 and Blue Lucy is bringing the Sheriff The AI Wild West is here, and media organisations are feeling the heat. On Booth W23...

27/02/2026

No-holds-barred feature documentary Billy Idol Should Be Dead coming to Sky Arts on 26 March

A deeply personal, uncompromising portrait of the legendary punk rock iconFriday...

27/02/2026

RT Media Sales: SIRO to sponsor Home of the Year on RT One

One of Ireland's favourite lifestyle shows Home of the Year, returns for its 12th series and will be proudly sponsored by SIRO. The brand-new series will ai...