top of page

AI Safety Prize

Safe Artificial Intelligence

Submissions are currently closed. See the winners of the Final Prize here.

See the winners of the Rough Draft Prize here.

Prizes to be awarded at the Swiss Cyber Security Days 2024

Considering the increasing proliferation of AI systems with safety-critical implications, the think tank Pour Demain and the organisers of the Swiss Cyber Security Days (SCSD) launched the inaugural "AI Safety Prize" in partnership with the federal government and academia.

While companies are working tirelessly to develop ever more powerful AI models and applications, leading AI experts from research and business are surprised and increasingly concerned by the speed of these developments and warn of the potential negative impact on society.

Inspired by similar initiatives and the long-standing work of academics, NGOs, and industry such as the red-teaming of Dr. Rumman Chowdhury's Humane Intelligence or successful bug bounty programs from the cybersecurity industry, the AI Safety Prize is designed to reward individuals who identify and report security vulnerabilities in AI systems. This prize is the first of its kind in the German-speaking world and marks a milestone in the advancement of AI safety.

The AI Safety Prize was awarded for the first time in February 2024 during the Swiss Cyber Security Days in Bern. This unique event serves as a platform to draw the attention of business, science and politics to the topic of AI safety. The aim is to identify concrete security gaps in two categories and thus contribute to a better and safer use of AI systems.

Untitled design (3).jpg

Large Language Models

Vulnerabilities in large language models like ChatGPT.

Classical and specialised ML models

Vulnerabilities in classical and specialised ML models already deployed in critical infrastructures in Switzerland.

Abstract Background


Sign up to our newsletter below to ensure you don’t miss out on any updates!

August 1st, 2023: Window for submissions opens

October 31st: Submission of rough drafts (optional)

February 20/21 2024: Prize awards at the SCSD

August - October: Rolling feedback on submissions of rough drafts. Prize money will be awarded for the best rough drafts.

December 31st, 2023: Window for submissions closes


Register now to receive further information about the AI Safety Prize and the call for submissions

Thank you for submitting!

Wavy Circles


Abstract Lines


The AI Safety Prize team welcomes enquiries about potential collaborations with scientific and industry partners. We also encourage questions around submissions. Reach out at info (at)

Wavy Abstract Background


Pour Demain

Pour Demain is a non-profit think tank which mediates between science, politics and society. We address socially important issues and develop concrete, science-based proposals - with a positive impact for Switzerland and beyond.

Swiss Cyber Security Days

The Swiss Cyber Security Days SCSD is Switzerland's leading dialogue and know-how platform in the field of cyber security.

in the field of cyber security. The SCSD bridge the knowledge gap between technology, business and the population and offer politicians, administrators, experts and users insights into current and future threats and innovative solutions. The focus is on politics, business, education and research. The platform is open to all participating national and international actors for the exchange of information, inspiration and meetings with politicians, federal administration, business and leading cyber security experts. The fifth edition of the Swiss Cyber Security Days will take place on the 20th and 21st of February 2024 at the BERNEXO site.

bottom of page