Home/resources/IMDA’s AI Safety Red Teaming Challenge

IMDA’s AI Safety Red Teaming Challenge

January 20, 2025

1 min read

IMDA, together with Humane Intelligence, completed the world’s first-ever multicultural and multilingual AI Safety Red Teaming Challenge focused on Asia-Pacific in November and December 2024! Over 350 participants across 9 countries tested 4 large language models for bias stereotypes in English and regional languages. AI safety initiatives like these go towards supporting the ongoing testing work of the AISI Network.

Stay tuned for the publication of the Challenge Evaluation Report in Feb 2025!

Other Related News

Improving Methodologies for AI Model Evaluations Across Global Languages

As part of the International Network of AI Safety Institutes’ continued effort to advance the science of AI model evaluations and work towards building common best practices for testing advanced AI systems, Singapore, Japan, and the United Kingdom led the Network’s latest joint testing exercise aimed at improving the efficacy of model evaluations across different languages

A Pilot Testing Exercise from the International Network of AI Safety Institutes

As part of the inaugural International Network of AI Safety Institutes (AISIs) convening in San Francisco last year, the Singapore AISI, alongside the US and UK AISIs, conducted a pilot joint testing exercise of a Gen AI model to explore methodological considerations impacting reproducibility – a key concept supporting the Network’s mission to develop best practices for model testing, amongst others. More details on the pilot testing exercise can be found in this jointly issued blogpost.