AI Safety Institute’s Post

The UK-US agreement on AI safety is a significant moment for the AI Safety Institute and for the development of global safety standards on AI.  Here’s what it involves: The US and UK AI Safety Institutes will jointly test advanced AI models. We will also share research insights, share model access, and enable expert secondments between the Institutes. This will allow us to develop a shared framework for testing advanced AI and international best practices for other countries to follow. By working together, the UK and US can minimise the risks of AI and harness its potential to help everyone live happier, healthier and more productive lives. Find out more: https://lnkd.in/eX4bsy6G

We are announcing new grants for research into systemic AI safety.   Initially backed by up to £8.5 million, this programme will fund researchers to advance the science underpinning AI safety.   The world needs to think carefully about how to adapt our infrastructure and systems for a new world in which AI is embedded in everything we do. This programme is designed to generate a huge body of ideas for how to tackle this problem, and to help make sure great ideas can be put into practice. Read more: https://lnkd.in/eHHiFCbG

We're opening an office in San Francisco! This will enable us to hire more top talent, collaborate closely with the US AI Safety Institute, and engage even more with the wider AI research community. In London, we have built a leading research team in government, attracting senior alumni from OpenAI, Google DeepMind, and Oxford. We're excited to keep building this team globally now and to drive international coordination around AI safety. Find out more: https://lnkd.in/eButCCAi

We have published our latest progress report.    Read more below on our fast-paced work delivering on our mission to evaluate AI models and advance the science on AI risk.    https://lnkd.in/giphDpGe

We open-sourced Inspect, our framework for large language model evaluations: https://lnkd.in/eZgtjHe8. Inspect enables researchers to easily create simple benchmark-style evaluations, scale up to more sophisticated evaluations, and build interactive workflows.   Sharing Inspect through open source means our approach to AI safety evaluations is now available to anyone to use and improve, leading to high-quality evaluations across the board and boosting collaboration on AI safety testing. We're excited to see the research community use and build upon this work!

1 year ago today, we started out as the Foundation Model Taskforce with £100m investment from the UK government.   Today, we're the AI Safety Institute.   In the last year, we've built our team, evaluated new models and enhanced global AI safety.

The legacy of Bletchley Park will continue with two days of talks in May at the AI Seoul Summit.   AI safety is a shared global challenge, and these continued discussions will ensure we can deliver a safe, responsible approach to AI development.