Safeguarded AI: Theory
ARIA is an R&D funding agency built to unlock scientific and technological breakthroughs that benefit everyone. We empower scientists and engineers to pursue research at the edge of what is technologically or scientifically possible. We will reach across disciplines, sectors and institutions to shape, fund and manage projects across the R&D ecosystem, from startups to universities, to break down silos and discover new pathways. We are looking for proposals for our Safeguarded AI: Theory programme. For more info see here https://www.aria.org.uk/programme-safeguarded-ai/
- Opening date:
- Closing date: (Midday)
Contents
Summary
Why this programme
As AI becomes more capable, it has the potential to power scientific breakthroughs, enhance global prosperity, and safeguard us from disasters. But only if it’s deployed wisely.Current techniques working to mitigate the risk of advanced AI systems have serious limitations, and can’t be relied upon empirically to ensure safety. To date, very little R&D effort has gone into approaches that provide quantitative safety guarantees for AI systems, because they’re considered impossible or impractical.
What we’re shooting for
By combining scientific world models and mathematical proofs we will aim to construct a ‘gatekeeper’, an AI system tasked with understanding and reducing the risks of other AI agents.In doing so we’ll develop quantitative safety guarantees for AI in the way we have come to expect for nuclear power and passenger aviation.
Our goal: to usher in a new era for AI safety, allowing us to unlock the full economic and social benefits of advanced AI systems while minimising risks.
For more information, see here.
Eligibility
Eligibility crtieria can be found in the programme call documents on ARIA's website here.
Objectives
See ARIA website for more detail here.
Dates
Detailed timelines can be found in the programme call information on ARIA's website here. The deadline for submission of proposals is 28.05.24 (12:00 BST).
How to apply
See ARIA's website here.
Supporting information
The total funding value is the estimated budget available. We expect to fund multiple applicants.The maximum individual award figure is an estimate only. Funding is anticipated to be awarded via both contracts and grants. For more information on how we fund, see here.