Centre for the Governance of AI

A research nonprofit, spun out of Oxford's Future of Humanity InstituteFuture of Humanity Institute, prop. n.: Nick Bostrom's research center at Oxford University (2005–2024), where philosophers and scientists studied threats that could permanently derail humanity's future, advanced artificial intelligence among them. in 2021, that works on how governments, companies and international bodies should handle the risks of advanced AI and the economic and political changes it could bring, and that runs a large fellowship program for new researchers. Its staff and alumni developed or popularized ideas central to frontier-AI policy, including compute governancecompute governance, n.: Using control over the computer chips and data centers that AI depends on — who can buy them, where they go, how they are used — as a way to oversee powerful AI., regulation of frontier AIfrontier AI, n.: The most capable general-purpose AI systems of the moment — those at or beyond the leading edge — which governments single out for extra safety attention. through safety standards and licensing, model evaluations for extreme risks, third-party auditingthird-party AI evaluation, n.: Testing of an AI system by someone other than the company that made it — a government institute, a nonprofit lab or independent researchers — to check what it can do and how risky it is. and the analysis of company safety frameworksresponsible scaling policy, n.: A public rulebook in which an AI company promises to test each new model for dangerous abilities and to add stronger safeguards, or slow down, as its models become more capable., and its surveys of AI researchers and the public are widely cited. Its alumni hold senior roles at AI companies, government AI safety institutes and think tanks, making it a significant source of personnel for the field.