Tag: Downing Street

A new global hub based in the UK and tasked with testing the safety of emerging types of AI has been backed by leading AI companies and nations, as the world’s first AI Safety Institute launches today (2 November).

After four months of building the first team inside a G7 Government that can evaluate the risks of frontier AI models, it has been confirmed today that the Frontier AI Taskforce will now evolve to become the AI Safety Institute, with Ian Hogarth continuing as its Chair. The External Advisory Board for the Taskforce, made up of industry heavyweights from national security to computer science, will now advise the new global hub.

The Institute will carefully test new types of frontier AI before and after they are released to address the potentially harmful capabilities of AI models, including exploring all the risks, from social harms like bias and misinformation, to the most unlikely but extreme risk, such as humanity losing control of AI completely. In undertaking this research, the AI Safety Institute will look to work closely with the Alan Turing Institute, as the national institute for data science and AI.

In launching the AI Safety Institute, the UK is continuing to cement its position as a world leader in AI safety, working to develop the most advanced AI protections of any country in the world and giving the British people peace of mind that the countless benefits of AI can be safely captured for future generations to come.

World leaders and major AI companies have today expressed their support for the Institute as the world’s first AI Safety Summit concludes. From Japan and Canada to OpenAI and DeepMind, the collective backing of key players will strengthen international collaboration on the safe development of frontier AI – putting the UK in prime position to become the home of AI safety and lead the world in seizing its enormous benefits.

Leading researchers at the Alan Turing Institute and Imperial College London have also welcomed the Institute’s launch, alongside representatives of the tech sector in TechUK and the Startup Coalition.

Already, the UK has agreed two partnerships: with the US AI Safety Institute, and with the Government of Singapore to collaborate on AI safety testing – two of the world’s biggest AI powers.

Deepening the UK’s stake and influence in this transformative technology, it will also advance the world’s knowledge of AI safety – with the Prime Minister committing to invest in its safe development for the rest of the decade, as part of the Government’s record investment into R&D.

Prime Minister Rishi Sunak said:

Our AI Safety Institute will act as a global hub on AI safety, leading on vital research into the capabilities and risks of this fast-moving technology.

It is fantastic to see such support from global partners and the AI companies themselves to work together so we can ensure AI develops safely for the benefit of all our people. This is the right approach for the long-term interests of the UK.

Secretary of State for Science, Innovation, and Technology, Michelle Donelan said:

The AI Safety Institute will be an international standard bearer. With the backing of leading AI nations, it will help policymakers across the globe in gripping the risks posed by the most advanced AI capabilities, so that we can maximise the enormous benefits.

We have spoken at length about the Summit at Bletchley Park being a starting point, and as we reach the final day of discussions, I am enormously encouraged by the progress we have made and the lasting processes we have set in motion.

The launch of the AI Safety Institute marks the UK’s contribution to the collaboration on AI safety testing agreed by world leaders and the companies developing frontier AI at a session in Bletchley Park this afternoon.

New details revealed today, as governments from across the globe gathered for a second day of talks, set out the body’s mission to prevent surprise to the UK and humanity from rapid and unexpected advances in AI. Ahead of new powerful models expected to be released next year whose capabilities may not be fully understood, its first task will be to quickly put in place the processes and systems to test them before they launch – including open-source models.

From its research informing UK and international policymaking, to providing technical tools for governance and regulation – such as the ability to analyse data being used to train these systems for bias – it will see the government take action to make sure AI developers are not marking their own homework when it comes to safety.

AI Safety Institute Chair Ian Hogarth, said:

The support of international governments and companies is an important validation of the work we’ll be carrying out to advance AI safety and ensure its responsible development.

Through the AI Safety Institute, we will play an important role in rallying the global community to address the challenges of this fast-moving technology.

Researchers are already in place to head up the work of the Institute who will be provided with access to the compute needed to support their work. This includes making use of the new AI Research Resource, an expanding £300 million network that will include some of Europe’s largest super computers, increasing the UK’s AI super compute capacity by a factor of thirty.

It follows the UK Government’s announcement yesterday of additional investment in Bristol’s “Isambard-AI” and a new computer called “Dawn” in Cambridge, that researchers will be able to access at the same time to boost their research and make AI safe. The AI Safety Institute will have priority access to this cutting-edge supercomputer to help develop its programme of research into the safety of frontier AI models and supporting government with this analysis.

It comes as government representatives were joined by CEOs of leading AI companies and a number of civil society leaders earlier today to discuss the year ahead and consider what immediate steps are needed – by countries, companies, and other stakeholders – to ensure the safety of frontier AI.

As the final day of talks come to a close at Bletchley Park, the AI Safety Summit has already laid the foundations for talks on frontier AI safety to be an enduring discussion with South Korea set to host next year.

Further information:

• Read an overview of the AI Safety Institute.
• A CEO for the Institute will be recruited in due course.

Notes for editors:

U.S. Secretary of Commerce Gina Raimondo said:

I welcome the United Kingdom’s announcement to establish an AI Safety Institute, which will work together in lockstep with the U.S. AI Safety Institute to ensure the safe, secure, and trustworthy development and use of advanced AI. AI is the defining technology of our generation, carrying both enormous potential and profound risk. Our coordinated efforts through these institutes is only the beginning of actions to facilitate the development of safety standards, build testing capabilities for advanced AI models, and to expand information-sharing, research collaboration, interoperability, and policy alignment across the globe on AI safety.

Singapore Minister for Communications and Information Josephine Teo said:

The rapid acceleration of AI investment, deployment and capabilities will bring enormous opportunities for productivity and public good. We believe that governments have an obligation to ensure that AI is deployed safely. We agree with the principle that governments should develop capabilities to test the safety of frontier AI systems. Following the MoUs on Emerging Technologies and Data Cooperation signed by Singapore and the UK earlier this year, we have agreed to collaborate directly with the UK to build capabilities and tools for evaluating frontier AI models. This will involve a partnership between Singapore’s Infocomm Media Development Authority and the UK’s new AI Safety Institute. The objective is to build a shared understanding of the risks posed by frontier AI. We look forward to working together with the UK to build shared technical and research expertise to meet this goal.

Canadian Minister of Innovation, Science and Industry, the Honourable François-Philippe Champagne said:

Canada welcomes the launch of the UK’s AI Safety Institute. Our government looks forward to working with the UK and leveraging the exceptional Canadian AI knowledge and expertise, including the knowledge developed by our AI institutes to support the safe and responsible development of AI.

The Government of Japan said:

The Japanese Government appreciate the UK’s leadership in holding the AI Safety Summit and welcomes the UK initiative to establish the UK AI Safety Institute. We look forward to working with the UK and other partners on AI safety issues toward achieving safe, secure, and trustworthy AI.

The German Government said:

Germany is interestedly taking notice of the foundation of the AI Safety Institute and is looking forward to exploring possibilities of cooperation.

CEO of Amazon Web Services Adam Selipsky said:

We commend the launch of the UK AI Safety Institute. As one of the world’s leading developers and deployers of AI tools and services, Amazon is committed to collaborating with government and industry in the UK and around the world to support the safe, secure, and responsible development of AI technology. We are dedicated to driving innovation on behalf of our customers and consumers, while also establishing and implementing the necessary safeguards to protect them.

CEO & co-founder of Anthropic Dario Amodei said:

While AI promises significant societal benefits, it also poses a range of potential harms. Critical to managing these risks is government capacity to measure and monitor the capability and safety characteristics of AI models. The AI Safety Institute is poised to play an important role in promoting independent evaluations across the spectrum of risks and advancing fundamental safety research. We welcome its establishment and look forward to partnering closely to advance safe and responsible AI.

CEO & co-founder of Google DeepMind Demis Hassabis said:

AI can help solve some of the most critical challenges of our time, from curing disease to addressing the climate crisis. But it will also present new challenges for the world and we must ensure the technology is built and deployed safely. Getting this right will take a collective effort from governments, industry and civil society to inform and develop robust safety tests and evaluations. I’m excited to see the UK launch the AI Safety Institute to accelerate progress on this vital work.

CEO & co-founder of Inflection Mustafa Suleyman said:

We welcome the Prime Minister’s leadership in establishing the UK AI Safety Institute and look forward to collaborating to ensure the world reaps the benefit of safe AI.

President of Global Affairs at Meta Sir Nick Clegg said:

Everyone has a responsibility to ensure AI is built and deployed responsibly to create social and economic opportunities for all. We look forward to working with the new Institute to deepen understanding of the technology, and help develop effective and workable benchmarks to evaluate models. It’s vital that we establish ways to assess and address the current challenges AI presents, as well as the potential risks from technology that does not yet exist.

Vice Chair and President of Microsoft Brad Smith said:

We applaud the UK Government’s creation of an AI Safety Institute with its own testing capacity for safety and security. Microsoft is committed to supporting the new Institute and to advancing the close collaboration that will be needed among governments, with industry, and with academic researchers and across civil society. These new steps will be vital to ensuring that innovation and safety move forward together.

CEO of OpenAI Sam Altman said:

The UK AI Safety Institute is poised to make important contributions in progressing the science of the measurement and evaluation of frontier system risks. Such work is integral to our mission – ensuring that artificial general intelligence is safe and benefits all of humanity – and we look forward to working with the Institute in this effort.

Dr Jean Innes, CEO of The Alan Turing Institute, said:

AI has immense potential to do good, but in order to realise the benefits our societies must be confident that risks are being addressed. We welcome the AI Safety Institute which will generate further momentum in this global endeavour, and we look forward to collaborating in the weeks and months ahead, helping to leverage the Turing’s expertise alongside the science and innovation capabilities of the UK’s universities, research community and wider AI ecosystem, building on the country’s strong track record of delivering work on AI safety, ethics and standards.

Executive Director of Startup Coalition Dom Hallas said:

We’re proud to see the UK take this critical step in its work on AI safety because a well-rounded approach to the issues at hand is vital to the AI ecosystem. When partnered with the UK’s other initiatives – and hopefully future ones that tackle talent, compute, and investment – that all focus on safe scaling and AI adoption, the UK is well on its way to creating a state capacity unlike any of our international competitors. Nailing the fundamentals of AI safety and building the regulatory capacity to keep up with the rate of innovation are large steps. When coupled with a well-rounded approach that tackles the needs of our AI startups and scaleups, the AI Safety Institute will help ensure the UK and its businesses’ places as global AI leaders.

Julian David, CEO of techUK, said:

techUK welcomes the establishment of the AI Safety Institute which will carry forward the UK’s pioneering work on Frontier AI. We are pleased that the Institute will have three clear objectives: to develop and conduct evaluations on advanced AI systems; to drive foundational AI safety research; and to facilitate information exchange. These are important but complex tasks and it is vital that the Institute has access to the compute capacity and skills that it will need.The diplomatic effort invested in the AI Safety Summit should help to ensure that the Institute is well placed to build further international collaboration on frontier AI. We look forward to working with the AI Safety Institute to facilitate industry collaboration in this important area.

Professor Mary Ryan, Vice-Provost (Research and Enterprise), Imperial College London said:

The new UK AI Safety Institute is an important step in our understanding of AI risks. Universities will play a critical role with the new Institute in the UK AI ecosystem – accelerating innovation from foundational to applied AI. Only by combining deep technical and academic expertise together with that of industry and policymakers, can we effectively develop frameworks that will ensure the safe, productive and accelerated deployment of AI.

Shahid Omer, Director of Policy at Universities UK said:

We welcome today’s announcement that will help to cement the UK’s status as a world-leader in AI research and AI safety. Backed by the world-leading research and innovation of UK universities, this important new Institute can help the UK to further understand and take advantage of AI, in a safe and secure manner.

UK universities are well placed to explore both the technological and societal impacts of AI. New funding announced earlier this week will also enable our universities to continue to carry out cutting-edge research into AI, boost the UK’s own AI skills base, as well as help attract talented AI researchers from overseas.

They discussed the rapid development of AI and the need to manage the risks in order to seize its opportunities. With Italy taking over the G7 presidency next year, the Prime Minister set out the UK’s support for Italy’s agenda on AI.

They turned to the ongoing war in Ukraine, where the PM reiterated that support for Ukraine will remain unwavering.

The leaders also spoke about the need to ensure long-term stability in the Middle East, in light of the growing humanitarian crisis following the terror inflicted by Hamas in Israel. They agreed to support both Israeli and Palestinian civilians now and in the future through continued international collaboration in the region.

They concluded by committing to work together on the shared priorities, including tackling illegal migration and trafficking in Europe.

The leaders discussed the importance of a better global understanding of the capabilities and risks surrounding frontier AI and how we can work together on this. The Prime Minister also welcomed the European Union’s support of the landmark Bletchley Declaration which will deepen international coordination on AI safety.

Both leaders agreed to work closely together on issues of international peace and security, in particular dealing with the humanitarian crisis in the Middle East and continuing to back Ukraine against Russian aggression in Europe. Both agreed that stepping up our efforts to tackle the humanitarian crisis in Gaza is a key priority.

The Prime Minister welcomed the Secretary-General’s attendance at the AI Summit and the establishment of the United Nations’ AI Advisory Body. The Prime Minister looked forward to its recommendations next year, which would be informed by the discussions at the AI Safety Summit and the ‘State of the Science’ report on frontier AI risk driven by the UK. They discussed the need for close global collaboration on AI safety, and the Prime Minister set out how the UK AI Safety Institute would be taking forward this work with global partners.

The leaders then discussed the worsening humanitarian situation in Gaza and agreed on the importance of urgently scaling up the delivery of life-saving humanitarian aid. The Prime Minister set out the work the UK is doing to support, including doubling aid funding for the United Nations and others’ work in Gaza and pre-positioning emergency supplies and equipment in Egypt. The Prime Minister and the Secretary-General agreed on the need to reinvigorate international efforts to reach a lasting resolution to the conflict and progress work towards a two-state solution.

The two leaders also discussed the war in Ukraine. The Prime Minister raised concerns about the breakdown of the Black Sea Grain Initiative and stressed the importance of maintaining support for Ukraine.

The Prime Minister welcomed the United States Vice President Kamala Harris to Downing Street for the first time this afternoon.

Ahead of travelling to the AI Safety Summit tomorrow, they discussed the need for global collaboration on the novel opportunities and risks presented by frontier AI, including issues like bias and disinformation. The Vice President thanked the Prime Minister for hosting the first summit to take forward these discussions.

The Prime Minister welcomed the shared focus on AI safety, including the announcement of a new US institute that will work closely alongside the UK’s AI Safety Institute to boost research into the capabilities and risks of this technology.

The Prime Minister and Vice President also spoke about the humanitarian crisis in Gaza. The Prime Minister reiterated Israel’s right to defend itself against terror as well as the need to get more humanitarian aid into Gaza and to free hostages taken by Hamas. Both agreed that the UK and US were aligned in these efforts and would continue to work with partners in the region to ensure stability.

The Prime Minister and Vice President also stressed the importance of continued support for Ukraine and close collaboration on the fight against Russian aggression.

Millions of people across the country are set to receive significant cost of living support ahead of winter, with the government freezing bus fares in England and the second cost-of-living payment – worth £900 in total – landing directly in bank accounts from today.

The bus fare cap had been due to rise to £2.50 but we are keeping the fares down at £2 until the end of next year to help millions of people make significant savings on their travel costs. The fare cap has helped cut bus fares in England outside London by 7.4% between June 2022 and June 2023, with even bigger savings in rural areas where fares have dropped by almost 11%.

This extension is only possible due to the redirected HS2 funding as part of our Network North plan and takes the total government investment to keep bus fares down to nearly £600 million – with over 140 operators signing up to continue offering the cap across more than 5,000 routes.

Over 8 million households across the UK will also receive the second of up to three payments from today, totalling up to £900 through 2023/24 with a further cost of living payment due to be made to eligible households by Spring next year.

These payments are entirely tax-free, will not count towards the benefit cap, and will not have any impact on existing benefit awards. Those who are eligible will be paid automatically and do not need to apply for the payment or do anything to receive it.

Prime Minister Rishi Sunak said:

I know that winter can be a particularly challenging period for many families across the country. That’s why we have put in place a package of immediate support for vulnerable households over the coming months.

We are lowering travel costs through the bus fare cap, which we are able to do because of our long-term decision to cancel phase 2 of HS2. We are also providing an extra top up to help pay energy bills and direct payments to cover the cost of day-to-day essentials.

But the best way to put more money in the pockets of hardworking people is to focus on the long-term decisions that will help not only them, but future generations too. We’re on track to halve inflation which will help people’s wages go further, and we’re growing the economy to create better paid jobs and opportunities across the country.

We are also committed to helping vulnerable households across the UK with their energy bills over winter. Winter Fuel Payments – boosted again this year by an additional £300 per household Pensioner Cost of Living payment – will provide pensioners with up to £600 to help with heating costs over the colder months.

On top of this, nearly three million low-income households are also eligible for a £150 rebate on their winter electricity bills through the Warm Home Discount. From tomorrow (1st November) Cold Weather Payments will also come into effect to provide eligible households £25 extra a week when the temperature is zero or below for more than seven days across the UK.

Transport Secretary Mark Harper said:

Buses are the most popular form of public transport and help people across the country get to work, attend medical appointments, and see loved ones – that’s why we are extending the ‘Get Around for £2’ scheme all the way to 31 December 2024.

Extending the £2 bus fare cap has only been possible with the redirected HS2 funding secured by this Government making the right long-term decisions for a brighter future, delivering immediate benefits and helping people save money.”

Mel Stride, Secretary of State for Work and Pensions, said:

Tackling inflation is the best way to boost people’s incomes, but as we work to halve it, we are protecting the most vulnerable households from high prices with this latest Cost of Living payment.

Thousands of Work Coaches based in Jobcentres across the country are on hand to help people find work or enhance their skills, and I encourage anyone wanting to strengthen their finances and unleash the benefits of work to contact their local Jobcentre to see what help is available.

Taken together, these measures build on the significant cost of living support already provided to eligible households throughout last year – now worth an average of £3,300 per household over this year and last.

We have also gone further by:

• Increasing benefits in line with inflation, meaning more than 10 million working age families will see an average increase of around £600.
• Maintaining the Triple Lock earlier this year to give around 12 million pensioners the largest ever cash increase to the State Pension.
• Extending the Household Support Fund for another year in England to help families with essential costs with £1 billion of extra funding.
• Increasing the National Living Wage by its largest ever cash amount for 2 million workers – worth over £1,600 to the annual earnings of a full-time worker – and committing to increase it to over £11 an hour from April 2024.
• Cutting fuel duty by 5 pence and freezing the increase, worth £100 to the average driver this year.
• Covering up to 85% of childcare costs for working households on Universal Credit, up from 70% under the legacy system – currently worth over £19,500-a-year for families with two or more children.

The government has a strong record on supporting the most vulnerable and lifting households out of poverty, with the latest data showing there were nearly 1 million fewer workless households since 2010 and 1.7 million fewer people in absolute poverty after housing costs over the last decade.

We know the best route out of poverty is through work, which is why we’ve introduced a package of measures worth £3.5 billion to break down the barriers for people to find jobs and fulfil their potential. This includes our flagship Universal Support scheme which will get thousands more people into jobs with a personal adviser providing wraparound support for up to a year while they find their feet.

We encourage people in need of additional support over winter to check their eligibility through our Help for Households website for the various cost of living schemes that are place.

The leaders discussed the humanitarian crisis unfolding in Gaza, and the Prime Minister once again expressed his deep condolences for the tragic loss of civilian life.

The Prime Minister set out the intensive diplomatic and practical efforts the United Kingdom is making to rapidly increase the delivery of life-saving aid to Gaza, following the announcement that the UK will double aid funding for Palestinian civilians. President Abbas thanked the Prime Minister for his active engagement in the region.

President Abbas also updated on the security situation in the West Bank. The Prime Minister emphasised the importance of making progress on the peace process to ensure that Palestinian civilians in both Gaza and the West Bank can live in security and prosperity.

He said the UK would continue to support diplomatic action to protect Palestinian civilians, prevent wider escalation and secure a peaceful and lasting resolution to the crisis.