FAR.AI is an AI safety research non-profit

We facilitate technical breakthroughs and foster global collaboration

Three pillars of fAR.AI

FAR.AI is spearheading AI Safety work in 3 different ways.

At FAR.AI, we are motivated by the potential risks posed by rapid advances in AI capabilities. Our mission is to ensure advanced AI is safe and beneficial for everyone.

We spark much-needed technical breakthroughs through our in-house research team and targeted grants to academic research groups. We also bring together policymakers, industry leaders and academics to foster a coordinated global solution for safe AI development.

Our 2027 goals

At FAR.AI, we are guided by two ambitious goals that we aim to achieve by the end of 2027.

1. Incubate highly impactful new research directions to substantially reduce risks from advanced AI.

We're accomplishing this through a combination of in-house research, research collaboration, targeted field-building efforts, and providing funding to promising initiatives. So far, our research teams have launched groundbreaking projects in AI robustness, evaluation, and interpretability. Through our grantmaking program, we're funding millions to external researchers and organizations exploring novel solutions in AI safety.

2. Enable a coordinated global response to AI safety by steering relevant actors

We drive global coordination on AI safety by convening top researchers, policymakers, and governance experts. Through the Alignment Workshop Series, IDAIS, and partnerships with AI safety institutes, we accelerate the right research directions and shape key policy debates.

Our history

No one has a plan to make advanced AI systems safe. This realization led our founders, Adam & Karl, to start FAR.AI in July 2022 focused on technical innovation to make AI systems safe, and coordination to ensure these techniques are adopted. Since then, our research has been cited in congress, featured in major media outlets, and won best paper awards. Our programs have directed millions of dollars in grant funding and our events have empowered global leaders in AI safety. We're proud of what we've achieved, but our team are just getting started.

Q3
2022

FAR.AI is founded

We incorporated in October 2022.

Q4
2022

Weaknesses in superhuman Go AIs

We found vulnerabilities in superhuman Go AI systems, one of the first of many influential research papers.

Q1
2023

Alignment Workshop established

We established the Alignment Workshop as a recurring series after a successful pilot organized by top researchers in Q1 2023.

Q3
2023

Founded FAR.Labs coworking space

We now have 40+ active members,
and a thriving community of AI Safety organizations.

Q3
2023

Incubated IDAIS

Bringing together leading scientists from around the world to collaborate on mitigating risks from AI.

Q4
2023

Started red teaming

Red teaming leading language models for frontier labs.

Q3
2024

Started grantmaking

Started our targeted grantmaking program, supporting a range of research on critical AI safety problems.

2025

Today...

We continue to conduct impactful research and organise highly-rated events and programs.

Our team

Meet the people behind FAR.AI

Our team comprises dedicated experts with diverse backgrounds in machine learning, AI safety, and related fields. Their collective expertise and passion drive our mission forward.

Support us

FAR.AI is committed to ensuring that advanced AI systems are developed safely and ethically. Together, we can shape a future where AI technologies benefit all of humanity.

Join our team

Become part of our mission-driven organization and help shape the future of AI safety.

Donate to us

Support our efforts in making AI systems are safe and beneficial.