All Posts

The Vienna Alignment Workshop gathered researchers to explore critical AI safety issues, including Robustness, Interpretability, Guaranteed Safe AI, and Governance, with a keynote by Jan Leike. It was followed by an informal Unconference, fostering further discussions and networking.

We are seeking applications for a Head of Engineering to lead and scale our engineering team, driving the technical execution of our frontier AI safety research projects
Deadline: September 30th, 2024.

Giving RNNs extra thinking time at the start boosts their planning skills in Sokoban. We explore how this planning ability develops during reinforcement learning. Intriguingly, we find that on harder levels the agent paces around to get enough computation to find a solution.

Frontier LLMs like ChatGPT are powerful but not always robust. Scale helps with many things. We wanted to see if scaling up the model size can ‘solve’ robustness issues.

Achieving robustness remains a significant challenge even in narrow domains like Go. We test three approaches to defend Go AIs from adversarial strategies. We find these defenses protect against previously discovered adversaries, but uncover qualitatively new adversaries that undermine these defenses.

We conducted 17 semi-structured interviews of AI safety experts about their big picture strategic view of the AI safety landscape: how will human-level AI play out, how things might go wrong, and what should the AI safety community be doing. While many respondents held “traditional” views (e.g. the main threat is misaligned AI takeover), there was more opposition to these standard views than we expected, and the field seems more split on many important questions than someone outside the field may infer.

FAR AI is seeking applications for a Business Operations Manager, reporting directly to the Chief Operating Officer (COO). As Business Operations Manager, you will be responsible for day-to-day operational excellence at FAR AI, ensuring our systems, processes and projects are thriving.
Deadline: Jun 7th, 2024.

FAR AI is seeking a highly organized and detail-oriented Coworking Space Manager to oversee the daily operations of FAR Labs, our AI safety co-working hub.

FAR seeks a resourceful Head of Event to lead impactful events that bring together senior computer scientists and AI governance experts, building international collaboration to minimize extreme AI risks.