Agent foundations research for superintelligence-robust AI alignment.

We are Orthogonal, a non-profit alignment research organization focused on agent foundations, based in Europe.

We are pursuing the formal alignment flavor of agent foundations in order to solve alignment in a manner which would scale to superintelligence in order to robustly overcome AI risk. If we can afford to, we also intend to hire agent foundations researchers which, while not directly aimed at such an agenda, produce output which is likely to be instrumental to it, such as finding useful "true names".

Within this framework, our foremost agenda for the moment is QACI, and we expect to make significant progress on ambitious alignment within short timelines (months to years) and produce a bunch of dignity in the face of high existential risk.

Our goal is to be the kind of object-level research which cyborgism would want to accelerate. And when other AI organizations attempt to "buy time" by restraining their AI systems, we intend to be the research that this time is being bought for.

We intend to exercise significant caution with regards to AI capability exfohazards: Conjecture's policy document offers a sensible precedent for handling matters of internal sharing, and locked posts are a reasonable default for publishing our content to the outside. Furthermore, we would like to communicate about research and strategy with MIRI, whose model of AI risk we largely share and who we percieve to have the most experience with non-independent agent foundations research.

Including myself — Tamsin Leake, founder of Orthogonal and LTFF-funded AI alignment researcher — we have several promising researchers intending to work fulltime, and several more who are considering that option. I expect that we will find more researchers excited to join our efforts in solving ambitious alignment.

If you are interested in such a position, we encourage you to get acquainted with our research agenda — provided we get adequate funding, we hope to run a fellowship where people who have demonstrated interest in this research can work alongside us in order to test their fit as a fellow researcher at Orthogonal.

We might also be interested in people who could help us with engineering, management, and operations. And, in order to make all of that happen, we are looking for funding. For these matters or any other inquiries, you can get in touch with us at contact@orxl.org.

Orthogonal

Support impactful organizations solving the world’s biggest challenges with cutting edge research and policy.

## The Founders Pledge Perspective

Science and technology have created amazing advances in human civilization, from agriculture to industry and beyond. Yet they have also created new challenges, both foreseen and unforeseen: the threat of engineered pandemics more deadly than any naturally occuring virus, the risk of artificial intelligence unaligned with conventional human values, the mental health implications of lives lived online, and others we may not yet recognize.

To address these challenges, improve the lives of people today, and protect future generations from natural and man-made risks, Founders Pledge has identified a short-list of charities working at the cutting edge of global risk response and human wellbeing. These organizations convene stakeholders, conduct research, and advocate for better national and global policies based on the best available evidence.

By giving to the Founders Pledge Science and Technology Index, you can spread your donation across several highly-impactful and neglected organisations working to answer big questions and create solutions to problems that affect us all. By pooling your donations, this Index fund allows you to make larger grants and thereby maximize your impact.

## Our Approach to Grantmaking

When evaluating potential grants, we consider several key points:

- **Counterfactual impact**. Our grants are designed to create a meaningful outcome that would not otherwise have happened. In particular, we aim to make grants that otherwise wouldn’t have been made, rather than those which just take the place of other philanthropists’ donations. This means that you can rely on the Funds to create meaningful, real change, rather than just maintaining the status quo.
- **The grant’s potential outcomes**. We focus on outcomes (e.g. how many lives were saved), rather than outputs (e.g. how many products were delivered). We review all the available evidence and take into account cost-effectiveness to assess whether the grant money could produce more good if donated elsewhere.
- **The organization’s funding gap**. Not all organizations are set up to scale up their programming and many can’t productively absorb large amounts of unsolicited funding. We evaluate all potential grantees’ capacity for growth and consider how much money they could put to good use.
- **Organizational strength**. Particularly with unrestricted funding, it’s important to have trust in the leadership and capacity of the organizations we support. We look at their track record of success and their transparency about failures as well as successes, and we only support those organizations which are exceptionally well run. We also look for organizations that demonstrate a strong commitment to measuring outcomes and evaluating the impact of their programs.

Science & Technology Index

1048940678

We are a nonprofit, so instead of charging fees we rely on the generosity of donors like you.

Choose a donation for Every.org

1258415673

1435915265

1737023302

1807908542

2074652487

2360520245

240751341

2516130445

2547000601

2624895975

2883383521

339774024

3605944885

3755280456

3794356679

3797661376

3868271524

3884515653

410756082

496574456

579816602

761293274

772217036

2729980760

3440869557

671754822

1014384873

1112422858

153399038

2028390811

203088037

220342792

2266630408

2456389719

2519810400

2539558839

2826465835

2843798242

2898624300

2916352438

3259439560

3583328878

3642494300

3902459442

4054861980

4136002033

4177183036

4250940449

585491400

641510716

91682487