Alignment Research Engineer

++++

Please apply to this role on our ATS

https://jobs.gem.com/atla-ai-com/am9icG9zdDpB3Xh1w57tkKYblAwt1O-U

++++

As Atla’s alignment research engineer, you'll develop language models as evaluators as well as use your insights to construct safety guardrails for LLMs, pushing the state of the art further. As part of your role, you will:

• Steer LLMs to become strong evaluators aligned with human preferences by using prompting, supervised fine-tuning, and adversarial training to effectively scale human oversight.
• Develop comprehensive evaluation and red teaming frameworks, including custom internal tooling, datasets and metrics for rigorous assessment of alignment and safety risks.
• Collaborate in defining and steering Atla’s evolving AI safety research direction to contribute significant findings to top-tier conferences in the field.
• Work closely with founders, advisors, and top-tier researchers to navigate the complexities of AI alignment.
• Build and grow our applied research organisation, setting a high bar of excellence that propels Atla forward.

Please note that this role is in-person (we can sponsor visas and offer international relocation support).

*This role is supported by AI Futures Grants, a UK Government scheme designed to help the next generation of AI leaders meet the costs of relocating to the UK. AI Futures Grants provide financial support to reimburse relocation costs such as visa fees, the immigration health surcharge and travel/subsistence expenses. Successful candidates for this role may be able to get up to £10,000 to meet relocations costs, subject to terms and conditions.

Qualifications

Evidence of exceptional ML engineering ability:

• Proficiency in training and evaluating language models across GPUs, preferably in PyTorch.
• Proven track record in empirical research, including designing and executing experiments, and effectively writing up and communicating findings.
• Strong software engineering experience with software design / architecture skills, preferably in Python.
• Aptitude for distilling and applying ideas from complex research papers in our products.
• Experience at elite AI research labs (OpenAI, DeepMind, Meta, Anthropic, etc.).

Nice to have

• Publications in top AI conferences.
• Experience as an early engineer at a fast growing startup.
• Interested in and thoughtful about the impacts of AI technology.

About you

You are going to thrive at Atla with the following mindset:

• Collaborative and team-oriented, with strong communication skills.
• Comfortable with the uncertainty and fast pace of a hyper-growth startup.
• Willingness to continuously learn and adapt in a dynamic environment.
• Unpretentious and hard working; find the best ideas wherever they come from.

Compensation

• Competitive salary
• Significant stake in equity as one of the first joiners

Join our driven team to make a dent in the universe by engineering safe, beneficial AI systems!