Software engineer
- Location
- San Francisco
- Type
- Full time
- Compensation
- $150k-$200k
- Posted
- 2 days ago
Join a team building useful software. Work closely with engineering and design to turn new ideas into products.
Find roles through people you trust, and message a verified founder or page admin about your interest.
About Klavis AI
Klavis AI builds RL environments and high-quality training data for frontier AI models. We work across long-horizon coding, AI4Science, AI4AI, knowledge work, and agentic tool use.
The role
We are hiring a Research Engineer to turn questions about agent learning into reliable systems and reproducible experiments. Work directly with the founders to build environments, datasets, and evaluations, and study how task design, rewards, and verification affect model capabilities.
What you will work on
• Build realistic multi-step tasks, isolated runtimes, reference solutions, and verifiers, including environments in Harbor format.
• Develop pipelines for high-quality data generation, environment orchestration, agent rollouts, evaluation, and quality control at scale.
• Run controlled experiments on task difficulty, curricula, reward design, and long-horizon agent behavior.
• Analyze failures and reward exploitation, and build evaluations that measure generalization.
• Work with domain experts to turn scientific and knowledge-work workflows into reproducible training environments.
What you bring
• Strong experience with containers, data pipelines, and reliable experiment infrastructure.
• Hands-on work with reinforcement learning, model post-training, or agent evaluation; experience with PyTorch or a similar framework.
• Careful experimental judgment: clear baselines, controlled comparisons, and useful failure analysis.
• A track record of using coding agents to build, test, and debug substantial software.
Show us your work
Share a system, experiment, benchmark, paper, or open-source contribution you are proud of. Explain what you built, what failed, and what you learned.
Location and compensation
Full-time. San Francisco or remote within the United States. Annual base salary: $150,000–$200,000 USD. Equity: 0.1%–0.5%.
Apply through YC with your CV and links to your work.
Klavis AI builds RL environments and high-quality training data at scale for frontier AI labs. We turn complex workflows into stateful environments, expert-curated tasks, and verifiable reward signals for model post-training and evaluation.
Our work spans long-horizon coding, AI4Science, AI4AI (including recursive self-improvement), knowledge work, and agentic tool use. We collaborate with domain experts on scientific and professional workflows and develop open research such as Multi-step-SWE.
Based in San Francisco and backed by Y Combinator, Klavis was founded by engineers with experience building Google Gemini function-calling infrastructure and ML/data systems serving millions of users.
We are hiring Research Engineers to build environments, data pipelines, and reproducible experiments for agent learning. Work directly with the founders on problems where research and production systems meet.