Example Company
Software engineer
- Location
- San Francisco
- Type
- Full time
- Compensation
- $150k-$200k
- Posted
- 2 days ago
Join a team building useful software. Work closely with engineering and design to turn new ideas into products.
Loading job details
Member of Technical Staff, AI Security Research
- Location
- San Francisco
- Type
- Full time
- Posted
- 2MO AGO
About the role
Study how AI agents violate security policy, then build and evaluate methods for detecting and controlling that behavior.
TeamResearchLocationSan FranciscoTypeOn-site · Full-timeAbout the roleWhat you will doWhat you bringAdditional experienceHow to applyAbout the role
You will research security failures in AI agents, including prompt injection, unauthorized data access, and misuse of tools. The work spans behavior classification, model evaluation, and controls on agent actions and permissions.
You will take a research question through dataset design, experiments, and reproducible results, then work with engineering to test the method in Reagent. Training experiments use synthetic and public reference data, hand-labeled by internal and third-party personnel. Customer data is not used to train shared models.
What you will do
- Build datasets and evaluations for prompt injection, data exfiltration, unauthorized tool use, and other agent security failures
- Fine-tune behavior classifiers and embedding models, and compare them with simpler baselines
- Measure false positives, detection recall, calibration, latency, and inference cost on held-out workflows
- Design and test controls for tool calls, data access, and agent permissions with product engineers
- Document methods, reproduce results, and publish findings with their limitations
What you bring
- Experience training or evaluating machine learning models, with work on language models, embeddings, or agent systems
- Strong Python skills and experience implementing experiments in PyTorch or a comparable framework
- Experience designing evaluations that account for data leakage, label quality, and distribution shift
- Able to read research, implement a method, and explain what the evidence does and does not establish
Additional experience
- Research on prompt injection, adversarial machine learning, or agent security
- Experience with contrastive learning, retrieval, or calibrated classifiers
- Published research, open-source implementations, or contributions to evaluation datasets
Introduce yourself.
Send a short note about the work you would contribute, along with a resume or relevant links.
Apply by emailMeet the companyYour email app will open. You can also write directly to people@zaun.ai.
Similar roles
Member of Technical Staff, SecuritySieve · San FranciscoStaff Software Engineer - Vehicle & Hardware SecurityAtoms · San Francisco
Staff Software Engineer - Vehicle & Hardware SecurityAtoms · San Francisco
Security & Trust AnalystTypeSafe AI · San Francisco
Physical & Facility Security EngineerPronto.ai, Inc. · San Francisco
Security LeadTrellis AI · San Francisco