Applied LLM Engineer
San Francisco · Remote · Full time · Posted 14D AGO
Join our AI team to help build next-generation language technologies for interactive gaming experiences. You'll be responsible for evaluating and optimizing language models that power character interactions and narrative elements.
Key Responsibilities:
- Implement comprehensive evaluation frameworks for language model performance
- Design and maintain automated testing pipelines for model quality assurance
- Analyze model outputs using various evaluation methodologies including human feedback
- Develop visualization tools to communicate complex performance metrics to stakeholders
Qualifications:
- Advanced degree in computer science, computational linguistics, or related field
- Strong programming skills in Python and experience with ML frameworks
- Demonstrated experience with language model evaluation and optimization
- Ability to solve complex problems independently and collaboratively
Preferred Qualifications:
- Experience in gaming or interactive entertainment applications
- Background in developing evaluation metrics for generative AI systems
- Familiarity with large-scale data processing and analysis
- Publications or patents in relevant AI fields