Member of Technical Staff, Inference
San Francisco · Full time · Posted 6MO AGO
Member of Technical Staff, Inference
We're looking for an ML Inference Engineer with deep expertise in high-performance ML engineering. This is a highly technical, high-impact role focused on squeezing every drop of performance from generative media models.
You'll work across the inference stack, designing novel frameworks, optimizing inference performance, and shaping Reactor's competitive edge in ultra-low-latency, high-throughput environments.
Department: Engineering
Employment Type: Full Time
Location: San Francisco
Description
Reactor is building the inference platform for real-time world models. We run the largest and fastest catalog of world models on the market (15+ and growing), including LingBot World 2, LTX 2.5 Realtime, and HappyOyster. Our founders, Alberto Taiuti (CEO) and Bryce Schmidtchen (CTO), met as technical leads on the early Apple Vision Pro team. Alberto went on to co-found Luma AI, now a $4B company. We've raised $59M, led by Lightspeed, with Amplify Partners, WndrCo, and NVIDIA's NVentures participating. Jeffrey Katzenberg, cofounder of Dreamworks Animation, sits on our board of directors.We're looking for an ML Inference Engineer with deep expertise in high-performance ML engineering. This is a highly technical, high-impact role focused on squeezing every drop of performance from generative media models.
You'll work across the inference stack, designing novel frameworks, optimizing inference performance, and shaping Reactor's competitive edge in ultra-low-latency, high-throughput environments.
What You'll Do
- Drive our frontier position on model performance for diffusion models
- Design and implement a high-performance in-house inference runtime
- Implement optimizations using torch.compile, custom CUDA kernels, and specialized inference frameworks
- Optimize neural network models through quantization, pruning, and architectural modifications
- Profile and benchmark model performance to identify computational bottlenecks
- Collaborate directly with model partner teams to integrate their models into our platform
Required Skills
- Bachelor's degree in Computer Science, Electrical Engineering, or a related technical field (or equivalent practical experience)
- Strong foundation in systems programming, with a track record of identifying and resolving bottlenecks
- Deep expertise in PyTorch, TensorRT, TransformerEngine, Nsight, ONNX Runtime
- Model compilation, quantization (INT8/FP16), and advanced serving architectures
- Working knowledge of GPU hardware (NVIDIA)
- Strong understanding of transformer architectures and modern ML optimization techniques
Benefits
- Competitive SF salary and meaningful early equity
- Visa sponsorship and relocation support
- Generous health, dental, and vision coverage
Office address: 539 Bryant Street, Suite 210, San Francisco, California, 94107, US
Similar roles
Member of Technical Staff, Data Infrastructure StorageFireworks
Technical WriterCapco · Toronto
Engineering Manager - ConsumerPlaid · San Francisco · Seattle
Staff Web Engineer, Advisor ProductsX1 Card · New York
Staff Electrical Engineer - Control PanelForm Energy
Staff Software Engineer in Test (Modeling and Simulation)CodeMetal · San Francisco