InferactCo-founder and CEO
Until Present
Builds infrastructure for serving AI models and helps maintain vLLM.
Simon Mo co-founded Inferact and maintains vLLM, the open-source engine for serving AI models. He previously worked on model inference at Character.AI and helped build Ray Serve at Anyscale.
Simon Mo co-founded Inferact and maintains vLLM, the open-source engine for serving AI models. He previously worked on model inference at Character.AI and helped build Ray Serve at Anyscale.
Career
Character.AIMember of Technical Staff
2024 — 2025
Worked on GPU efficiency and model inference.
AnyscaleSoftware Engineer
2019 — 2023
Built and explained Ray Serve, a scalable model-serving framework.