Example Company
Software engineer
- Location
- San Francisco
- Type
- Full time
- Compensation
- $150k-$200k
- Posted
- 2 days ago
Join a team building useful software. Work closely with engineering and design to turn new ideas into products.
Loading job details
Senior Data Engineer
- Posted
- 17D AGO
About the role
The Opportunity
Help modernize the data platform behind the automotive aftermarket. As Senior Data Engineer at MOTOR Information Systems, you’ll take a leading role in architecting, designing, building and evolving our AWS-based data platform, supporting the next generation of products and AI-driven capabilities.
This is not a maintenance role. You’ll have meaningful technical ownership and influence over how data is architected, processed and delivered across our systems and product suite. You’ll tackle large-scale, complex data challenges while driving architectural decisions, establishing engineering best practices and designing for scalability, reliability, performance and cost efficiency. As a senior member of the team, you’ll collaborate across engineering and product, provide technical guidance and mentorship, and help shape our platform toward a more modern, scalable and intelligent data architecture.
Hybrid: This hybrid role is based in our Troy, Michigan office and requires working in the office 3 days per week.
No visa sponsorship is available at this time.
What You’ll Do
- Analyze large and complex data sets.
- Design, develop and coordinate the generation of data pipelines.
- Work collaboratively with the team to plan and solve complex problems.
- Design for, or optimize existing pipelines for, performance and cost.
What You’ll Bring
Required Qualifications
- Expert Python and SQL developer.
- Strong AWS experience (Lambda, Glue, State Machines, Fargate, CloudFormation, Redshift).
- Strong experience with semi-structured data (XML, CSV, JSON, Parquet).
- Strong automation experience.
- Experience with Databricks (Delta Lake, Notebooks, SQL Analytics).
- Experience with Kubernetes (cluster orchestration, container networking, pod management).
- Experience with DevOps, CI/CD and deployment orchestration (Octopus Deploy).
- Experience with agentic AI (LangGraph, MCP servers, agent frameworks).
- Experience with data handling (Pandas/NumPy, Apache Spark, Ray).
Preferred Qualifications
- Experience with LLMs, machine learning and deep learning libraries, AI application frameworks and vector databases.
- Experience with automotive data or the automotive industry.
- Experience with Agile/Scrum.
Benefits
As part of Hearst, MOTOR employees have access to modern, flexible benefits designed to support you and your family. Benefits include:
- Medical, dental and vision coverage
- 401(k) matching
- Emotional wellness support
- Paid time off
- Paid parental leave
- LGBTQ+ health services
- Additional benefits to meet you and your family’s needs
