Example Company
Software engineer
- Location
- San Francisco
- Type
- Full time
- Compensation
- $150k-$200k
- Posted
- 2 days ago
Join a team building useful software. Work closely with engineering and design to turn new ideas into products.
Loading job details
Senior Python Data Engineer
- Type
- Full time
- Posted
- 2MO AGO
About the role
Job Summary:
Convo is looking for Python Data Engineers with 10+ years of experience in production data engineering and pipeline operations. The ideal candidate should have strong expertise in Python, SQL, Airflow/Azure Data Factory, Spark, data quality, schema validation, and monitoring, with the ability to troubleshoot pipeline issues, maintain reliable data workflows, and ensure data quality, freshness, and operational stability.
Technical mission
Maintain data pipelines, implement schema-validation automation and resolve operational incidents within the approved platform architecture.
Key responsibilities
Maintain and enhance Python/SQL pipelines orchestrated through Airflow, Azure Data Factory or equivalent.
Implement schema, completeness, freshness and reconciliation checks.
Diagnose and resolve pipeline failures, data-quality incidents and performance regressions.
Support Spark jobs and incremental data-processing patterns.
Add monitoring, structured logging and actionable alerts.
Document fixes, recurring failure patterns and operational procedures.
Required technical capabilities
Production Python and SQL for data engineering.
Airflow, Azure Data Factory or comparable workflow orchestration.
Working knowledge of Spark and distributed data-processing concepts.
Data-quality and schema-validation implementation.
Monitoring, incident triage and root-cause analysis.
Version control, automated testing and controlled deployment practices.
Preferred experience
Databricks, Delta Lake and cloud storage patterns.
On-call or production-support experience for data platforms.
CPG, retail or enterprise-source data.
Expected deliverables / acceptance evidence
Stable pipelines meeting agreed freshness and quality thresholds.
Automated validation and monitoring coverage.
Closed incidents with documented root cause and preventive action.
Updated runbooks and maintainable handover documentation.
Primary interfaces
Works with Senior Data Engineers, Telemetry Support, connector teams and platform operations.
What We Have For You
- Great compensation package, medical benefit for you and your family, free lunch, annual performance-tied increments & performance recognition awards and a great lean and agile work culture!
- Convo endorses a culture of diversity in all aspects and aims to build a diverse team of amazing individuals!
Workplace: Hybrid | Can work remotely sometimes
