Senior Data Engineer
How you'll make an impact Design and build production pipelines on Databricks using Spark Declarative Pipelines (SDP) and PySpark, from raw ingestion through business-ready data products. Define all pipelines, jobs, and schedules as code in Databricks Asset Bundles, deployed to every environment through automated CI/CD. Build data quality, monitoring, and lineage into pipelines so issues are caught and diagnosed before they reach consumers. Turn recurring solutions into...
- Databricks
- Spark
- CI/CD
- Python
- SQL
- Git
- Snowflake
- AWS
- dbt
- Kafka
- Airflow
- SAP