Process Manager
1.Lead the design and implementation of scalable Databricks Lakehouse data solutions supporting analytics and business applications. 2. Design and optimize high-volume batch and near-real-time data pipelines using PySpark, SQL, Python, Delta Lake, and Databricks workflows. 3. Design and develop end to end frameworks using patterns such as CDC, incremental processing, deduplication, SCD, and schema evolution. 4. Design data models and processing frameworks that provide...
- Databricks
- SQL
- Python
- Git
- CI/CD
- Airflow
- Spark
- Terraform
- ETL
- Docker
- Kubernetes