Role Overview
We are seeking a strong Data Engineering Lead with support engagement experience to manage and enhance a Data Platform built on Azure and Databricks. This role requires a hands-on leader who can stabilize, optimize, and mature platform operations through structured processes and automation.
Key Responsibilities
- Incident & Communication Management – Ensure quick resolution, RCA, and transparent stakeholder updates.
- Proactive Monitoring & Optimization – Improve performance, cost, and reliability.
- Data Quality & Governance – Enforce data integrity, lineage, and compliance.
- Change & Release Management – Streamline deployments and minimize disruptions.
- Reporting & Continuous Improvement – Track KPIs, resolve recurring issues, and drive efficiency.
- Knowledge Management – Maintain documentation, SOPs, and training for seamless operations.
- Automation & Monitoring – Implement self-healing mechanisms and reduce manual overhead.
Qualifications
- 8+ years in data engineering & platform support, with expertise in Azure & Databricks.
- Strong knowledge of incident management, performance tuning, and data governance.
- Hands-on experience with SQL, Python, Spark, and CI/CD pipelines.
- Familiarity with monitoring tools (Azure Monitor etc.) and automation frameworks.
- Excellent communication and stakeholder management skills.