Role Overview:
We are seeking a strong Data Engineering Lead with support engagement experience to manage and enhance a Data Platform built on Azure-ADF and Databricks. This role requires a hands-on leader who can stabilize, optimize, and mature platform operations through structured processes and automation.
Key Responsibilities:
Incident & Communication Management – Ensure quick resolution, RCA, and transparent stakeholder updates.
Proactive Monitoring & Optimization – Improve performance, cost, and reliability.
Data Quality & Governance – Enforce data integrity, lineage, and compliance.
Change & Release Management – Streamline deployments and minimize disruptions.
Reporting & Continuous Improvement – Track KPIs, resolve recurring issues, and drive efficiency.
Knowledge Management – Maintain documentation, SOPs, and training for seamless operations.
Automation & Monitoring – Implement self-healing mechanisms and reduce manual overhead.
Qualifications:
8+ years in data engineering & platform support, with expertise in Azure (ADF) & Databricks.
Strong knowledge of incident management, performance tuning, and data governance.
Hands-on experience with SQL, Python, Spark, and CI/CD pipelines.
Familiarity with monitoring tools (Azure Monitor etc.) and automation frameworks.
Excellent communication and stakeholder management skills.