📌 Job Title: Databricks Lead Engineer - Technology - Contract
📍 Location: Canary Wharf, London, United Kingdom
🕐 Employment type: Contract, 6 months
🌍 Environment: Professional Services Environment
About the Role
We are searching on behalf of our client for this role. This position is not with OVI.
We are hiring a hands-on Databricks Lead Engineer with experience in delivering modern data platforms on Databricks. This role requires a minimum of 2 years of recent Databricks experience.
Key Responsibilities
• Lead the engineering delivery of Databricks lakehouse solutions from ingestion to curated serving layers.
• Define and implement Medallion Architecture (Bronze/Silver/Gold) and reusable engineering patterns.
• Build scalable ingestion pipelines using AutoLoader, Lakeflow Connect, batch/streaming, and incremental patterns.
• Develop Declarative Pipelines with Expectations (DLT) to enforce and monitor data quality.
• Implement and operate Unity Catalog for governance, access control, lineage, and secure data sharing patterns.
• Drive code quality and operational excellence (CI/CD approach, testing strategy, monitoring, incident triage).
• Partner with architects, platform teams, and stakeholders to align delivery with enterprise standards.
• Mentor engineers and act as the technical escalation point during delivery.
Your Profile
• 2+ years of hands-on Databricks experience in recent years, demonstrating usage of modern capabilities and patterns.
• Active Databricks Certification: Data Engineer Associate/Professional, Machine Learning Associate/Professional, or Generative AI Engineer (Associate).
• Unity Catalog hands-on experience with metastore/catalog design, grants, lineage, and secure access patterns.
• Experience with Declarative Pipelines with Expectations (DLT) for building pipelines and handling failures.
• Proficiency in Databricks-native ingestion engineering using AutoLoader and/or Lakeflow Connect.
• Implementation experience with Medallion Architecture and best practices.
What's Offered
• Competitive daily rate of £500
• £550.
• Opportunity to work in a dynamic and innovative environment.
• Chance to lead and mentor a team of engineers.
• Collaborative work culture with architects and platform teams.
Ideal Candidate
The ideal candidate is a proactive and skilled Databricks engineer with a strong foundation in modern data platform capabilities. You should be comfortable leading projects, mentoring team members, and collaborating with stakeholders to deliver high-quality solutions. Your expertise in Databricks and commitment to operational excellence will be key to your success in this role.
When you apply to this role, AI may be used to help analyse and format your information so the hiring team can review it more easily.