Experience- 12+ Years of IT Experience with 5+ Years in Databricks Architecture
Databricks Architect who brings both technical expertise and domain knowledge of the drilling business.
The ideal candidate should:
- Have strong hands-on experience in Databricks architecture and implementation.
- Possess a solid understanding of drilling operations and associated business processes.
- Demonstrate leadership and stakeholder management skills.
- Be capable of working directly with business stakeholders to understand requirements and translate them into effective solutions.
- Bring industry best practices, architectural governance, and strategic guidance to the engagement.
Role Overview
We are seeking a highly experienced Databricks Architect with strong expertise in modern data platforms and a deep understanding of the Oil & Gas Drilling business. The ideal candidate will serve as a trusted advisor to business and technology stakeholders, driving data strategy, architecture, and solution delivery while enabling business transformation through data-driven insights.
This role requires a combination of technical leadership, industry domain expertise, stakeholder management, and consulting skills to design and implement scalable data solutions aligned with business objectives.
Success Criteria
The successful candidate will:
- Bring industry best practices and architectural leadership to the engagement.
- Act as a strategic partner to business stakeholders.
- Drive scalable, secure, and future-ready data solutions.
- Accelerate business value realization through effective use of the Databricks platform.
- Improve collaboration between business and technology teams while ensuring successful solution adoption.
Key Responsibilities
Architecture & Technology Leadership
- Design and implement enterprise-scale data platforms using Databricks, Azure/AWS cloud technologies, and modern data architectures.
- Define end-to-end data architecture, data models, integration patterns, security, governance, and performance optimization strategies.
- Establish architectural standards, best practices, and implementation frameworks across projects.
- Lead modernization initiatives involving data lakes, lakehouse architecture, real-time analytics, AI/ML enablement, and cloud migration programs.
Business & Domain Engagement
- Work directly with business stakeholders, drilling engineers, operations teams, and leadership to understand business challenges and translate them into technology solutions.
- Provide thought leadership on leveraging data and analytics to improve drilling performance, operational efficiency, asset utilization, and decision-making.
- Drive business workshops, solution reviews, and architecture discussions with customer leadership.
Delivery & Governance
- Provide technical oversight throughout the solution lifecycle from discovery through deployment.
- Ensure compliance with enterprise architecture, security, data governance, and quality standards.
- Mentor engineering teams and provide technical guidance on Databricks implementations.
- Review solution designs and ensure adherence to best practices.
Leadership & Stakeholder Management
- Act as a trusted advisor for business and IT stakeholders.
- Collaborate with project managers, product owners, data engineers, data scientists, and business users.
- Influence strategic decisions regarding data and analytics investments.
- Drive adoption of industry-leading practices and innovation.
Technology Focus: Azure Databricks, Azure Data Platform, Lakehouse Architecture, Advanced Analytics, AI/ML.
Reporting To: Account Delivery Leadership
Target Industry Experience: Oil & Gas, Drilling, Energy Services, Upstream Operations.
Required Qualifications
Technical Skills
- Strong expertise in Databricks Lakehouse Platform.
- Hands-on experience with:
- Apache Spark
- Delta Lake
- Unity Catalog
- Databricks Workflows
- MLflow
- Structured Streaming
- Strong experience with Azure Data Services and/or AWS Data Analytics services.
- Expertise in Data Warehousing, Data Lakes, ETL/ELT, Data Modeling, and Analytics platforms.
- Experience implementing scalable enterprise data architectures.
- Strong knowledge of SQL, Python, Spark, and cloud-native solutions.
Domain Expertise
- Strong understanding of Oil & Gas Drilling Operations.
- Experience working with drilling, well planning, rig performance, production, operational analytics, and drilling data management.
- Ability to engage effectively with drilling business stakeholders and translate business needs into technical solutions.
Leadership Skills
- Excellent stakeholder management and communication skills.
- Experience leading architecture discussions with senior business and technology leaders.
- Proven ability to influence decisions and drive consensus across teams.
- Strong mentoring and coaching capabilities.
Preferred Qualifications
- Experience with Energy, Oil & Gas, or Drilling industry clients.
- Databricks Certified Professional Certification.
- Azure Solutions Architect / Data Engineer certification.
- Experience with AI/ML, Generative AI, and advanced analytics initiatives.
- Experience working in global delivery models.