Senior Data Cloud Engineer – Databricks & Azure + JAVAJob Details
Role: Senior Data Cloud Engineer
Experience: 4–6 Years
Location: Bangalore
Notice Period: Immediate to 30 Days
Budget: Up to ₹27 LPA
Work Mode: As per business requirement
Role Overview
We are looking for a Senior Data Cloud Engineer with 4–6 years of strong experience in Azure Data Engineering and Databricks. The ideal candidate should have hands-on expertise in Databricks REST APIs, Databricks SDK (Python/Java), and Databricks CLI, along with strong experience in developing Java/Spring Boot microservices and REST APIs.
The candidate will be responsible for designing and developing API-driven Databricks integrations, automating Databricks administration and deployments, and building scalable cloud data engineering solutions.
Top 3 Mandatory Skills
- Databricks REST API – MUST
- Databricks SDK (Python/Java) – MUST
- Databricks CLI – MUST
Key Responsibilities
- Design and develop integrations using Databricks REST APIs, SDKs, and automation frameworks.
- Create and manage Databricks Jobs, Workflows, Clusters, Repos, Unity Catalog, and Workspace resources through APIs.
- Develop API-driven solutions for orchestrating Databricks notebooks, jobs, and streaming pipelines.
- Integrate Databricks with enterprise applications, microservices, and external platforms using REST APIs.
- Understand business requirements related to data ingestion and cloud data engineering.
- Work with data modelers to translate business requirements into cloud/on-premise data engineering solutions.
- Develop and maintain Databricks and Azure Data Factory (ADF) pipelines.
- Automate Databricks administration, deployment, monitoring, and operational activities.
- Develop scalable and reusable data engineering solutions on Microsoft Azure.
- Implement proactive and reactive application self-healing solutions through automation.
- Collaborate with development, data, architecture, and business teams to deliver high-quality solutions.
Technical RequirementsDatabricks
- Strong hands-on experience with Databricks REST API.
- Strong experience with Databricks SDK using Python or Java.
- Hands-on experience with Databricks CLI.
- Strong understanding of:
- Databricks Jobs API
- Clusters API
- Workspace API
- SQL Execution API
- Unity Catalog API
- Delta Sharing API
- Experience managing Databricks Jobs, Workflows, Clusters, Repos, and Workspace resources.
- Experience automating Databricks deployment and administration.
Azure Data Engineering
- 4+ years of strong experience in Azure Data Engineering and Databricks.
- Hands-on experience developing Azure Data Factory pipelines.
- Strong understanding of cloud-based data ingestion and transformation.
- Experience designing and implementing scalable cloud data engineering workloads.
- Microsoft Azure cloud deployment experience is preferred.
Java / Microservices
- Experience developing Java/Spring Boot microservices.
- Strong experience developing REST APIs.
- Experience integrating enterprise applications with Databricks through APIs and microservices.
- Ability to develop scalable and maintainable API-driven solutions.
API Security
Strong understanding of API and cloud security concepts, including:
- OAuth 2.0
- IDP / Identity Providers
- JWT
- Service Principals
- RBAC
- Secrets Management
Required Qualifications & Experience
- 4–6 years of overall experience in cloud data engineering and transformation.
- 4+ years of strong experience in Azure Data Engineering and Databricks.
- Mandatory hands-on experience with:
- Databricks REST API
- Databricks SDK – Python/Java
- Databricks CLI
- Experience integrating Databricks with enterprise applications through APIs and microservices.
- Strong knowledge of Databricks APIs and automation.
- Experience developing Java/Spring Boot microservices and REST APIs.
- Experience with Azure Data Factory and cloud data pipelines.
- Experience with application self-healing and automated operational solutions is preferred.
- Bachelor's degree in Computer Science, Information Technology, Engineering, Computer/Telecommunication Engineering, or an equivalent discipline.
Preferred Candidate Profile
The ideal candidate should be a hands-on Azure + Databricks engineer who combines strong data engineering capabilities with API development and automation expertise.
Candidates without hands-on experience in Databricks REST API, Databricks SDK, and Databricks CLI should not be considered, as these are mandatory skills for the role.
Compensation & Joining Details
- Budget: Up to ₹27 LPA
- Location: Bangalore
- Experience: 4–6 Years
- Notice Period: Immediate to 30 Days