Your Role
- Designing and developing end-to-end data pipelines using Azure Data Factory and Databricks, PySpark, SQL, Delta Lake, azure data lake Building and optimizing ETL workflows for ingestion, transformation, and loading of structured and semi-structured data into Azure Synapse Analytics and ADLS.
- Implementing data validation and quality frameworks to ensure data reliability. Writing efficient PySpark and SQL code for complex transformations, aggregations, and performance tuning
- Managing secure access using Azure Key Vault, role-based permissions, and compliance best practices
Your Profile
- Should have 12+ years of experience in Azure Databricks with strong pyspark experience
- Experience with Azure Data Bricks, Data Factory
- Experience with Azure Data components such as Azure SQL Database, Azure SQL Warehouse, SYNAPSE Analytics
- Experience in Python/Pyspark/Scala/Hive Programming.
- Experience with Azure Databricks/ADB
- Experience with building CI/CD pipelines in Data environments
- Proficiency in data visualization and BI tools, preferably Power BI, with experience in developing complex reports and data models
- Strong understanding of data warehousing concepts, data and ETL/ELT best practices.
Application Question(s):
- What Is Your Current Salary? *
- What Is Your Expected Salary? *
- What Is Your Notice Period ? *
Location:
- Chennai, Tamil Nadu (Preferred)
Work Location: Hybrid remote in Chennai, Tamil Nadu