LEAD DATA ENGINEER – MICROSOFT FABRIC & AZURE
HSO India Pvt. Ltd.
Experience
10+ Years
Work Mode
Remote / Work From Home
Notice Period
Immediate to 30 Days
Employment Type
Full-Time
Salary
Best in the Market
About The Role
HSO is looking for an experienced Lead Data Engineer with 10+ years of experience in designing, developing, and implementing scalable data engineering solutions. The ideal candidate will have strong hands-on expertise in Microsoft Fabric and Microsoft Azure, along with experience in modern data platforms, data pipelines, data warehousing, ETL/ELT, and cloud-based data engineering.
Microsoft Fabric and Microsoft Azure are MANDATORY requirements for this position.
Key Responsibilities
- Lead the design and development of enterprise-grade data engineering solutions using Microsoft Fabric and Azure.
- Design scalable and reliable data pipelines for batch and real-time data processing.
- Develop and optimize ETL/ELT processes using modern Azure and Microsoft Fabric technologies.
- Work extensively with Microsoft Fabric Data Factory, Lakehouse, Data Warehouse, OneLake, and related Fabric components.
- Design and implement solutions using Azure Data Factory, Azure Data Lake Storage Gen2, Azure Synapse Analytics, Azure SQL, and other Azure data services.
- Develop data ingestion, transformation, cleansing, and integration processes from multiple source systems.
- Implement data models and data warehouse solutions supporting analytics and reporting requirements.
- Optimize data pipelines, queries, storage, and processing performance.
- Establish data quality, security, governance, and monitoring practices.
- Collaborate with Data Architects, Solution Architects, BI Developers, and business stakeholders.
- Provide technical leadership and mentoring to data engineering teams.
- Participate in solution design, estimation, code reviews, troubleshooting, and production support.
Mandatory Skills – Microsoft Fabric
- Strong hands-on experience with Microsoft Fabric Data Factory.
- Hands-on experience with Fabric Lakehouse and Fabric Data Warehouse.
- Strong understanding of OneLake.
- Experience with data pipelines, notebooks, and Dataflows Gen2.
- Experience with Fabric architecture, workspace management, data ingestion, transformation, and optimization.
Mandatory Skills – Microsoft Azure
- Strong hands-on experience with Azure Data Factory (ADF).
- Azure Data Lake Storage Gen2.
- Azure Synapse Analytics and Azure SQL.
- Azure Databricks and Azure Storage.
- Azure Functions / Logic Apps.
- Azure Key Vault, monitoring, and security services.
Technical Skills
- 10+ years of experience in Data Engineering / Data Platform development.
- Strong SQL and database development skills.
- Experience with Python and/or PySpark.
- Strong understanding of ETL/ELT and data pipeline development.
- Experience with Data Warehousing, dimensional modelling, and Lakehouse architecture.
- Knowledge of batch and real-time data processing.
- Experience with APIs, structured and unstructured data sources.
- Experience with Git, CI/CD, and DevOps practices.
- Knowledge of data security, governance, lineage, and data quality.
- Experience troubleshooting and optimizing complex data pipelines.
Leadership & Collaboration
- Proven ability to lead technical discussions and data engineering initiatives.
- Ability to translate business requirements into scalable technical solutions.
- Strong stakeholder management and communication skills.
- Experience mentoring data engineers.
- Ability to work independently in a remote environment.
- Strong analytical and problem-solving capabilities.
Preferred / Good-to-Have Skills
- Microsoft Certified: Azure Data Engineer Associate or equivalent certification.
- Experience with Power BI and Microsoft Power Platform.
- Experience integrating Dynamics 365 / Dataverse data.
- Experience with Microsoft Purview and Azure DevOps.
- Knowledge of real-time analytics and event-driven architectures.
- Experience with enterprise data migration and modernization projects.
Education
- Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.
- Relevant Microsoft/Azure certifications will be an advantage.
Candidate Profile
- 10+ years of relevant Data Engineering experience.
- Strong hands-on experience with Microsoft Fabric – Mandatory.
- Strong hands-on experience with Microsoft Azure Data Services – Mandatory.
- Available to join immediately or within 30 days.
- Excellent communication and stakeholder management skills.
- Ability to independently lead data engineering projects and provide technical guidance.
Why Join HSO?
- Opportunity to work on global enterprise data and cloud transformation projects.
- Work with modern Microsoft technologies including Microsoft Fabric and Azure.
- Remote / Work From Home opportunity.
- Exposure to international clients and large-scale data platforms.
- Opportunity to work with a highly skilled and collaborative technology team.