Role: SR Data Engineer
Experience: - Min 8+ Years
Location: - Chicago, IL(3 days/Week) OR Remote (F2F Interview Mandatory)
Data Engineer with expertise in ETL development, Python, SQL, and cloud-based data processing, responsible for building and managing scalable data pipelines using Databricks, AWS, and modern DevOps practices.
Responsibilities: -
- Perform Develop and manage ETL processes using Python, PySpark, and SQL.
- Work with Databricks for data processing.
- Utilize AWS services like S3, CloudWatch, IAM, SNS, and Lambda.
- Familiarity with Terraform for infrastructure management.
- Work with Angular for front-end integration.
- Collaborate on version control using Git and deployment using Octopus and Azure DevOps.
- Support CI/CD processes using Git, Octopus, and Azure DevOps.
- Work within cloud-based data engineering environments and data processing frameworks.
Educational Qualifications: -
- Engineering Degree BE/ME/BTech/MTech/BSc/MSc.
- Technical certification in multiple technologies is desirable.
Skills: -
Mandatory skills
- Strong ETL
- Python
- SQL
- PySpark
- Angular for front-end development
- Experience with AWS services (S3, CloudWatch, IAM, SNS, Lambda)
- Terraform knowledge
- Experience with Git, Octopus, and Azure DevOps for CI/CD
Good to Have Skills
- Databricks
- Terraform
- Angular
- Basic knowledge of Scala
- Basic knowledge of HL7
VeeRteq Solutions is an Equal Opportunity Employer