Job Title: ETL SDET
Location: Halifax, Canada
Job Type: Contract
Job Description :
Work Experience: 7-10 Years
- The SDET (Software Development Engineer in Test) is responsible for ensuring the quality and reliability of ETL processes and data integration workflows.
- This role involves designing and implementing automated tests to validate data transformation and migration, as well as collaborating with data engineers and developers to identify and resolve data quality issues.
- The ideal candidate will leverage their expertise in ETL testing and data validation to enhance the overall data pipeline performance and integrity.
Minimum Qualification: At least 8 years of IT experience with minimum 5 years of experience in below skills:
Tech Skills:
- Proficiency in ETL Testing and developing automation framework & testcases in at least one scripting language.
- Strong SQL skills, with experience in handling big data using ETL tools (e.g. Informatica).
- Mandatory work experience with PySpark.
- Testing experience in cloud environment (AWS) S3, SSS, Glue, EMR, Data Catalog, Crawler, SQS, ETL Jobs, Event Bridge.
- Athena, Redshift Spectrum Databases.? AWS Commands for running the jobs, file process, and movements.
- Experience with Test Automation and DevOps practices in ETL and Cloud Systems.
- Work experience in a Big Data ecosystem processing data in data lakehouse.
- Experience providing testing oversight in the Agile team.
- Hands-on experience in large-scale test data generation, preparation, validation, and reconciliation, including working with Big Data and high-volume datasets across complex testing scenarios.
- Should have excellent business communication to interact with Business teams and cross-functional teams.
Responsibilities:
- Review requirements, specifications, and technical design documents to understand and feedback.
- Experience in developing and implementing test strategies for complex initiatives.
- Estimate, prioritize, plan and coordinate testing activities.
- Create an automation test framework.
- Design, develop and execute automation scripts.
- Identify, record, document thoroughly and track bugs.
- Strong problem-solving skills, troubleshooting, and root cause analysis skills.
- Perform thorough regression testing when bugs are resolved.
- Develop and apply testing processes for new and existing features to meet client needs.
- Liaise with cross functional teams to identify system requirements.