We're Hiring: Senior Data Engineer | AWS | Insurance
Location- KL
Preferred- Mandarin
We are looking for an experienced Senior Data Engineer to join our Data & Analytics team within the Insurance domain.
This role is ideal for a hands-on data engineer with strong AWS, Data Lake/Data Warehouse, ETL/ELT, PySpark, Python, SQL, Terraform, and Apache Iceberg experience, with an interest in modern AI-enabled software development.
🔹 Key Responsibilities
• Design and develop scalable, secure, and high-performing data pipelines
• Build and optimize ETL/ELT processes across Data Lake and Data Warehouse environments
• Develop batch and near real-time data processing solutions
• Design and maintain Apache Iceberg datasets
• Build and support cloud-native data platforms on AWS
• Implement Infrastructure as Code (IaC) using Terraform
• Monitor, troubleshoot, and optimize data pipelines and platform performance
• Support Disaster Recovery (DR), failover/failback, RTO/RPO, and business continuity activities
• Implement data quality, reconciliation, governance, and metadata management controls
• Support AWS DataZone initiatives and enterprise data governance
• Collaborate with Architects, Business Analysts, Data Analysts, BI Developers, Product Owners, and business stakeholders
• Prepare technical documentation, runbooks, solution designs, and data flow diagrams
• Conduct knowledge transfer sessions and mentor junior engineers
🔹 Required Skills & Experience
✅ 3+ years of experience in Data Engineering, Data Warehousing, or Data Platform Engineering
✅ Strong hands-on experience with SQL, Python, PySpark, and Terraform
✅ Strong AWS experience, particularly:
AWS Glue | Amazon Redshift | Amazon S3 | Amazon RDS | Amazon SNS | AWS Step Functions | Amazon CloudWatch | AWS IAM | Amazon EventBridge | AWS DataZone
✅ Experience designing and supporting Enterprise Data Lake & Data Warehouse solutions
✅ Hands-on experience with Apache Iceberg
✅ Strong understanding of ETL/ELT, data modeling, and data integration
✅ Experience with Terraform / Infrastructure as Code
✅ Understanding of cloud security, IAM, permissions, and access control
✅ Experience supporting Disaster Recovery and Business Continuity activities
✅ Knowledge of Generative AI, Agentic AI, and AI-assisted software development
✅ Experience using AI-powered coding assistants to improve engineering productivity and code quality
✅ Strong analytical, troubleshooting, communication, and problem-solving skills
🔹 Good to Have
• AWS Certifications such as AWS Certified Data Engineer / Solutions Architect / Developer / Cloud Practitioner
• Power BI experience
• SAP BusinessObjects (SAP BO) knowledge
• AWS DataZone and enterprise data governance experience
• Data Lakehouse architecture experience
• DevOps, CI/CD, and cloud automation experience
• Experience in Insurance or Financial Services
🎯 Core Technologies:
AWS | Glue | Redshift | S3 | RDS | Step Functions | CloudWatch | IAM | EventBridge | DataZone | SQL | Python | PySpark | Terraform | Apache Iceberg | Data Lake | Data Warehouse | Power BI | Generative AI