Lead Data Engineer
Job Description
Our client, a leading organisation, is seeking an experienced Lead Data Engineer to play a key technical leadership role in the design, development and evolution of modern cloud-based data platforms. This is a hands-on architectural position suited to an experienced data engineering professional with deep expertise in Python, AWS and enterprise-scale data solutions.
Job Responsibilities
- Lead the architecture, design and implementation of scalable, secure and high-performing data engineering solutions.
- Design and develop modern cloud-native data platforms using AWS services and Python.
- Provide technical leadership and architectural guidance across data engineering initiatives while remaining hands-on with solution delivery.
- Design robust ETL/ELT pipelines to support large-scale data ingestion, transformation and integration requirements.
- Drive best practices around data architecture, governance, security, scalability and performance optimisation.
- Collaborate with solution architects, software engineers, business stakeholders and product teams to deliver enterprise data solutions.
- Evaluate emerging technologies and recommend improvements to existing data engineering frameworks and platforms.
- Mentor and support engineering teams through technical leadership, code reviews and architectural direction without direct people management responsibilities.
- Ensure solutions are resilient, maintainable and aligned with enterprise architecture standards.
Experience Required
- Minimum of 10 years' experience in Data Engineering, Data Platform Engineering or a closely related technical discipline.
- Extensive hands-on experience designing and building enterprise-scale data platforms.
- Strong expertise developing solutions using Python.
- Extensive experience delivering cloud-native data solutions within AWS environments.
- Proven experience designing modern data architectures and implementing scalable data pipelines.
- Strong understanding of data modelling, data warehousing and distributed data processing concepts.
- Experience working with large, complex datasets in enterprise environments.
- Excellent stakeholder engagement skills with the ability to communicate technical concepts to both technical and non-technical audiences.
- Strong analytical and problem-solving abilities with a focus on delivering high-quality technical solutions.
Desirable Skills
- Experience with AWS services such as Glue, Lambda, EMR, Redshift, S3, Athena and Step Functions.
- Experience with Infrastructure as Code tools such as Terraform or AWS CloudFormation.
- Knowledge of modern orchestration frameworks including Apache Airflow or similar.
- Experience working with containerisation technologies such as Docker and Kubernetes.
- Exposure to streaming technologies including Kafka or Kinesis.
- Understanding of CI/CD pipelines and DevOps practices.
- Experience working within Agile delivery environments.
- Knowledge of data governance, security and regulatory best practices.
Educational Requirements
- Bachelor's degree or higher in Computer Science, Software Engineering, Information Technology or a related discipline.
- Relevant cloud or data engineering certifications (such as AWS Certified Solutions Architect, AWS Certified Data Engineer or equivalent) would be advantageous.
Working Hours & Benefits
- Hybrid working model based in Dublin 2.
- Competitive salary package (Circa 120k base salary plus bonus and strong benefits).
- Performance-related bonus.
- Pension contribution.
- Healthcare package.
- Life assurance.
- Professional training and certification support.
- Career progression opportunities within a growing technology team.
HOW TO APPLY
If you are interested in this role, please apply with your updated CV