Position: Data Engineer
Location: Hanover, NJ
Job Description:
- Bachelor's degree or Master’s Degree in Computer science, or a related field, with minimum 14+ years of experience
- Data Engineering
- Strong experience in designing and building large-scale data platforms.
- Expertise in data warehousing and dimensional modeling.
- Experience with ETL/ELT design and implementation.
- Strong understanding of data governance, metadata management, and data quality frameworks.
- Programming & Databases
- Advanced proficiency in Python and SQL.
- Experience with Spark/PySpark for large-scale data processing.
- Strong knowledge of relational and NoSQL databases.
- Cloud Technologies
- Experience with one or more cloud platforms:
- AWS
- S3
- Glue
- Lambda
- Redshift
- Athena
- EMR
- Step Functions
- Azure
- Azure Data Factory (ADF)
- Azure Synapse Analytics
- Azure Databricks
- ADLS Gen2
- Big Data & Streaming
- Apache Spark
- Kafka
- Kinesis
- Hadoop ecosystem (preferred)
- DevOps & Automation
- Git
- Jenkins/GitHub Actions/Azure DevOps
- Terraform or CloudFormation
- Docker and Kubernetes (preferred)
- Preferred Qualifications
- Experience with Apache Iceberg, Delta Lake, or Hudi.
- Hands-on experience with Snowflake or Databricks.
- Experience implementing Lakehouse architectures.
- Working knowledge of Data Mesh and modern data platform concepts.
- Exposure to AI/ML data pipelines and feature engineering.
- Experience in Banking, Financial Services, or Capital Markets domains.
- Strong analytical and problem-solving skills, with a proven track record of identifying and resolving complex billing issues.
- Excellent communication and presentation skills, with the ability to explain complex technical concepts to both technical and non-technical audiences.