Hadoop Data Engineer
Scottsdale AZ (100% Onsite)
Experience: 10–12 Years
Key Responsibilities:
- Develop scalable data applications using Java 8+ & Spring Boot
- Build and optimize Spark/Scala big data pipelines
- Develop REST APIs for data integration
- Implement batch & streaming pipelines using Spark Streaming & Kafka
- Optimize Hive & SQL queries
- Work with Hadoop ecosystem & distributed data platforms
- Troubleshoot performance, scalability & data reliability issues
- Follow Git, code review & CI/CD best practices
Required Skills:
- Java 8+, Spring Boot
- Apache Spark, Scala
- Hadoop, Hive, Kafka
- SQL Optimization
- Spark Streaming / Kafka Streams
- RESTful Web Services
- Distributed Systems & Big Data Architecture
- Git/GitLab
- Maven/Gradle
- Enterprise-scale data platforms
- Performance Tuning & Capacity Planning
Plus: DevOps / CI-CD experience.