Role: Data Engineer
Role Overview:
Support the design and development of data ingestion and ETL processes used within the Quantexa demo environment.
Required Skills:
- Apache Spark
- ETL development
- Data integration
- Data transformation
- Data modelling
- Elasticsearch / OpenSearch (preferred)
- Python / Scala (preferred)
Key Responsibilities:
- Participate in technical workshops with Quantexa architects.
- Support decisions around Spark execution approaches.
- Support data ingestion and ETL development activities.
- Assist with loading and preparing demonstration datasets.
- Support integration between Spark processing and Elasticsearch/OpenSearch.