Mandatory skills: Python, PySpark, Azure Databricks. Good to have SQL, ADF.
Job Description:
- ideally 5+ years of experience as a Data Engineer, including exposure to large‑scale or Big Data environments
- strong experience with SQL and database systems (relational and NoSQL), including query optimization and schema design
- hands‑on experience with search platforms or information retrieval technologies (indexing, ranking, text search, semantic search, metadata modeling, vector search, relevance tuning, etc.)
- knowledge of Graph Databases (e.g., Neo4j, Cosmos DB Gremlin API) and their application to knowledge graphs or entity‑relationship search
- strong programming skills in Python, Scala, Spark, and experience with Big Data tools such as Azure Cloud, Databricks, and PowerBI (or equivalents)
- experience designing or maintaining search APIs, indexing pipelines, or metadata‑driven search components
- good understanding of Agile methodologies and experience delivering incrementally within an Agile team
- strong communication and stakeholder‑management skills, with the ability to translate search‑related needs into technical solutions
- solid analytical, problem‑solving, and data‑management abilities
- proactive team player with flexibility, resilience, and the initiative to drive improvements across search and data‑discovery workflows
- strong interest in understanding business context to create meaningful and effective data search experiences
- fluent in English with excellent written and verbal communication skills, and the ability to work as part of a global team