Staff Software Engineer – Berlin
We are partnering with our client, a cutting-edge software company in Berlin, to hire a Staff Software Engineer for a team at the forefront of Agentic Engineering. You will play a pivotal role in building backend services that drive thousands of realistic, concurrent, AI-driven conversations at enterprise scale, directly impacting latency, throughput, reliability, and operational visibility in production.
Key Skills and Experience
- High-performance, real-time systems: Designing and operating low-latency services for WebSocket/Socket.IO, server-sent events, and long-lived connections, including handling reconnects, backpressure, and partial delivery.
- Python (asyncio) expertise: Deep proficiency with Python 3.13, asyncio, FastAPI, Pydantic, and hexagonal architectures to build scalable, maintainable, and testable backend services.
- LLM integration: Experience integrating LLMs via SDKs and gateways, managing prompt-driven personas, streaming completions, and balancing cost–latency trade-offs in production.
- Concurrent, event-driven systems: Task orchestration and scheduling with tools like APScheduler, managing thousands of concurrent jobs, implementing retries, resilience, idempotency, and graceful shutdown.
- Data and storage: Working with MongoDB (async), Azure Blob Storage, and contract-first API design using OpenAPI/AsyncAPI.
- Observability and quality: Implementing OpenTelemetry, Datadog, structured logging, SLOs, and robust testing with pytest, Testcontainers, Pact, Locust, ruff, mypy, and SonarQube.
- Cloud-native delivery: Operating Dockerized services on Kubernetes with Helm, GitHub Actions CI/CD, feature flags, and Renovate.
- Leadership and ownership: Leading complex multi-month roadmaps, owning end-to-end delivery and operations, and thriving in fast-paced, product-focused environments.
If this aligns with your background and aspirations, we would be delighted to introduce you to our client's team.