Senior AI / Agent Platform Engineer
Location: New York, NY
Employment Type: Full-Time
Work Model: Hybrid (3 Days Onsite)
Position Overview
We are seeking a Senior AI / Agent Platform Engineer to build the execution layer powering enterprise AI agent capabilities. This role focuses on designing scalable runtime services and distributed systems that support long-running AI workflows in secure production environments.
Key Responsibilities
- Design and build runtime services for long-running, asynchronous AI workloads.
- Develop model routing and abstraction layers across multiple LLM providers.
- Implement tool invocation, execution state management, retries, checkpointing, and failure recovery.
- Build APIs and SDKs enabling reusable AI workflows.
- Develop tracing, telemetry, and evaluation capabilities.
- Collaborate with Security, Identity, and Platform Engineering teams.
Required Qualifications
- Strong software engineering and distributed systems background.
- Experience building production AI applications using LLMs, AI Agents, Function Calling, or Workflow Orchestration.
- Experience with asynchronous systems, queues, state management, retries, and observability.
- Understanding of model APIs, structured outputs, prompt/context management, and AI performance optimization.
- Cloud-native development experience (Containers, APIs, Kubernetes, Microservices).