AI Engineer – Agents, LLM Gateway, Model Integration & SDK
Job Type: Contract
Location: USA – Remote
Duration: 12+ Months
Job Summary
We are looking for an experienced AI Engineer to design and develop AI platforms and solutions focused on AI agents, LLM gateways, model integration, and SDK development. The ideal candidate will have strong experience building scalable AI/ML applications and integrating multiple LLMs and AI services.
Key Responsibilities
- Design and develop AI agents and agentic workflows using LLMs.
- Build and maintain LLM gateway/platform services for secure and scalable model access.
- Integrate and orchestrate multiple LLMs, foundation models, APIs, and AI services.
- Develop SDKs and reusable frameworks for AI/LLM integrations.
- Implement prompt management, model routing, authentication, observability, logging, and monitoring.
- Optimize model performance, latency, reliability, and cost.
- Collaborate with product, engineering, and data teams to deliver production-ready AI solutions.
- Ensure AI integrations follow security, scalability, and governance best practices.
Required Skills
- 5+ years of experience in AI/ML or Software Engineering, with hands-on GenAI experience.
- Strong experience with LLMs, Generative AI, AI Agents, and model integration.
- Proficiency in Python and experience developing APIs/SDKs.
- Experience with LLM gateways, model routing, API integration, and orchestration.
- Experience with frameworks such as LangChain, LangGraph, Semantic Kernel, or similar.
- Strong understanding of REST APIs, microservices, cloud platforms, and distributed systems.
- Experience with LLM providers such as OpenAI, Azure OpenAI, Anthropic, Google Gemini, or AWS Bedrock.
- Experience with AI observability, evaluation, security, and production deployment.
Preferred
- Experience building enterprise-scale AI platforms or developer SDKs.
- Knowledge of RAG, vector databases, embeddings, function/tool calling, and MCP.
- Experience with AWS, Azure, or GCP.
- Experience with Kubernetes, CI/CD, and cloud-native architectures.
Keywords: AI Engineer | Generative AI | LLM | AI Agents | LLM Gateway | Model Integration | SDK | Python | LangChain | LangGraph | RAG | MCP | OpenAI | Azure OpenAI | AWS Bedrock | Gemini