AI Platform Operations Engineer
Experience Required: Min 3 Years
Full-Time Job
Role Summary
Responsible for the operational management, governance, and support of enterprise AI platforms, ensuring secure, scalable, and cost-effective onboarding and operation of Generative AI and Agentic AI workloads on Microsoft Azure.
Key Responsibilities
- Operate Azure AI platform services, including Azure AI Foundry / Azure OpenAI and associated platform-level services.
- Support onboarding of Nexus AI, GenAI and agentic workloads using approved landing-zone patterns, platform blueprints, governance gates and release processes.
- Support AI gateway / LLM gateway and APIM exposure, including API connectivity, registration and production-readiness checks.
- Assist use-case teams with environment readiness, identity/access, network/API connectivity, deployment pre-checks and post-deployment verification.
- Ensure AI workloads and agents are onboarded with approved guardrails, content-safety controls, observability, quota controls, cost attribution and use-case governance.
- Support prompt/model monitoring, evaluation awareness and AI observability; help validate dashboards, alerts and operational health indicators.
- Support integrations with MCP/agent interfaces, data products, event streams and operational data stores where applicable.
- Track incidents, onboarding issues, risks and dependencies; coordinate resolution with Microsoft, Client IT, CIS, Architecture, Data & AI and use-case teams.
- Maintain onboarding checklists, AI operational procedures, troubleshooting guides, governance evidence and knowledge-transfer/handover materials.
Must-Have Skills
-
Minimum 3+ years of hands-on Microsoft Azure experience.
-
Strong experience with Azure AI Foundry, Azure OpenAI, and Azure AI Services.
-
Experience with Azure API Management (APIM) and API exposure patterns.
-
Knowledge of Generative AI, Large Language Models (LLMs), RAG, and Agentic AI concepts.
-
Experience implementing AI guardrails, content filtering, and Responsible AI controls.
-
Familiarity with AI observability, monitoring, logging, and performance tracking.
-
Experience with Azure Monitor, Application Insights, Log Analytics, and Azure Cost Management.
-
Understanding of Azure security, RBAC, Managed Identities, Key Vault, and networking concepts.
-
Strong troubleshooting, operational support, and stakeholder management skills.
Good-to-Have Skills
-
Experience with AI Gateway solutions (Azure APIM AI Gateway or similar).
-
Knowledge of Prompt Flow, AI evaluations, and model benchmarking frameworks.
-
Experience with LangChain, LangGraph, Semantic Kernel, or AutoGen.
-
Exposure to MLOps, CI/CD pipelines, GitHub Actions, and Azure DevOps.
-
Knowledge of Microsoft Purview, AI governance, and compliance frameworks.
-
Experience with vector databases, Azure AI Search, and RAG architectures.
-
Familiarity with Kubernetes, Container Apps, or Azure OpenAI at enterprise scale.
-
Knowledge of quota planning, token consumption analysis, and FinOps practices for AI workloads.
Required Experience & Skills
- 3-10 years hands-on Azure administration/operations experience, including support of production cloud environments.
- Operational knowledge of Azure AI Foundry / Azure OpenAI, GenAI workload patterns and agentic application operations.
- Understanding of AI gateway/APIM, REST APIs, MCP awareness, guardrails, content safety, prompt/model monitoring and evaluation concepts.
- Experience with Azure monitoring/observability services such as Azure Monitor, Log Analytics and Application Insights.
- Working knowledge of identity, managed identities, RBAC, secrets management, private connectivity, security controls, quota management and cost attribution.
- Operational familiarity with APIM, Azure Event Hubs, Application Insights, Cosmos DB and ADLS Gen2.
- Strong incident/problem management, stakeholder coordination, runbook preparation and knowledge-transfer skills.
Preferred Certifications
Strongly preferred: Microsoft Azure Administrator Associate (AZ-104). Additional preferred certifications: Azure AI Engineer Associate (AI-102) and Azure Solutions Architect Expert (AZ-305). Google Cloud Associate Cloud Engineer is an advantage due to cross-cloud dependencies.
Key Deliverables
AI/use-case onboarding checklist; platform monitoring and incident register; security/governance evidence inputs; AI operational runbooks and troubleshooting guides; operational dependency records; knowledge-transfer and handover pack.
oHnkB0EPEi