Job Summary
As an LLM / MLOps Engineer at SentraAI, you are responsible for operationalising, deploying, and governing machine learning and LLM-based systems in production.
This role exists to ensure AI systems are reliable, observable, reproducible, and controllable once live. You will own pipelines, deployment patterns, monitoring, and controls that allow AI systems to operate safely within enterprise run-states.
This is a systems and platform-focused role, not a research position.
About SentraAI
SentraAI is a specialist enterprise AI firm, focused on helping large, regulated organisations move AI and data platforms from experimentation into production safely and sustainably.
We work inside enterprise run-states, where governance, operational risk, change control, and long-term ownership are integral to delivery. Our teams are trusted to design and deliver systems, platforms, and operating models that can be run, audited, and evolved, not just launched.
We prioritise engineering discipline, architectural clarity, and delivery quality over speed theatre or hype.
Key Responsibilities
LLM and ML Operations
• Build and operate end-to-end ML and LLM pipelines from training through inference
• Manage model registries, versioning, and promotion workflows
• Package and deploy models using containerised and cloud-native patterns
Deployment, Reliability, and Scale
• Design and operate inference services for real-time and batch workloads
• Implement rollout, rollback, and blue/green deployment strategies
• Ensure systems meet performance, availability, and cost expectations
Observability and Governance
• Implement monitoring for model performance, drift, and anomalous behaviour
• Instrument AI systems for logging, metrics, and traceability
• Embed validation, guardrails, and runtime controls for LLM-based systems
• Support audit, risk, and compliance requirements
Platform and Collaboration
• Work closely with AI/ML Engineers to productionise models
• Partner with data engineering, security, and platform teams
• Contribute to platform standards, runbooks, and reference architectures
Required Qualifications
Core Engineering Capability
• Strong proficiency in Python for production systems
• Experience with CI/CD and automation for ML systems
• Strong understanding of distributed systems fundamentals
MLOps and LLM Ops Tooling
• MLflow or Weights and Biases
• Docker and containerised deployments
• FastAPI or equivalent inference frameworks
• Kubernetes or managed equivalents
LLM Operations
• Experience deploying and operating LLM-based applications
• Familiarity with vector databases such as Pinecone, Weaviate, or FAISS
• Understanding of prompt orchestration and runtime controls
Cloud Platforms
• Strong experience with AWS, Azure, or GCP
Advantageous but Not Mandatory
• Experience operating AI systems in regulated enterprise environments
• Exposure to AI security, guardrails, or red-teaming practices
• Experience with cost optimisation or FinOps for AI workloads
• Familiarity with SOC, monitoring, or incident response processes
Why Work for SentraAI
• Enterprise AI, done properly. We exist to take AI and data out of experimentation and into production environments that are regulated, scrutinised, and expected to work every day.
• Quality is not optional. SentraAI is built on the belief that engineering discipline, governance by design, and delivery rigour are competitive advantages, not overhead.
• Clear ownership and accountability. You will be trusted with real responsibility, clear mandates, and meaningful outcomes, not diluted roles or performative activity.
• Work that survives contact with reality. We design systems, operating models, and decisions that still stand up months and years after go-live, not just at demo time.
• Run-state matters as much as build-state. We optimise for operability, auditability, and change control from day one, because that is where enterprise value is won or lost.
• Substance over hype. We deliberately avoid delivery theatre, buzzwords, and novelty for novelty’s sake. Credibility is earned through execution.
• Learn from experienced practitioners. You will work alongside people who have built, broken, fixed, and run enterprise AI systems.
A firm with a point of view. SentraAI is opinionated by design. We stand for doing fewer things better, and we expect our people to take pride in that standard