Senior Software Engineer
We’re seeking a senior software engineer to support our AI infrastructure team, helping build and maintain the foundation for advanced AI capabilities while supporting an ecosystem of AI-enabled applications.
Responsibilities
- Lead the evaluation, configuration, and deployment of inference models for users.
- Mentor engineers and grow development best practices and standards for the team.
- Develop in-house services to guarantee high-quality inference service.
- Collaborate with other teams to establish solid infrastructure and integrate LLM-powered tools.
- Support surge efforts to meet short-term, high-priority inference needs from stakeholders.
Required Skills
- Experience with Python and/or modern programming languages.
- Experience with Argo CD and/or other CI/CD frameworks.
- Knowledge of Kubernetes/Helm.
- Experience with AWS or another cloud service provider.
- Strong communication skills and ability to mentor engineers.
- Excellent leadership and stakeholder management skills.
Nice To Have
- Experience with vLLM, LiteLLM, or similar inference-serving frameworks.
- Familiarity with other LLM hosting frameworks and practices.
- Experience supporting production software using SRE best practices.
- Knowledge of observability frameworks like Elastic, Grafana/Prometheus.
- Experience with Docker and containerization.
Experience Required: 12 years with Bachelor’s degree in a technical discipline or 16 years without degree
Location: Columbia, MD
Clearance: TS/SCI with Polygraph required
Salary Range: $204,000 - $247,000