Software Engineer - AI Infrastructure
We are looking for a software engineer to support our AI infrastructure team in Columbia, MD. In this role, you will develop and maintain high-quality tools and applications that enable seamless and efficient use of AI by the customer base.
Responsibilities
- Develop high-quality AI tools and applications for workforce usage
- Ensure high availability, reliability, performance, and security of AI tools
- Modify FOSS to accommodate customer-specific use cases
- Regularly engage with customers, conducting requirements elicitation and developing solutions
- Maintain existing customer-facing infrastructure and applications for reliable service provision
- Serve as a technical lead for AI Tools and Applications initiatives, coordinating work across teams
- Conduct regular one-on-ones and provide coaching, feedback, and support to team members
- Navigate ambiguity and define solutions for complex, underspecified systems and requirements
- Establish new technical policies, standards, and governance frameworks where gaps exist
- Drive adoption of new technologies and practices across engineering teams
- Implement and oversee monitoring, logging, and observability solutions for AI services
- Communicate effectively with stakeholders at multiple organizational levels
Required Skills
- Expertise in UI/UX principles
- Significant experience using LLMs as part of a code solution workflow
- Ability to learn new technologies quickly
- Strong communication skills and willingness to ask questions
- Mastery of Python
- Demonstrate a willingness to lead a team and manage multiple junior developers
- Significant experience developing and maintaining production software
- Familiarity with AWS or other cloud service providers
- Experience with Kubernetes/Helm
- Familiarity with Argo CD and/or other CI/CD frameworks
- Experience supporting production software using SRE best practices
- Experience with Docker and containerization
Nice To Have
- Experience with LLM UI Open-Source software such as OpenWebUI
- Proficiency with AWS or other cloud service providers
- Proficiency with Kubernetes/Helm
- Proficiency with Argo CD and/or other CI/CD frameworks
- Extensive experience supporting production software using SRE best practices
- Proficiency with Docker and containerization
- Experience with LLM model hosting
Experience Required: 12 years with Bachelor’s degree in a technical field, or 16 years without degree
Location: Columbia, MD
Clearance: TS/SCI with Polygraph required
Salary Range: $204,000 - $247,000