AI Jobs Map

Photon · Dallas-Fort Worth Metroplex

Gen AI Inferencing Engineer

seniorfull timePosted yesterday
Apply on LinkedInLinkedInOpens the original posting. AI Jobs Map never asks for your details.

Stack mentioned

ragci/cdpythonscalajavamlopsvllmmongodbredisangularreactdevopsgitbitbucketjenkinspytestansiblegenerative-aiobject-oriented-programmingartificial-intelligence

About the Company

Who are we? For the past 20 years, we have powered many Digital Experiences for the Fortune 500. Since 1999, we have grown from a few people to more than 4000 team members across the globe that are engaged in various Digital Modernization. Our current focus and innovation in Digital Hyper expansion TM offers nearly limitless opportunities for career growth. For a brief 1-minute video about us, you can check out this video. Photon is an equal opportunity employer and values diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status. We bring out the best in each other.

About the Role

This position is focused on design, build, and operate of reusable toolkits for Gen AI RAG capabilities. This job is responsible for developing and delivering complex requirements to accomplish business goals. Key responsibilities of the job include ensuring that software is developed to meet functional, non-functional and compliance requirements, and solutions are well designed with maintainability/ease of integration and testing built-in from the outset. Job expectations include a strong knowledge of development and testing practices common to the industry and design and architectural patterns.

Responsibilities:

- Codes solutions and unit test to deliver a requirement/story per the defined acceptance criteria and compliance requirements

- Designs, develops, and modifies architecture components, application interfaces, and solution enablers while ensuring principal architecture integrity is maintained

- Mentors other software engineers and coach team on Continuous Integration and Continuous Development (CI-CD) practices and automating tool stack

- Executes story refinement, definition of requirements, and estimating work necessary to realize a story through the delivery lifecycle

- Performs spike/proof of concept as necessary to mitigate risk or implement new ideas

- Automates manual release activities

- Designs, develops, and maintains automated test suites (integration, regression, performance)

- Utilizes multiple architectural components (across data, application, business) in design and development of client requirements

- Manage multiple priorities, and simultaneously engage with multiple teams.

- Participates in estimating work necessary to realize a story/requirement through the delivery lifecycle.

- Be vocal and actively participate in all session with business stakeholders and agile teams.

- Collaborate with product teams, data analysts and data scientists to design and build solutions.

Qualifications:

- 5+ years OOP in Python/Scala/Java programming experience with expert level development skills

- Experience with AI/ML/GenAI Lifecycle Management and Development and its Ecosystem.

- Hands on experience building frameworks using MLOps, Fine – Tuning techniques, Inference Frameworks

- Experience with deploying models using vLLM/Triton Inference Server in containers in production with automation.

- Performs Continuous Integration and Continuous Development (CI-CD) activities.

- Performance Tuning those models and deployment to provide higher throughput.

- Track record of maintaining large scale Python/Unix based systems.

- Hands on experience and knowledge generative AI RAG process for various use cases, including chunking, embedding, retrieval, reranking and summarization.

- Hands-on experience in application development in one or more areas MongoDB, Redis, Angular/React Frameworks, Containerization, Building API based application leveraging FAST API services, JWT Integration, API Gateway

- Develop efficient utilities, automation frameworks, data science platforms that can be utilized across multiple Data Science teams for AI/ML and GenAI work.

- Working in large sized teams that collaboratively develop on a shared multi-repo codebase using IDEs (e.g. VS Code rather than Jupyter Notebooks), Continuous Integration (CI), Continuous Deployment (CD) and Continuous Testing

- Strong automation, scripting, and Python development skills.

- Hands-on DevOps experience with one or more of the following enterprise development tools: Version Control (GIT/Bitbucket), Build Orchestration (Jenkins), Code Quality (SonarQube and pytest Unit Testing), Artifact Management (Artifactory) and Deployment (Ansible)

More jobs at Photon