AI Jobs Map

Ethos Profinds · Work from Home

QA Automation & AI-Driven Testing Leader (Remote)

Remotefull timePosted 28 days ago
Apply on IndeedOpens the original posting. AI Jobs Map never asks for your details.

Stack mentioned

agentic-aillmci/cdplaywrightcypressseleniumopenaiaws

The Role

As Chief Agentic Quality Architect, you will take ownership of quality engineering across a newly acquired product or suite of products. You'll audit existing test coverage, define a phased quality roadmap, and build out agentic (AI-driven) automation that keeps pace with an engineering org where AI is generating much of the codebase. You will also build and lead a specialist QA team skilled specifically in AI-assisted testing.

This is not a generalist QA management role — it's an architecture and transformation mandate for someone who has deep, hands-on automation expertise and is genuinely fluent in applying AI/LLM tooling to real testing workflows.

Key Responsibilities

Assess & Benchmark Quality Coverage

- Conduct a comprehensive audit of existing test coverage across unit, integration, API, UI, sanity, and regression layers.

- Evaluate current QA tooling and automation maturity against benchmark standards; identify test debt and high-risk gaps.

- Produce a Current State & Gap Coverage Report that becomes the baseline for the roadmap.

Define the Quality Engineering Roadmap

- Prioritize end-to-end automation across critical business flows using agentic automation patterns, with a left-heavy coverage strategy (unit/integration first, then UI/regression).

- Own a phased roadmap across three horizons:

- 2 weeks: Current-state assessment complete, highest-risk gaps identified, quick-win automation live, tooling selected.

- 1 month: Core regression coverage established, CI/CD quality gates operational, first agentic test suites validated.

- 3 months: Self-maintaining end-to-end automation live, benchmark coverage achieved, AI guardrails enforced, quality metrics visible to leadership.

Agentic Test Generation & Automation

- Use AI agents to convert business requirements and manual test cases into executable Playwright or Cypress scripts.

- Implement tools that autonomously generate synthetic test data and edge-case scenarios.

- Deploy self-healing automation frameworks that detect UI changes and update selectors without manual intervention.

Guardrails for AI-Generated Code

- Design a regression strategy tuned to catch non-deterministic errors and "hallucinations" common in AI-generated code.

- Implement characterization testing to lock in expected legacy behavior during AI-assisted refactoring.

- Define quality gates to validate autonomous agent output against functional, security, and performance standards.

Build & Mentor an AI-Skilled QA Team

- Hire QA specialists with genuine, hands-on experience in AI-assisted testing and agentic frameworks.

- Mentor the team on agentic workflows, guardrails, and quality benchmarks through code review, pairing, and coaching.

- Instill a quality-first culture where QA is embedded throughout the development lifecycle, not a downstream gate.

What You Bring

- 10+ years in QA automation engineering, SDET, or test architecture roles.

- Expert-level proficiency in Playwright, Cypress, or Selenium.

- Hands-on experience using LLMs (Claude, GPT-4, etc.) and agentic frameworks to generate code or automate testing workflows.

- Deep understanding of integrating quality gates into AWS-based CI/CD pipelines or equivalent environments.

- Proven ability to design "behavioral snapshots" to safeguard critical business logic during rapid technical transformation.

- Strong track record of building and leading QA teams, not just individually executing.

Nice to Have

- Experience in remote-first or globally distributed engineering teams.

- Background in SaaS scale-ups, legacy modernization projects, or PE-backed companies.

- Exposure to performance, load, or security testing tools.

- Comfort operating in high-ambiguity, high-ownership environments with evolving requirements.

Why This Role

- High ownership, flexibility, and real transformation impact from day one.

- Exposure to multiple products, industries, and technologies across a growing portfolio.

- Clear growth pathway into broader engineering, product, or operations leadership.

- Fully remote-first setup — work from anywhere in the Philippines.

- Backed by a well-resourced technology-focused private equity firm with an active acquisition pipeline.

Benefits:

- Work from home

Work Location: Remote

More jobs at Ethos Profinds