Role Overview
You will operate as a remote freelance generalist supporting multiple workstreams that connect product delivery with AI/ML training workflows. The role blends execution, coordination, and quality control—helping teams maintain training data quality, follow annotation guidelines compliance, and drive model performance improvement.
Responsibilities
- Coordinate cross-functional work across engineering, data operations, and vendor partners in a remote environment
- Support LLM training pipelines by organizing, triaging, and validating training datasets and labeling outputs
- Perform QA evaluation on labeled data, prompt evaluation results, and RLHF preference data to ensure consistency
- Enforce annotation guidelines compliance and contribute to guideline updates based on observed edge cases
- Support NLP tasks such as named entity recognition and taxonomy mapping; support CV tasks such as bounding boxes and segmentation review
- Contribute to content safety labeling workflows, including policy-based checks and escalation of ambiguous cases
- Track operational metrics (throughput, accuracy, rework) and propose process improvements
- Maintain clear documentation, handoffs, and status updates for distributed teams
Qualifications
- Mid-Senior experience in operations, program coordination, or delivery roles supporting technical teams
- Familiarity with AI/ML data workflows (data labeling, QA evaluation, prompt evaluation, RLHF) and quality frameworks
- Strong written communication and documentation skills for remote stakeholders
- Comfort working across multiple domains (NLP, computer vision annotation, content safety)
- Ability to reason about edge cases, ambiguity, and guideline interpretation
How To Apply
Apply on Rex.zone with a resume highlighting operations ownership, remote delivery, and any AI/ML data or evaluation experience.
Pay range: $30–$50 per hour.