ABOUT THE JOB
We are looking for senior professors, academic leaders, researchers, and recognized domain experts to help design and validate assessments used to evaluate professionals and subject-matter experts across STEM and broader knowledge-worker domains.
The expert will bring deep academic and industry knowledge to ensure that assessments are technically rigorous, domain-relevant, unbiased, and capable of distinguishing genuine expertise from superficial knowledge or AI-assisted responses.
The role will involve working with our Talent/Assessment team to establish domain competency frameworks, assessment blueprints, questions, scoring rubrics and validation standards.
Key Responsibilities
1. Domain Competency Framework
- Define the core competencies and knowledge areas required for different levels of expertise within the domain.
- Identify the difference between basic knowledge, working proficiency, advanced expertise and specialist-level capability.
- Recommend what a qualified professional should be able to know, analyze, solve, interpret and apply.
2. Assessment Design
- Design and/or review assessments for domain-specialized resources.
- Develop questions covering:
- Fundamental concepts
- Applied knowledge
- Analytical reasoning
- Problem-solving
- Case-based scenarios
- Domain judgment
- Interpretation of data/results
- Practical application
- Recommend the appropriate balance of MCQs, scenario-based questions, case studies, open-ended questions and practical assessments.
3. Assessment Validation
- Review assessments developed by internal assessment teams.
- Validate technical accuracy, relevance, difficulty and ambiguity.
- Ensure questions genuinely test domain capability rather than memorization.
- Identify questions that can be answered through generic AI-generated responses without demonstrating real expertise.
4. Scoring & Evaluation Framework
- Develop answer keys, scoring rubrics and evaluation criteria.
- Establish benchmarks for different proficiency levels.
- Define what constitutes:
- Pass / Fail
- Basic competency
- Intermediate competency
- Advanced competency
- Expert-level competency
- Provide guidance for evaluating subjective/open-ended responses.
Domains
STEM
- Computer Science & Software Engineering
- Data Science & AI/ML
- Mathematics & Statistics
- Physics
- Chemistry
- Biology & Life Sciences
- Engineering – Mechanical, Electrical, Civil, Chemical, etc.
- Environmental Sciences
- Biotechnology
- Materials Science
Other Knowledge Domains
- Economics
- Finance & Accounting
- Business & Management
- Law
- Psychology
- Sociology
- Education
- Research & Academia
- Healthcare-related knowledge domains
- Linguistics
- Communications
- Supply Chain & Operations
- Marketing
- Other specialized professional domains
Ideal Candidate Profile
We are looking for individuals who have deep credibility within their discipline, such as:
- Professors from leading universities
- Associate/Assistant Professors with strong domain expertise
- Distinguished researchers
- Academic department heads
- Industry-academia experts
- Principal Scientists / Chief Scientists
- Published researchers and recognized subject-matter experts
Preferred Credentials
- PhD or equivalent advanced qualification in the relevant discipline
- 10+ years of domain experience preferred
- Strong academic/research credentials
- Publications, patents, research or recognized contributions in the field
- Experience designing examinations, assessments, curriculum or certification programs is highly desirable
- Experience evaluating professionals, students, researchers or technical experts is a strong advantage