Research Evaluation Specialist (PhD / Researcher / Professor)

Requirements

• PhD completed, active candidacy, or equivalent research experienceMust
• Subject matter expertise in academic or research disciplineMust
• Demonstrated track record of scholarly research and publicationsMust
• Familiarity with primary literature and authoritative references in disciplineMust
• Expert-level written communication skills in EnglishMust
• Analytical thinking and close attention to detailMust
• Self-directed work and reliability in remote independent engagementMust
• Skill in composing challenging, original, and methodologically sound questionsMust
• Ability to meet minimum weekly submission requirements and deadlinesMust
• Experience sourcing and triangulating information from multiple authoritative references
• Experience in AI training or evaluation

What you'll do

• Create original, high-difficulty question-and-answer pairs for AI evaluation
• Source, verify, and document answers using primary sources and citations
• Design questions requiring advanced reasoning and methodological nuance
• Test questions against AI systems and iteratively increase complexity
• Write questions and answers with high precision, clarity, and defensible responses
• Integrate reviewer feedback and uphold project guidelines and quality standards

About the role

Role Title: Research Evaluation Specialist (PhD / Researcher / Professor) Role Type: Contractor Location: Remote micro1 is engaging Research Evaluation Specialists (PhD / Researcher / Professor) to contribute expert insight in developing rigorous test material for advanced AI model evaluation as part of a customer's project. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required — your domain knowledge is what matters. Scope of Work • Create original, high-difficulty question-and-answer pairs at the cutting edge of your discipline to rigorously assess AI model capabilities. • Source, verify, and thoroughly document answers using primary sources and authoritative references, including clear citations and reasoning. • Design questions demanding advanced reasoning, methodological nuance, or synthesis across multiple sources, ensuring resistance to oversimplified or shortcut solutions. • Test questions against AI systems, identify items that are not sufficiently challenging, and iteratively increase complexity while maintaining accuracy. • Write each question and answer with high precision and clarity, eliminating ambiguity and supporting defensible responses. • Integrate reviewer feedback and consistently uphold all project guidelines and quality standards throughout your deliverables. Preferred Qualifications • PhD completed, active candidacy, or equivalent research experience as a specialist, researcher, or professor in your domain. • Demonstrated track record of scholarly research, in-depth subject matter expertise, and familiarity with primary literature. • Exceptional analytical thinking, close attention to detail, and strong written communication skills in English. • Experience sourcing and triangulating information from authoritative references. • Proven self-direction and reliability in delivering expert-level work independently within remote engagements. • Skill in composing challenging, original, and methodologically sound questions. • Experience in AI training or evaluation is advantageous but not required. Compensation Structure Compensation is output-based; experts are paid per task that meets the project specifications. The time required to complete work may vary depending on the expert’s experience and workflow. Minimum submission requirements apply. Experts must submit a minimum of tasks per week. Start Timeline & Availability We typically fill roles within 48 hours and are looking for experts ready to jump in right away. If selected, we expect you to start your first tasks within 24–48 hours of completing onboarding. Originally posted on Himalayas