Agentic Audio Specialist - Freelance AI Trainer Project

Requirements

• Evaluate model performance across flight bookings, financial services, and telecommunications domainsMust
• Understanding of JSON structures and structured data formatsMust
• Familiarity with functions, methods, and basic programming logicMust
• Technical communication clarity in support-style problem-solving contextsMust
• Strong verbal communication skills in simulated customer support scenariosMust
• English language proficiency including reading, listening, writing, and speaking fluencyMust
• Comfort working with structured prompts, evaluation rubrics, and technical guidelinesMust
• High-quality microphone for clean and reliable audio inputMust
• Device capable of running audio recording softwareMust
• Ability to access and work with large technical documentationMust
• Secure computer and high-speed internet accessMust
• Experience evaluating or benchmarking AI and machine learning models
• Background in customer support, quality assurance, or user experience testing
• Familiarity with audio processing or voice technology

What you'll do

• Create and execute role-play-based evaluation scenarios simulating realistic customer service interactions
• Evaluate agentic audio models across conversational, technical, and audio-specific metrics
• Assess model performance on task completion accuracy, conversational naturalness, and audio comprehension
• Contribute to development of diverse and representative datasets for conversational audio agents
• Ensure evaluations reflect real customer expectations for clarity, efficiency, and natural conversational flow

About the role

A project dedicated to assessing and benchmarking advanced agentic audio models against leading systems. The program’s mission is to evaluate and optimize model performance for real-world customer support use cases. Responsibilities • Create and execute role-play–based evaluation scenarios that simulate realistic customer service interactions across multiple domains, including: • Flight bookings and travel support • Financial services • Telecommunications and technical support • Contribute to the development of diverse and representative datasets used to assess conversational audio agents. • Evaluate model performance across a standardized set of qualitative and quantitative metrics. • Ensure evaluations reflect real customer expectations for clarity, efficiency, and natural conversational flow. Evaluation Metrics Model performance is assessed using a combination of conversational, technical, and audio-specific criteria, including but not limited to: • Task completion accuracy and efficiency • Conversational naturalness (tone, flow, and coherence) • Audio comprehension and response quality • Instruction adherence and contextual understanding • Basic computer programming literacy , including: • Understanding of JSON structures • Familiarity with functions and methods • Ability to reason about structured data and simple logic • Technical communication clarity when handling support-style problem-solving Technical & Equipment Requirements • Strong verbal communication skills in a simulated customer support context • English proficiency including fluency across all language skills: reading, listening, writing, and speaking. • Access to a high-quality microphone to ensure clean, reliable audio input during evaluations • Comfort working with structured prompts, evaluation rubrics, and technical guidelines • Device capable of running audio recording software and opening large technical documentation We offer a pay range of $11-to- $30.65 per hour, with the exact rate determined after evaluating your experience, expertise, and geographic location. Final offer amounts may vary from the pay range listed above. As a contractor you’ll supply a secure computer and high‑speed internet; company‑sponsored benefits such as health insurance and PTO do not apply. Employment type: Contract Workplace type: Remote Seniority level: Mid‑Senior Level Originally posted on Himalayas