Program Management Expert - Evaluator
Mercor
Mumbai
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Program management / implementation planning Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
- Provide clear, structured written feedback to improve AI-generated work products.
- Apply deep subject-matter expertise to grade outputs for accuracy and rigor.
- Work independently and asynchronously to ensure high-quality evaluations.
Qualifications
Must-Have
- 5+ years of relevant professional experience in Program management / implementation planning.
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides .
Preferred
- Advanced degree (Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Program Management Expert - Evaluator in Mumbai vacancy
- ...Jack Dorsey . Position: Government / public administration Evaluator Type: Contract Compensation: $80–$120/hour... ...improve AI model outputs. Collaborate with subject matter experts to ensure consistency and quality. Work independently and asynchronously...SuggestedRemote jobContract workSummer work
- ...Jack Dorsey . Position: PDF Annotation & Transcription Experts – Japanese Type: Contract Compensation: $34/hour... ...with AI training data annotation, labeling, or bilingual evaluation. Skills in transcription and localization, including MTPE...SuggestedRemote jobFull timeContract workSummer work
- ...Jack Dorsey . Position: PDF Annotation & Transcription Experts – Odia Type: Contract Compensation: $13/hour... ...-language AI data annotation, labeling, grading, or bilingual evaluation. Skills in transcription and localization: MTPE , subtitling...SuggestedRemote jobFull timeContract workSummer work
- ...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Mathematics PhD Coding Experts Type: Contract Compensation: $70/hour Location: Remote Duration: 6 weeks Commitment: 2...SuggestedRemote jobContract workSummer workImmediate start
- .... Position: Engineering, Procurement & Construction (EPC) Expert — Data Centers Type: Contract Compensation: $... ...capital projects through EPC , design-build, or construction-management models. ~ Relevant roles include Project Engineer, Engineering...SuggestedRemote jobContract workSummer workImmediate start
- ...Windows - STEM Type: Contract Compensation: $45–$55/hour Location: Remote Role Responsibilities Evaluate the accuracy and depth of statistical analysis using Stata SE on Windows . Develop and improve data analysis...Remote jobContract workSummer work
- This role is for one of our clients Industry: Artificial Intelligence Seniority level: Mid-Senior level Min Experience: 5+ years Location: Mumbai, Maharashtra, India JobType: full-timeFull time
- ...Jack Dorsey . Position: PDF Annotation & Transcription Experts – Gujarati Type: Contract Compensation: $13/hour... ...regional-language AI data annotation, labeling, or bilingual evaluation. Skills in transcription and localization, such as MTPE ,...Remote jobFull timeContract workSummer work
- ...Windows - STEM Type: Contract Compensation: $45–$55/hour Location: Remote Role Responsibilities Evaluate the accuracy and depth of AutoCAD Mechanical applications in mechanical drafting to strengthen design outputs. Review...Remote jobContract workSummer work
- About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position...Remote jobContract workSummer work
- About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position...Remote jobContract workSummer work
- ...hour Location: Remote Role Responsibilities Evaluate the accuracy and depth of AI-generated content in Statistics... ...tasks and solutions. Collaborate with subject matter experts to ensure consistency, relevance, and coverage across datasets....Remote jobContract workSummer work
- About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position...Remote jobContract workSummer work
- ...macOS - Code Type: Contract Compensation: $55–$65/hour Location: Remote Role Responsibilities Evaluate and utilize Visual Studio Code on macOS for specialized applications. Capture high-resolution screenshots with more than 2.5...Remote jobContract workSummer work
- ...Windows - STEM Type: Contract Compensation: $45–$55/hour Location: Remote Role Responsibilities Evaluate the functionality and usability of Inventor Professional on Windows for mechanical and product design. Capture and analyze...Remote jobContract workSummer work
- ...Generalist Type: Contract Compensation: $30–$40/hour Location: Remote Role Responsibilities Evaluate the functionality and performance of Blender on Windows systems. Capture high-resolution screenshots exceeding 2.5 megapixels...Remote jobContract workSummer work
- ...information in the problem statement. Rate each question's difficulty: Medium (intro undergraduate), Hard (advanced undergraduate), or Expert (post-graduate and above). Provide 1 correct answer and 9 plausible but subtly incorrect alternatives to challenge expert-level...Remote jobContract workSummer work
- ...Windows - Code Type: Contract Compensation: $55–$65/hour Location: Remote Role Responsibilities Evaluate FPGA and digital hardware designs using Quartus II on Windows . Develop and review FPGA design projects to ensure...Remote jobContract workSummer workFlexible hours
- ...Jack Dorsey . Position: Survey Research & Consumer Insights Expert Type: Contract Compensation: $120/hour... ...Location: Remote Role Responsibilities Review and evaluate surveys for methodological quality, clarity, and fitness for purpose...Remote jobContract workSummer work
- ..., General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Product management / roadmap / PRD Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities...Remote jobContract workSummer work
- ...Jack Dorsey . Position: PDF Annotation & Transcription Experts – Bengali Type: Contract Compensation: $13/hour... ...language AI data: annotation, labeling, grading, or bilingual evaluation for training datasets. Transcription and localization: MTPE...Remote jobFull timeContract workSummer work
- ...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: People ops / recruiting Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer work
- ...Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Operations / inventory / capacity planning Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer work
- ...Studio — Check, Golden, Run, Analyze — and iterate until every stage passes. Document your work in the task README and submit for expert review, addressing reviewer feedback on returned tasks. Qualifications Must-Have ~3+ years of professional software...Remote jobFull timeContract workSummer work
- ...Studio — Check, Golden, Run, Analyze — and iterate until every stage passes. Document your work in the task README and submit for expert review, addressing reviewer feedback on returned tasks. Qualifications Must-Have ~3+ years of professional software...Remote jobFull timeContract workSummer work
- ...Position: Computational Statistics and Applied Mathematics Expert (R, Python, and Matlab/Scilab) Type: Contract Compensation... ...software packages. Familiarity with benchmark or evaluation design. Background in scientific teaching or exam/problem-set...Remote jobContract workSummer work
- ...contained, and precisely defined. Rate each question's difficulty: Medium (intro undergraduate), Hard (advanced undergraduate), or Expert (post-graduate and above). Provide 1 correct answer and 9 plausible but subtly incorrect alternatives to challenge expert-level...Remote jobContract workSummer work
- ...Jack Dorsey . Position: PDF Annotation & Transcription Experts – Telugu Type: Contract Compensation: $13/hour... ...Experience with regional-language AI data annotation or bilingual evaluation. Skills in transcription, localization, and OCR correction...Remote jobFull timeContract workSummer work
- ...Jack Dorsey . Position: PDF Annotation & Transcription Experts – Korean Type: Contract Compensation: $34/hour... ...AI training data : annotation, labeling, grading, or bilingual evaluation. Skills in transcription and localization: MTPE , subtitling...Remote jobFull timeContract workSummer work
- ...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Incident management / reliability / SRE Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities...Remote jobContract workSummer work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Program Management Expert - Evaluator. Be the first to apply!
