Computer Science Engineer

JOB DESCRIPTION:

Role Overview We are looking for PhD level computer science experts to help fine-tune and evaluate large language models, including systems similar to ChatGPT. The role focuses on designing challenging, conceptual computer science problems that test advanced AI reasoning across topics such as algorithms, systems design, cybersecurity, theory, databases, networks, and other undergraduate to PhD-level computer science domains.

Key Responsibilities Design advanced computer science problems that test AI model performance across conceptual and reasoning-heavy topics, including systems design, algorithms, cybersecurity, and other advanced CS areas. Develop clear, step-by-step reference solutions with rigorous logic, well-structured explanations, and defensible reasoning. Evaluate AI-generated responses for correctness, reasoning quality, completeness, clarity, and alignment with the intended problem requirements. Identify flaws, gaps, edge cases, and near-miss reasoning patterns in AI outputs. Collaborate with researchers to refine benchmarks across undergraduate, graduate, and PhD-level computer science topics. Provide structured feedback to improve problem quality, benchmark reliability, and model evaluation standards.

Required Qualifications PhD, completed or pursuing, in Computer Science or a closely related field. Strong computer science reasoning and problem-solving skills across advanced domains. Ability to design challenging conceptual problems that require deep understanding rather than straightforward recall or coding. Excellent written communication skills, with the ability to explain complex technical ideas clearly and logically. Strong attention to detail in evaluating reasoning, assumptions, definitions, edge cases, and solution validity. Ability to provide structured, high-quality feedback on AI-generated responses. No prior AI experience required.

Evaluation Process Approved candidates will be sent a Job Interest Form. After the profile review, an assessment will be shared, which must be completed within 24 hours. Based on the assessment outcomes, shortlisted candidates will be contacted to schedule an interview.