Sign up to access all features of our service
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Analyst - LLM Evaluation

Okda Solutions

Job Description : Immediate joiners or less than 30 days notice period.Support the design and evaluation of safe, grounded and useful AI learning experiences for children, including prompt behaviour, multilingual quality and model-response testing.Required Skills : - LLM prompting, evaluation methods and structured testing rubrics- Working knowledge of RAG, grounding and hallucination testing- Multilingual evaluation and dataset/test-case creation- Understanding of child-safe AI behaviour and responsible content standards- Analytical thinking, documentation and AI-cost awarenessKey Responsibilities : - Define and test AI-tutor prompts, response behaviour and grounding standards- Create evaluation datasets, test cases, scoring rubrics and quality reports- Identify hallucinations, unsafe outputs and multilingual quality issues- Work with product and academic teams to improve learning accuracy- Document findings and recommend practical model or prompt improvements (ref:hirist.tech)

Vacancy posted 23 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Analyst - LLM Evaluation. Be the first to apply!