Copy of Senior Python Developer (AI Evaluation & Benchmarking)
Temporary
Lifted, an Upwork Company™
An enterprise client is seeking experienced Senior Python Developers to help build the next generation of Artificial Intelligence systems. This opportunity support the client who is a leading AI platform that enables organizations to build intelligent applications through high-quality human feedback, AI evaluation, and model alignment.
The selected consultants will contribute to AI research by designing programming benchmarks, evaluating AI-generated code, and helping improve the performance, reasoning, and reliability of frontier AI models. This is an excellent opportunity for experienced software engineers who enjoy solving complex technical problems while contributing to the future of Generative AI.
Job Description
This opportunity is ideal for senior software engineers with strong Python expertise who enjoy writing high-quality code, reviewing technical solutions, and working on AI-related projects.
What You'll Do:
- Design and develop coding benchmarks used to evaluate frontier AI models.
- Analyze AI-generated code for correctness, reliability, efficiency, and edge cases.Build and maintain scalable data pipelines that support AI evaluation workflows.
- Create structured programming scenarios to test reasoning, debugging, and code quality.
- Work with large codebases and multi-language software environments.
- Collaborate with teams focused on improving how AI models understand, generate, and evaluate software.
- Write clean, maintainable, and well-tested Python code following software engineering best practices.
Qualifications
Requirements:
- 4+ years of professional software engineering experience (required).
- Expert-level proficiency in Python.
- Experience working at a high-growth technology company or top-tier software organization.
- Proficiency in at least one additional programming language such as JavaScript, Go, C++, or similar.
- Experience with CI/CD pipelines and automated testing frameworks such as pytest, Mocha, or JUnit.
- Strong understanding of software engineering best practices, debugging, and code quality.
- Excellent analytical and problem-solving skills.
Nice to Haves:
- Experience with AI/ML evaluation, model benchmarking, or Generative AI.
- Background in security engineering.
- Significant contributions to open-source software projects.
- Experience working with large-scale distributed systems or enterprise software platforms.
Additional Information
- Fully remote contract opportunity.
- Compensation ranges from $80–$100 USD per hour .
- Expected workload is 10–39 hours per week , depending on project needs.
- Weekly payments for approved work completed during the previous week.
- Work volume may fluctuate throughout the duration of the engagement.
Hiring Process:
- Submit your proposal.
- Complete a short qualification form provided by the client.
- Qualified candidates will receive an Upwork contract offer and onboarding instructions.
- After accepting the contract, candidates will gain access to the client's evaluation.
- Candidates who successfully pass the evaluation will be invited to a technical interview with the client.
Vacancy posted 24 days ago
Similar jobs that could be interesting for youBased on the Copy of Senior Python Developer (AI Evaluation & Benchmarking) in Hyderabad vacancy
- ...Job Title: Senior AI/ML Developer Location: Hyderabad Company: OSI Digital Experience: 5–8 Years About the Role OSI Digital is... ...Support data preprocessing, feature engineering, and model evaluation tasks. Work on implementing APIs and integrating ML services...SeniorFull timeRemote job
- ...Strong hands-on experience in Python development, building data-... ...solutions.- Must have experience in developing data-based chatbots using... ..., fine-tuning, model evaluation, response quality analysis, and... ...evaluation pipelines, and quality benchmarking will be highly preferred.-...Senior
- ...ideal responsesthat serve as the benchmark for every model update we ship... ...: Implement automated evaluation frameworks using tools like Ragas... ...Technical Skills & Qualifications : - Python Native : Deep proficiency in... ...interact with asynchronous AI APIs and handle complex data...Suggested
- ...Roboyo AI is a category shaper in Applied AI and Agentic Automation. We help leading enterprises move from automation projects... ...About the role A highly skilled and experienced Senior Python Developer is needed to lead the design, development, and optimization of...SeniorHybrid work
- We are looking for a Senior .NET & Python Developer with strong expertise in Graph Databases and hands-on experience integrating custom Agentic AI solutions into enterprise-grade applications. The ideal candidate is a seasoned engineer who thrives in complex systems, understands...Senior
- Python Next JS Senior Developer Position Description Founded in 1976, CGI is among the largest independent IT and business consulting services firms... ...to how we use technology. To support our recruitment team, AI tools may be used to help assess applications though they...SeniorFull timeHybrid workLocal areaShift work
- ...Skills : - Strong hands-on experience in Python development- Expertise in Django or Flask... ...Lambda, RDS, CloudWatch- Good knowledge of AI/ML concepts and model integration- REST API... ...optimization skillsResponsibilities : - Design and develop scalable backend applications using Python...Senior
- ...Senior AI Engineer Location: Hyderabad, Telangana, India About the Role GHX... ...you will focus on prompt engineering and evaluation systems , building the quality foundation... ...evaluation pipelines Establish accuracy benchmarks and quality baselines Mid-Term (6–12...SeniorLong term contractFull timeWorldwideShift work
- ...seeking a highly skilled Full Stack Engineer to design, develop, and scale next-generation Data Quality and AI-enabled platforms. In this role, you will work across... ...full-stack solutions using React, TypeScript, and Python (FastAPI), delivering high-performance web applications...SeniorFull timeWorldwide
- ...applications, services, and platforms using Python and AWS. Build and manage cloud-... ...into scalable technical solutions. Develop reusable frameworks, libraries, APIs, and... ..., SQL, and cloud data services. Evaluate emerging AI engineering tools, LLM frameworks, model...SeniorFull time
- WORKFALLJob Title : Senior AI EngineerWorkfall is a new-age premium talent tech platform, looking... ...powered systems (prompting, RAG, agents, evaluation, guardrails)- Translate business problems... ...roles- Strong programming skills (Python required)- Hands-on experience with ML/DL...SeniorFull time
- Job Description :Your responsibilities :- Design and develop responsive, high-performance frontend interfaces for... ..., ensuring an intuitive self-service experience for AI-powered workflows.- Build and maintain scalable Python/FastAPI backend services and REST APIs that power...SeniorContract work
- Position Responsibilities : The Senior Cloud AI Architect will serve as a principal technical authority... ...AI-driven architectural solutions.- Evaluate, select, and define integration patterns... ...) or domain-driven design.- Development Skill - Python (Mandatory) (ref:hirist.tech)SeniorLong term contract
- Job Description :We are seeking a highly skilled Python Developer with hands-on experience in Generative AI to design, develop, and deploy AI-powered applications... ..., and agent orchestration.- Understanding of model evaluation, guardrails, hallucination mitigation, and...
- ...We are seeking a Senior Software Engineer with a strong technical background in Python development and expertise in Generative AI to join our team. This role focuses on building cutting... ...with cross-functional teams to design, develop, and deploy web applications powered...Senior
- ...Work Mode: Hybrid Mode Budget :up to 28 LPA We are looking for a strong Python Developer with solid backend and data-handling experience and working familiarity with Artificial Intelligence (AI) and Machine Learning (ML) concepts. The ideal candidate is an excellent...SeniorHybrid work
- AI/ML EngineerExperience : 3+ years of overall experiencePrimary Skills (Must Have) : - AI- ML- Python- NLP- RAG- OCR- Deep Learning- Computer Vision- Vector... ...:- Design and develop end-to-end ML pipelines using Python for training, evaluation, and production deployment...Full timeHybrid workShift work
- ...: The Role : We are looking for a Senior Data Scientist who will support our... ...business requirements. In the new age of AI, this role will lead the design, evaluation, and operationalization of advanced... ...to drive business solutions.- Develop custom AI/ML models and algorithms...Senior
- Position : Python Developer With Agentic AILocation : Chennai/HyderabadMode : Full-TimeWork Model... ...This role demands an experienced Agentic AI Developer to design, build, and deploy... ...manage vector databases.- Implement robust evaluation frameworks, strict grounding techniques,...Full timeHybrid work
- ...Blend is a premier AI services provider, committed to co-creating... ...Job Description As a Senior Data Scientist – Marketing Mix... ...measurable business outcomes. You will develop statistical models, causal... ...marketing objectives. Design and evaluate causal inference frameworks...SeniorCasual work
Rs 15 - 20 lakhs p.a.
We're Hiring | PySpark Developer / Senior Data Engineer Location: Hyderabad, Pune, Chennai, Bengaluru Experience: 6–9 Years Work Mode... .../ Senior Data Engineer with strong expertise in PySpark, Python, SQL, and large-scale data engineering. Requirements Key...SeniorFull timeHybrid work- ...looking for highly motivated expert Senior Data Engineer who can own the... ...will be responsible to design, develop, and optimize data pipelines,... ...self-service analytics, AI-driven insights, and enterprise... ...PySpark, SparkSQL Apache Spark, AWS, Python, SQL, and Scaled Agile methodologies...SeniorFull time
- ...Zeta is seeking an experienced Senior Data Scientist to join our Machine Learning team. You will design, build, and... ...architecture and workflows Machine Learning & AI Development ~ Design, develop, evaluate, and deploy ML/AI models in production environments...SeniorFull time
- Description :About the Opportunity :As a Senior Software Engineer, you'll design, develop, and optimize scalable backend and... ...our next-generation Generative AI platform. You'll work across distributed... ...field- Strong coding skills in Python, Go, or Java- Hands-on with microservices...SeniorHybrid work
- ...or within 15 days is preferred.Job Title : Senior Data Scientist - AI EngineerLocation : Pune, IndiaAbout the Role... ...production.Key Responsibilities :- Design, develop, and deploy production-grade LLM-powered applications using Python.- Architect and implement Agentic AI...SeniorHybrid workImmediate start
- ...Description : Role Overview : We are hiring a Senior AI Engineer to design, build and scale... ...on GenAI, NLP, and healthcare applications.- Develop and productionize LLM-based workflows, including prompt engineering, evaluation frameworks, fine-tuning approaches, and Retrieval...SeniorFull time
- ...future with Yuno! We are seeking a Senior AI Engineer to architect, build, and scale AI... ...headcount. You will be at the forefront of developing the next generation of autonomous systems... ...Programming & Frameworks: Proficiency in Python, GO, and AI/ML libraries such as PyTorch,...SeniorLong term contractFull timeWork at office
- ...mathematical modeling/tool development. Develops solutions supporting the... ...problems. Mentors less senior team members to drive results.... ...and emerging technologies to evaluate trends and develop actionable... ...and other core ML frameworks Python and other modern programming languages...Senior
- Role : Senior Fullstack Engineer L3 : Location : Hyderabad, India.Work Type... ...the engineering bar, and drive AI-powered feature development across React and Python. A hands-on senior engineer who shapes... ...: standards, testing strategy, developer experience.- Healthcare...SeniorFull timeHybrid work
- As a Senior Data Engineer on the Data Science team, you will be embedded... ...into analysis-ready data.- Develop deep familiarity with Veho's... ...English.- Comfortable using modern AI coding assistants (Claude Code... ...- prompting, agentic tooling, evaluations, retrieval.- Tech : DBT,...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Copy of Senior Python Developer (AI Evaluation & Benchmarking). Be the first to apply!
