Llm reliability & evaluation engineer jobs

 ...world’s transition to   AI + Human Intelligence   by making AI agents   reliable, explainable, and enterprise-ready . THE OPPORTUNITY We are seeking an   LLM Reliability & Evaluation Engineer   to ensure that large language models (LLMs) and agentic AI systems meet... 

 ...cloud provider – foundational understanding Very Strong Communication and Customer service skills Nice to Have Skills & Experience ~ LLM or AI Experience Job Description Insight Global is seeking a skilled LLM System Monitor to support the LLM Proxy team. You... 

 ...Job Responsibilities : Technically evaluate the Cars Submit a report for each Cars according to the defined process Estimate the...  ...handling skills. Should have a basic technical knowledge of engine, parts/ components, and everything technical. Valid driving license... 

 ...are looking for experienced Rust software engineers (tech lead level) who are familiar with...  ...environment automation, issue triaging, and evaluating test coverage and quality. You'll be at...  ...Modify and run codebases locally to assess LLM performance in bug-fixing scenarios.... 

 ...are looking for experienced C++ software engineers (tech lead level) who are familiar with high...  ...automation, issue triaging, and evaluating test coverage and quality. You'll be at the...  ...Modify and run codebases locally to assess LLM performance in bug-fixing scenarios. Collaborate... 

We are looking for a senior-level Data Scientist to drive experimentation, evaluation, and AI/LLM-powered product improvements. In this role, you will act as a strategic partner to product, engineering, and trust & safety teams, responsible for defining evaluation frameworks,... 

 ...Commitment: 30 hours/week Role Responsibilities Evaluate the scientific accuracy, reasoning, and technical rigor of LLM-generated content across chemical disciplines....  ...PhD (or PhD candidate) in Chemistry, Chemical Engineering, Biochemistry, or a closely related field.... 

 ...from Apollo ($750B AUM) and AI engineers from UIUC, IIT, and other top-...  ...and rigorous classical ML evaluation methodologies. Your primary responsibility...  ...measurable, explainable, and reliable. If you're excited by the...  ..., and A/B testing setups for LLM responses. • Stay up-to-date... 

 ...learn how modern AI systems are tested and evaluated This is a flexible, project-based...  ...correctness of evaluation scenarios created for LLM agents. This project opportunity blends...  ..., and collaboration with writers and engineers. You will verify test logic, flag inconsistencies... 

 ...variants). You'll split your time between building/owning our LLM evaluation stack — leveraging best practices in experimental design, measurement...  ...verbal communication; proven ability to teach and mentor engineers/researchers. Nice to have Safety evals, hallucination/... 

 ...can mentor our junior team members and collaborate with our senior engineers to help build and promote technical products to the world. You...  ...across the team. Proactively adopt and champion the use of AI/LLM tools for code generation, documentation, troubleshooting, and automation... 

 ...strong community of 2,000+ professionals and a reliable partner for global industry leaders and...  ...a motivated, self-reliant SRE / DevOps engineer with Python and ML framework experience to...  ...model training, inferencing platforms, and LLM fine-tuning systems. Collaborate with developers... 

 ...investment science and intelligence to build algorithmic engines inside the software and APIs to enable better investor...  .... Role Overview As a Language Translator for LLM (Large Language Model) Training & Evaluation at TIFIN, you'll leverage your linguistic expertise, evaluation... 

 ...SRE & DevOps Engineer (ML/AI Platform) Contract Position | Global E-Commerce Leader | Hybrid About the Opportunity We're partnering...  ...Experience with AI/ML model training and inference platforms LLM fine-tuning systems knowledge Performance monitoring and application... 

 ...We're on the hunt for hands-on Python engineers for a new project focused on developing Model...  ...and internal tools for running and evaluating agent behavior. You'll implement base methods...  ...infrastructures Familiarity with how LLM agents are prompted, executed, and evaluated... 

 ...classification and labeling. ENHANCING LLMs: Prompt engineering, SFT, RLHF, red teaming and adversarial model...  ...Culturally nuanced and aware, ranking, relevance, and evaluation to train models for search, ads, and LLM output. Want to join our Welo Data teamWe bring... 

 ...Job Description The Subsurface Reliability Engineer is part of the Production Engineering team within the Chevron ENGINE Center and is responsible...  ..., and operational procedures. Technology Integration: Evaluate and integrate new technologies and methodologies that enhance... 

 ...Job Title – Reliability Engineer City, Country - Dahej, India At dsm-firmenich, being a force for good is not optional. Diversity, Equity...  ...Engineer supports the Maintenance manager to monitor and evaluate the performance of the PM Plan To facilitate the process to... 

 ...external labs, to ensure robust product reliability and continuous improvement. Responsibilities...  ...destructive physical analysis (DPA) to evaluate failures and propose design or process...  ...protocols. Drive reliability engineering best practices, including Design for Reliability... 

 ...Position Summary With Job Responsibilities This role is to evaluate the Ergonomic aspects, vehicle accomdation aspects, stowage aspects...  ...the end customer requirements and converting the same in engineering aspects. Should have innovative thinking to provide appropriate... 

 ...Career Area: Engineering Job Description: Your Work Shapes the World at Caterpillar...  ...Role Definition The Gas Turbine Start Reliability Engineer plays a critical role in...  ...improvement plans for senior management and evaluates the outcome of the design against the functionality... 

 ...A Day in the Life Experienced individual contributor in Reliability Engineering, working on complex projects. Responsible for entire projects...  ..., and conducting technical reliability studies and evaluations of engineering design concepts and design of experiments (DOE... 

 ...JLL is seeking a Reliability Engineer to join our team! This exciting opportunity is responsible for providing reliability engineering support...  ...Inspect and document and prioritize asset and field conditions to evaluate remaining useful life. Document findings in detailed written... 

 ...And Responsibilities Manage the reliability team including reliability data analysis...  ...improvements. Identify and evaluate fundamental issues with product quality/...  ...measurement methodologies. Work with engineering and manufacturing to develop control plans... 

 ...shipping features at insane velocity, and so we need a software engineer / site reliability engineer who will use new agentic features to ensure quality...  ...Build agentic quality systems (e.g., Claude Agent SDK) and LLM-driven test harnesses - Broad product surface: Touch API,... 

 ...Permanent Location(s): Chennai, IN Senior Network Reliability Engineer Role Description Summary As a leading contributor, you...  ...for design, requirements analysis, architecture, development, evaluation, prototype demonstration, production implementation, and... 

 ...and supplier stakeholders to enable high reliability and high-quality performance of the...  ...Experience ~ Bachelor's/Master's in engineering disciplines- Mechanical/ Electrical/ Electronics...  ...system integration and evaluation. ~ Exposure/ experience of understanding... 

 ...Lead the implementation and advocacy for SRE (Support SIte Reliablity Engineer) principles to improve the reliability and availability of our...  ...compliance teams as needed. Continuous Improvement: Continuously evaluate and improve system reliability, scalability, and performance... 

 ...Azure DevOps (SRE) : ~ Azure core services Site Reliability Engineer who can implement and drive SRE discipline in the project. Tool Evaluation : ~ Evaluates emerging SRE tools and stays updated on the infrastructure tool and solution. Monitoring and Alerting... 

 ...Description Essential Duties: ~ As a DevOps SRE Engineer, should have knowledge of SRE and ITIL Processes ~3 to 6 years of software...  ...across the enterprise ~ Work with the team on manual support evaluation and provide recommendations on DevOps tooling and automation,...