Evaluation engineer jobs in Canada

 ...We are looking for a Security Test Engineer to validate the security, reliability, and correctness of authorization and policy enforcement...  ...precedence rules, parameter-level access controls, and policy evaluation correctness. Test transitions between LOG_ONLY and ENFORCE... 

 ...We are looking for a QA / ML Tester – Evaluation Framework to ensure the quality, reliability, and correctness of evaluation systems used...  ...quality assessment pipelines. You will work closely with AI engineers, platform teams, and quality specialists to establish confidence... 

 ...We are looking for a Security & Governance Engineer to establish and enforce security controls, governance standards, and compliance...  ...Perform security reviews, threat assessments, and architecture evaluations for enterprise services. Conduct security testing activities... 

 ...We are looking for a Python Engineer – Evaluator Library to design and implement reusable evaluation components that ensure the quality, safety, and compliance of enterprise AI agents and LLM-powered workflows. You will build custom evaluation capabilities used across AI... 

 ...We are looking for a Policy Engineer to design, implement, and validate fine-grained authorization policies for AI agent platforms and cloud-native services. The role focuses on Cedar policy development, identity provider integrations, policy enforcement, and attribute-based... 

 ...We are looking for an Observability Engineer – AgentCore Telemetry to build and evolve observability capabilities for enterprise AI platforms and agent-based systems running on AWS. In this role, you will design telemetry solutions, implement end-to-end tracing strategies... 

 ...We are looking for a Platform Engineer – CI/CD Gate & Online Evaluation to help establish automated quality controls for enterprise AI platforms and agent-based systems. In this role, you will integrate evaluation workflows into deployment pipelines, configure online quality... 

 ...Media IP Limited are not affiliated with, and do not endorse products or services of GitLab. An overview of this role You will engineer security improvements to the GitLab product as well as building and maintaining the tools we use to detect and prevent abuse on our SaaS... 

 ...of working effectively with cross-functional teams in a fast-paced, global environment.- A bachelor's degree in Computer Science, Engineering, or a related technical field is preferred.- Adaptability to work in a distributed team setup across multiple time zones (India, Canada... 

Role Overview :As a Software Engineer you will be instrumental in designing, developing, and deploying robust, scalable, and secure applications...  ..., to ensure maintainable and scalable codebases.- Research and evaluate new technologies and tools to continuously improve our... 

 ...We are looking for a Senior Python Engineer to design and build enterprise-grade multi-agent AI systems on AWS. The role focuses on LangGraph...  ...) Will be a plus: • AWS AgentCore Runtime maturity evaluation experience • AWS Bedrock Memory API • Enterprise HITL approval... 

 ...collaboration with our product managers, UI/UX designers, and backend engineers to deliver a seamless and engaging experience for our global...  ...abreast of emerging frontend technologies and industry trends, evaluating and recommending new tools and approaches to enhance our... 

GET TO KNOW THE ROLE Talent Acquisition is a massive priority for us, and we operate in a unique environment in which hiring the best -- versus “making the hire” -- is the north star. In order to thrive then, Talent Acquisition Partners need to be deeply expert in the roles...

 ...deploying robust, scalable, and user-centric applications. You will engage daily with product managers, UX/UI designers, and fellow engineers to translate complex requirements into elegant technical solutions. This role directly impacts our users by enhancing their experience... 

 ...Media IP Limited are not affiliated with, and do not endorse products or services of GitLab. An overview of this role As a Backend Engineer on the Tenant Scale: Git team, you'll help improve one of the most widely used foundations of modern software development. Git is at... 

Senior QA Manager (Onsite - Canada)We are looking for an experienced Senior QA Manager to lead QA strategy and delivery for multiple product streams at our client's location in Canada. This is a hands-on leadership role requiring expertise in manual and automation testing, distributed...

 ...We are looking for a Platform Engineer to build secure discovery and credential management capabilities for enterprise AI platforms. The role focuses on semantic search, vector-based discovery, secrets management, credential access services, and AI tool classification. The...