Evaluation engineer jobs in Canada

 ...We are looking for an Agent Evaluation Engineer to design and build enterprise-grade evaluation frameworks for agentic AI systems. In this role, you will be responsible for creating automated evaluation pipelines, deployment quality gates, and reliability measurements that... 

 ...We are looking for a Security Test Engineer to validate the security, reliability, and correctness of authorization and policy enforcement...  ...precedence rules, parameter-level access controls, and policy evaluation correctness. Test transitions between LOG_ONLY and ENFORCE... 

 ...Microsoft Copilot, ChatGPT) in their day-to-day workflows, able to evaluate AI-generated outputs critically, and open to continuously...  ...100% remote anywhere in the US Overview: Senior Automation Engineers at Precisely design, build, and scale automation that connects tools... 

 ...We are looking for a Python Engineer – Evaluator Library to design and implement reusable evaluation components that ensure the quality, safety, and compliance of enterprise AI agents and LLM-powered workflows. You will build custom evaluation capabilities used across AI... 

 ...We are looking for an  Observability Engineer – AgentCore Telemetry to build and evolve observability capabilities for enterprise AI platforms and agent-based systems running on AWS. In this role, you will design telemetry solutions, implement end-to-end tracing strategies,... 

 ...We are looking for a Policy Engineer to design, implement, and validate fine-grained authorization policies for AI agent platforms and cloud-native services. The role focuses on Cedar policy development, identity provider integrations, policy enforcement, and attribute-based... 

 ...We are looking for a Platform Engineer – CI/CD Gate & Online Evaluation to help establish automated quality controls for enterprise AI platforms and agent-based systems. In this role, you will integrate evaluation workflows into deployment pipelines, configure online quality... 

 ...We are looking for a Security & Governance Engineer focused on securing MCP-based enterprise AI platforms and agent ecosystems. In this role, you will be responsible for designing and enforcing security controls for MCP (Model Context Protocol) servers, agent-to-tool communication... 

 ...of working effectively with cross-functional teams in a fast-paced, global environment.- A bachelor's degree in Computer Science, Engineering, or a related technical field is preferred.- Adaptability to work in a distributed team setup across multiple time zones (India, Canada... 

Role Overview :As a Software Engineer you will be instrumental in designing, developing, and deploying robust, scalable, and secure applications...  ..., to ensure maintainable and scalable codebases.- Research and evaluate new technologies and tools to continuously improve our... 

 ...We are looking for a Senior Python Engineer to design and build enterprise-grade multi-agent AI systems on AWS. The role focuses on LangGraph...  ...) Will be a plus: • AWS AgentCore Runtime maturity evaluation experience • AWS Bedrock Memory API • Enterprise HITL approval... 

 ...collaboration with our product managers, UI/UX designers, and backend engineers to deliver a seamless and engaging experience for our global...  ...abreast of emerging frontend technologies and industry trends, evaluating and recommending new tools and approaches to enhance our... 

Job Description About the Company: CGK Linens is a leading US-based eCommerce company specializing in high-quality bedding products. With a strong commitment to delivering exceptional customer experiences, we manage complex international supply chain operations to ensure...

 ...applications. Intellia’s mission is to help the client with the engineering of a comprehensive software ecosystem for a game-changing IoT...  .... What you will do Design and implement automated evaluation frameworks for LangGraph-based agent workflows and orchestration... 

 ...deploying robust, scalable, and user-centric applications. You will engage daily with product managers, UX/UI designers, and fellow engineers to translate complex requirements into elegant technical solutions. This role directly impacts our users by enhancing their experience... 

 ...We are looking for a Senior Python Backend Engineer to build and integrate agent-to-agent communication capabilities on AWS AgentCore platforms. The role focuses on Python backend development, A2A protocol implementation, agent discovery and registration, event-driven communication... 

 ...creates business value and drives positive outcomes for our users. - Are natural collaborators who build alignment across Product, Engineering, Brand, and executive leadership. - Hold a strong point of view on craft and quality, and know how to keep the bar high without... 

 ...We are looking for a Python Engineer to build and integrate enterprise-grade Agent Registry capabilities for AI and agentic platforms. In this role, you will design and implement backend services supporting agent registration, discovery, metadata management, and lifecycle operations... 

Senior QA Manager (Onsite - Canada)We are looking for an experienced Senior QA Manager to lead QA strategy and delivery for multiple product streams at our client's location in Canada. This is a hands-on leadership role requiring expertise in manual and automation testing, distributed...

 ...We are looking for a Platform Engineer to build secure discovery and credential management capabilities for enterprise AI platforms. The role focuses on semantic search, vector-based discovery, secrets management, credential access services, and AI tool classification. The... 

 ...We are looking for a Senior Platform Engineer (Agent Gateway) to design and operate secure, scalable agent communication infrastructure built on AWS AgentCore Gateway. The role focuses on A2A protocol implementation, agent discovery and routing, gateway architecture, authentication...