Openings testing jobs in Japan

 ...We are looking for a Security Test Engineer to validate the security, reliability, and correctness of authorization and policy enforcement systems used in AI agent platforms. The role combines security testing, automated test development, API security validation, and policy... 

 ...predictable agent behavior before production release. You will work closely with AI, platform, and engineering teams to establish robust testing methodologies covering reasoning quality, tool usage, multi-turn interactions, and production feedback integration. What project... 

 ...for APIs, metadata schemas, registry workflows, and operational procedures. Participate in architecture discussions, code reviews, testing, and continuous improvement initiatives related to agent platform services. What you need for this Skills: • AWS AgentCore... 

 ...Collaborate with platform, security, and product teams to design production-ready AI solutions. Establish engineering standards, testing approaches, and operational best practices for agent-based systems. Support deployment, monitoring, and continuous improvement of... 

 ...Design scalable multi-agent orchestration and communication patterns across distributed environments. Perform gateway performance testing, load validation, capacity planning, and latency analysis. Conduct security testing and threat assessments for agent communication... 

 ...quality. Create evaluation methodologies combining deterministic grading approaches with LLM-as-judge evaluation techniques. Build test harnesses for LangGraph graphs, nodes, state transitions, and agent execution paths. Design multi-turn conversation simulations to... 

 ...agent-to-tool and agent-to-agent communication capabilities. Define best practices for protocol versioning, backward compatibility, testing, and governance. Review architecture, design decisions, and implementation approaches across multiple engineering teams.... 

 ...authorization policies using Cedar policy language. Develop and test policy definitions, validation workflows, and policy enforcement...  ...Okta, Cognito) • Policy definition in any ABAC or RBAC system • Open Policy Agent (OPA) or Cedar hands-on Will be a plus: • LangGraph... 

 ...evaluation, prompt design, analytical reasoning, Japanese language expertise, and attention to detail . What You’ll Do Create and test multi-turn prompts, typically 1–5 turns, using personal context. Evaluate whether AI responses appropriately address the user's... 

 ...mechanisms for evaluation outcomes, quality trends, and operational KPIs. Contribute to the evolution of enterprise AI governance, testing methodologies, and evaluation best practices. What you need for this Skills: • AWS AgentCore Evaluation (on-demand mode for... 

 ...sprint planning, reviews, and other Agile ceremonies. Clarify requirements and support the development team during implementation and testing. Validate delivered functionality against business requirements and acceptance criteria. Coordinate with Japanese stakeholders... 

 ...agents and services. Collaborate with AI, platform, and security teams to support multi-agent ecosystem integration. Troubleshoot, test, and optimize backend services for performance, reliability, and scalability. Produce technical documentation for integration... 

 ...evaluation standards, scoring methodologies, and quality acceptance criteria. Design and maintain unit, integration, and validation tests for evaluator libraries and quality frameworks. Support observability and troubleshooting by integrating evaluation outputs with... 

We are looking for a Platform Engineer – CI/CD Gate & Online Evaluation to help establish automated quality controls for enterprise AI platforms and agent-based systems. In this role, you will integrate evaluation workflows into deployment pipelines, configure online quality...

We are looking for a Platform Engineer to build secure discovery and credential management capabilities for enterprise AI platforms. The role focuses on semantic search, vector-based discovery, secrets management, credential access services, and AI tool classification. The...