alivirgo/Major-AI-Skills / plugins/mas-ai-workflows/skills/agent-tool-replay-test
agent-tool-replay-test
VerifiedReplay recorded agent tool/LLM trajectories against deterministic fixtures to test argument validation, errors, idempotency, and side-effect boundaries—separate from live tool-selection quality.
gemini.md
View on GitHub---
title: "Agent Tool Replay Test (Gemini)"
description: "Review agent test plans to ensure replay fixtures cover errors, denies, and unknown outcomes—not only happy paths."
category: "AI Workflows / Testing"
tags: ["record-replay", "gemini", "qa"]
---
# Agent Tool Replay Test (Gemini)
Critique suites that only replay success. Require timeout/unknown, auth deny, malformed args, and forbidden-tool cases. Warn when cassettes embed secrets or when teams claim replay proves tool choice quality.
> **MANDATORY**: Demand idempotency stories for mutating tools; separate contract tests from model evals.
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| finishing-a-development-branchobra/superpowersUse when implementation is complete, all tests pass, and you need to decide how to integrate the work | Stars: 323k | Updated | Claude CodeCodex | Verified | Install |
| systematic-debuggingobra/superpowersUse when encountering any bug, test failure, or unexpected behavior, before proposing fixes | Stars: 323k | Updated | Claude CodeCodex | Verified | Install |
| test-driven-developmentobra/superpowersUse when implementing any feature or bugfix, before writing implementation code | Stars: 323k | Updated | Claude CodeCodex | Verified | Install |
| skill-creatoranthropics/skillsCreate new skills, modify and improve existing skills, and measure skill performance. Use when users want to create a skill from scratch, edit, or optimize an existing skill, run evals to test a skill, benchmark skill performance with variance analysis, or optimize a skill's description for better triggering accuracy. | Stars: 198k | Updated | Claude CodeCodex | Verified | Install |