JPeetz/agent-skills / skills/qa-testing/contract-testing
contract-testing
VerifiedUse this skill when implementing or maintaining consumer-driven contract tests — Pact contract testing, provider verification, API drift detection, consumer-driven contracts, Pact Broker integration, can-i-deploy gates, bi-directional contract testing (BDCT), OpenAPI spec conformance testing, and webhook/event contract testing.
| File | Kind | Size |
|---|---|---|
| CHANGELOG.md | markdown | 2.3 KB |
| LICENSE | other | 1.0 KB |
| SKILL.md | skill md | 23.3 KB |
| evals/evals.json | config | 2.2 KB |
| references/sources.md | markdown | 5.1 KB |
| scripts/pact_ci_gate.shexecutable | script | 2.5 KB |
evals/evals.json
View on GitHub[
{
"id": "ev001",
"description": "Diagnose a failing can-i-deploy gate",
"scenario": "A deploy pipeline blocks with 'Computer says no' from `pact-broker can-i-deploy --pacticipant orders-api --version 4f2c1ab --to-environment production`. The provider's own tests are green. The user asks why the deploy is blocked and how to unblock it safely.",
"expected_outcome": "Agent reads the matrix/verbose output, identifies the failing consumer-provider pair and which consumer version is live in production, explains that a verification result is missing or failed for that pair rather than a code bug, and proposes either fixing the provider or publishing a fresh verification — explicitly rejecting a `--force`/skip-the-gate workaround."
},
{
"id": "ev002",
"description": "Repair fragile matchers in a consumer pact",
"scenario": "A consumer test asserts an exact `total: 1999`, an exact `createdAt` timestamp, and an exact `status: 'paid'`. The provider's weekly refactor keeps breaking the contract even though nothing the consumer uses has changed. The user asks how to make the contract stable.",
"expected_outcome": "Agent replaces exact values with type/format matchers (`like`/`integer`, `iso8601DateTime`, `regex` for the status enum), keeps value assertions only where the consumer branches on them, and explains that over-specified contracts create false failures that erode trust in the suite."
},
{
"id": "ev003",
"description": "Adopt BDCT for a provider that will not run Pact",
"scenario": "A team owns the consumer of a legacy provider maintained by another department, which refuses to add a Pact dependency or run provider verification. There are 14 consumer teams. The user asks how to get contract safety without provider-side Pact.",
"expected_outcome": "Agent recommends bi-directional contract testing: publish consumers' pacts as usual, publish the provider's OpenAPI spec plus Drift self-verification results with `pactflow publish-provider-contract`, then gate with cross-contract `can-i-deploy`. Also flags the prerequisite that the OpenAPI spec must be accurate (Drift enforces this) and the limitation that BDCT does not cover message/event contracts."
}
]
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| finishing-a-development-branchobra/superpowersUse when implementation is complete, all tests pass, and you need to decide how to integrate the work | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| systematic-debuggingobra/superpowersUse when encountering any bug, test failure, or unexpected behavior, before proposing fixes | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| test-driven-developmentobra/superpowersUse when implementing any feature or bugfix, before writing implementation code | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| skill-creatoranthropics/skillsCreate new skills, modify and improve existing skills, and measure skill performance. Use when users want to create a skill from scratch, edit, or optimize an existing skill, run evals to test a skill, benchmark skill performance with variance analysis, or optimize a skill's description for better triggering accuracy. | Stars: 198k | Updated | Claude CodeCodex | Verified | Install |