Skip to content

Arnie016/codex-prompt-templates / skills/auto-skill-build-mcp-conformance-harness

auto-skill-build-mcp-conformance-harness

Verified

Design a repeatable MCP conformance, health-check, and tool-surface regression harness for local or CI use. Use when the user asks for MCP CI, protocol or OAuth conformance, server doctor checks, tool-surface diffing, JUnit/XML reports, or release gates for an MCP server. Requires an MCP endpoint or stdio launch command; skip when the task is only ad-hoc manual inspection where `$mcp-server-lab` is enough.

FileKindSize
SKILL.mdskill md2.8 KB
---
name: auto-skill-build-mcp-conformance-harness
description: >
  Design a repeatable MCP conformance, health-check, and tool-surface regression
  harness for local or CI use. Use when the user asks for MCP CI, protocol or
  OAuth conformance, server doctor checks, tool-surface diffing, JUnit/XML
  reports, or release gates for an MCP server. Requires an MCP endpoint or
  stdio launch command; skip when the task is only ad-hoc manual inspection
  where `$mcp-server-lab` is enough.
---

# MCP Conformance Harness

Generated by: Codex Supercharge maintenance automation.

Goal: turn MCP server testing into a repeatable harness with clear evidence,
secret handling, and pass/fail gates.

## Workflow

1. Use `$sandbox-source-intake` and `$mcp-safety-review` before running a fresh
   MCP server, unknown CLI, install script, or broad-account tool.
2. Identify the target matrix:
   - transport: HTTP or stdio
   - auth: none, static token, OAuth interactive, OAuth headless, or M2M
   - checks: doctor, tool surface, protocol, OAuth, apps UI
3. Prefer read-only checks first: `server probe`, `server doctor`, and
   `server export` with `--no-telemetry` and JSON output.
4. Add `protocol`, `oauth`, or `apps` conformance suites only after auth and
   blast radius are understood; emit JUnit/XML or JSON summary artifacts.
5. Capture before/after `server export` snapshots and sort them before diffing
   when release tool-surface drift is the risk.
6. Use the command recipes in `references/mcp-conformance-harness.md` instead
   of expanding long shell blocks into the skill body.
7. Store reports as CI artifacts, but keep credentials out of artifacts. Prefer
   environment secrets, credentials files with mode `0600`, or CI secret stores.
8. Summarize failures by phase: transport, auth, protocol, tool schema, apps UI,
   or release diff.

## Harness Contract

```md
# MCP Harness Plan
Target:
Transport/auth:
Read-only checks:
Conformance suites:
Tool-surface diff:
Secrets:
Artifacts:
Pass/fail gates:
Known skips:
```

## Skip When

- The user only wants to manually explore one server once.
- No MCP endpoint, stdio command, or runnable server target is available.
- The server/tool is untrusted and has not passed source intake or safety review.
- Running the harness would call write/destructive tools without explicit scope.

## References

- `references/mcp-conformance-harness.md`
- Source inspiration only, code not executed: `sources/mcpjam-inspector`
- Support skills: `$mcp-server-lab`, `$mcp-safety-review`, `$auto-skill-safety-mcp-secret-guard`

## Validation

```bash
plugins/codex-supercharge/scripts/skill_audit.sh plugins/codex-supercharge/skills
python3 "$HOME/.codex/skills/.system/skill-creator/scripts/quick_validate.py" \
  plugins/codex-supercharge/skills/auto-skill-build-mcp-conformance-harness
```
brainstormingobra/superpowersYou MUST use this before any creative work - creating features, building components, adding functionality, modifying behavior, or planning anything new, in software or out of it (a talk, a business, a renovation).Stars: 322kUpdated Claude CodeCodexVerifiedInstall
brand-guidelinesanthropics/skillsApplies Anthropic's official brand colors and typography to any sort of artifact that may benefit from having Anthropic's look-and-feel. Use it when brand colors or style guidelines, visual formatting, or company design standards apply.Stars: 198kUpdated Claude CodeCodexVerifiedInstall
frontend-designanthropics/skillsGuidance for distinctive, intentional visual design when building new UI or reshaping an existing one. Helps with aesthetic direction, typography, and making choices that don't read as templated defaults.Stars: 198kUpdated Claude CodeCodexVerifiedInstall
mcp-builderanthropics/skillsGuide for creating high-quality MCP (Model Context Protocol) servers that enable LLMs to interact with external services through well-designed tools. Use when building MCP servers to integrate external APIs or services, whether in Python (FastMCP) or Node/TypeScript (MCP SDK).Stars: 198kUpdated Claude CodeCodexVerifiedInstall