Arnie016/codex-prompt-templates / skills/auto-skill-build-mcp-conformance-harness
auto-skill-build-mcp-conformance-harness
VerifiedDesign a repeatable MCP conformance, health-check, and tool-surface regression harness for local or CI use. Use when the user asks for MCP CI, protocol or OAuth conformance, server doctor checks, tool-surface diffing, JUnit/XML reports, or release gates for an MCP server. Requires an MCP endpoint or stdio launch command; skip when the task is only ad-hoc manual inspection where `$mcp-server-lab` is enough.
MCP Conformance Harness
Generated by: Codex Supercharge maintenance automation.
Goal: turn MCP server testing into a repeatable harness with clear evidence, secret handling, and pass/fail gates.
Workflow
- Use
$sandbox-source-intakeand$mcp-safety-reviewbefore running a fresh MCP server, unknown CLI, install script, or broad-account tool. - Identify the target matrix:
- transport: HTTP or stdio
- auth: none, static token, OAuth interactive, OAuth headless, or M2M
- checks: doctor, tool surface, protocol, OAuth, apps UI
- Prefer read-only checks first:
server probe,server doctor, andserver exportwith--no-telemetryand JSON output. - Add
protocol,oauth, orappsconformance suites only after auth and blast radius are understood; emit JUnit/XML or JSON summary artifacts. - Capture before/after
server exportsnapshots and sort them before diffing when release tool-surface drift is the risk. - Use the command recipes in
references/mcp-conformance-harness.mdinstead of expanding long shell blocks into the skill body. - Store reports as CI artifacts, but keep credentials out of artifacts. Prefer
environment secrets, credentials files with mode
0600, or CI secret stores. - Summarize failures by phase: transport, auth, protocol, tool schema, apps UI, or release diff.
Harness Contract
# MCP Harness Plan
Target:
Transport/auth:
Read-only checks:
Conformance suites:
Tool-surface diff:
Secrets:
Artifacts:
Pass/fail gates:
Known skips:
Skip When
- The user only wants to manually explore one server once.
- No MCP endpoint, stdio command, or runnable server target is available.
- The server/tool is untrusted and has not passed source intake or safety review.
- Running the harness would call write/destructive tools without explicit scope.
References
references/mcp-conformance-harness.md- Source inspiration only, code not executed:
sources/mcpjam-inspector - Support skills:
$mcp-server-lab,$mcp-safety-review,$auto-skill-safety-mcp-secret-guard
Validation
plugins/codex-supercharge/scripts/skill_audit.sh plugins/codex-supercharge/skills
python3 "$HOME/.codex/skills/.system/skill-creator/scripts/quick_validate.py" \
plugins/codex-supercharge/skills/auto-skill-build-mcp-conformance-harness
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| brainstormingobra/superpowersYou MUST use this before any creative work - creating features, building components, adding functionality, modifying behavior, or planning anything new, in software or out of it (a talk, a business, a renovation). | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| brand-guidelinesanthropics/skillsApplies Anthropic's official brand colors and typography to any sort of artifact that may benefit from having Anthropic's look-and-feel. Use it when brand colors or style guidelines, visual formatting, or company design standards apply. | Stars: 198k | Updated | Claude CodeCodex | Verified | Install |
| frontend-designanthropics/skillsGuidance for distinctive, intentional visual design when building new UI or reshaping an existing one. Helps with aesthetic direction, typography, and making choices that don't read as templated defaults. | Stars: 198k | Updated | Claude CodeCodex | Verified | Install |
| mcp-builderanthropics/skillsGuide for creating high-quality MCP (Model Context Protocol) servers that enable LLMs to interact with external services through well-designed tools. Use when building MCP servers to integrate external APIs or services, whether in Python (FastMCP) or Node/TypeScript (MCP SDK). | Stars: 198k | Updated | Claude CodeCodex | Verified | Install |