sno-ai/sno-station-skills / skills/J-peer-review-and-audit/cross-vendor-security-audit/skill
cross-vendor-security-audit
VerifiedSecurity guidance and vulnerability review for codebases, APIs, services, CLI tools, libraries, and daemons, in which a model from another vendor re-reads everything the audit set aside. Use for security questions, focused reviews, vulnerability research, security audits, or pen tests. Run the complete workflow only for explicit codebase audit or pen-test requests, full/comprehensive/end-to-end reviews, or requested report artifacts.
| File | Kind | Size |
|---|---|---|
| AI-AND-LLM.md | markdown | 10.4 KB |
| ATTACK-CLASSES.md | markdown | 15.3 KB |
| CLIENT-SIDE.md | markdown | 8.4 KB |
| CLOUD-AND-DEPLOYMENT.md | markdown | 8.1 KB |
| DATA-ISOLATION-AND-LIFECYCLE.md | markdown | 7.6 KB |
| DESKTOP-MOBILE-AND-LOCAL-IPC.md | markdown | 8.5 KB |
| HUNTING.md | markdown | 21.9 KB |
| LICENSE-MIT-cloudflare | other | 1.1 KB |
| MEMORY-SAFETY-AND-BINARY.md | markdown | 10.3 KB |
| PROTOCOLS-RPC-AND-MESSAGING.md | markdown | 7.3 KB |
| RECONNAISSANCE.md | markdown | 15.5 KB |
| RESOURCE-EXHAUSTION-AND-AVAILABILITY.md | markdown | 7.3 KB |
| SKILL.md | skill md | 23.0 KB |
| SUPPLY-CHAIN-AND-RELEASE.md | markdown | 7.1 KB |
| VALIDATION-AND-REPORTING.md | markdown | 24.0 KB |
| WEB-PROTOCOL-AND-AUTH.md | markdown | 12.0 KB |
| report-schema.json | config | 14.2 KB |
| scripts/selftest/run-selftest.shexecutable | script | 5.2 KB |
| validate-coverage-ledger.cjsexecutable | script | 32.7 KB |
| validate-coverage-ledger.test.cjs | script | 27.8 KB |
| validate-findings.cjsexecutable | script | 28.1 KB |
| validate-findings.test.cjs | script | 25.8 KB |
| validate-second-look.cjs | script | 1.9 KB |
scripts/selftest/run-selftest.sh
View on GitHub#!/usr/bin/env bash
# Three checks on this payload: the upstream validators' own tests, the second-look answer check on a
# complete and a skipped answer, and the text contract of the second-look step, including a negative control.
set -Eeuo pipefail
export PYTHONDONTWRITEBYTECODE=1
selftest_dir="$(cd -- "$(dirname -- "${BASH_SOURCE[0]}")" && pwd)"
skill_dir="$(cd -- "$selftest_dir/../.." && pwd)"
temp_dir="$(mktemp -d)"
trap 'rm -rf -- "$temp_dir"' EXIT
command -v node >/dev/null || { printf 'selftest: node is required for the validator tests\n' >&2; exit 1; }
(cd -- "$skill_dir" && node --test validate-findings.test.cjs validate-coverage-ledger.test.cjs)
printf '[{"item_id":"hardening:a"},{"item_id":"rejected:b"}]' >"$temp_dir/input.json"
printf '{"items":[{"item_id":"hardening:a","verdict":"needs_validation","evidence":"x.js:1"},{"item_id":"rejected:b","verdict":"not_a_finding","evidence":"y.js:2"}],"new_candidates":[]}' >"$temp_dir/complete.json"
printf '{"items":[{"item_id":"hardening:a","verdict":"needs_validation","evidence":"x.js:1"}],"new_candidates":[]}' >"$temp_dir/skipped.json"
node "$skill_dir/validate-second-look.cjs" "$temp_dir/input.json" "$temp_dir/complete.json"
if skipped_output="$(node "$skill_dir/validate-second-look.cjs" "$temp_dir/input.json" "$temp_dir/skipped.json" 2>&1)" \
|| [[ "$skipped_output" != *"1 of 2 set-aside items have no answer: rejected:b"* ]]; then
printf 'failed second-look check: a skipped item was not caught: %s\n' "$skipped_output" >&2
exit 1
fi
printf 'second-look answer check passed: skipped item caught\n'
python3 - "$skill_dir" "$temp_dir" <<'PY'
import pathlib
import re
import shutil
import sys
import yaml
validation_rules = {
"pile includes hardening notes": "every `hardening` note retained in ledger bookkeeping",
"pile includes rejected records": "every `rejected` record in `findings.json`",
"pile includes deferred and blocked units": "every in-scope ledger unit left `deferred` or `blocked`",
"reviewer from another vendor": "It must come from a different model vendor than the agents that hunted and validated.",
"pick reviewer through sno": "`sno subscription-quota-check --pick review --from <parent-agent> --json`",
"same-vendor fallback is disclosed": "`REPORT.md` then says the second look stayed inside one vendor.",
"reviewer checks the dismissal reason": "Do not accept the audit's reason as given; check it against the source.",
"codex runs read-only without user config or proxy": "--ignore-user-config --disable apps --sandbox read-only",
"claude runs with read tools only": "claude -p --strict-mcp-config --tools Read Grep Glob",
"answer is checked against the pile": "node <skill-dir>/validate-second-look.cjs <output-dir>/agents/second-look/input.json",
"revived items get fresh validation": "send it through Phase 3 candidate validation with a fresh verifier that did not hunt, validate it before, or run the second look",
"disagreement is never dropped": "Never drop it silently; the owner decides.",
"report lists disagreements": 'Under the heading "Reviewers disagree"',
}
skill_rules = {
"upstream credit and license": "used under its MIT license (`LICENSE-MIT-cloudflare` in this folder)",
"phase 5 names the second look": "then give everything the run set aside to a reviewer from another model vendor",
"budget reserves the second look": "plus the one second-look reviewer call",
"profiles keep the second look": "or the second look at everything set aside.",
}
def check(root):
failures = []
skill = (root / "SKILL.md").read_text(encoding="utf-8")
validation = " ".join((root / "VALIDATION-AND-REPORTING.md").read_text(encoding="utf-8").split())
frontmatter = re.match(r"\A---\r?\n(.*?)\r?\n---(?:\r?\n|$)", skill, re.S)
header = yaml.safe_load(frontmatter.group(1)) if frontmatter else None
if not isinstance(header, dict) or header.get("name") != "cross-vendor-security-audit":
failures.append("name is cross-vendor-security-audit")
if not (root / "LICENSE-MIT-cloudflare").read_text(encoding="utf-8").startswith("MIT License"):
failures.append("MIT license file ships")
body = " ".join(skill.split())
failures += [f"skill: {name}" for name, phrase in skill_rules.items() if phrase not in body]
failures += [f"validation: {name}" for name, phrase in validation_rules.items() if phrase not in validation]
return failures
source = pathlib.Path(sys.argv[1])
failures = check(source)
if failures:
raise SystemExit(f"failed second-look checks: {', '.join(failures)}")
print("second-look text contract passed")
negative = pathlib.Path(sys.argv[2]) / "skill"
negative.mkdir()
for name in ("SKILL.md", "LICENSE-MIT-cloudflare"):
shutil.copy(source / name, negative / name)
original = (source / "VALIDATION-AND-REPORTING.md").read_text(encoding="utf-8")
(negative / "VALIDATION-AND-REPORTING.md").write_text(
original.replace(validation_rules["disagreement is never dropped"], "", 1), encoding="utf-8"
)
failures = check(negative)
if failures != ["validation: disagreement is never dropped"]:
raise SystemExit(f"failed second-look check: negative control; expected missing disagreement rule, got {failures}")
print("second-look negative control passed: missing disagreement rule detected")
PY
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| rea-analysis-optimizationmorluto/reaOptimize REA providers and shared analysis workflows for agent context, latency, CPU, and memory while preserving correctness and Evidence. Use for analysis bottlenecks and cache or query design; CI/test-suite optimization belongs to rea-ci-tests-audit. | Stars: 472k | Updated | Claude CodeCodex | Verified | Install |
| rea-ci-tests-auditmorluto/reaAudit REA CI and test suites for correctness, fixture drift, false passes, and measured performance; use for suite or workflow investigations and efficiency changes, rather than ordinary feature testing or a single test failure. | Stars: 472k | Updated | Claude CodeCodex | Verified | Install |
| rea-tool-designmorluto/reaAudit, investigate, design, or change REA investigation tools, CLI/MCP contracts, provider capabilities, and Evidence semantics. | Stars: 472k | Updated | Claude CodeCodex | Verified | Install |
| ponytail-auditDietrichGebert/ponytailQuality audit of the whole repo: bugs, security, real load, missing tests, speed, and what to delete. Most important first. | Stars: 194k | Updated | Claude CodeCodex | Verified | Install |