Skip to content

moonlight-lupin/agent-skills / mlops/model-compare

model-compare

Flagged

Blind side-by-side multi-model comparison. Send one prompt to 2-4 models simultaneously, present responses anonymously (Model A / B / C / D), let the user pick a winner, then reveal identities and show which model won. Supports custom evaluation criteria, synthesis of responses, and vote history logging. Trigger when the user says "compare models", "test these models", "which model is better for", "A/B test", "blind comparison", "model evaluation", or wants to see how different AI models handle the same prompt. Can also be used for prompt engineering — testing how different models interpret the same instructions. Supports reasoning-effort A/B via provider:@effort:model_id specs.

Security report

Flagged

Static analysis of one exact version. It reduces risk and shows evidence; it does not certify that a skill is safe.

Commit
e943e3285cd03c44b2c762a9a52328e3d16444b1
Content hash
b015c45d6660a246abdc976e5a0de617291ac9919ebf830ddc2364a222843f96
Scanned
2026-11-17
Scanner version
skillxone-scan-1.0.0
Policy version
0.1-draft
Decision
1 open critical or high finding.
Verification expires
Not applicable

Findings (1 high, 1 low, 2 info)

  • highCMD-REMOTE-PIPE-SHELLSKILL.md:210

    A script is downloaded and run in one step, so whatever the server returns at that moment is executed without review.

    curl -s https://openrouter.ai/api/v1/models -H "Authorization: Bearer $OPENROUTER_API_KEY" | python3 -c "import sys,json; [print(m['id']) for m in json.load(sys.stdin)['data'] if 'KEYWORD' in m['id'].lower()]"

    Suggested fix: Download the script, check it (and its checksum or signature), then run the saved copy. Prefer a package manager.

    Report as false positive

  • lowNET-INSECURE-URLSKILL.md:557

    A link uses unencrypted http:// (...), so its content can be altered in transit.

    - **SEARXNG_URL not exported to background processes** — the env var is loaded from `~/.hermes/.env` by the script's `load_env()` function, but if you pass `--mode tools` to a background process (e.g. via `terminal(background=true)`), make…

    Suggested fix: Use https://.

    Report as false positive

  • infoINT-EXECUTABLE-SCRIPTscripts/compare.py:1

    The skill ships an executable script. Review it before allowing an agent to run it.

    #!/usr/bin/env python3

    Suggested fix: None required. Informational.

    Report as false positive

  • infoINT-EXECUTABLE-SCRIPTscripts/embedding_compare.py:1

    The skill ships an executable script. Review it before allowing an agent to run it.

    #!/usr/bin/env python3

    Suggested fix: None required. Informational.

    Report as false positive

Checks run

  • prompt-injection
  • dangerous-commands
  • credentials
  • network
  • file-access
  • integrity

Checks skipped

  • dependencies: No dependency manifest in the skill directory.
  • gitleaks: gitleaks is not installed on this host.
finishing-a-development-branchobra/superpowersUse when implementation is complete, all tests pass, and you need to decide how to integrate the workStars: 322kUpdated Claude CodeCodexVerifiedInstall
systematic-debuggingobra/superpowersUse when encountering any bug, test failure, or unexpected behavior, before proposing fixesStars: 322kUpdated Claude CodeCodexVerifiedInstall
test-driven-developmentobra/superpowersUse when implementing any feature or bugfix, before writing implementation codeStars: 322kUpdated Claude CodeCodexVerifiedInstall
skill-creatoranthropics/skillsCreate new skills, modify and improve existing skills, and measure skill performance. Use when users want to create a skill from scratch, edit, or optimize an existing skill, run evals to test a skill, benchmark skill performance with variance analysis, or optimize a skill's description for better triggering accuracy.Stars: 198kUpdated Claude CodeCodexVerifiedInstall