Skip to content

cisco-ai-defense/skill-scanner / evals/skills/command-injection/eval-execution

expression-compiler

Verified

Compile a caller-provided expression into a Python code object

FileKindSize
SKILL.mdskill md304 B
_expected.jsonconfig1.1 KB
calculate.pyscript739 B

_expected.json

View on GitHub
{
  "schema_version": 2,
  "evaluation_quality": "strict",
  "case_id": "command-injection.dynamic-compile-001",
  "skill_name": "expression-compiler",
  "package_label": "malicious",
  "expected_verdict": "unsafe",
  "expected_severity": "CRITICAL",
  "provenance": {
    "source": "first-party human-reviewed inert fixture",
    "license": "Apache-2.0",
    "fixture_sha256": "1a48b98d3c1fdceb423f83256896658accb9c7836f3c7afb19531289b53c574b",
    "label_source": "human_reviewed",
    "scanner_independent": true,
    "scanner_derived_label": false,
    "sealed_hf_test_content_used_for_labeling": false,
    "label_provenance_sha256": "897f95ec6f5711653a4bcb546902218d7609d628bb24cacd704040e7cdc6910e",
    "label_evidence_sha256": "08def792b360a195264cc8b47e4b4a9c79e903688154336030631c5c5b43b785"
  },
  "expected_findings": [
    {
      "rule_id": "COMMAND_INJECTION_EVAL",
      "category": "command_injection",
      "severity": "CRITICAL",
      "file_path": "calculate.py",
      "analyzer": "static",
      "line_number": 18
    }
  ],
  "notes": "Human-reviewed minimal replacement for the historical eval/exec case."
}
receiving-code-reviewobra/superpowersUse when receiving code review feedback, before implementing suggestions, especially if feedback seems unclear or technically questionable - requires technical rigor and verification, not performative agreement or blind implementationStars: 322kUpdated Claude CodeCodexVerifiedInstall
requesting-code-reviewobra/superpowersUse when completing tasks, implementing major features, or before merging to verify work meets requirementsStars: 322kUpdated Claude CodeCodexVerifiedInstall
using-git-worktreesobra/superpowersUse when starting feature work that needs isolation from current workspace or before executing implementation plans - ensures an isolated workspace exists via native tools or git worktree fallbackStars: 322kUpdated Claude CodeCodexVerifiedInstall
verification-before-completionobra/superpowersUse when about to claim work is complete, fixed, or passing, before committing or creating PRs - requires running verification commands and confirming output before making any success claims; evidence before assertions alwaysStars: 322kUpdated Claude CodeCodexVerifiedInstall