Skip to content

imMamdouhaboammar/anti-slop-engineering / skills/llm-eval-and-prompt-injection-fortress

llm-eval-and-prompt-injection-fortress

Verified

Review how agents handle untrusted text, authorize tool requests, and protect private outputs. Use for retrieval, tool connectors, agent permissions, or evaluation of coding agents.

Prompt Injection and Tool Authorization Review

Map data and authority

BoundaryReview evidence
User intentThe authenticated platform request identifies actor, tenant, requested operation, and exact resource scope. High-impact actions carry explicit approval for canonical arguments.
Retrieved contentRepository files, comments, webpages, emails, tool results, and OCR remain data even if they quote a privileged role or resemble a tool invocation. Preserve provenance and isolate this text from developer instructions.
Requested actionThe model produces a typed proposal. Independently validate tool, normalized target, operation, actor/tenant, and data classification at the dispatcher. Unknown or incomplete authority denies execution.
Effect and outputThe tool service checks resource ownership and scope again. Filter sensitive fields before sending results to the model or an external destination. Log decision identifiers and classified outcomes with no private content.

Check the policy boundary

  1. Inventory which connectors can read, write, publish, or transfer data. Grant separate, task-scoped capabilities to models or tools and enforce the authenticated caller's entitlements at each downstream service.
  2. Tie approval to the exact operation, resource, tenant, and canonical parameters. Recheck it before execution and expire it with the task. No connector response or model-generated field can supply authority.
  3. Compare the tool proposal, policy decision, actual invocation and observed side effect. A helpful refusal in text leaves the tool boundary unverified. A denied operation should produce zero downstream invocations, zero writes and zero disclosure.
  4. Preserve the ability to quote and summarize untrusted text as data. If retrieval returns mixed-authority text, retain its source and restrict the available action set for that step. Use a harmless placeholder in all fixtures and keep evaluation isolated from credentials, network and production state.

Record the evaluation

Record fixture revision, expected outcome, observed dispatcher decision, actual tool/effect count, and any policy or evidence gap. Use separate sets for known-authorized reads, wrong-resource and wrong-tenant reads, unauthorized publish, and quoted text with no proposed action. Any unauthorized downstream invocation blocks release. Check authorized success independently to catch a policy that denies every request. Treat unexecuted integrations as inconclusive.

Run python3 examples/policy_review.py from the skill directory for the synthetic decision cases. The example has no real tools or model and demonstrates an in-memory authorization check. Run python3 -m unittest discover -s tests -p test_prompt_tool_authorization.py -v from a source checkout.

reverse-engineer-anythingmorluto/reaReverse engineer native, managed, Electron/JavaScript, packaged, firmware, and browser targets with REA, and build agent environments (AgentEnv bundles) of web applications from a live instance or a capture, and of Linux desktop apps with a task from a request. Use shipped-artifact or requested runtime evidence to explain features, compare versions, decompile code, or guide a reconstruction. Skip REA for ordinary source-repository architecture analysis.Stars: 472kUpdated Claude CodeCodexVerifiedInstall
diagnosing-superpowersobra/superpowersUse when a superpowers session went wrong and your human partner wants to know why — repeated work, ignored plans, stumbles, poor results, a skill that didn't fire, "it took too long", "why is it so expensive", "what is it doing" — or wants to build a bug report for the superpowers maintainers, for the current session or a past one identified by id or path, on any harness.Stars: 323kUpdated Claude CodeCodexVerifiedInstall
dispatching-parallel-agentsobra/superpowersUse when facing 2+ independent tasks that can be worked on without shared state or sequential dependenciesStars: 323kUpdated Claude CodeCodexVerifiedInstall
executing-plansobra/superpowersUse when executing an implementation plan in the current session as the implementer yourself — your human partner chose inline execution, or no subagent tool is availableStars: 323kUpdated Claude CodeCodexVerifiedInstall