Skip to content

richfrem/agent-plugins-skills / plugins/agent-orchestration/.apm/skills/orchestrating-agent-work

orchestrating-agent-work

Verified

Interactive orchestrator for complex engineering work. Analyzes the task, conducts a diagnostic interview to select the appropriate execution strategy (Directed Acyclic Graph versus Loop, and which Loop type), plans the artifact, and supervises execution and verification. Use for "how should I orchestrate this", "plan this workflow", "should this be a DAG or a loop", "run these jobs in parallel", "delegate this to a worker agent", or "run/resume this graph manifest". Not for single trivial edits or skill self-improvement.

FileKindSize
SKILL.mdskill md6.8 KB
assets/templates/dual-loop-meta-tasks.mdmarkdown1.6 KB
assets/templates/loop_retrospective_template.mdmarkdown1.5 KB
assets/templates/red_team_briefing_template.mdmarkdown747 B
assets/templates/scratchpad-template.mdmarkdown991 B
assets/templates/strategy-packet-template.mdmarkdown1.2 KB
assets/templates/workflow-retrospective-template.mdmarkdown1.3 KB
evals/evals.jsonconfig7.0 KB
references/PATTERN_GUIDE.mdmarkdown6.2 KB
references/acceptance-criteria.mdmarkdown6.8 KB
references/agentic-os-reuse-map.mdmarkdown2.5 KB
references/bot-delegation-patterns.mdmarkdown5.2 KB
references/cheapest_models.jsonconfig845 B
references/cheapest_models.mdmarkdown1.1 KB
references/cli-agent-executor.mdmarkdown3.5 KB
references/delegated-dag-refactoring-playbook.mdmarkdown5.5 KB
references/diagrams/agent_swarm.mmdother1.8 KB
references/diagrams/dual_loop_architecture.mmdother1.4 KB
references/diagrams/graph-planner-flow.mmdother540 B
references/diagrams/graph_execution_state_machine.mmdother823 B
references/diagrams/orchestrating_agent_work_architecture.mmdother4.5 KB
references/dispatch-preflight.mdmarkdown2.1 KB
references/fallback-tree.mdmarkdown9.7 KB
references/graph-execution.mdmarkdown4.1 KB
references/graph-manifest-schema.jsonconfig7.0 KB
references/graph-planning.mdmarkdown3.0 KB
references/learning-loop.mdmarkdown4.9 KB
references/patterns.jsonconfig2.0 KB
references/post_run_survey.mdmarkdown1.4 KB
references/routing-and-closure.mdmarkdown2.4 KB
references/strategy-agent-swarm.mdmarkdown2.1 KB
references/strategy-dual-loop.mdmarkdown1.6 KB
references/strategy-red-team-review.mdmarkdown2.0 KB
references/strategy-selection.mdmarkdown4.0 KB
references/topology-rules.mdmarkdown6.0 KB
scripts/agent_orchestrator.pyscript7.6 KB
scripts/dispatch_guard.pyscript1.1 KB
scripts/graph_runner.pyexecutablescript36.3 KB
scripts/select_strategy.pyscript13.1 KB
scripts/swarm_run.pyscript28.0 KB
scripts/validate_manifest.pyexecutablescript19.8 KB
scripts/work_loop.pyscript28.0 KB
tests/_loop_fixtures.pyscript2.5 KB
tests/test_graph_fixes.pyscript12.6 KB
tests/test_graph_runner.pyscript30.0 KB
tests/test_isolation.pyscript3.5 KB
tests/test_loop_strategies.pyscript7.7 KB
tests/test_select_strategy.pyscript7.8 KB
tests/test_swarm_run.pyscript9.4 KB
tests/test_swarm_run_models.pyscript3.1 KB
tests/test_validate_manifest.pyscript18.1 KB
tests/test_work_loop_e2e.pyscript3.8 KB
tests/test_work_loop_hardening.pyscript27.3 KB

tests/test_work_loop_e2e.py

View on GitHub
"""Two related tasks in a non-Sanctuary repo through the real loop. MOCKED: the worker (a fixture executable). REAL: run_agent.py subprocesses,
claims, ledger, assessment, lessons. Asserts over action traces and state, not stated intent."""
import json, os, sys, tempfile, unittest
from pathlib import Path
sys.path.insert(0, str(Path(__file__).resolve().parent))
from _loop_fixtures import *  # noqa
import lessons as L, eval_core as core


class E2E(unittest.TestCase):
    def test_two_related_tasks_learning_loop(self):
        repo, tools, worker = make_repo()
        bad_path = tempfile.mkdtemp()                         # injected failure: the worker environment lacks the executable
        # task 1: first dispatch refused by the worker-environment preflight, repaired by supplying the explicit executable
        p1 = put(repo, contract("t1", goal="create hello script with the claude worker"), "c1.json")
        self.assertTrue(wl.start(p1, repo)["ok"])
        r = wl.dispatch("t1", "u1", "orch", "claude", bad_path, "CREATE:hello.py", repo, repo)
        self.assertEqual(r["status"], "refused")
        f = wl.evaluate("t1", repo)
        self.assertEqual((f["recommended"], f["incomplete"]), ("repair", ["A1"]))          # worker refusal is not completion
        r = wl.dispatch("t1", "u1", "orch", "claude", bad_path, "CREATE:hello.py", repo, repo, executable=str(worker))
        self.assertTrue(r["ok"], r)
        f = wl.evaluate("t1", repo)
        self.assertEqual((f["complete"], f["recommended"], f["integration_allowed"]), (True, "accept", False))
        self.assertEqual(f["accounting"]["preflight_refusals"], 1)                           # refusal kept apart from executions
        self.assertEqual(f["accounting"]["execution_attempts"], 1)
        self.assertIsNone(f["usage"]["total_tokens"])                                        # fixture reports none: unknown, not zero
        lesson = L.add("worker PATH lacks the claude executable at launch", "dispatch refused: executable unavailable in worker environment",
                       "trace t1: exec_check ok=false", "pass the explicit executable path", "e2e", "restricted PATH launches", cause_status="known",
                       tags=["claude", "path", "executable"], root=repo)
        core.record_repair("worker_env_executable", "trace t1", "explicit executable", "e2e", "test", root=repo)
        # task 2: lesson is retrieved AND placed in the worker brief; usefulness is recorded only from observed evidence
        p2 = put(repo, contract("t2", "greet.py", "create greet script, launching the claude worker from a restricted PATH"), "c2.json")
        plan = wl.start(p2, repo)["plan"]
        self.assertEqual([l["id"] for l in plan["lessons"]], [lesson["id"]])
        r = wl.dispatch("t2", "u2", "orch", "claude", bad_path, "CREATE:greet.py", repo, repo, executable=str(worker), lessons_supplied=plan["lessons"])
        self.assertTrue(r["ok"], r)
        brief = (repo / ".agent-work/t2/attempts" / r["attempt_id"] / "input.md").read_text()
        self.assertIn(lesson["id"], brief); self.assertIn("fallible guidance", brief); self.assertIn("NEVER override", brief)
        self.assertEqual(L.stats(repo)[lesson["id"]]["helped"], 0)                           # retrieval/supply alone is not "helped"
        wl.evaluate("t2", repo)
        wl.observe_lessons("t2", {lesson["id"]: "helped"}, [r["attempt_id"]], repo)
        self.assertEqual(L.stats(repo)[lesson["id"]]["helped"], 1)
        tr = [t["action"] for t in wl.read_trace(repo, "t2")]
        self.assertLess(tr.index("lessons_retrieved"), tr.index("attempt_reserved")); self.assertNotIn("dispatch_refused", tr)
        for p in (repo / ".agent-work").rglob("*"):
            self.assertTrue(str(p.resolve()).startswith(str(repo.resolve())))


if __name__ == "__main__":
    unittest.main()
reverse-engineer-anythingmorluto/reaReverse engineer native, managed, Electron/JavaScript, packaged, firmware, and browser targets with REA, and build agent environments (AgentEnv bundles) of web applications from a live instance or a capture, and of Linux desktop apps with a task from a request. Use shipped-artifact or requested runtime evidence to explain features, compare versions, decompile code, or guide a reconstruction. Skip REA for ordinary source-repository architecture analysis.Stars: 469kUpdated Claude CodeCodexVerifiedInstall
diagnosing-superpowersobra/superpowersUse when a superpowers session went wrong and your human partner wants to know why — repeated work, ignored plans, stumbles, poor results, a skill that didn't fire, "it took too long", "why is it so expensive", "what is it doing" — or wants to build a bug report for the superpowers maintainers, for the current session or a past one identified by id or path, on any harness.Stars: 321kUpdated Claude CodeCodexVerifiedInstall
dispatching-parallel-agentsobra/superpowersUse when facing 2+ independent tasks that can be worked on without shared state or sequential dependenciesStars: 321kUpdated Claude CodeCodexVerifiedInstall
executing-plansobra/superpowersUse when executing an implementation plan in the current session as the implementer yourself — your human partner chose inline execution, or no subagent tool is availableStars: 321kUpdated Claude CodeCodexVerifiedInstall