Skip to content

akiiwa-games/AgentCompass / skills/agent-compass

agent-compass

Flagged

Choose owner, model and effort, outbound authorization, advisor use, and continuation for delegated work. Reads local usage and effective account policy, profiles the task with the configured System-One scorer, then allocates a compatible worker. Use for independent worker or advisor work; ordinary local execution needs no routing.

FileKindSize
SKILL.mdskill md5.5 KB
agents/openai.yamlconfig427 B
calibration/README.mdmarkdown55.2 KB
calibration/arena_capture.pyscript14.0 KB
calibration/community.pyscript25.2 KB
calibration/five_axis.pyscript196.4 KB
calibration/measurements.pyscript68.4 KB
calibration/refresh.pyscript48.6 KB
calibration/series.pyscript10.2 KB
calibration/sources.pyscript24.1 KB
calibration/tiers.pyscript14.6 KB
grok-bot/.gitignoreother47 B
grok-bot/dependency_patch.pyscript4.5 KB
grok-bot/install_cli.pyscript3.6 KB
grok-bot/test-recovery.mjsscript8.6 KB
grok-bot/test_install_cli.pyscript4.1 KB
grok-bot/upstream.jsonconfig3.4 KB
references/accounts.jsonconfig155.9 KB
references/classifier-cases.jsonconfig21.5 KB
references/dispatch-lifecycle.mdmarkdown28.9 KB
references/dispatch-rules.mdmarkdown11.3 KB
references/effort-matching.mdmarkdown5.1 KB
references/fast-modes.mdmarkdown3.5 KB
references/five-axis-scores.jsonconfig3.1 MB
references/gemini-decisions-api.mdmarkdown2.9 KB
references/grok-bot.mdmarkdown13.0 KB
references/herdr.mdmarkdown5.1 KB
references/jev-api.mdmarkdown1.6 KB
references/level-3-conversion.jsonconfig2.4 KB
references/model-capabilities.jsonconfig3.6 KB
references/model-capabilities.mdmarkdown14.6 KB
references/parent-address-gate.mdmarkdown10.1 KB
references/plan-templates.jsonconfig13.2 KB
references/provider-discovery.mdmarkdown11.5 KB
references/provider-usage.mdmarkdown4.1 KB
references/public-data.jsonconfig816 B
references/public-measurements.jsonconfig1.3 MB
references/roll-reference.mdmarkdown26.7 KB
references/router-internals.mdmarkdown93.7 KB
references/task-classifier.mdmarkdown6.1 KB
references/user-scores.jsonconfig6.8 KB
references/work-kinds.mdmarkdown4.7 KB
references/worker-communication.mdmarkdown2.1 KB
scripts/account_fleet.pyscript32.9 KB
scripts/account_state.pyscript22.2 KB
scripts/accounts_override.pyscript14.8 KB
scripts/allocator.pyscript19.8 KB
scripts/antigravity_plan.pyscript18.7 KB
scripts/antigravity_telemetry.pyscript5.1 KB
scripts/auto_bundles.pyscript31.3 KB
scripts/axis_scores.pyscript40.3 KB
scripts/caller_input.pyscript3.0 KB
scripts/candidate_eval.pyscript54.0 KB
scripts/candidate_ranking.pyscript9.5 KB
scripts/capability_catalog.pyscript8.0 KB
scripts/check_router_contract.pyscript2.8 KB
scripts/conftest.pyscript2.5 KB
scripts/cwd_policy.pyscript1.5 KB
scripts/data_age.pyscript1.5 KB
scripts/decision_ledger.pyscript18.9 KB
scripts/demo_plan.pyscript6.3 KB
scripts/dispatch_fallback.pyscript40.3 KB
scripts/dispatch_flow.pyscript58.7 KB
scripts/dispatch_ground_truth.pyscript43.5 KB
scripts/dispatch_registry.pyscript113.7 KB
scripts/entry.pyscript1.7 KB
scripts/env_vars.pyscript580 B
scripts/fast_modes.pyscript2.5 KB
scripts/fixtures/grok-api-responses.jsonconfig907 B
scripts/fixtures/reference-accounts.jsonconfig26.9 KB
scripts/grok_bot_paths.pyscript1005 B
scripts/host_herdr.pyscript16.8 KB
scripts/host_placement.pyscript9.4 KB
scripts/host_policy.pyscript10.1 KB
scripts/launch_failures.pyscript5.9 KB
scripts/launch_values.pyscript12.3 KB
scripts/ledger_snapshot.pyscript11.1 KB
scripts/live_models.pyscript21.1 KB
scripts/model_latch.pyscript7.6 KB
scripts/model_resolution.pyscript18.0 KB
scripts/override_store.pyscript2.2 KB
scripts/plan_state_residue.pyscript5.0 KB
scripts/provider_inventory.pyscript128.2 KB
scripts/provider_retry.pyscript34.6 KB
scripts/public_data.pyscript59.2 KB
scripts/quota_economy.pyscript38.0 KB
scripts/quota_exhaustion.pyscript5.9 KB
scripts/quota_overrides.pyscript25.6 KB
scripts/quota_pools.pyscript29.8 KB
scripts/reference_provenance.pyscript32.3 KB
scripts/released_names.pyscript3.8 KB
scripts/roll.pyscript106.3 KB
scripts/route_judge.pyscript83.4 KB
scripts/route_simulation.pyscript26.3 KB
scripts/router_test_support.pyscript6.7 KB
scripts/run_grok_bot.pyscript18.8 KB
scripts/scorer_client.pyscript55.2 KB
scripts/stage_help.pyscript5.8 KB
scripts/state_upgrade.pyscript24.0 KB
scripts/subscription_cli.pyscript3.6 KB
scripts/task_intake.pyscript33.6 KB
scripts/test_account_identity.pyscript7.1 KB
scripts/test_account_state.pyscript63.3 KB
scripts/test_accounts_override.pyscript30.1 KB
scripts/test_allocator.pyscript94.2 KB
scripts/test_antigravity_plan.pyscript13.2 KB
scripts/test_applicable_quota.pyscript9.1 KB
scripts/test_auto_bundles.pyscript10.8 KB
scripts/test_billing_routing_policy.pyscript9.9 KB
scripts/test_cadence_count.pyscript32.2 KB
scripts/test_calibration_units.pyscript27.0 KB
scripts/test_capability_catalog.pyscript5.0 KB
scripts/test_decision_ledger.pyscript8.5 KB
scripts/test_demo_plan.pyscript3.4 KB
scripts/test_derived_state.pyscript21.6 KB
scripts/test_dispatch.pyscript322.3 KB
scripts/test_dispatch_answers.pyscript14.8 KB
scripts/test_dispatch_fallback.pyscript53.2 KB
scripts/test_entry.pyscript1.6 KB
scripts/test_fast_modes.pyscript9.9 KB
scripts/test_five_axis.pyscript290.1 KB
scripts/test_five_axis_economy.pyscript105.0 KB
scripts/test_fleet_parity.pyscript15.6 KB
scripts/test_grok_bot.pyscript47.7 KB
scripts/test_ground_truth_recording.pyscript68.8 KB
scripts/test_herdr.pyscript14.1 KB
scripts/test_host_policy.pyscript24.6 KB
scripts/test_launch_values.pyscript8.0 KB
scripts/test_metered_usd.pyscript60.4 KB
scripts/test_model_resolution.pyscript9.2 KB
scripts/test_named_route_facts.pyscript28.6 KB
scripts/test_native_hosts.pyscript6.0 KB
scripts/test_new_user_fleet.pyscript3.3 KB
scripts/test_no_hardcode_classification.pyscript75.1 KB
scripts/test_no_legacy_scoring.pyscript6.5 KB
scripts/test_override_store.pyscript2.3 KB
scripts/test_plan_says_why.pyscript44.9 KB
scripts/test_provider_inventory.pyscript83.2 KB
scripts/test_provider_names.pyscript126.0 KB
scripts/test_provider_pools.pyscript14.2 KB
scripts/test_public_data.pyscript93.5 KB
scripts/test_quota_exhaustion.pyscript5.6 KB
scripts/test_rate_limit_windows.pyscript6.3 KB
scripts/test_record_says_why.pyscript26.5 KB
scripts/test_reference_provenance.pyscript16.7 KB
scripts/test_refresh_entry.pyscript110.7 KB
scripts/test_released_names.pyscript4.1 KB
scripts/test_reset_priority.pyscript4.8 KB
scripts/test_roll_answers.pyscript44.7 KB
scripts/test_roll_notifications.pyscript10.4 KB
scripts/test_route_judge.pyscript99.8 KB
scripts/test_route_simulation.pyscript7.0 KB
scripts/test_routing_parity.pyscript32.3 KB
scripts/test_routing_review.pyscript25.1 KB
scripts/test_setup_discovery_parity.pyscript9.5 KB
scripts/test_stage_help.pyscript2.0 KB
scripts/test_state_upgrade.pyscript13.8 KB
scripts/test_turn_refusal.pyscript16.7 KB
scripts/test_usage_cache.pyscript4.9 KB
scripts/test_usage_collector.pyscript21.4 KB
scripts/test_usage_core_claude_accounts.pyscript1.8 KB
scripts/test_usage_core_grok_cli_billing.pyscript15.6 KB
scripts/test_usage_core_magpie.pyscript5.4 KB
scripts/test_usage_core_magpie_pool.pyscript10.8 KB
scripts/test_usage_core_safety.pyscript24.4 KB
scripts/test_user_scores.pyscript102.3 KB
scripts/test_venice_usage.pyscript1.3 KB
scripts/test_window_scope.pyscript5.5 KB
scripts/turn_refusal.pyscript10.7 KB
scripts/usage_cache.pyscript4.7 KB
scripts/usage_collector.pyscript7.4 KB
scripts/usage_core.pyscript142.0 KB
scripts/usage_magpie.pyscript10.6 KB
scripts/usage_reading.pyscript17.1 KB
scripts/user_scores.pyscript72.8 KB
scripts/venice_usage.pyscript2.6 KB
scripts/window_scope.pyscript3.2 KB
scripts/worker_context.pyscript8.9 KB
scripts/worker_sessions.pyscript10.9 KB

scripts/test_decision_ledger.py

View on GitHub
"""Every plan decision is written to the ledger with the ranking and component scores it was made with."""
from datetime import datetime, timedelta, timezone
import json
import os
from pathlib import Path
import tempfile
import unittest
from unittest.mock import patch

import allocator
import account_fleet
import ledger_snapshot
import route_judge as router
import decision_ledger
from router_test_support import isolated_router_state, profile


class DecisionLedgerTests(unittest.TestCase):
    def setUp(self):
        isolated_router_state(self.addCleanup)
        self.now = datetime.now(timezone.utc)
        scorer_env = patch.dict(os.environ, {'ROUTER_DISABLE_LIVE_SCORER': '1'})
        scorer_env.start()
        self.addCleanup(scorer_env.stop)
        self.addCleanup(setattr, decision_ledger, 'LEDGER_WRITES', True)
        self.directory = tempfile.TemporaryDirectory()
        self.addCleanup(self.directory.cleanup)
        self.ledger = Path(self.directory.name) / 'ledger.jsonl'
        patcher = patch.object(decision_ledger, 'ledger_path', return_value=self.ledger)
        patcher.start()
        self.addCleanup(patcher.stop)
        window = lambda wid, used, hours: {'id': wid, 'used_pct': used, 'resets_at': (self.now + timedelta(hours=hours)).isoformat()}
        row = lambda *windows: {'fetched_at': self.now.isoformat(), 'available': True, 'stale': False, 'windows': list(windows)}
        self.cache = Path(self.directory.name) / 'usage-cache.json'
        self.cache.write_text(json.dumps({'providers': {
            'claude': row(window('five_hour', 10, 3), window('seven_day', 40, 100), window('weekly_fable', 0, 100)),
            'codex': row(window('usage', 40, 100)),
            'antigravity': row(window('gemini-5h', 10, 3), window('gemini-weekly', 20, 100))}}), encoding='utf-8')
        self.task = Path(self.directory.name) / 'task.json'
        self.task.write_text(json.dumps({'task': {
            'objective': 'Fix the pagination bug', 'work_kind': 'code_implementation', 'expected_hours': 1,
            'needs': {'local_only': True},
            'profile': profile(primary_level=3, local_only=True, expected_hours=1.0, reason='private reasoning')}}), encoding='utf-8')

    def run_plan(self, *extra):
        argv = ['route_judge.py', 'plan', '--input', str(self.task), '--usage-cache', str(self.cache), *extra]
        with patch('sys.argv', argv), patch('builtins.print') as shown:
            code = router.main()
        return code, json.loads(shown.call_args.args[0])

    def plan_rows(self):
        return [row for row in decision_ledger.read_ledger() if row.get('stage') == 'plan']

    def test_plan_line_carries_ranking_components_and_scoring_system(self):
        code, result = self.run_plan()
        self.assertEqual(code, 0)
        [line] = self.plan_rows()
        snapshot = line['decision_snapshot']
        self.assertEqual(snapshot['choice'], result['choice'])
        self.assertEqual(snapshot['v'], 1)
        ranking = snapshot['ranking']
        self.assertEqual(ranking[0]['id'], result['choice'])
        self.assertEqual(snapshot['ranking_total'], len(result['ranking']))
        self.assertEqual(snapshot['ranking_eligible'], sum(1 for c in result['ranking'] if not c['excluded']))
        live_eligible = [c for c in result['ranking'] if not c['excluded']]
        recorded_eligible = [row for row in ranking if not row['excluded']]
        self.assertEqual(len(recorded_eligible), min(len(live_eligible), ledger_snapshot.SNAPSHOT_FULL + ledger_snapshot.SNAPSHOT_COMPACT))
        for row, live in zip(recorded_eligible, live_eligible):
            self.assertEqual((row['id'], row['score']), (live['id'], round(live['score'], 4)))
        full = recorded_eligible[:ledger_snapshot.SNAPSHOT_FULL]
        # Full rows hold every component, the binding window and the money numbers the comparison table reads.
        winner, live = ranking[0], result['ranking'][0]
        self.assertEqual(winner['components'], {k: (round(v, 4) if isinstance(v, float) else v) for k, v in live['components'].items()})
        self.assertEqual(winner['capacity']['window'], live['capacity']['window'])
        self.assertEqual((winner['expected_pct'], winner['expected_usd']), (round(live['expected_pct'], 4), round(live['expected_usd'], 4)))
        self.assertEqual(winner['action'], live['action'])
        self.assertTrue({'creativity', 'coding', 'aesthetics', 'tool_operation'} <= set(winner['components']))
        self.assertTrue(all('capacity' in row or row['expected_pct'] is None for row in full if 'expected_pct' in row))
        # Blocked candidates keep their reasons; the scoring system and the task demand are recorded with the decision.
        blocked = [row for row in ranking if row['excluded']]
        self.assertTrue(blocked)
        self.assertTrue(all(row['score'] is None or row['excluded'] for row in blocked))
        decision = snapshot['decision']
        self.assertEqual(decision['system']['weights'], result['decision']['system']['weights'])
        self.assertEqual(decision['task']['axis_demand'], result['decision']['task']['axis_demand'])
        self.assertEqual(decision['action'], result['decision']['action'])
        self.assertNotIn('reason', decision['task']['profile'])                 # the classifier's free text is not copied
        self.assertNotIn('private reasoning', json.dumps(snapshot))

    def test_snapshot_is_bounded_so_the_ledger_stays_cheap_to_tail(self):
        _, result = self.run_plan()
        [line] = self.plan_rows()
        text = json.dumps(line)
        # The cap is the row limits (SNAPSHOT_FULL + SNAPSHOT_COMPACT eligible rows, SNAPSHOT_EXCLUDED blocked ones), not a byte
        # size tuned to one fixture: the recorded line is smaller than the whole ranking it was cut from, which the fleet's
        # size and the data's notes decide.
        ranking = line['decision_snapshot']['ranking']
        self.assertGreater(line['decision_snapshot']['ranking_total'], len(ranking), 'the fixture must exceed the row limits')
        self.assertLess(len(json.dumps(ranking)), len(json.dumps(result['ranking'])))
        eligible = [row for row in ranking if not row['excluded']]
        self.assertLessEqual(len(eligible), ledger_snapshot.SNAPSHOT_FULL + ledger_snapshot.SNAPSHOT_COMPACT)
        self.assertLessEqual(len(ranking) - len(eligible), ledger_snapshot.SNAPSHOT_EXCLUDED)
        omitted = line['decision_snapshot']['ranking_omitted']
        self.assertEqual(len(ranking) + omitted['eligible'] + omitted['excluded'], line['decision_snapshot']['ranking_total'])
        compact = eligible[ledger_snapshot.SNAPSHOT_FULL:]
        self.assertTrue(all('capacity' not in row and 'notes' not in row for row in compact))
        self.assertTrue(all({'fit', 'opportunity_cost'} <= set(row['components']) for row in compact))

    def test_dry_run_and_non_ranking_stages_write_no_snapshot(self):
        before = len(decision_ledger.read_ledger())
        self.run_plan('--dry-run')
        self.assertEqual(len(decision_ledger.read_ledger()), before)
        self.assertIsNone(decision_ledger.decision_snapshot({'stage': 'record'}))
        self.assertIsNone(ledger_snapshot.decision_snapshot({'stage': 'record'}))

    def test_snapshot_survives_a_later_change_of_configuration_and_quota(self):
        self.run_plan()
        [before] = self.plan_rows()
        accounts = account_fleet.load_accounts()
        accounts['accounts']['codex']['verified'] = False             # the fleet is reconfigured afterwards
        later = allocator.plan({'work_kind': 'code_implementation', 'needs': {'local_only': True}, 'profile': profile(local_only=True)},
                               {'read_ok': True, 'accounts': {}}, self.now + timedelta(days=3), accounts=accounts, overrides=[])
        self.assertNotEqual(later['choice'], before['choice'])
        [after] = self.plan_rows()
        self.assertEqual(after, before)

    def test_tail_read_keeps_a_ledger_over_the_cap_usable(self):
        small = 4096
        with patch.object(decision_ledger, 'LEDGER_TAIL_BYTES', small):
            lines = [json.dumps({'v': 1, 'stage': 'plan', 'choice': f'bundle{i}', 'pad': 'x' * 200}) for i in range(100)]
            self.ledger.write_text('\n'.join(lines) + '\n', encoding='utf-8')
            rows = decision_ledger.read_ledger()
        self.assertTrue(rows)
        self.assertLess(len(rows), 100)
        self.assertEqual(rows[-1]['choice'], 'bundle99')
        self.assertTrue(all(row['choice'].startswith('bundle') for row in rows))     # the cut first line is dropped, not parsed


if __name__ == '__main__':
    unittest.main()
reverse-engineer-anythingmorluto/reaReverse engineer native, managed, Electron/JavaScript, packaged, firmware, and browser targets with REA, and build agent environments (AgentEnv bundles) of web applications from a live instance or a capture, and of Linux desktop apps with a task from a request. Use shipped-artifact or requested runtime evidence to explain features, compare versions, decompile code, or guide a reconstruction. Skip REA for ordinary source-repository architecture analysis.Stars: 471kUpdated Claude CodeCodexVerifiedInstall
diagnosing-superpowersobra/superpowersUse when a superpowers session went wrong and your human partner wants to know why — repeated work, ignored plans, stumbles, poor results, a skill that didn't fire, "it took too long", "why is it so expensive", "what is it doing" — or wants to build a bug report for the superpowers maintainers, for the current session or a past one identified by id or path, on any harness.Stars: 322kUpdated Claude CodeCodexVerifiedInstall
dispatching-parallel-agentsobra/superpowersUse when facing 2+ independent tasks that can be worked on without shared state or sequential dependenciesStars: 322kUpdated Claude CodeCodexVerifiedInstall
executing-plansobra/superpowersUse when executing an implementation plan in the current session as the implementer yourself — your human partner chose inline execution, or no subagent tool is availableStars: 322kUpdated Claude CodeCodexVerifiedInstall