Skip to content

akiiwa-games/AgentCompass / skills/agent-compass

agent-compass

Flagged

Choose owner, model and effort, outbound authorization, advisor use, and continuation for delegated work. Reads local usage and effective account policy, profiles the task with the configured System-One scorer, then allocates a compatible worker. Use for independent worker or advisor work; ordinary local execution needs no routing.

FileKindSize
SKILL.mdskill md5.5 KB
agents/openai.yamlconfig427 B
calibration/README.mdmarkdown55.2 KB
calibration/arena_capture.pyscript14.0 KB
calibration/community.pyscript25.2 KB
calibration/five_axis.pyscript196.4 KB
calibration/measurements.pyscript68.4 KB
calibration/refresh.pyscript48.6 KB
calibration/series.pyscript10.2 KB
calibration/sources.pyscript24.1 KB
calibration/tiers.pyscript14.6 KB
grok-bot/.gitignoreother47 B
grok-bot/dependency_patch.pyscript4.5 KB
grok-bot/install_cli.pyscript3.6 KB
grok-bot/test-recovery.mjsscript8.6 KB
grok-bot/test_install_cli.pyscript4.1 KB
grok-bot/upstream.jsonconfig3.4 KB
references/accounts.jsonconfig155.9 KB
references/classifier-cases.jsonconfig21.5 KB
references/dispatch-lifecycle.mdmarkdown28.9 KB
references/dispatch-rules.mdmarkdown11.3 KB
references/effort-matching.mdmarkdown5.1 KB
references/fast-modes.mdmarkdown3.5 KB
references/five-axis-scores.jsonconfig3.1 MB
references/gemini-decisions-api.mdmarkdown2.9 KB
references/grok-bot.mdmarkdown13.0 KB
references/herdr.mdmarkdown5.1 KB
references/jev-api.mdmarkdown1.6 KB
references/level-3-conversion.jsonconfig2.4 KB
references/model-capabilities.jsonconfig3.6 KB
references/model-capabilities.mdmarkdown14.6 KB
references/parent-address-gate.mdmarkdown10.1 KB
references/plan-templates.jsonconfig13.2 KB
references/provider-discovery.mdmarkdown11.5 KB
references/provider-usage.mdmarkdown4.1 KB
references/public-data.jsonconfig816 B
references/public-measurements.jsonconfig1.3 MB
references/roll-reference.mdmarkdown26.7 KB
references/router-internals.mdmarkdown93.7 KB
references/task-classifier.mdmarkdown6.1 KB
references/user-scores.jsonconfig6.8 KB
references/work-kinds.mdmarkdown4.7 KB
references/worker-communication.mdmarkdown2.1 KB
scripts/account_fleet.pyscript32.9 KB
scripts/account_state.pyscript22.2 KB
scripts/accounts_override.pyscript14.8 KB
scripts/allocator.pyscript19.8 KB
scripts/antigravity_plan.pyscript18.7 KB
scripts/antigravity_telemetry.pyscript5.1 KB
scripts/auto_bundles.pyscript31.3 KB
scripts/axis_scores.pyscript40.3 KB
scripts/caller_input.pyscript3.0 KB
scripts/candidate_eval.pyscript54.0 KB
scripts/candidate_ranking.pyscript9.5 KB
scripts/capability_catalog.pyscript8.0 KB
scripts/check_router_contract.pyscript2.8 KB
scripts/conftest.pyscript2.5 KB
scripts/cwd_policy.pyscript1.5 KB
scripts/data_age.pyscript1.5 KB
scripts/decision_ledger.pyscript18.9 KB
scripts/demo_plan.pyscript6.3 KB
scripts/dispatch_fallback.pyscript40.3 KB
scripts/dispatch_flow.pyscript58.7 KB
scripts/dispatch_ground_truth.pyscript43.5 KB
scripts/dispatch_registry.pyscript113.7 KB
scripts/entry.pyscript1.7 KB
scripts/env_vars.pyscript580 B
scripts/fast_modes.pyscript2.5 KB
scripts/fixtures/grok-api-responses.jsonconfig907 B
scripts/fixtures/reference-accounts.jsonconfig26.9 KB
scripts/grok_bot_paths.pyscript1005 B
scripts/host_herdr.pyscript16.8 KB
scripts/host_placement.pyscript9.4 KB
scripts/host_policy.pyscript10.1 KB
scripts/launch_failures.pyscript5.9 KB
scripts/launch_values.pyscript12.3 KB
scripts/ledger_snapshot.pyscript11.1 KB
scripts/live_models.pyscript21.1 KB
scripts/model_latch.pyscript7.6 KB
scripts/model_resolution.pyscript18.0 KB
scripts/override_store.pyscript2.2 KB
scripts/plan_state_residue.pyscript5.0 KB
scripts/provider_inventory.pyscript128.2 KB
scripts/provider_retry.pyscript34.6 KB
scripts/public_data.pyscript59.2 KB
scripts/quota_economy.pyscript38.0 KB
scripts/quota_exhaustion.pyscript5.9 KB
scripts/quota_overrides.pyscript25.6 KB
scripts/quota_pools.pyscript29.8 KB
scripts/reference_provenance.pyscript32.3 KB
scripts/released_names.pyscript3.8 KB
scripts/roll.pyscript106.3 KB
scripts/route_judge.pyscript83.4 KB
scripts/route_simulation.pyscript26.3 KB
scripts/router_test_support.pyscript6.7 KB
scripts/run_grok_bot.pyscript18.8 KB
scripts/scorer_client.pyscript55.2 KB
scripts/stage_help.pyscript5.8 KB
scripts/state_upgrade.pyscript24.0 KB
scripts/subscription_cli.pyscript3.6 KB
scripts/task_intake.pyscript33.6 KB
scripts/test_account_identity.pyscript7.1 KB
scripts/test_account_state.pyscript63.3 KB
scripts/test_accounts_override.pyscript30.1 KB
scripts/test_allocator.pyscript94.2 KB
scripts/test_antigravity_plan.pyscript13.2 KB
scripts/test_applicable_quota.pyscript9.1 KB
scripts/test_auto_bundles.pyscript10.8 KB
scripts/test_billing_routing_policy.pyscript9.9 KB
scripts/test_cadence_count.pyscript32.2 KB
scripts/test_calibration_units.pyscript27.0 KB
scripts/test_capability_catalog.pyscript5.0 KB
scripts/test_decision_ledger.pyscript8.5 KB
scripts/test_demo_plan.pyscript3.4 KB
scripts/test_derived_state.pyscript21.6 KB
scripts/test_dispatch.pyscript322.3 KB
scripts/test_dispatch_answers.pyscript14.8 KB
scripts/test_dispatch_fallback.pyscript53.2 KB
scripts/test_entry.pyscript1.6 KB
scripts/test_fast_modes.pyscript9.9 KB
scripts/test_five_axis.pyscript290.1 KB
scripts/test_five_axis_economy.pyscript105.0 KB
scripts/test_fleet_parity.pyscript15.6 KB
scripts/test_grok_bot.pyscript47.7 KB
scripts/test_ground_truth_recording.pyscript68.8 KB
scripts/test_herdr.pyscript14.1 KB
scripts/test_host_policy.pyscript24.6 KB
scripts/test_launch_values.pyscript8.0 KB
scripts/test_metered_usd.pyscript60.4 KB
scripts/test_model_resolution.pyscript9.2 KB
scripts/test_named_route_facts.pyscript28.6 KB
scripts/test_native_hosts.pyscript6.0 KB
scripts/test_new_user_fleet.pyscript3.3 KB
scripts/test_no_hardcode_classification.pyscript75.1 KB
scripts/test_no_legacy_scoring.pyscript6.5 KB
scripts/test_override_store.pyscript2.3 KB
scripts/test_plan_says_why.pyscript44.9 KB
scripts/test_provider_inventory.pyscript83.2 KB
scripts/test_provider_names.pyscript126.0 KB
scripts/test_provider_pools.pyscript14.2 KB
scripts/test_public_data.pyscript93.5 KB
scripts/test_quota_exhaustion.pyscript5.6 KB
scripts/test_rate_limit_windows.pyscript6.3 KB
scripts/test_record_says_why.pyscript26.5 KB
scripts/test_reference_provenance.pyscript16.7 KB
scripts/test_refresh_entry.pyscript110.7 KB
scripts/test_released_names.pyscript4.1 KB
scripts/test_reset_priority.pyscript4.8 KB
scripts/test_roll_answers.pyscript44.7 KB
scripts/test_roll_notifications.pyscript10.4 KB
scripts/test_route_judge.pyscript99.8 KB
scripts/test_route_simulation.pyscript7.0 KB
scripts/test_routing_parity.pyscript32.3 KB
scripts/test_routing_review.pyscript25.1 KB
scripts/test_setup_discovery_parity.pyscript9.5 KB
scripts/test_stage_help.pyscript2.0 KB
scripts/test_state_upgrade.pyscript13.8 KB
scripts/test_turn_refusal.pyscript16.7 KB
scripts/test_usage_cache.pyscript4.9 KB
scripts/test_usage_collector.pyscript21.4 KB
scripts/test_usage_core_claude_accounts.pyscript1.8 KB
scripts/test_usage_core_grok_cli_billing.pyscript15.6 KB
scripts/test_usage_core_magpie.pyscript5.4 KB
scripts/test_usage_core_magpie_pool.pyscript10.8 KB
scripts/test_usage_core_safety.pyscript24.4 KB
scripts/test_user_scores.pyscript102.3 KB
scripts/test_venice_usage.pyscript1.3 KB
scripts/test_window_scope.pyscript5.5 KB
scripts/turn_refusal.pyscript10.7 KB
scripts/usage_cache.pyscript4.7 KB
scripts/usage_collector.pyscript7.4 KB
scripts/usage_core.pyscript142.0 KB
scripts/usage_magpie.pyscript10.6 KB
scripts/usage_reading.pyscript17.1 KB
scripts/user_scores.pyscript72.8 KB
scripts/venice_usage.pyscript2.6 KB
scripts/window_scope.pyscript3.2 KB
scripts/worker_context.pyscript8.9 KB
scripts/worker_sessions.pyscript10.9 KB

scripts/test_no_legacy_scoring.py

View on GitHub
"""The four category scores and the quota economy are the only scoring: no field of the older scoring may come back.

One test. It fails when a legacy field reappears in the shipped data, in the classifier's schema or answer, in a
normalized task, or as a module-level name of the allocator.
"""
import json
from pathlib import Path
import unittest

import allocator
import account_fleet
import axis_scores
import task_intake
import scorer_client

REFERENCES = Path(__file__).resolve().parents[1] / 'references'
FIXTURES = Path(__file__).resolve().parent / 'fixtures'

# Keys that belonged to the older scoring (a per-model tier score, capability and preference rows and their weights, ability
# gates, exchange-rate pricing, packaged capacity and burn priors, per-difficulty hours). They may appear nowhere in shipped data.
LEGACY_KEYS = {
    'capabilities', 'subjective', 'weights', 'five_axis', 'ability_floor', 'route_ability_floor', 'ability_floor_basis',
    'ability_score_origin', 'critical_headroom_by_difficulty', 'opportunity_exchange', 'shortage_loss_per_usd',
    'shortage_loss_per_worker_hour', 'unmeasured_models', 'mainstream_defaults', 'burn_pct_per_worker_hour',
    'capacity_change', 'free_usage_bonus', 'default_hours', 'fast_burn_multiplier', 'burn_basis', 'context_scale',
    'hallucination_risk', 'error_cost', 'reset_sunk_weight', 'demand_pct', 'surplus_pct',
    # the effort burn curve (the spend of an effort is the usd rate times the hours at that effort) and the flat speed hours
    'effort_burn', 'burn', 'burn_mult', 'speed_hours', 'speed_source',
}
# Keys a model row of the accounts catalogue may not carry: its scores, tier and price live in five-axis-scores.json.
LEGACY_MODEL_KEYS = {'tier', 'visual', 'cost', 'usd_per_hour', 'score_estimated', 'capability', 'dna'}
# Profile fields only the older rows read; the classifier answers the 10 concrete `TASK_PROFILE_SCHEMA` fields and
# `task_intake` projects `axis_demand` deterministically from `work_kind`.
LEGACY_PROFILE_FIELDS = {
    'context_scale', 'divergence', 'hallucination_risk', 'error_cost', 'needs_critical',
    'reasoning_depth', 'code_complexity', 'interaction_style', 'hours_confidence', 'urgency',
}
LEGACY_ALLOCATOR_NAMES = {
    'USD_PER_HOUR_DEFAULTS', 'exchange_rate', 'effort_ability', 'demand_forecast', 'task_demand', 'five_axis_enabled',
    'load_subjective', 'capability_fit', 'tier_gate', 'ability_floor', 'default_hours',
    'effort_value', 'burn_scale', 'model_duration_multiplier', 'five_axis_duration_multiplier', 'five_axis_speed_hours',
    'FIVE_AXIS_ANCHOR_VALUE',
}


def walk_keys(node, path=''):
    if isinstance(node, dict):
        for key, value in node.items():
            yield path + '/' + key, key
            yield from walk_keys(value, path + '/' + key)
    elif isinstance(node, list):
        for value in node:
            yield from walk_keys(value, path)


def load(path):
    return json.loads(Path(path).read_text(encoding='utf-8-sig'))


class NoLegacyScoringTests(unittest.TestCase):
    def test_no_legacy_field_in_shipped_data_or_classifier_output(self):
        accounts = load(REFERENCES / 'accounts.json')
        documents = {'accounts.json': accounts, 'reference-accounts.json': load(FIXTURES / 'reference-accounts.json'),
                     'plan-templates.json': load(REFERENCES / 'plan-templates.json'),
                     'model-capabilities.json': load(REFERENCES / 'model-capabilities.json'),
                     'classifier-cases.json': load(REFERENCES / 'classifier-cases.json')}
        found = [f'{name}{path}' for name, doc in documents.items() for path, key in walk_keys(doc) if key in LEGACY_KEYS]
        self.assertEqual(found, [], 'legacy scoring fields in shipped data')

        # A model row carries routing flags only; its scores, tier and price are the public data's.
        for name, doc in documents.items():
            for model, row in (doc.get('models') or {}).items():
                self.assertFalse(LEGACY_MODEL_KEYS & set(row), (name, model, LEGACY_MODEL_KEYS & set(row)))
        # A subscription account states its plan, never a capacity: that comes from public data only.
        for name, doc in documents.items():
            for account, spec in (doc.get('accounts') or {}).items():
                if spec.get('billing') == 'subscription':
                    self.assertFalse({'capacity_usd', 'capacity_basis'} & set(spec), (name, account))
        # A plan template names window structure; capacity and burn come from public data only.
        for family, plans in load(REFERENCES / 'plan-templates.json').items():
            for plan, template in (plans if isinstance(plans, dict) else {}).items():
                self.assertFalse({'capacity_usd', 'burn'} & set(template if isinstance(template, dict) else ()), (family, plan))

        # The scores the router reads carry the four categories, the economy's inputs and the tier only as provenance.
        scores = load(REFERENCES / 'five-axis-scores.json')
        for model, row in scores['models'].items():
            self.assertEqual(set(row['axes']), set(axis_scores.FIVE_AXES), model)
            self.assertFalse({'capabilities', 'subjective', 'score'} & set(row), model)

        # The classifier: the answer's schema, the shipped calibration cases and a normalized task.
        schema = scorer_client.scorer_schema(account_fleet.load_capabilities())
        self.assertFalse(LEGACY_PROFILE_FIELDS & set(schema['properties']), 'classifier schema')
        self.assertNotIn('axis_demand', schema['properties'])
        for case in load(REFERENCES / 'classifier-cases.json')['calibration_cases']:
            self.assertFalse(LEGACY_PROFILE_FIELDS & set(case['expected_profile']), case['id'])
            self.assertEqual(set(case['expected_profile']), set(schema['required']), case['id'])
            validated = task_intake.validate_profile(case['expected_profile'])
            self.assertEqual(set(validated['axis_demand']), set(axis_scores.FIVE_AXES), case['id'])
        self.assertFalse(LEGACY_PROFILE_FIELDS & set(task_intake.TASK_PROFILE_SCHEMA['properties']))
        accepted = set(task_intake.TASK_PROFILE_SCHEMA['properties']) | {
            'axis_demand', 'needs_gui', 'read_only_review', 'multi_task', 'reason',
        }
        self.assertFalse(LEGACY_PROFILE_FIELDS & accepted)

        # The router's own scoring policy has no switch, weights or gates of the older scoring.
        self.assertFalse(LEGACY_KEYS & set(accounts['scoring']), 'scoring policy')
        self.assertFalse(LEGACY_ALLOCATOR_NAMES & set(dir(allocator)), 'allocator names')


if __name__ == '__main__':
    unittest.main()
reverse-engineer-anythingmorluto/reaReverse engineer native, managed, Electron/JavaScript, packaged, firmware, and browser targets with REA, and build agent environments (AgentEnv bundles) of web applications from a live instance or a capture, and of Linux desktop apps with a task from a request. Use shipped-artifact or requested runtime evidence to explain features, compare versions, decompile code, or guide a reconstruction. Skip REA for ordinary source-repository architecture analysis.Stars: 471kUpdated Claude CodeCodexVerifiedInstall
diagnosing-superpowersobra/superpowersUse when a superpowers session went wrong and your human partner wants to know why — repeated work, ignored plans, stumbles, poor results, a skill that didn't fire, "it took too long", "why is it so expensive", "what is it doing" — or wants to build a bug report for the superpowers maintainers, for the current session or a past one identified by id or path, on any harness.Stars: 322kUpdated Claude CodeCodexVerifiedInstall
dispatching-parallel-agentsobra/superpowersUse when facing 2+ independent tasks that can be worked on without shared state or sequential dependenciesStars: 322kUpdated Claude CodeCodexVerifiedInstall
executing-plansobra/superpowersUse when executing an implementation plan in the current session as the implementer yourself — your human partner chose inline execution, or no subagent tool is availableStars: 322kUpdated Claude CodeCodexVerifiedInstall