Skip to content

dse120071750/m8m-harness-builder / skills/m8m/m8m-harness-builder

m8m-harness-builder

Flagged

Build and edit M8M harnesses that coordinate existing tools and FlowSteps, validate milestone outputs, and track progress and resume. Reuse working implementations in place. Compile workflow changes without runtime packaging; build portable packages when requested and deliver server installations through the dedicated M8M server installer.

FileKindSize
.gitattributesother112 B
.gitignoreother208 B
LICENSEother673 B
README.mdmarkdown29.8 KB
SKILL.mdskill md1.3 KB
agents/audit_complete.yamlconfig1.6 KB
agents/flow_generated.yamlconfig2.2 KB
agents/harness_validated.yamlconfig2.3 KB
agents/openai.yamlconfig4.6 KB
agents/skill_shipped.yamlconfig2.1 KB
agents/toolbox_ready.yamlconfig1.6 KB
conftest.pyscript275 B
contracts/conformance/expectation_first_runtime/candidate-cases.jsonconfig4.1 KB
contracts/conformance/expectation_first_runtime/common-linear.jsonconfig2.7 KB
contracts/conformance/expectation_first_runtime/schemas/judge-decision.schema.jsonconfig373 B
contracts/conformance/expectation_first_runtime/schemas/result.output.schema.jsonconfig589 B
contracts/conformance/expectation_first_runtime/schemas/source.output.schema.jsonconfig500 B
contracts/conformance/flowstep_flow_v4/invalid/judge-loop-unbound.jsonconfig483 B
contracts/conformance/flowstep_flow_v4/invalid/malformed-execution.jsonconfig571 B
contracts/conformance/flowstep_flow_v4/invalid/no-required-output.jsonconfig455 B
contracts/conformance/flowstep_flow_v4/invalid/nonjudge-bound.jsonconfig763 B
contracts/conformance/flowstep_flow_v4/invalid/unknown-field.jsonconfig469 B
contracts/conformance/flowstep_flow_v4/valid/authoring-union.jsonconfig4.3 KB
contracts/conformance/flowstep_flow_v4/valid/platform-dag.jsonconfig1.9 KB
contracts/file_ref_v2.schema.jsonconfig484 B
contracts/flow_sequence_action_v2.schema.jsonconfig1.5 KB
contracts/flowstep_flow_v4.schema.jsonconfig13.6 KB
contracts/flowstep_output_v2.schema.jsonconfig2.8 KB
contracts/flowstep_output_v3.schema.jsonconfig3.0 KB
contracts/flowstep_skill_audit_v1.schema.jsonconfig5.1 KB
contracts/m8m_builder_configuration_v1.schema.jsonconfig252 B
contracts/m8m_builder_input_v1.schema.jsonconfig183 B
contracts/m8m_builder_installation_receipt_v2.schema.jsonconfig2.9 KB
contracts/m8m_builder_output_v1.schema.jsonconfig453 B
contracts/m8m_builder_request_v3.schema.jsonconfig707 B
contracts/m8m_builder_result_v3.schema.jsonconfig422 B
contracts/m8m_builder_source_audit_v2.schema.jsonconfig6.1 KB
contracts/m8m_builder_source_bundle_v2.schema.jsonconfig8.6 KB
contracts/m8m_builder_toolbox_manifest_v2.schema.jsonconfig2.6 KB
contracts/m8m_builder_validation_report_v2.schema.jsonconfig3.4 KB
contracts/m8m_cache_receipt_v1.schema.jsonconfig1.2 KB
contracts/m8m_candidate_cache_entry_v1.schema.jsonconfig2.8 KB
contracts/m8m_chosen_output_v1.schema.jsonconfig2.3 KB
contracts/m8m_context_capsule_v1.schema.jsonconfig1.9 KB
contracts/m8m_contract_bundle_lock_v1.schema.jsonconfig648 B
contracts/m8m_goal_ledger_v1.schema.jsonconfig1.8 KB
contracts/m8m_milestone_agent_v1.schema.jsonconfig13.8 KB
contracts/m8m_milestone_expectation_v1.schema.jsonconfig1.9 KB
contracts/m8m_milestone_judge_receipt_v1.schema.jsonconfig1.7 KB
contracts/m8m_milestone_judge_request_v1.schema.jsonconfig3.0 KB
contracts/m8m_run_context_v1.schema.jsonconfig994 B
contracts/m8m_run_context_v2.schema.jsonconfig1.2 KB
contracts/m8m_run_storage_contract_v1.schema.jsonconfig894 B
contracts/m8m_runtime_lock_v1.schema.jsonconfig1.7 KB
contracts/m8m_runtime_release_v1.schema.jsonconfig2.2 KB
contracts/m8m_skill_canvas_v1.schema.jsonconfig4.0 KB
contracts/m8m_source_asset_manifest_v1.schema.jsonconfig1.2 KB
contracts/m8m_workflow_package_archive_v1.schema.jsonconfig1.1 KB
contracts/m8m_workflow_source_bundle_proof_v1.schema.jsonconfig1.6 KB
contracts/m8m_workflow_source_bundle_v1.schema.jsonconfig19.5 KB
contracts/tool_vs_intelligence_table_v1.schema.jsonconfig1.3 KB
docs/m8m-chart.jpgbinary172.2 KB
docs/m8m-task-builder-design.zh-HK.mdmarkdown66.9 KB
examples/article_infographic/README.mdmarkdown598 B
examples/article_infographic/planning/m8m-flowchart.jpgbinary186.0 KB
examples/article_infographic/planning/m8m-flowchart.mdmarkdown4.2 KB
flows/m8m_build_v2.yamlconfig9.9 KB
flowsteps/tools/audit_complete_judge/input.schema.jsonconfig190 B
flowsteps/tools/audit_complete_judge/output.schema.jsonconfig477 B
flowsteps/tools/audit_complete_judge/tests/test_tool.pyscript1.1 KB
flowsteps/tools/audit_complete_judge/tool.pyscript1.2 KB
flowsteps/tools/audit_skill/input.schema.jsonconfig250 B
flowsteps/tools/audit_skill/output.schema.jsonconfig136 B
flowsteps/tools/audit_skill/tests/test_tool.pyscript1.9 KB
flowsteps/tools/audit_skill/tool.pyscript2.9 KB
flowsteps/tools/flow_generated_judge/input.schema.jsonconfig190 B
flowsteps/tools/flow_generated_judge/output.schema.jsonconfig475 B
flowsteps/tools/flow_generated_judge/tests/test_tool.pyscript1.1 KB
flowsteps/tools/flow_generated_judge/tool.pyscript1.5 KB
flowsteps/tools/generate_from_audit/input.schema.jsonconfig562 B
flowsteps/tools/generate_from_audit/output.schema.jsonconfig137 B
flowsteps/tools/generate_from_audit/tests/test_tool.pyscript2.2 KB
flowsteps/tools/generate_from_audit/tool.pyscript3.0 KB
flowsteps/tools/harness_validated_judge/input.schema.jsonconfig193 B
flowsteps/tools/harness_validated_judge/output.schema.jsonconfig488 B
flowsteps/tools/harness_validated_judge/tests/test_tool.pyscript1.1 KB
flowsteps/tools/harness_validated_judge/tool.pyscript1.3 KB
flowsteps/tools/install_local_skill/input.schema.jsonconfig733 B
flowsteps/tools/install_local_skill/output.schema.jsonconfig144 B
flowsteps/tools/install_local_skill/tests/test_tool.pyscript2.1 KB
flowsteps/tools/install_local_skill/tool.pyscript3.0 KB
flowsteps/tools/install_toolbox/input.schema.jsonconfig400 B
flowsteps/tools/install_toolbox/output.schema.jsonconfig140 B
flowsteps/tools/install_toolbox/tests/test_tool.pyscript1.9 KB
flowsteps/tools/install_toolbox/tool.pyscript3.0 KB
flowsteps/tools/skill_shipped_judge/input.schema.jsonconfig189 B
flowsteps/tools/skill_shipped_judge/output.schema.jsonconfig484 B
flowsteps/tools/skill_shipped_judge/tests/test_tool.pyscript1.1 KB
flowsteps/tools/skill_shipped_judge/tool.pyscript1.3 KB
flowsteps/tools/toolbox_ready_judge/input.schema.jsonconfig189 B
flowsteps/tools/toolbox_ready_judge/output.schema.jsonconfig490 B
flowsteps/tools/toolbox_ready_judge/tests/test_tool.pyscript1.3 KB
flowsteps/tools/toolbox_ready_judge/tool.pyscript1.6 KB
flowsteps/tools/validate_harness/input.schema.jsonconfig563 B
flowsteps/tools/validate_harness/output.schema.jsonconfig141 B
flowsteps/tools/validate_harness/tests/test_tool.pyscript2.1 KB
flowsteps/tools/validate_harness/tool.pyscript3.0 KB
planning/upgrade.mdmarkdown16.2 KB
references/architecture.mdmarkdown28.1 KB
references/audit_complete.mdmarkdown739 B
references/builder-authoring.mdmarkdown9.8 KB
references/flow_generated.mdmarkdown1.2 KB
references/flowstep-development.mdmarkdown4.3 KB
references/harness-invocation.mdmarkdown2.9 KB
references/harness_validated.mdmarkdown786 B
references/master-prompts.mdmarkdown14.0 KB
references/milestone.mdmarkdown11.4 KB
references/output-lineage.mdmarkdown4.4 KB
references/runtime-packaging.mdmarkdown35.2 KB
references/server-delivery.mdmarkdown6.8 KB
references/skill_shipped.mdmarkdown798 B
references/tool-vs-intelligence.mdmarkdown10.0 KB
references/toolbox_ready.mdmarkdown612 B
requirements.txtmanifest150 B
scripts/audit_harness.pyscript80.7 KB
scripts/candidate_cache.pyscript27.6 KB
scripts/coordinate_workflow.pyscript4.3 KB
scripts/execution_identity.pyscript1.0 KB
scripts/flowchart_jpg.pyscript16.1 KB
scripts/flowstep_instruction.pyscript14.1 KB
scripts/flowstep_runtime.pyscript108.6 KB
scripts/flowstep_tools.pyscript5.7 KB
scripts/gem_text.pyscript5.7 KB
scripts/generate_harness.pyscript61.4 KB
scripts/humanize_chart.pyscript5.6 KB
scripts/humanize_chart_zh.pyscript5.2 KB
scripts/import_flow_v4.pyscript62.3 KB
scripts/m8m_build_steps.pyscript143.2 KB
scripts/m8m_cache.pyscript1.7 KB
scripts/m8m_delivery_common.pyscript3.8 KB
scripts/m8m_deploy.pyscript5.6 KB
scripts/m8m_factory.pyscript10.1 KB
scripts/m8m_flowchart.pyscript16.6 KB
scripts/m8m_local_bundle.pyscript4.5 KB
scripts/migrate_skill_source.pyscript34.2 KB
scripts/milestone_expectation.pyscript3.3 KB
scripts/milestone_pair.pyscript3.1 KB
scripts/package_archive.pyscript7.1 KB
scripts/project_imports.pyscript10.8 KB
scripts/run_flow.pyscript153.8 KB
scripts/run_goal.pyscript14.1 KB
scripts/run_m8m.pyscript3.8 KB
scripts/runtime_release.pyscript45.0 KB
scripts/schema_gate.pyscript5.6 KB
scripts/session_layout.pyscript74.4 KB
scripts/skill_source.pyscript65.3 KB
scripts/source_bundle.pyscript87.7 KB
scripts/teaching_contracts.pyscript8.9 KB
scripts/tool_vs_intelligence.pyscript9.3 KB
scripts/toolbox_plan.pyscript6.1 KB
scripts/validate_harness.pyscript24.1 KB
scripts/verify_platform_contract_parity.pyscript2.9 KB
seeds/branch_receipt/input.schema.jsonconfig1.0 KB
seeds/branch_receipt/output.schema.jsonconfig359 B
seeds/branch_receipt/tests/test_tool.pyscript2.0 KB
seeds/branch_receipt/tool.pyscript3.7 KB
seeds/cycle_receipt/input.schema.jsonconfig1.0 KB
seeds/cycle_receipt/output.schema.jsonconfig319 B
seeds/cycle_receipt/tests/test_tool.pyscript1.5 KB
seeds/cycle_receipt/tool.pyscript2.0 KB
seeds/hash_bind/input.schema.jsonconfig213 B
seeds/hash_bind/output.schema.jsonconfig288 B
seeds/hash_bind/tests/test_tool.pyscript814 B
seeds/hash_bind/tool.pyscript527 B
seeds/ledger_receipt/input.schema.jsonconfig278 B
seeds/ledger_receipt/output.schema.jsonconfig355 B
seeds/ledger_receipt/tests/test_tool.pyscript842 B
seeds/ledger_receipt/tool.pyscript747 B
seeds/ok_receipt/input.schema.jsonconfig280 B
seeds/ok_receipt/output.schema.jsonconfig280 B
seeds/ok_receipt/tests/test_tool.pyscript667 B
seeds/ok_receipt/tool.pyscript682 B
seeds/schema_validate/input.schema.jsonconfig265 B
seeds/schema_validate/output.schema.jsonconfig196 B
seeds/schema_validate/tests/test_tool.pyscript1.0 KB
seeds/schema_validate/tool.pyscript844 B
seeds/slot_write/input.schema.jsonconfig558 B
seeds/slot_write/output.schema.jsonconfig346 B
seeds/slot_write/tests/test_tool.pyscript1.2 KB
seeds/slot_write/tool.pyscript1015 B
tests/__init__.pyscript0 B
tests/support.pyscript668 B
tests/test_audit_harness.pyscript23.5 KB
tests/test_branch.pyscript14.4 KB
tests/test_builder3_templates.pyscript2.4 KB
tests/test_builder_install_integrity.pyscript30.6 KB
tests/test_builder_native_snapshot.pyscript5.0 KB
tests/test_builder_requirements.pyscript26.8 KB
tests/test_builder_self_dogfood.pyscript7.0 KB
tests/test_builder_self_source.pyscript10.3 KB

scripts/tool_vs_intelligence.py

View on GitHub
"""Tool-vs-intelligence table: schema, sample rows, and markdown."""

from __future__ import annotations

from typing import Any

from flowstep_runtime import local_tool_package_name

TABLE_SCHEMA = "tool_vs_intelligence_table_v1"
TOOL_TEST = "same input → same action; fixture-testable; receipt not opinion; junior can implement from schema"
INTEL_TEST = "fails at least one of the four tests; no fixture without a model"

EXAMPLE_ROWS: list[dict[str, str]] = [
    {
        "id": "fetch_record",
        "class": "tool",
        "test": "same id → same record",
        "why": "structured read; MCP/DB/HTTP GET",
        "destination": "flowsteps/tools/fetch_record/",
    },
    {
        "id": "crop_4x5",
        "class": "tool",
        "test": "fixture PNG in, transformed PNG out",
        "why": "pixel math; not a milestone",
        "destination": "flowsteps/tools/crop_4x5/",
    },
    {
        "id": "hash_bind",
        "class": "tool",
        "test": "same bytes → same sha256",
        "why": "optional checksum for an explicit request or external API contract",
        "destination": "flowsteps/tools/hash_bind/",
    },
    {
        "id": "schema_validate",
        "class": "tool",
        "test": "pass/fail from rules",
        "why": "JSON Schema gate",
        "destination": "flowsteps/tools/schema_validate/",
    },
    {
        "id": "render_html_shell",
        "class": "tool",
        "test": "fixture HTML → screenshot file",
        "why": "fixed viewport generator",
        "destination": "flowsteps/tools/render_html_shell/",
    },
    {
        "id": "materialize_package",
        "class": "tool",
        "test": "typed inputs → zip/manifest",
        "why": "assembly of already-valid receipts",
        "destination": "flowsteps/tools/materialize_package/",
    },
    {
        "id": "plan_frozen",
        "class": "intelligence",
        "test": "no fixture without a model",
        "why": "editorial plan is not a typed transform",
        "milestone": "plan_frozen",
    },
    {
        "id": "choose_lesson",
        "class": "intelligence",
        "test": "no fixture without a model",
        "why": "judgment among plausible alternatives",
        "milestone": "plan_frozen",
    },
    {
        "id": "image_generate",
        "class": "intelligence",
        "test": "model produces bytes",
        "why": "invention; runtime admits the declared image output",
        "milestone": "assets_bound",
    },
    {
        "id": "release_judge",
        "class": "intelligence",
        "test": "not a pixel measurement",
        "why": "taste / teaching quality; footer geometry stays a tool",
        "milestone": "release_packaged",
    },
]


def make_table(rows: list[dict[str, Any]], *, flow_id: str | None = None) -> dict[str, Any]:
    cleaned: list[dict[str, Any]] = []
    seen: set[str] = set()
    for row in rows:
        item_id = str(row.get("id") or "").strip()
        klass = row.get("class")
        if not item_id or klass not in {"tool", "intelligence"} or item_id in seen:
            continue
        seen.add(item_id)
        entry: dict[str, Any] = {
            "id": item_id,
            "class": klass,
            "test": str(row.get("test") or (TOOL_TEST if klass == "tool" else INTEL_TEST)),
            "why": str(row.get("why") or ("premade toolbox function" if klass == "tool" else "judgment the schema cannot compute")),
        }
        if row.get("milestone"):
            entry["milestone"] = str(row["milestone"])
        if row.get("destination"):
            entry["destination"] = str(row["destination"])
        elif klass == "tool":
            entry["destination"] = f"flowsteps/tools/{item_id}/"
        cleaned.append(entry)
    table: dict[str, Any] = {"schema": TABLE_SCHEMA, "rows": cleaned}
    if flow_id:
        table["flow_id"] = flow_id
    return table


def example_table() -> dict[str, Any]:
    return make_table(EXAMPLE_ROWS, flow_id="m8m_examples")


def doctrine_table() -> dict[str, Any]:
    return example_table()


def from_audit(audit: dict[str, Any]) -> dict[str, Any]:
    rows: list[dict[str, Any]] = []
    for item in audit.get("proposed_milestones") or []:
        mid = str(item.get("id") or "")
        intel = item.get("intelligence") or "none"
        if intel not in {None, "none"}:
            rows.append(
                {
                    "id": mid,
                    "class": "intelligence",
                    "test": INTEL_TEST,
                    "why": item.get("model_justification") or f"{intel} on milestone {mid}",
                    "milestone": mid,
                }
            )
        bindings = (
            (item.get("execution") or {}).get("tool_bindings") or []
            if isinstance(item.get("execution"), dict)
            else []
        )
        packages = (
            [
                local_tool_package_name(
                    str(binding.get("ref") or ""),
                    label=(
                        f"{mid}.execution.tool_bindings"
                        f"[{binding.get('tool')}].ref"
                    ),
                )
                for binding in bindings
                if isinstance(binding, dict) and binding.get("ref")
            ]
            if bindings
            else [str(tool_id) for tool_id in item.get("tools") or [] if tool_id]
        )
        for tool_id in packages:
            rows.append(
                {
                    "id": str(tool_id),
                    "class": "tool",
                    "test": TOOL_TEST,
                    "why": "listed toolbox function for this milestone",
                    "milestone": mid,
                    "destination": f"flowsteps/tools/{tool_id}/",
                }
            )
    for item in audit.get("python_standardization") or []:
        tool_id = str(item.get("tool_id") or "")
        if tool_id:
            rows.append(
                {
                    "id": tool_id,
                    "class": "tool",
                    "test": TOOL_TEST,
                    "why": item.get("reason") or "promote to project toolbox",
                    "destination": item.get("destination") or f"flowsteps/tools/{tool_id}/",
                }
            )
    flow_id = (audit.get("grade") or {}).get("flow_id") or (audit.get("audited_skill") or {}).get("name")
    table = make_table(rows, flow_id=str(flow_id) if flow_id else None)
    if not table["rows"]:
        table = make_table(
            [
                {
                    "id": "schema_validate",
                    "class": "tool",
                    "test": TOOL_TEST,
                    "why": "structural validation of declared outputs",
                    "destination": "flowsteps/tools/schema_validate/",
                }
            ],
            flow_id=str(flow_id) if flow_id else None,
        )
    return table


def from_flow(flow: dict[str, Any]) -> dict[str, Any]:
    rows: list[dict[str, Any]] = []
    for step in flow.get("steps") or []:
        mid = str(step.get("id") or "")
        intel = step.get("intelligence") or step.get("model") or "none"
        if intel not in {None, "none"}:
            rows.append(
                {
                    "id": mid,
                    "class": "intelligence",
                    "test": INTEL_TEST,
                    "why": step.get("model_justification") or f"{intel} on milestone {mid}",
                    "milestone": mid,
                }
            )
        bindings = (
            (step.get("execution") or {}).get("tool_bindings") or []
            if isinstance(step.get("execution"), dict)
            else []
        )
        packages = (
            [
                local_tool_package_name(
                    str(binding.get("ref") or ""),
                    label=(
                        f"{mid}.execution.tool_bindings"
                        f"[{binding.get('tool')}].ref"
                    ),
                )
                for binding in bindings
                if isinstance(binding, dict) and binding.get("ref")
            ]
            if bindings
            else [str(item) for item in step.get("tools") or [] if item]
        )
        for tool_id in packages:
            rows.append(
                {
                    "id": str(tool_id),
                    "class": "tool",
                    "test": TOOL_TEST,
                    "why": "listed toolbox function for this milestone",
                    "milestone": mid,
                    "destination": f"flowsteps/tools/{tool_id}/",
                }
            )
        if not packages and (intel in {None, "none"}):
            klass = "tool" if step.get("class") != "intelligence" else "intelligence"
            rows.append(
                {
                    "id": mid,
                    "class": klass,
                    "test": TOOL_TEST if klass == "tool" else INTEL_TEST,
                    "why": step.get("handler") or mid,
                    "milestone": mid,
                }
            )
    return make_table(rows, flow_id=str(flow.get("flow_id") or "") or None)


def render_markdown(table: dict[str, Any]) -> str:
    lines = [
        "| id | class | test | why |",
        "| --- | --- | --- | --- |",
    ]
    for row in table.get("rows") or []:
        lines.append(
            f"| `{row['id']}` | `{row['class']}` | {row['test']} | {row['why']} |"
        )
    if len(lines) == 2:
        lines.append("| (none) | | | |")
    return "\n".join(lines)
planning-and-task-breakdownaddyosmani/agent-skillsBreaks work into ordered tasks. Use when you have a spec or clear requirements and need to break work into implementable tasks. Use when a task feels too large to start, when you need to estimate scope, or when parallel work is possible.Stars: 119kUpdated Claude CodeCodexVerifiedInstall
screenpipethedotmack/claude-memSearch screen and audio history recorded by Screenpipe and optionally save selected context into claude-mem. Use when the user asks to recall desktop activity, a meeting, or something seen in another app through Screenpipe.Stars: 118kUpdated Claude CodeCodexVerifiedInstall
contact-widgetnexu-io/open-designSelf-contained floating chat widget with welcome screen, social links, meeting button, and message input. Single HTML file, zero dependencies.Stars: 108kUpdated Claude CodeCodexVerifiedInstall
meeting-notesnexu-io/open-designMeeting notes page — title bar with attendees, agenda checklist, decisions block, action items table with owners + dates, and a "next meeting" footer. Use when the brief mentions "meeting notes", "minutes", "1:1 notes", "all-hands recap", or "会议纪要".Stars: 108kUpdated Claude CodeCodexVerifiedInstall