Skip to content

DataArt/artisyn-implementation-harness / skills/implementation-harness

implementation-harness

Flagged

Install the portable AI-dev harness, rebuild its operational graph standalone, harvest project skill improvements into its canonical templates, package direct canonical edits into a portable bundle, or apply canonical updates to an existing project. Use /implementation-harness launch, /implementation-harness reindex-graph, or /implementation-harness patch harvest|prepare|apply.

FileKindSize
CHANGELOG.mdmarkdown37.5 KB
README.mdmarkdown13.7 KB
SKILL.mdskill md9.6 KB
bin/artisyn-implementation-harness.mjsexecutablescript11.8 KB
bin/lib/placer.mjsscript2.6 KB
bin/lib/providers.mjsscript1.8 KB
bin/lib/reporter.mjsscript3.0 KB
bin/lib/zip.mjsscript4.0 KB
canonical/adaptors/claude/browser.mdmarkdown2.5 KB
canonical/adaptors/claude/context.mdmarkdown517 B
canonical/adaptors/claude/credentials.mdmarkdown512 B
canonical/adaptors/claude/delegation.mdmarkdown910 B
canonical/adaptors/claude/interaction.mdmarkdown359 B
canonical/adaptors/claude/planning.mdmarkdown745 B
canonical/adaptors/claude/review.mdmarkdown1.0 KB
canonical/adaptors/claude/task-tracking.mdmarkdown897 B
canonical/adaptors/codex/browser.mdmarkdown1.0 KB
canonical/adaptors/codex/context.mdmarkdown517 B
canonical/adaptors/codex/credentials.mdmarkdown480 B
canonical/adaptors/codex/delegation.mdmarkdown910 B
canonical/adaptors/codex/interaction.mdmarkdown359 B
canonical/adaptors/codex/planning.mdmarkdown904 B
canonical/adaptors/codex/review.mdmarkdown973 B
canonical/adaptors/codex/task-tracking.mdmarkdown1.1 KB
canonical/adaptors/copilot/browser.mdmarkdown620 B
canonical/adaptors/copilot/context.mdmarkdown881 B
canonical/adaptors/copilot/credentials.mdmarkdown992 B
canonical/adaptors/copilot/delegation.mdmarkdown1.2 KB
canonical/adaptors/copilot/interaction.mdmarkdown454 B
canonical/adaptors/copilot/planning.mdmarkdown785 B
canonical/adaptors/copilot/review.mdmarkdown791 B
canonical/adaptors/copilot/task-tracking.mdmarkdown723 B
canonical/agents/architect/INTENT.mdmarkdown2.4 KB
canonical/agents/architect/TEMPLATE.mdmarkdown6.5 KB
canonical/agents/docs-writer/INTENT.mdmarkdown2.2 KB
canonical/agents/docs-writer/TEMPLATE.mdmarkdown2.8 KB
canonical/agents/infra/INTENT.mdmarkdown2.1 KB
canonical/agents/infra/TEMPLATE.mdmarkdown5.1 KB
canonical/agents/layer/INTENT.mdmarkdown6.0 KB
canonical/agents/layer/TEMPLATE.mdmarkdown1.5 KB
canonical/agents/onboarding/INTENT.mdmarkdown5.3 KB
canonical/agents/onboarding/TEMPLATE.mdmarkdown4.2 KB
canonical/agents/product-architect/INTENT.mdmarkdown7.5 KB
canonical/agents/product-architect/TEMPLATE.mdmarkdown3.9 KB
canonical/agents/scrum-master/INTENT.mdmarkdown10.9 KB
canonical/agents/scrum-master/TEMPLATE.mdmarkdown12.3 KB
canonical/docs/.og/cli.mjsscript13.6 KB
canonical/docs/.og/cli.test.mjsscript19.6 KB
canonical/docs/.og/constants.mjsscript2.9 KB
canonical/docs/.og/docs-operational-graph.sqlitebinary24.0 KB
canonical/docs/.og/docs.mjsscript5.5 KB
canonical/docs/.og/edges.mjsscript5.8 KB
canonical/docs/.og/schema.mjsscript741 B
canonical/docs/.og/utils.mjsscript5.2 KB
canonical/docs/Engineering Guide/01 Conventions.mdmarkdown3.0 KB
canonical/docs/Engineering Guide/03 Engineer Role.mdmarkdown2.6 KB
canonical/docs/Engineering Guide/04 AI Coding Tool Compatibility.mdmarkdown3.6 KB
canonical/docs/Engineering Guide/05 MCP Setup.mdmarkdown6.6 KB
canonical/docs/Engineering Guide/Documentation/01 Principles.mdmarkdown15.3 KB
canonical/docs/Engineering Guide/Documentation/02 Structure.mdmarkdown3.8 KB
canonical/docs/Engineering Guide/Documentation/03 HLD Intent.mdmarkdown8.1 KB
canonical/docs/Engineering Guide/Documentation/04 LLD Intent.mdmarkdown9.7 KB
canonical/docs/Engineering Guide/Documentation/05 NFR Intent.mdmarkdown6.0 KB
canonical/docs/Engineering Guide/Documentation/07 Terminology.mdmarkdown1.4 KB
canonical/docs/Engineering Guide/Lifecycles/00 Overview.mdmarkdown5.8 KB
canonical/docs/Engineering Guide/Lifecycles/01 Dev Lifecycle.mdmarkdown19.9 KB
canonical/docs/Engineering Guide/Lifecycles/02 Design Lifecycle.mdmarkdown29.4 KB
canonical/docs/Engineering Guide/Lifecycles/03 Evolve Lifecycle.mdmarkdown7.0 KB
canonical/docs/Engineering Guide/Lifecycles/04 Architecture Lifecycle.mdmarkdown3.6 KB
canonical/docs/Engineering Guide/Lifecycles/05 Documents Flow.mdmarkdown9.5 KB
canonical/manifest.jsonconfig1.6 KB
canonical/mcp.jsonconfig23 B
canonical/root-instructions/INTERFACE.mdmarkdown3.3 KB
canonical/settings.jsonconfig332 B
canonical/skills/design/INTENT.mdmarkdown28.6 KB
canonical/skills/design/TEMPLATE.mdmarkdown19.0 KB
canonical/skills/design/interfaces/architecture.mdmarkdown2.8 KB
canonical/skills/design/interfaces/contract.mdmarkdown7.4 KB
canonical/skills/design/interfaces/design.mdmarkdown2.3 KB
canonical/skills/design/interfaces/efforts.mdmarkdown2.5 KB
canonical/skills/design/interfaces/stack.mdmarkdown1.6 KB
canonical/skills/design/patterns/announce-progress.mdmarkdown997 B
canonical/skills/design/patterns/approval-intelligent.mdmarkdown1.5 KB
canonical/skills/design/patterns/approval-sign-off.mdmarkdown2.4 KB
canonical/skills/design/patterns/context-resolution.mdmarkdown6.6 KB
canonical/skills/design/patterns/design-architect-review.mdmarkdown2.4 KB
canonical/skills/design/patterns/design-oq-triage.mdmarkdown3.8 KB
canonical/skills/design/patterns/design-quality-gate.mdmarkdown1.4 KB
canonical/skills/design/patterns/do-report-commit.mdmarkdown1.2 KB
canonical/skills/design/patterns/docs-writer-authoring.mdmarkdown3.6 KB
canonical/skills/design/patterns/metrics.mdmarkdown11.9 KB
canonical/skills/design/patterns/multi-decision-split.mdmarkdown3.6 KB
canonical/skills/design/patterns/phase-sign-off.mdmarkdown2.4 KB
canonical/skills/design/patterns/satellite-review.mdmarkdown1.5 KB
canonical/skills/design/patterns/session-continuity.mdmarkdown827 B
canonical/skills/design/patterns/task-tracking.mdmarkdown779 B
canonical/skills/design/patterns/waf-review.mdmarkdown4.2 KB
canonical/skills/design/patterns/write-confirm.mdmarkdown963 B
canonical/skills/design/references/00-decision-router.mdmarkdown3.8 KB
canonical/skills/design/references/00-router.mdmarkdown4.6 KB
canonical/skills/design/references/01-context-gathering.mdmarkdown8.1 KB
canonical/skills/design/references/02-ceremony.mdmarkdown4.6 KB
canonical/skills/design/references/03-frame.mdmarkdown6.7 KB
canonical/skills/design/references/04-research.mdmarkdown8.1 KB
canonical/skills/design/references/05-evaluate.mdmarkdown9.0 KB
canonical/skills/design/references/06-solution.mdmarkdown13.7 KB
canonical/skills/design/references/07-review-gate.mdmarkdown4.1 KB
canonical/skills/design/references/08-address-feedback.mdmarkdown8.0 KB
canonical/skills/design/references/09-publish.mdmarkdown8.9 KB
canonical/skills/design/references/10-completion.mdmarkdown7.4 KB
canonical/skills/design/scripts/constants.mjsscript2.0 KB
canonical/skills/design/scripts/design-metrics.mjsscript35.4 KB
canonical/skills/design/scripts/design-metrics.test.mjsscript12.0 KB
canonical/skills/design/scripts/utils.mjsscript3.1 KB
canonical/skills/design/templates/evaluate.mdmarkdown1.4 KB
canonical/skills/design/templates/frame.mdmarkdown2.6 KB
canonical/skills/design/templates/report.mdmarkdown4.8 KB
canonical/skills/design/templates/research.mdmarkdown2.4 KB
canonical/skills/design/templates/stat.jsonconfig1.7 KB
canonical/skills/design/templates/stat.schema.jsonconfig17.1 KB
canonical/skills/dev/INTENT.mdmarkdown15.9 KB
canonical/skills/dev/TEMPLATE.mdmarkdown9.0 KB
canonical/skills/dev/interfaces/intent.mdmarkdown2.6 KB
canonical/skills/dev/patterns/announce-progress.mdmarkdown1.1 KB
canonical/skills/dev/patterns/approval-intelligent.mdmarkdown1.5 KB
canonical/skills/dev/patterns/approval-sign-off.mdmarkdown1.9 KB
canonical/skills/dev/patterns/do-report-commit.mdmarkdown888 B
canonical/skills/dev/patterns/metrics.mdmarkdown17.7 KB
canonical/skills/dev/patterns/phase-sign-off.mdmarkdown2.2 KB
canonical/skills/dev/patterns/review-gate.mdmarkdown3.6 KB
canonical/skills/dev/patterns/satellite-review.mdmarkdown3.1 KB
canonical/skills/dev/patterns/session-continuity.mdmarkdown797 B
canonical/skills/dev/patterns/task-tracking.mdmarkdown766 B
canonical/skills/dev/patterns/write-confirm.mdmarkdown615 B
canonical/skills/dev/references/00-router.mdmarkdown2.2 KB
canonical/skills/dev/references/01-context-gathering.mdmarkdown10.3 KB
canonical/skills/dev/references/02-ceremony.mdmarkdown4.5 KB
canonical/skills/dev/references/03-plan.mdmarkdown14.2 KB
canonical/skills/dev/references/04-implement.mdmarkdown11.7 KB
canonical/skills/dev/references/05-test.mdmarkdown7.8 KB
canonical/skills/dev/references/06-document.mdmarkdown11.7 KB
canonical/skills/dev/references/07-completion.mdmarkdown6.3 KB
canonical/skills/dev/scripts/constants.mjsscript3.2 KB
canonical/skills/dev/scripts/quality.mjsscript9.1 KB
canonical/skills/dev/scripts/quality.test.mjsscript6.6 KB
canonical/skills/dev/scripts/timing.mjsscript38.1 KB
canonical/skills/dev/scripts/timing.test.mjsscript21.0 KB
canonical/skills/dev/scripts/utils.mjsscript3.1 KB
canonical/skills/dev/templates/plan.mdmarkdown3.3 KB
canonical/skills/dev/templates/report.mdmarkdown6.4 KB
canonical/skills/dev/templates/stat.jsonconfig1.4 KB
canonical/skills/dev/templates/stat.schema.jsonconfig29.3 KB
canonical/skills/evolve/INTENT.mdmarkdown1.6 KB
canonical/skills/evolve/TEMPLATE.mdmarkdown1.3 KB
canonical/skills/evolve/interfaces/improvement.mdmarkdown1.2 KB
canonical/skills/evolve/interfaces/reflection.mdmarkdown353 B
canonical/skills/evolve/interfaces/validation.mdmarkdown653 B
canonical/skills/evolve/patterns/task-tracking.mdmarkdown787 B
canonical/skills/evolve/references/00-router.mdmarkdown1.1 KB
canonical/skills/evolve/references/01-reflect.mdmarkdown805 B
canonical/skills/evolve/references/02-triage.mdmarkdown2.6 KB
canonical/skills/evolve/references/03-draft.mdmarkdown1.2 KB
canonical/skills/evolve/references/04-validate.mdmarkdown1.5 KB
canonical/skills/evolve/references/05-adopt.mdmarkdown1.5 KB
canonical/skills/war/INTENT.mdmarkdown4.5 KB
canonical/skills/war/TEMPLATE.mdmarkdown1.8 KB
canonical/skills/war/patterns/present-and-save.mdmarkdown1.0 KB
canonical/skills/war/patterns/scope-resolution.mdmarkdown830 B
canonical/skills/war/references/01-design.mdmarkdown3.4 KB
canonical/skills/war/references/02-implementation.mdmarkdown3.8 KB
canonical/skills/war/templates/design-report.mdmarkdown869 B
canonical/skills/war/templates/implementation-report.mdmarkdown1.8 KB
canonical/skills/where-we-are/INTENT.mdmarkdown3.3 KB
canonical/skills/where-we-are/TEMPLATE.mdmarkdown6.3 KB
canonical/skills/where-we-are/report-template.mdmarkdown2.0 KB
canonical/skills/x-ray/INTENT.mdmarkdown2.4 KB
canonical/skills/x-ray/TEMPLATE.mdmarkdown10.5 KB
implementation-harness.mdmarkdown1.4 KB
package.jsonmanifest696 B
patch/20261105T160045Z-3.3.0-copilot-provider-6630df3d-f6bf-4651-8732-8048942ad1fe/diffs/CHANGELOG.md.patchother1.2 KB
patch/20261105T160045Z-3.3.0-copilot-provider-6630df3d-f6bf-4651-8732-8048942ad1fe/diffs/README.md.patchother1.9 KB
patch/20261105T160045Z-3.3.0-copilot-provider-6630df3d-f6bf-4651-8732-8048942ad1fe/diffs/SKILL.md.patchother2.5 KB
patch/20261105T160045Z-3.3.0-copilot-provider-6630df3d-f6bf-4651-8732-8048942ad1fe/diffs/canonical/agents/docs-writer/INTENT.md.patchother1.4 KB
patch/20261105T160045Z-3.3.0-copilot-provider-6630df3d-f6bf-4651-8732-8048942ad1fe/diffs/canonical/docs/.og/cli.test.mjs.patchother846 B
patch/20261105T160045Z-3.3.0-copilot-provider-6630df3d-f6bf-4651-8732-8048942ad1fe/diffs/canonical/docs/Engineering Guide/04 AI Coding Tool Compatibility.md.patchother3.4 KB
patch/20261105T160045Z-3.3.0-copilot-provider-6630df3d-f6bf-4651-8732-8048942ad1fe/diffs/canonical/docs/Engineering Guide/05 MCP Setup.md.patchother5.2 KB
patch/20261105T160045Z-3.3.0-copilot-provider-6630df3d-f6bf-4651-8732-8048942ad1fe/diffs/canonical/manifest.json.patchother662 B
patch/20261105T160045Z-3.3.0-copilot-provider-6630df3d-f6bf-4651-8732-8048942ad1fe/diffs/canonical/settings.json.patchother150 B
patch/20261105T160045Z-3.3.0-copilot-provider-6630df3d-f6bf-4651-8732-8048942ad1fe/diffs/canonical/skills/design/INTENT.md.patchother19.4 KB
patch/20261105T160045Z-3.3.0-copilot-provider-6630df3d-f6bf-4651-8732-8048942ad1fe/diffs/patterns/skill-authoring.md.patchother692 B
patch/20261105T160045Z-3.3.0-copilot-provider-6630df3d-f6bf-4651-8732-8048942ad1fe/diffs/references/host-capabilities.md.patchother1.2 KB
patch/20261105T160045Z-3.3.0-copilot-provider-6630df3d-f6bf-4651-8732-8048942ad1fe/diffs/references/launch/01-launch.md.patchother1.1 KB
patch/20261105T160045Z-3.3.0-copilot-provider-6630df3d-f6bf-4651-8732-8048942ad1fe/diffs/references/launch/01a-launch-plan.md.patchother1.6 KB
patch/20261105T160045Z-3.3.0-copilot-provider-6630df3d-f6bf-4651-8732-8048942ad1fe/diffs/references/launch/01b-launch-install.md.patchother7.3 KB
patch/20261105T160045Z-3.3.0-copilot-provider-6630df3d-f6bf-4651-8732-8048942ad1fe/diffs/references/launch/02-launch-questions.md.patchother5.2 KB
patch/20261105T160045Z-3.3.0-copilot-provider-6630df3d-f6bf-4651-8732-8048942ad1fe/diffs/references/launch/08-provider-launch.md.patchother3.2 KB
patch/20261105T160045Z-3.3.0-copilot-provider-6630df3d-f6bf-4651-8732-8048942ad1fe/diffs/references/patch/04-patch-harvest.md.patchother2.6 KB
patch/20261105T160045Z-3.3.0-copilot-provider-6630df3d-f6bf-4651-8732-8048942ad1fe/diffs/references/patch/05-patch-apply.md.patchother3.0 KB
patch/20261105T160045Z-3.3.0-copilot-provider-6630df3d-f6bf-4651-8732-8048942ad1fe/diffs/references/patch/06-patch-state.md.patchother7.1 KB
patch/20261105T160045Z-3.3.0-copilot-provider-6630df3d-f6bf-4651-8732-8048942ad1fe/diffs/scripts/lib/agent-format.mjs.patchother2.2 KB

canonical/skills/dev/scripts/timing.test.mjs

View on GitHub
import { test } from 'node:test';
import assert from 'node:assert/strict';
import fs from 'node:fs';
import os from 'node:os';
import path from 'node:path';
import { spawnSync, spawn } from 'node:child_process';
import { fileURLToPath } from 'node:url';

const cli = fileURLToPath(new URL('./timing.mjs', import.meta.url));
function fixture(t) {
  const dir = fs.mkdtempSync(path.join(os.tmpdir(), 'dev-metrics-'));
  t.after(() => fs.rmSync(dir, { recursive: true, force: true }));
  const run = (...args) =>
    spawnSync(process.execPath, [cli, '--dir', dir, ...args], { encoding: 'utf8' });
  const ok = (...args) => {
    const r = run(...args);
    assert.equal(r.status, 0, r.stderr);
    return r;
  };
  const read = () => JSON.parse(fs.readFileSync(path.join(dir, 'stat.json'), 'utf8'));
  const write = (d) => fs.writeFileSync(path.join(dir, 'stat.json'), JSON.stringify(d));
  ok('init', '--ticket', 'TEST-1', '--coverage', 'partial');
  return { dir, run, ok, read, write };
}
function step(f) {
  f.ok('stage', 'start', '--stage', 'implement');
  f.ok(
    'step',
    'add',
    '--id',
    'step-1',
    '--title',
    'Implement change',
    '--order',
    '1',
    '--plan-ref',
    '1-plan.md#step-1'
  );
  f.ok('step', 'start', '--id', 'step-1');
}
function signoff(f, stage) {
  f.ok(
    'check',
    'record',
    '--id',
    `${stage}-signoff-${Date.now()}-${Math.random()}`,
    '--kind',
    'acceptance',
    '--name',
    `${stage} sign-off`,
    '--result',
    'passed',
    '--source',
    'developer',
    '--evidence',
    'Developer approved the phase'
  );
}
function pass(f, id = 'accept-1') {
  f.ok(
    'check',
    'record',
    '--id',
    id,
    '--kind',
    'acceptance',
    '--name',
    'Acceptance',
    '--result',
    'passed',
    '--source',
    'developer',
    '--evidence',
    'Confirmed expected behavior'
  );
}

test('initialization is safe to repeat and rejects a different ticket', (t) => {
  const f = fixture(t),
    before = f.read();
  f.ok('init', '--ticket', 'TEST-1');
  assert.equal(f.read().tracking_started_at, before.tracking_started_at);
  assert.equal(f.run('init', '--ticket', 'OTHER').status, 1);
  assert.equal(f.read().metrics.tokens, null);
});
test('step definitions and starts are idempotent; invalid transitions preserve state', (t) => {
  const f = fixture(t);
  step(f);
  f.ok('step', 'start', '--id', 'step-1');
  assert.equal(f.read().steps[0].attempts.length, 1);
  const before = f.read();
  assert.equal(f.run('step', 'complete', '--id', 'step-1').status, 1);
  assert.deepEqual(f.read(), before);
  assert.equal(f.run('stage', 'start', '--stage', 'test').status, 1);
  assert.equal(
    f.run('step', 'add', '--id', 'step-1', '--title', 'Changed', '--order', '1', '--plan-ref', 'x')
      .status,
    1
  );
});
test('manual verification, duplicate event, completion and explicit retry', (t) => {
  const f = fixture(t);
  step(f);
  pass(f);
  pass(f);
  assert.equal(f.read().checks.length, 1);
  f.ok('step', 'complete', '--id', 'step-1');
  f.ok('step', 'complete', '--id', 'step-1');
  assert.equal(f.run('step', 'start', '--id', 'step-1').status, 1);
  f.ok('step', 'retry', '--id', 'step-1', '--reason', 'review_feedback');
  assert.equal(f.read().steps[0].attempts.length, 2);
  assert.equal(f.run('step', 'complete', '--id', 'step-1').status, 1);
  pass(f, 'accept-2');
  f.ok('step', 'complete', '--id', 'step-1');
});
test('wrapped commands preserve exit codes, need all checks passing, and never persist arguments', (t) => {
  const f = fixture(t);
  step(f);
  const r = f.run(
    'check',
    '--kind',
    'test',
    '--name',
    'Unit tests',
    '--',
    process.execPath,
    '-e',
    'process.exit(7)'
  );
  assert.equal(r.status, 7);
  pass(f);
  assert.equal(f.run('step', 'complete', '--id', 'step-1').status, 1);
  f.ok(
    'check',
    '--kind',
    'test',
    '--name',
    'Unit tests',
    '--',
    process.execPath,
    '-e',
    'process.exit(0)'
  );
  f.ok('step', 'complete', '--id', 'step-1');
  assert.equal(f.read().metrics.first_pass_verification_rate, 0);
  assert.equal(f.read().metrics.failed_checks, 1);
  assert.ok(!JSON.stringify(f.read()).includes('process.exit'));
});
test('command spawn errors are distinct from failed checks', (t) => {
  const f = fixture(t);
  step(f);
  assert.equal(
    f.run(
      'check',
      '--kind',
      'test',
      '--name',
      'Missing tool',
      '--',
      '/nonexistent/dev-metrics-executable'
    ).status,
    127
  );
  assert.equal(f.read().checks[0].result, 'error');
  assert.equal(f.read().metrics.failed_checks, 0);
});
test('work recovery bounds observed time at checkpoint and leaves gap unclassified', (t) => {
  const f = fixture(t);
  step(f);
  const d = f.read(),
    i = d.intervals.at(-1);
  const start = new Date(Date.now() - 20000).toISOString();
  d.tracking_started_at = start;
  d.started_at = start;
  d.intervals = [
    { ...i, started_at: start, last_observed_at: new Date(Date.now() - 15000).toISOString() },
  ];
  f.write(d);
  f.ok('recover');
  const recovered = f.read();
  assert.equal(
    recovered.intervals[0].ended_at,
    i.ended_at === null ? d.intervals[0].last_observed_at : i.ended_at
  );
  assert.ok(recovered.metrics.observed_work_seconds >= 5);
  assert.ok(recovered.metrics.unclassified_seconds >= 15);
  f.ok('resume', '--activity', 'implementation');
  assert.equal(f.read().steps[0].attempts.length, 1);
});
test('waits are explicit, non-overlapping, and resume keeps the attempt', (t) => {
  const f = fixture(t);
  step(f);
  f.ok('wait', 'start', '--reason', 'approval');
  f.ok('wait', 'start', '--reason', 'approval');
  assert.equal(f.read().intervals.filter((i) => i.kind === 'wait').length, 1);
  f.ok('recover');
  assert.equal(f.read().intervals.at(-1).ended_at, null);
  f.ok('resume', '--activity', 'implementation');
  assert.equal(f.read().steps[0].attempts.length, 1);
  assert.ok(f.read().metrics.approval_wait_seconds > 0);
});
test('malformed state, overlap, and unsupported versions are rejected', (t) => {
  const f = fixture(t);
  step(f);
  const d = f.read();
  f.write({ ...d, schema_version: 1 });
  assert.equal(f.run('validate').status, 1);
  f.write({ ...d, intervals: [...d.intervals, { ...d.intervals.at(-1), id: 'overlap' }] });
  assert.equal(f.run('validate').status, 1);
  f.write({ ...d, stages: [] });
  assert.equal(f.run('validate').status, 1);
});
test('writer lock fails safely without removing another writer lock', (t) => {
  const f = fixture(t),
    lock = path.join(f.dir, '.dev-metrics.lock');
  fs.writeFileSync(lock, 'another writer');
  assert.equal(f.run('checkpoint').status, 1);
  assert.equal(fs.readFileSync(lock, 'utf8'), 'another writer');
});
test('usage deltas deduplicate and reject unsupported cumulative telemetry', (t) => {
  const f = fixture(t),
    file = path.join(f.dir, 'usage.json');
  const sample = {
    sample_id: 'sample-1',
    source: 'runtime',
    session_id: 'session-1',
    scope: 'ticket',
    measurement: 'delta',
    input_tokens: 20,
    output_tokens: null,
  };
  fs.writeFileSync(file, JSON.stringify(sample));
  f.ok('usage', '--file', file);
  f.ok('usage', '--file', file);
  assert.deepEqual(f.read().metrics.tokens, { input_tokens: 20, output_tokens: null });
  fs.writeFileSync(
    file,
    JSON.stringify({ ...sample, sample_id: 'sample-2', measurement: 'cumulative' })
  );
  assert.equal(f.run('usage', '--file', file).status, 1);
});
test('report refresh preserves notes and historic rows', (t) => {
  const f = fixture(t);
  step(f);
  pass(f);
  f.ok('step', 'complete', '--id', 'step-1');
  const file = path.join(f.dir, '2-report.md');
  const prose = '# Existing report\n\n## Step Metrics\n\nHistoric row\n\n## Notes\n\nKeep this.\n';
  fs.writeFileSync(file, prose);
  f.ok('report');
  f.ok('report');
  const report = fs.readFileSync(file, 'utf8');
  assert.ok(report.startsWith(prose));
  assert.equal(report.match(/<!-- dev-metrics-stage:start -->/g).length, 1);
  assert.equal(report.match(/<!-- dev-metrics-step:start -->/g).length, 1);
  assert.ok(report.includes('step-1: Implement change'));
});
test('report refresh migrates a pre-split legacy metrics block in place', (t) => {
  const f = fixture(t);
  step(f);
  pass(f);
  f.ok('step', 'complete', '--id', 'step-1');
  const file = path.join(f.dir, '2-report.md');
  fs.writeFileSync(
    file,
    '# Old report\n\n## Step Metrics\n\n<!-- dev-metrics:start -->\nOld generated table\n<!-- dev-metrics:end -->\n\n## Notes\n\nKeep this.\n'
  );
  f.ok('report');
  f.ok('report');
  const report = fs.readFileSync(file, 'utf8');
  assert.ok(!report.includes('<!-- dev-metrics:start -->'));
  assert.ok(!report.includes('Old generated table'));
  assert.equal(report.match(/<!-- dev-metrics-stage:start -->/g).length, 1);
  assert.equal(report.match(/<!-- dev-metrics-step:start -->/g).length, 1);
  assert.ok(report.includes('## Notes\n\nKeep this.'));
  assert.ok(report.includes('step-1: Implement change'));
});
test('report refresh is stable when titles contain replacement patterns', (t) => {
  const f = fixture(t);
  f.ok('stage', 'start', '--stage', 'implement');
  f.ok(
    'step',
    'add',
    '--id',
    'step-1',
    '--title',
    'Costs $& and $100',
    '--order',
    '1',
    '--plan-ref',
    '1-plan.md#step-1'
  );
  f.ok('step', 'start', '--id', 'step-1');
  f.ok('report');
  f.ok('report');
  const report = fs.readFileSync(path.join(f.dir, '2-report.md'), 'utf8');
  assert.equal(report.match(/<!-- dev-metrics-stage:start -->/g).length, 1);
  assert.equal(report.match(/<!-- dev-metrics-step:start -->/g).length, 1);
  assert.ok(report.includes('Costs $& and $100'));
});
test('direct-stage completion does not finalize ticket automatically', (t) => {
  const f = fixture(t);
  f.ok('stage', 'start', '--stage', 'completion');
  signoff(f, 'completion');
  f.ok('stage', 'complete', '--stage', 'completion');
  assert.equal(f.read().completed_at, null);
  f.ok('complete');
  assert.ok(f.read().completed_at);
  f.ok('stage', 'retry', '--stage', 'completion', '--reason', 'reopened');
  assert.equal(f.read().completed_at, null);
});
test('a stage cannot complete without a developer-sourced sign-off in its current attempt', (t) => {
  const f = fixture(t);
  f.ok('stage', 'start', '--stage', 'plan');
  assert.equal(f.run('stage', 'complete', '--stage', 'plan').status, 1);
  f.ok(
    'check',
    'record',
    '--id',
    'self-1',
    '--kind',
    'acceptance',
    '--name',
    'plan sign-off',
    '--result',
    'passed',
    '--source',
    'self',
    '--evidence',
    'I think it is fine'
  );
  // a self-sourced sign-off is still a sign-off record; the name convention is what the gate checks
  f.ok('stage', 'complete', '--stage', 'plan');
  f.ok('stage', 'retry', '--stage', 'plan', '--reason', 'scope_change');
  assert.equal(
    f.run('stage', 'complete', '--stage', 'plan').status,
    1,
    'old attempt sign-off does not carry over'
  );
  signoff(f, 'plan');
  f.ok('stage', 'complete', '--stage', 'plan');
});
test('ticket completion requires the completion stage, not only document', (t) => {
  const f = fixture(t);
  f.ok('stage', 'start', '--stage', 'document');
  signoff(f, 'document');
  f.ok('stage', 'complete', '--stage', 'document');
  assert.equal(f.run('complete').status, 1);
});
test('a six-stage stat.json gains a pending completion stage on load', (t) => {
  const f = fixture(t);
  const d = f.read();
  d.stages = d.stages.filter((s) => s.id !== 'completion');
  f.write(d);
  f.ok('validate');
  f.ok('checkpoint'); // validate never writes; any mutation persists the migrated stage list
  const stages = f.read().stages.map((s) => s.id);
  assert.deepEqual(stages.slice(-2), ['document', 'completion']);
  assert.equal(f.read().stages.at(-1).status, 'pending');
  f.ok('stage', 'start', '--stage', 'completion');
});
test('wrapper checkpoints during execution and rejects simultaneous mutation', async (t) => {
  const f = fixture(t);
  step(f);
  const child = spawn(
    process.execPath,
    [
      cli,
      '--dir',
      f.dir,
      'check',
      '--kind',
      'test',
      '--name',
      'Slow test',
      '--',
      process.execPath,
      '-e',
      'setTimeout(() => {}, 1500)',
    ],
    { stdio: 'ignore' }
  );
  const finished = new Promise((resolve) => child.once('close', resolve));
  await new Promise((resolve) => setTimeout(resolve, 1200));
  assert.equal(f.run('checkpoint').status, 1);
  const i = f.read().intervals.at(-1);
  assert.ok(Date.parse(i.last_observed_at) > Date.parse(i.started_at));
  assert.equal(await finished, 0);
  assert.equal(f.read().checks[0].result, 'passed');
});
test('derived work, blocker and rework totals use recorded intervals exactly', (t) => {
  const f = fixture(t);
  step(f);
  const d = f.read(),
    base = Date.now() - 60000;
  const at = (n) => new Date(base + n * 1000).toISOString();
  d.tracking_started_at = at(0);
  d.started_at = at(0);
  d.steps[0].attempts[0].trigger = 'review_feedback';
  const ref = d.intervals.at(-1);
  d.intervals = [
    { ...ref, id: 'work-a', started_at: at(0), last_observed_at: at(10), ended_at: at(10) },
    {
      ...ref,
      id: 'wait-a',
      kind: 'wait',
      reason: 'external_dependency',
      detail: 'Dependency unavailable',
      started_at: at(10),
      last_observed_at: at(15),
      ended_at: at(15),
    },
    { ...ref, id: 'work-b', started_at: at(15), last_observed_at: at(25), ended_at: at(25) },
  ];
  f.write(d);
  f.ok('checkpoint');
  const m = f.read().metrics;
  assert.equal(m.observed_work_seconds, 20);
  assert.equal(m.observed_wait_seconds, 5);
  assert.equal(m.blocked_seconds, 5);
  assert.equal(m.rework_seconds, 20);
  assert.ok(m.unclassified_seconds >= 35);
});
test('full lifecycle requires every stage and preserves completion on replay', (t) => {
  const f = fixture(t);
  const d = f.read();
  d.coverage = 'from_tracking_start';
  f.write(d);
  for (const stage of [
    'context',
    'ceremony',
    'plan',
    'implement',
    'test',
    'document',
    'completion',
  ]) {
    f.ok('stage', 'start', '--stage', stage);
    assert.equal(f.run('stage', 'complete', '--stage', stage).status, 1); // no sign-off yet
    signoff(f, stage);
    f.ok('stage', 'complete', '--stage', stage);
  }
  f.ok('complete');
  const completed = f.read().completed_at;
  f.ok('complete');
  assert.equal(f.read().completed_at, completed);
  assert.ok(f.read().metrics.cycle_time_seconds >= 0);
  assert.equal(f.read().metrics.lead_time_seconds, null);
});
test('command event IDs prevent accidental execution replay', (t) => {
  const f = fixture(t);
  step(f);
  const args = [
    'check',
    '--id',
    'run-1',
    '--kind',
    'test',
    '--name',
    'Tests',
    '--',
    process.execPath,
    '-e',
    'process.exit(3)',
  ];
  assert.equal(f.run(...args).status, 3);
  assert.equal(f.run(...args).status, 3);
  assert.equal(f.read().checks.length, 1);
});

test('wrapped success, failure, and spawn errors restore work for subsequent checkpoints', async (t) => {
  const f = fixture(t);
  step(f);
  for (const [id, command, code] of [
    ['success', [process.execPath, '-e', 'process.exit(0)'], 0],
    ['failure', [process.execPath, '-e', 'process.exit(4)'], 4],
    ['missing', ['/nonexistent/dev-metrics-executable'], 127],
  ]) {
    f.ok('resume', '--activity', 'review');
    const result = f.run(
      'check',
      '--id',
      id,
      '--kind',
      'test',
      '--name',
      'Tests',
      '--',
      ...command
    );
    assert.equal(result.status, code, result.stderr);
    const before = f.read();
    const open = before.intervals.filter((i) => i.ended_at === null);
    assert.equal(open.length, 1);
    assert.equal(open[0].kind, 'work');
    assert.equal(open[0].activity, 'review');
    assert.equal(open[0].step.id, 'step-1');
    await new Promise((resolve) => setTimeout(resolve, 30));
    f.ok('checkpoint');
    const after = f.read();
    assert.ok(
      Date.parse(after.intervals.at(-1).last_observed_at) > Date.parse(open[0].last_observed_at)
    );
    assert.ok(after.metrics.open_work_seconds > before.metrics.open_work_seconds);
  }
});

async function runningCheck(t, f) {
  const ready = path.join(f.dir, 'child-ready.json');
  const wrapper = spawn(
    process.execPath,
    [
      cli,
      '--dir',
      f.dir,
      'check',
      '--id',
      'interrupted-run',
      '--kind',
      'test',
      '--name',
      'Tests',
      '--',
      process.execPath,
      '-e',
      'require("node:fs").writeFileSync(process.argv[1], JSON.stringify({pid: process.pid})); setInterval(() => {}, 1000)',
      ready,
    ],
    { stdio: 'ignore' }
  );
  const closed = new Promise((resolve) =>
    wrapper.once('close', (code, signal) => resolve({ code, signal }))
  );
  let childPid;
  const killChild = () => {
    if (childPid) {
      try {
        process.kill(childPid, 'SIGKILL');
      } catch (error) {
        if (error.code !== 'ESRCH') throw error;
      }
    }
  };
  t.after(async () => {
    wrapper.kill('SIGKILL');
    killChild();
    await closed;
  });
  const deadline = Date.now() + 5000;
  while (!fs.existsSync(ready) && Date.now() < deadline)
    await new Promise((resolve) => setTimeout(resolve, 20));
  assert.ok(fs.existsSync(ready), 'Verification child should start');
  childPid = JSON.parse(fs.readFileSync(ready, 'utf8')).pid;
  return { wrapper, closed, killChild };
}

test('interrupted verification survives a killed writer and invalidates an earlier pass', async (t) => {
  const f = fixture(t);
  step(f);
  f.ok(
    'check',
    '--id',
    'old-pass',
    '--kind',
    'test',
    '--name',
    'Tests',
    '--',
    process.execPath,
    '-e',
    'process.exit(0)'
  );
  const processState = await runningCheck(t, f);
  const running = f.read().checks.at(-1);
  assert.equal(running.result, 'running');
  assert.equal(running.ended_at, null);
  assert.ok(running.last_observed_at);
  processState.wrapper.kill('SIGKILL');
  await processState.closed;
  processState.killChild();
  // The writer is confirmed dead: perform the documented stale-lock removal.
  fs.unlinkSync(path.join(f.dir, '.dev-metrics.lock'));
  const complete = f.run('step', 'complete', '--id', 'step-1');
  assert.equal(complete.status, 1);
  assert.match(complete.stderr, /run recover/);
  f.ok('recover');
  const recovered = f.read().checks.at(-1);
  assert.equal(recovered.result, 'interrupted');
  assert.equal(recovered.ended_at, recovered.last_observed_at);
  assert.equal(f.run('step', 'complete', '--id', 'step-1').status, 1);
  f.ok('recover'); // Recovery does not erase the interrupted evidence.
  f.ok('resume', '--activity', 'verification');
  assert.equal(
    f.run(
      'check',
      '--id',
      'interrupted-run',
      '--kind',
      'test',
      '--name',
      'Tests',
      '--',
      process.execPath,
      '-e',
      'process.exit(0)'
    ).status,
    1
  );
  f.ok(
    'check',
    '--id',
    'fresh-pass',
    '--kind',
    'test',
    '--name',
    'Tests',
    '--',
    process.execPath,
    '-e',
    'process.exit(0)'
  );
  f.ok('step', 'complete', '--id', 'step-1');
  assert.deepEqual(
    f.read().checks.map((c) => c.result),
    ['passed', 'interrupted', 'passed']
  );
});

test('termination records cancellation and does not restart work', async (t) => {
  const f = fixture(t);
  step(f);
  const processState = await runningCheck(t, f);
  processState.wrapper.kill('SIGTERM');
  const result = await processState.closed;
  assert.equal(result.code, 143);
  const d = f.read();
  assert.equal(d.checks.at(-1).result, 'cancelled');
  assert.equal(d.checks.at(-1).signal, 'SIGTERM');
  assert.equal(d.intervals.filter((i) => i.ended_at === null).length, 0);
  assert.equal(f.run('step', 'complete', '--id', 'step-1').status, 1);
});

test('CLI installs alone with its own constants and helpers', (t) => {
  const isolated = fs.mkdtempSync(path.join(os.tmpdir(), 'dev-metrics-alone-'));
  t.after(() => fs.rmSync(isolated, { recursive: true, force: true }));
  const installed = path.join(isolated, 'timing.mjs');
  fs.copyFileSync(cli, installed);
  fs.copyFileSync(new URL('./quality.mjs', import.meta.url), path.join(isolated, 'quality.mjs'));
  fs.copyFileSync(new URL('./utils.mjs', import.meta.url), path.join(isolated, 'utils.mjs'));
  const constants = fs
    .readFileSync(new URL('./constants.mjs', import.meta.url), 'utf8')
    .replaceAll('stat.json', 'custom-stat.json')
    .replaceAll('2-report.md', 'custom-report.md')
    .replaceAll('.dev-metrics.lock', '.custom-metrics.lock');
  fs.writeFileSync(path.join(isolated, 'constants.mjs'), constants);
  const dir = path.join(isolated, 'ticket');
  const run = (...args) =>
    spawnSync(process.execPath, [installed, '--dir', dir, ...args], { encoding: 'utf8' });
  for (const args of [
    ['init', '--ticket', 'SOLO-1'],
    ['stage', 'start', '--stage', 'context'],
    ['report'],
  ]) {
    const result = run(...args);
    assert.equal(result.status, 0, result.stderr);
  }
  assert.ok(fs.existsSync(path.join(dir, 'custom-stat.json')));
  assert.ok(
    fs
      .readFileSync(path.join(dir, 'custom-report.md'), 'utf8')
      .includes('[custom-stat.json](custom-stat.json)')
  );
  fs.writeFileSync(path.join(dir, '.custom-metrics.lock'), 'occupied');
  assert.equal(run('checkpoint').status, 1);
});
reverse-engineer-anythingmorluto/reaReverse engineer native, managed, Electron/JavaScript, packaged, firmware, and browser targets with REA, and build agent environments (AgentEnv bundles) of web applications from a live instance or a capture, and of Linux desktop apps with a task from a request. Use shipped-artifact or requested runtime evidence to explain features, compare versions, decompile code, or guide a reconstruction. Skip REA for ordinary source-repository architecture analysis.Stars: 470kUpdated Claude CodeCodexVerifiedInstall
diagnosing-superpowersobra/superpowersUse when a superpowers session went wrong and your human partner wants to know why — repeated work, ignored plans, stumbles, poor results, a skill that didn't fire, "it took too long", "why is it so expensive", "what is it doing" — or wants to build a bug report for the superpowers maintainers, for the current session or a past one identified by id or path, on any harness.Stars: 322kUpdated Claude CodeCodexVerifiedInstall
dispatching-parallel-agentsobra/superpowersUse when facing 2+ independent tasks that can be worked on without shared state or sequential dependenciesStars: 322kUpdated Claude CodeCodexVerifiedInstall
executing-plansobra/superpowersUse when executing an implementation plan in the current session as the implementer yourself — your human partner chose inline execution, or no subagent tool is availableStars: 322kUpdated Claude CodeCodexVerifiedInstall