Skip to content

code-yeongyu/oh-my-openagent / packages/shared-skills/skills/ulw-research

ulw-research

Unverified

Runs maximum-saturation research with a cooperating team, claim-graph gating, and a cited, QA'd deliverable. Use when the user explicitly asks for research or a deep investigation, including any 'ulw' research wording.

FileKindSize
AGENTS.mdmarkdown9.2 KB
ATTRIBUTION.mdmarkdown2.4 KB
SKILL.mdskill md42.2 KB
references/deliverable-phase.mdmarkdown49.1 KB
references/fact-ledger-grammar.mdmarkdown6.8 KB
references/fact-ledger.mdmarkdown24.4 KB
references/fidelity-claim-kinds.mdmarkdown5.2 KB
references/markdown-blocks.mdmarkdown721 B
references/report-gates.mdmarkdown32.0 KB
references/report-visualization.mdmarkdown15.4 KB
references/research-collection.mdmarkdown26.8 KB
references/research-delivery.mdmarkdown14.3 KB
references/unit-rules.mdmarkdown16.3 KB
scripts/claim-kinds.mjsscript11.2 KB
scripts/claim-kinds.test.tsscript13.5 KB
scripts/claim-prefix.test.tsscript4.9 KB
scripts/claims-index.mjsscript5.3 KB
scripts/claims-index.test.tsscript5.7 KB
scripts/cli-support.mjsscript4.1 KB
scripts/cli-support.test.tsscript4.3 KB
scripts/contracts-validation.test.tsscript3.3 KB
scripts/contracts.mjsscript26.1 KB
scripts/contracts.test.tsscript7.9 KB
scripts/conversion-altered.test.tsscript11.0 KB
scripts/conversion-originals.test.tsscript22.7 KB
scripts/conversion-probe-classes.test.tsscript45.2 KB
scripts/conversion-probe.mjsscript13.5 KB
scripts/conversion-probe.test.tsscript11.6 KB
scripts/copy-returns-fidelity-policy.test.tsscript10.4 KB
scripts/copy-returns-polish.test.tsscript12.1 KB
scripts/copy-returns.test.tsscript10.6 KB
scripts/css-hiding.mjsscript9.1 KB
scripts/css-lite.mjsscript7.6 KB
scripts/css-lite.test.tsscript6.4 KB
scripts/delivery-barrier-meaning.test.tsscript12.3 KB
scripts/delivery-barrier.test.tsscript11.4 KB
scripts/design-spec.mjsscript7.2 KB
scripts/design-spec.test.tsscript6.7 KB
scripts/entities.mjsscript2.5 KB
scripts/entry-guard.mjsscript794 B
scripts/fact-commands-fill.mjsscript6.6 KB
scripts/fact-commands-meaning.mjsscript12.6 KB
scripts/fact-commands-polish.mjsscript10.3 KB
scripts/fact-commands-verify.mjsscript12.6 KB
scripts/fact-commands.mjsscript13.8 KB
scripts/fact-derive-2.test.tsscript7.2 KB
scripts/fact-derive.mjsscript4.9 KB
scripts/fact-derive.test.tsscript10.8 KB
scripts/fact-expr.mjsscript4.5 KB
scripts/fact-fill.mjsscript11.7 KB
scripts/fact-fill.test.tsscript10.7 KB
scripts/fact-ledger-grammar.test.tsscript11.8 KB
scripts/fact-ledger-kinds.mjsscript16.5 KB
scripts/fact-ledger-kinds.test.tsscript9.3 KB
scripts/fact-ledger-legacy.test.tsscript8.9 KB
scripts/fact-ledger-schema.mjsscript11.9 KB
scripts/fact-ledger-schema.test.tsscript1.5 KB
scripts/fact-ledger.mjsscript5.5 KB
scripts/fact-ledger.test.tsscript9.7 KB
scripts/fact-locate.mjsscript12.1 KB
scripts/fact-locate.test.tsscript7.2 KB
scripts/fact-pairs.mjsscript8.3 KB
scripts/fact-pairs.test.tsscript6.6 KB
scripts/fact-recompute.mjsscript4.8 KB
scripts/fact-unit-dimensions-2.test.tsscript8.4 KB
scripts/fact-unit-dimensions.test.tsscript11.9 KB
scripts/fact-unit-rules.test.tsscript8.9 KB
scripts/fidelity-binding.mjsscript6.7 KB
scripts/fidelity-binding.test.tsscript4.0 KB
scripts/fidelity-brief.mjsscript6.4 KB
scripts/fidelity-brief.test.tsscript7.8 KB
scripts/fidelity-claims.mjsscript5.1 KB
scripts/fidelity-csv.mjsscript1.1 KB
scripts/fidelity-lexicon.mjsscript8.1 KB
scripts/fidelity-lexicon.test.tsscript6.0 KB
scripts/fidelity-originals.mjsscript9.9 KB
scripts/fidelity-policy.mjsscript10.1 KB
scripts/fidelity-records.mjsscript13.4 KB
scripts/fidelity-snapshot-readability.mjsscript2.2 KB
scripts/fidelity-sources.mjsscript4.3 KB
scripts/fidelity-state.mjsscript2.1 KB
scripts/fidelity-state.test.tsscript1.7 KB
scripts/fidelity-trace.mjsscript6.1 KB
scripts/fidelity-trace.test.tsscript3.3 KB
scripts/fidelity-value-unit.mjsscript13.3 KB
scripts/fidelity-values.mjsscript16.1 KB
scripts/fidelity-values.test.tsscript15.8 KB
scripts/format-extract-css.mjsscript5.1 KB
scripts/format-extract.mjsscript10.3 KB
scripts/format-extract.test.tsscript11.2 KB
scripts/gates-context.test.tsscript2.6 KB
scripts/gates-fidelity.mjsscript6.3 KB
scripts/gates-fidelity.test.tsscript3.3 KB
scripts/gates-figures.mjsscript9.9 KB
scripts/gates-layout.mjsscript6.6 KB
scripts/gates-layout.test.tsscript12.4 KB
scripts/gates-static-headings.test.tsscript961 B
scripts/gates-static.mjsscript8.1 KB
scripts/gates-static.test.tsscript14.9 KB
scripts/gates-structure.mjsscript4.7 KB
scripts/gates-text.mjsscript7.2 KB
scripts/glossary-vocabulary.test.tsscript1.7 KB
scripts/html-foreign-object.mjsscript2.8 KB
scripts/html-lite.mjsscript9.7 KB
scripts/html-lite.test.tsscript7.9 KB
scripts/html-markup.mjsscript7.0 KB
scripts/html-text-map.mjsscript4.8 KB
scripts/html-text-map.test.tsscript15.2 KB
scripts/layout-probe.mjsscript4.6 KB
scripts/layout-probe.test.tsscript4.2 KB
scripts/lexicon.mjsscript2.6 KB
scripts/lexicon.test.tsscript3.2 KB
scripts/markdown-closers.mjsscript4.9 KB
scripts/md-lite-boundaries.test.tsscript2.2 KB
scripts/md-lite.mjsscript7.8 KB
scripts/md-lite.test.tsscript10.3 KB
scripts/meaning-check.mjsscript9.7 KB
scripts/meaning-check.test.tsscript12.0 KB
scripts/number-grammar.mjsscript2.1 KB
scripts/number-grammar.test.tsscript1.8 KB
scripts/numerals.mjsscript12.0 KB
scripts/numerals.test.tsscript6.1 KB
scripts/outcome-start.mjsscript3.8 KB
scripts/outcome-start.test.tsscript5.0 KB
scripts/outcome.mjsscript10.5 KB
scripts/outcome.test.tsscript12.8 KB
scripts/page-source-locator.test.tsscript11.7 KB
scripts/particles-ko.mjsscript4.8 KB
scripts/particles-ko.test.tsscript4.3 KB
scripts/placeholder.mjsscript9.3 KB
scripts/placeholder.test.tsscript3.8 KB
scripts/polish-apply.mjsscript6.8 KB
scripts/polish-apply.test.tsscript19.7 KB
scripts/polish-diff.mjsscript1.7 KB
scripts/polish-diff.test.tsscript10.1 KB
scripts/polish-markup.test.tsscript14.0 KB
scripts/polish-partial.test.tsscript2.5 KB
scripts/polish-project.mjsscript5.8 KB
scripts/polish-rules.mjsscript9.8 KB
scripts/rational.mjsscript5.2 KB
scripts/rational.test.tsscript1.9 KB
scripts/raw-decode.mjsscript4.5 KB
scripts/raw-locator.mjsscript2.4 KB
scripts/raw-snapshot.test.tsscript7.3 KB
scripts/references-fences.test.tsscript1.2 KB
scripts/repair-tracker.mjsscript7.5 KB
scripts/repair-tracker.test.tsscript10.8 KB
scripts/report-tools-2.test.tsscript16.1 KB
scripts/report-tools-3.test.tsscript9.3 KB
scripts/report-tools-4.test.tsscript10.1 KB
scripts/report-tools-5.test.tsscript14.6 KB
scripts/report-tools-commands.mjsscript12.9 KB
scripts/report-tools.mjsscript2.6 KB
scripts/report-tools.test.tsscript12.1 KB
scripts/sentence-split.mjsscript3.0 KB
scripts/sentence-split.test.tsscript4.5 KB
scripts/snapshot-readability.test.tsscript7.0 KB
scripts/source-commands.mjsscript12.4 KB
scripts/source-integrity.test.tsscript18.1 KB
scripts/source-refresh.mjsscript5.2 KB
scripts/source-snapshot.mjsscript9.9 KB
scripts/source-snapshot.test.tsscript6.3 KB
scripts/source-view.mjsscript5.0 KB
scripts/sources-citation.mjsscript12.1 KB
scripts/sources-citation.test.tsscript14.8 KB
scripts/tests/contracts-support.tsscript3.5 KB
scripts/tests/delivery-barrier-session.tsscript3.3 KB
scripts/tests/derive-clock.tsscript341 B
scripts/tests/fact-derive-support.tsscript1.9 KB
scripts/tests/fact-unit-dimensions-support.tsscript1.5 KB
scripts/tests/fact-unit-rules-support.tsscript16.8 KB
scripts/tests/fidelity-values-support.tsscript1.6 KB
scripts/tests/fixtures/assets/figure-1.svgother141 B
scripts/tests/fixtures/bad-report.htmlother2.1 KB
scripts/tests/fixtures/boxes.jsonconfig3.2 KB
scripts/tests/fixtures/conversion-probe.htmlother485 B
scripts/tests/fixtures/design-spec.mdmarkdown458 B
scripts/tests/fixtures/fidelity-brief-locked.mdmarkdown571 B
scripts/tests/fixtures/fidelity-brief-pending.mdmarkdown574 B
scripts/tests/fixtures/fidelity/assets/share.csvother40 B
scripts/tests/fixtures/fidelity/claim-graph.mdmarkdown449 B
scripts/tests/fixtures/fidelity/gen-legacy-dev.mjsscript5.0 KB
scripts/tests/fixtures/fidelity/ledger-basic.jsonconfig5.1 KB
scripts/tests/fixtures/fidelity/ledger-legacy-dev.jsonconfig18.3 KB
scripts/tests/fixtures/fidelity/ledger-verify.jsonconfig9.1 KB
scripts/tests/fixtures/fidelity/polish-edits.jsonconfig303 B
scripts/tests/fixtures/fidelity/report-bad.htmlother821 B
scripts/tests/fixtures/fidelity/report-good.htmlother2.4 KB
scripts/tests/fixtures/fidelity/sources/S4.htmlother680 B
scripts/tests/fixtures/fidelity/sources/S4/acronyms.jsonconfig36 B
scripts/tests/fixtures/fidelity/sources/S4/meta.jsonconfig256 B
scripts/tests/fixtures/fidelity/sources/S4/sentences.jsonlother623 B
scripts/tests/fixtures/fidelity/sources/S4/text.txtmarkdown300 B
scripts/tests/fixtures/fidelity/sources/S5/acronyms.jsonconfig3 B
scripts/tests/fixtures/fidelity/sources/S5/meta.jsonconfig235 B
scripts/tests/fixtures/fidelity/sources/S5/sentences.jsonlother53 B
scripts/tests/fixtures/fidelity/sources/S5/text.txtmarkdown10 B
scripts/tests/fixtures/fidelity/sources/S9.txtmarkdown128 B
scripts/tests/fixtures/good-report.htmlother2.7 KB
scripts/tests/fixtures/reference-report.htmlother2.5 KB

scripts/repair-tracker.test.ts

View on GitHub
import { describe, expect, test } from "bun:test"

import { REPAIR_DEFAULTS, validateRepairState } from "./contracts.mjs"
import {
  RepairTrackerError,
  createTracker,
  decide,
  deserializeState,
  isArtifactOk,
  serializeState,
} from "./repair-tracker.mjs"

const START = "2026-09-24T00:00:00.000Z"
const MINUTE = 60 * 1000
const OK = { artifactOk: true }

function at(minutes: number): string {
  return new Date(Date.parse(START) + minutes * MINUTE).toISOString()
}

function defects(...codes: string[]) {
  return codes.map((code) => ({ code, message: `${code} found` }))
}

type Step = { codes: string[]; minutes?: number }

function runSequence(options: Record<string, unknown>, steps: Step[], extra: Record<string, unknown> = OK) {
  let state = createTracker({ startedAt: START, ...options })
  const decisions = []
  for (const [index, step] of steps.entries()) {
    const result = decide(state, defects(...step.codes), at(step.minutes ?? index), extra)
    state = result.state
    decisions.push(result.decision)
  }
  return { state, decisions }
}

describe("createTracker", () => {
  test("#given no budget #when a tracker is created #then it uses REPAIR_DEFAULTS and validates", () => {
    const state = createTracker({ startedAt: START })

    expect(state.budget).toEqual({ ...REPAIR_DEFAULTS })
    expect(state.attempts).toEqual([])
    expect(state.consecutiveNonProgress).toBe(0)
    expect(validateRepairState(state)).toEqual({ ok: true, errors: [] })
  })

  test("#given no startedAt #when a tracker is created #then it throws instead of reading the clock", () => {
    // @ts-expect-error startedAt is deliberately omitted to prove the runtime guard
    expect(() => createTracker({})).toThrow(RepairTrackerError)
  })

  test("#given an empty integrityCodes list #when a blocker remains at stop #then the integrity code is still blocking", () => {
    const { decisions } = runSequence({ maxAttempts: 1, integrityCodes: [] }, [
      { codes: ["missing_citation_section"] },
      { codes: ["missing_citation_section", "heading_generic"] },
    ])

    expect(decisions[1]).toMatchObject({ action: "block", reason: "blocking" })
  })

  test("#given an extra integrity code #when it remains at stop #then delivery is blocked on it", () => {
    const { decisions } = runSequence({ maxAttempts: 1, integrityCodes: ["em_dash_in_prose"] }, [
      { codes: ["em_dash_in_prose"] },
      { codes: ["em_dash_in_prose", "heading_generic"] },
    ])

    expect(decisions[1].action).toBe("block")
    expect(decisions[1].blocking.map((d: { code: string }) => d.code)).toEqual(["em_dash_in_prose"])
  })

  test("#given an unknown integrity code #when a tracker is created #then it throws a typed error", () => {
    expect(() => createTracker({ startedAt: START, integrityCodes: ["not_a_code"] })).toThrow(RepairTrackerError)
  })
})

describe("decide stop conditions", () => {
  test("#given plateauLimit 2 #when the measure stops improving twice #then the fourth decide stops with plateau", () => {
    // [0,3,1] -> [0,2,1] -> [0,2,1] -> [0,2,1], every signature distinct
    const { decisions, state } = runSequence({ maxAttempts: 5, plateauLimit: 2 }, [
      { codes: ["emoji_in_prose", "em_dash_in_prose", "unsourced_number", "heading_generic"] },
      { codes: ["chart_without_figure", "chart_svg_no_text", "heading_too_long"] },
      { codes: ["korean_no_keep_all", "korean_serif_font", "palette_off_token"] },
      { codes: ["layout_overflow", "layout_text_clipped", "en_dash_in_prose"] },
    ])

    expect(decisions.slice(0, 3).map((d) => d.action)).toEqual(["repair", "repair", "repair"])
    expect(decisions[3]).toMatchObject({ action: "deliver", reason: "plateau" })
    expect(decisions[3].residual.map((d: { code: string }) => d.code)).toEqual([
      "layout_overflow",
      "layout_text_clipped",
      "en_dash_in_prose",
    ])
    expect(state.consecutiveNonProgress).toBe(2)
  })

  test("#given the literal blocker plateau sequence #when it stops #then the integrity codes block delivery", () => {
    // [2,1,0] -> [1,1,0] -> [1,1,0] -> [1,1,0]
    const { decisions } = runSequence({ maxAttempts: 5, plateauLimit: 2 }, [
      { codes: ["missing_citation_section", "missing_closing_section", "emoji_in_prose"] },
      { codes: ["missing_citation_section", "em_dash_in_prose"] },
      { codes: ["missing_closing_section", "unsourced_number"] },
      { codes: ["broken_asset_reference", "layout_overflow"] },
    ])

    expect(decisions.slice(0, 3).map((d) => d.action)).toEqual(["repair", "repair", "repair"])
    expect(decisions[3]).toMatchObject({ action: "block", reason: "blocking" })
    expect(decisions[3].blocking.map((d: { code: string }) => d.code)).toEqual(["broken_asset_reference"])
  })

  test("#given signatures A, B, A #when the third decide runs #then it stops with oscillation", () => {
    const { decisions } = runSequence({ maxAttempts: 5 }, [
      { codes: ["emoji_in_prose", "heading_generic"] },
      { codes: ["unsourced_number"] },
      { codes: ["heading_generic", "emoji_in_prose"] },
    ])

    expect(decisions.map((d) => d.action)).toEqual(["repair", "repair", "deliver"])
    expect(decisions[2].reason).toBe("oscillation")
  })

  test("#given oscillation and plateau both hold #when decided #then oscillation wins by precedence", () => {
    const { decisions } = runSequence({ maxAttempts: 5, plateauLimit: 1 }, [
      { codes: ["unsourced_number"] },
      { codes: ["unsourced_number"] },
    ])

    expect(decisions[1]).toMatchObject({ action: "deliver", reason: "oscillation" })
  })

  test("#given maxAttempts 3 and improving measures #when the fourth decide runs #then it stops with max_attempts", () => {
    // [0,3,0] -> [0,2,0] -> [0,1,0] -> [0,1,0], every signature distinct
    const { decisions } = runSequence({ maxAttempts: 3 }, [
      { codes: ["emoji_in_prose", "em_dash_in_prose", "unsourced_number"] },
      { codes: ["chart_without_figure", "chart_svg_no_text"] },
      { codes: ["korean_serif_font"] },
      { codes: ["layout_text_clipped"] },
    ])

    expect(decisions.slice(0, 3).map((d) => d.action)).toEqual(["repair", "repair", "repair"])
    expect(decisions[3]).toMatchObject({ action: "deliver", reason: "max_attempts" })
  })

  test("#given the literal blocker max_attempts sequence #when the fourth decide runs #then it blocks", () => {
    // [3,0,0] -> [2,0,0] -> [1,0,0] -> [1,0,0]
    const { decisions } = runSequence({ maxAttempts: 3 }, [
      { codes: ["missing_citation_section", "missing_closing_section", "broken_asset_reference"] },
      { codes: ["missing_citation_section", "missing_required_section"] },
      { codes: ["missing_closing_section"] },
      { codes: ["missing_citation_section"] },
    ])

    expect(decisions.slice(0, 3).map((d) => d.action)).toEqual(["repair", "repair", "repair"])
    expect(decisions[3]).toMatchObject({ action: "block", reason: "blocking" })
  })

  test("#given wallClockMs 900000 and improving measures #when now is start + 15 min #then it stops with wall_clock", () => {
    const { decisions } = runSequence({ maxAttempts: 5, wallClockMs: 900000 }, [
      { codes: ["emoji_in_prose", "em_dash_in_prose"], minutes: 0 },
      { codes: ["unsourced_number"], minutes: 7 },
      { codes: ["heading_generic"], minutes: 15 },
    ])

    expect(decisions.map((d) => d.action)).toEqual(["repair", "repair", "deliver"])
    expect(decisions[2].reason).toBe("wall_clock")
  })

  test("#given an integrity code and no stop condition #when decided #then it schedules a repair", () => {
    const { decisions } = runSequence({}, [{ codes: ["missing_citation_section"] }])

    expect(decisions[0]).toMatchObject({ action: "repair", reason: null })
    expect(decisions[0].blocking.map((d: { code: string }) => d.code)).toEqual(["missing_citation_section"])
  })

  test("#given a stop without a usable artifact #when decided #then it blocks with the stop reason", () => {
    const { decisions } = runSequence(
      { maxAttempts: 1 },
      [{ codes: ["emoji_in_prose"] }, { codes: ["heading_generic"] }],
      {
        artifactOk: false,
      },
    )

    expect(decisions[1]).toMatchObject({ action: "block", reason: "max_attempts", blocking: [] })
  })

  test("#given zero defects #when decided #then it delivers clean", () => {
    const { decisions } = runSequence({ maxAttempts: 1 }, [{ codes: ["emoji_in_prose"] }, { codes: [] }], {
      artifactOk: false,
    })

    expect(decisions[1]).toEqual({ action: "deliver", reason: "clean", residual: [], blocking: [] })
  })

  test("#given a defect with an unknown code #when decided #then it throws a typed error", () => {
    const state = createTracker({ startedAt: START })
    let caught: unknown
    try {
      decide(state, [{ code: "made_up_code", message: "x" }], at(1), OK)
    } catch (error) {
      caught = error
    }

    expect(caught).toBeInstanceOf(RepairTrackerError)
    expect((caught as RepairTrackerError).code).toBe("unknown_defect_code")
  })

  test("#given an invalid now #when decided #then it throws a typed error", () => {
    const state = createTracker({ startedAt: START })

    expect(() => decide(state, [], "not a date", OK)).toThrow(RepairTrackerError)
  })

  test("#given a state #when decided #then the input state is not mutated", () => {
    const state = createTracker({ startedAt: START })
    const before = serializeState(state)
    decide(state, defects("emoji_in_prose"), at(1), OK)

    expect(serializeState(state)).toBe(before)
  })
})

describe("isArtifactOk", () => {
  test("#given bytes and renders #when checked #then it needs at least 512 bytes and one render", () => {
    expect(isArtifactOk({ bytes: 512, renders: 1 })).toBe(true)
    expect(isArtifactOk({ bytes: 511, renders: 1 })).toBe(false)
    expect(isArtifactOk({ bytes: 4096, renders: 0 })).toBe(false)
  })
})

describe("serializeState / deserializeState", () => {
  test("#given a state after several decides #when round-tripped #then the bytes are identical and valid", () => {
    const { state } = runSequence({ maxAttempts: 5 }, [{ codes: ["emoji_in_prose"] }, { codes: ["heading_generic"] }])
    const text = serializeState(state)
    const restored = deserializeState(text)

    expect(serializeState(restored)).toBe(text)
    expect(validateRepairState(restored)).toEqual({ ok: true, errors: [] })
  })

  test("#given a restored state #when decide continues #then it keeps the attempt history", () => {
    const { state } = runSequence({ maxAttempts: 5 }, [{ codes: ["emoji_in_prose"] }, { codes: ["heading_generic"] }])
    const { decision } = decide(deserializeState(serializeState(state)), defects("emoji_in_prose"), at(3), OK)

    expect(decision.reason).toBe("oscillation")
  })

  test("#given an invalid state file #when deserialized #then it throws a typed error", () => {
    expect(() => deserializeState('{"schemaVersion":1}')).toThrow(RepairTrackerError)
    expect(() => deserializeState("not json")).toThrow(RepairTrackerError)
  })
})
finishing-a-development-branchobra/superpowersUse when implementation is complete, all tests pass, and you need to decide how to integrate the workStars: 322kUpdated Claude CodeCodexVerifiedInstall
systematic-debuggingobra/superpowersUse when encountering any bug, test failure, or unexpected behavior, before proposing fixesStars: 322kUpdated Claude CodeCodexVerifiedInstall
test-driven-developmentobra/superpowersUse when implementing any feature or bugfix, before writing implementation codeStars: 322kUpdated Claude CodeCodexVerifiedInstall
skill-creatoranthropics/skillsCreate new skills, modify and improve existing skills, and measure skill performance. Use when users want to create a skill from scratch, edit, or optimize an existing skill, run evals to test a skill, benchmark skill performance with variance analysis, or optimize a skill's description for better triggering accuracy.Stars: 198kUpdated Claude CodeCodexVerifiedInstall