Skip to content

code-yeongyu/oh-my-openagent / packages/shared-skills/skills/ulw-research

ulw-research

Unverified

Runs maximum-saturation research with a cooperating team, claim-graph gating, and a cited, QA'd deliverable. Use when the user explicitly asks for research or a deep investigation, including any 'ulw' research wording.

FileKindSize
AGENTS.mdmarkdown9.2 KB
ATTRIBUTION.mdmarkdown2.4 KB
SKILL.mdskill md42.2 KB
references/deliverable-phase.mdmarkdown49.1 KB
references/fact-ledger-grammar.mdmarkdown6.8 KB
references/fact-ledger.mdmarkdown24.4 KB
references/fidelity-claim-kinds.mdmarkdown5.2 KB
references/markdown-blocks.mdmarkdown721 B
references/report-gates.mdmarkdown32.0 KB
references/report-visualization.mdmarkdown15.4 KB
references/research-collection.mdmarkdown26.8 KB
references/research-delivery.mdmarkdown14.3 KB
references/unit-rules.mdmarkdown16.3 KB
scripts/claim-kinds.mjsscript11.2 KB
scripts/claim-kinds.test.tsscript13.5 KB
scripts/claim-prefix.test.tsscript4.9 KB
scripts/claims-index.mjsscript5.3 KB
scripts/claims-index.test.tsscript5.7 KB
scripts/cli-support.mjsscript4.1 KB
scripts/cli-support.test.tsscript4.3 KB
scripts/contracts-validation.test.tsscript3.3 KB
scripts/contracts.mjsscript26.1 KB
scripts/contracts.test.tsscript7.9 KB
scripts/conversion-altered.test.tsscript11.0 KB
scripts/conversion-originals.test.tsscript22.7 KB
scripts/conversion-probe-classes.test.tsscript45.2 KB
scripts/conversion-probe.mjsscript13.5 KB
scripts/conversion-probe.test.tsscript11.6 KB
scripts/copy-returns-fidelity-policy.test.tsscript10.4 KB
scripts/copy-returns-polish.test.tsscript12.1 KB
scripts/copy-returns.test.tsscript10.6 KB
scripts/css-hiding.mjsscript9.1 KB
scripts/css-lite.mjsscript7.6 KB
scripts/css-lite.test.tsscript6.4 KB
scripts/delivery-barrier-meaning.test.tsscript12.3 KB
scripts/delivery-barrier.test.tsscript11.4 KB
scripts/design-spec.mjsscript7.2 KB
scripts/design-spec.test.tsscript6.7 KB
scripts/entities.mjsscript2.5 KB
scripts/entry-guard.mjsscript794 B
scripts/fact-commands-fill.mjsscript6.6 KB
scripts/fact-commands-meaning.mjsscript12.6 KB
scripts/fact-commands-polish.mjsscript10.3 KB
scripts/fact-commands-verify.mjsscript12.6 KB
scripts/fact-commands.mjsscript13.8 KB
scripts/fact-derive-2.test.tsscript7.2 KB
scripts/fact-derive.mjsscript4.9 KB
scripts/fact-derive.test.tsscript10.8 KB
scripts/fact-expr.mjsscript4.5 KB
scripts/fact-fill.mjsscript11.7 KB
scripts/fact-fill.test.tsscript10.7 KB
scripts/fact-ledger-grammar.test.tsscript11.8 KB
scripts/fact-ledger-kinds.mjsscript16.5 KB
scripts/fact-ledger-kinds.test.tsscript9.3 KB
scripts/fact-ledger-legacy.test.tsscript8.9 KB
scripts/fact-ledger-schema.mjsscript11.9 KB
scripts/fact-ledger-schema.test.tsscript1.5 KB
scripts/fact-ledger.mjsscript5.5 KB
scripts/fact-ledger.test.tsscript9.7 KB
scripts/fact-locate.mjsscript12.1 KB
scripts/fact-locate.test.tsscript7.2 KB
scripts/fact-pairs.mjsscript8.3 KB
scripts/fact-pairs.test.tsscript6.6 KB
scripts/fact-recompute.mjsscript4.8 KB
scripts/fact-unit-dimensions-2.test.tsscript8.4 KB
scripts/fact-unit-dimensions.test.tsscript11.9 KB
scripts/fact-unit-rules.test.tsscript8.9 KB
scripts/fidelity-binding.mjsscript6.7 KB
scripts/fidelity-binding.test.tsscript4.0 KB
scripts/fidelity-brief.mjsscript6.4 KB
scripts/fidelity-brief.test.tsscript7.8 KB
scripts/fidelity-claims.mjsscript5.1 KB
scripts/fidelity-csv.mjsscript1.1 KB
scripts/fidelity-lexicon.mjsscript8.1 KB
scripts/fidelity-lexicon.test.tsscript6.0 KB
scripts/fidelity-originals.mjsscript9.9 KB
scripts/fidelity-policy.mjsscript10.1 KB
scripts/fidelity-records.mjsscript13.4 KB
scripts/fidelity-snapshot-readability.mjsscript2.2 KB
scripts/fidelity-sources.mjsscript4.3 KB
scripts/fidelity-state.mjsscript2.1 KB
scripts/fidelity-state.test.tsscript1.7 KB
scripts/fidelity-trace.mjsscript6.1 KB
scripts/fidelity-trace.test.tsscript3.3 KB
scripts/fidelity-value-unit.mjsscript13.3 KB
scripts/fidelity-values.mjsscript16.1 KB
scripts/fidelity-values.test.tsscript15.8 KB
scripts/format-extract-css.mjsscript5.1 KB
scripts/format-extract.mjsscript10.3 KB
scripts/format-extract.test.tsscript11.2 KB
scripts/gates-context.test.tsscript2.6 KB
scripts/gates-fidelity.mjsscript6.3 KB
scripts/gates-fidelity.test.tsscript3.3 KB
scripts/gates-figures.mjsscript9.9 KB
scripts/gates-layout.mjsscript6.6 KB
scripts/gates-layout.test.tsscript12.4 KB
scripts/gates-static-headings.test.tsscript961 B
scripts/gates-static.mjsscript8.1 KB
scripts/gates-static.test.tsscript14.9 KB
scripts/gates-structure.mjsscript4.7 KB
scripts/gates-text.mjsscript7.2 KB
scripts/glossary-vocabulary.test.tsscript1.7 KB
scripts/html-foreign-object.mjsscript2.8 KB
scripts/html-lite.mjsscript9.7 KB
scripts/html-lite.test.tsscript7.9 KB
scripts/html-markup.mjsscript7.0 KB
scripts/html-text-map.mjsscript4.8 KB
scripts/html-text-map.test.tsscript15.2 KB
scripts/layout-probe.mjsscript4.6 KB
scripts/layout-probe.test.tsscript4.2 KB
scripts/lexicon.mjsscript2.6 KB
scripts/lexicon.test.tsscript3.2 KB
scripts/markdown-closers.mjsscript4.9 KB
scripts/md-lite-boundaries.test.tsscript2.2 KB
scripts/md-lite.mjsscript7.8 KB
scripts/md-lite.test.tsscript10.3 KB
scripts/meaning-check.mjsscript9.7 KB
scripts/meaning-check.test.tsscript12.0 KB
scripts/number-grammar.mjsscript2.1 KB
scripts/number-grammar.test.tsscript1.8 KB
scripts/numerals.mjsscript12.0 KB
scripts/numerals.test.tsscript6.1 KB
scripts/outcome-start.mjsscript3.8 KB
scripts/outcome-start.test.tsscript5.0 KB
scripts/outcome.mjsscript10.5 KB
scripts/outcome.test.tsscript12.8 KB
scripts/page-source-locator.test.tsscript11.7 KB
scripts/particles-ko.mjsscript4.8 KB
scripts/particles-ko.test.tsscript4.3 KB
scripts/placeholder.mjsscript9.3 KB
scripts/placeholder.test.tsscript3.8 KB
scripts/polish-apply.mjsscript6.8 KB
scripts/polish-apply.test.tsscript19.7 KB
scripts/polish-diff.mjsscript1.7 KB
scripts/polish-diff.test.tsscript10.1 KB
scripts/polish-markup.test.tsscript14.0 KB
scripts/polish-partial.test.tsscript2.5 KB
scripts/polish-project.mjsscript5.8 KB
scripts/polish-rules.mjsscript9.8 KB
scripts/rational.mjsscript5.2 KB
scripts/rational.test.tsscript1.9 KB
scripts/raw-decode.mjsscript4.5 KB
scripts/raw-locator.mjsscript2.4 KB
scripts/raw-snapshot.test.tsscript7.3 KB
scripts/references-fences.test.tsscript1.2 KB
scripts/repair-tracker.mjsscript7.5 KB
scripts/repair-tracker.test.tsscript10.8 KB
scripts/report-tools-2.test.tsscript16.1 KB
scripts/report-tools-3.test.tsscript9.3 KB
scripts/report-tools-4.test.tsscript10.1 KB
scripts/report-tools-5.test.tsscript14.6 KB
scripts/report-tools-commands.mjsscript12.9 KB
scripts/report-tools.mjsscript2.6 KB
scripts/report-tools.test.tsscript12.1 KB
scripts/sentence-split.mjsscript3.0 KB
scripts/sentence-split.test.tsscript4.5 KB
scripts/snapshot-readability.test.tsscript7.0 KB
scripts/source-commands.mjsscript12.4 KB
scripts/source-integrity.test.tsscript18.1 KB
scripts/source-refresh.mjsscript5.2 KB
scripts/source-snapshot.mjsscript9.9 KB
scripts/source-snapshot.test.tsscript6.3 KB
scripts/source-view.mjsscript5.0 KB
scripts/sources-citation.mjsscript12.1 KB
scripts/sources-citation.test.tsscript14.8 KB
scripts/tests/contracts-support.tsscript3.5 KB
scripts/tests/delivery-barrier-session.tsscript3.3 KB
scripts/tests/derive-clock.tsscript341 B
scripts/tests/fact-derive-support.tsscript1.9 KB
scripts/tests/fact-unit-dimensions-support.tsscript1.5 KB
scripts/tests/fact-unit-rules-support.tsscript16.8 KB
scripts/tests/fidelity-values-support.tsscript1.6 KB
scripts/tests/fixtures/assets/figure-1.svgother141 B
scripts/tests/fixtures/bad-report.htmlother2.1 KB
scripts/tests/fixtures/boxes.jsonconfig3.2 KB
scripts/tests/fixtures/conversion-probe.htmlother485 B
scripts/tests/fixtures/design-spec.mdmarkdown458 B
scripts/tests/fixtures/fidelity-brief-locked.mdmarkdown571 B
scripts/tests/fixtures/fidelity-brief-pending.mdmarkdown574 B
scripts/tests/fixtures/fidelity/assets/share.csvother40 B
scripts/tests/fixtures/fidelity/claim-graph.mdmarkdown449 B
scripts/tests/fixtures/fidelity/gen-legacy-dev.mjsscript5.0 KB
scripts/tests/fixtures/fidelity/ledger-basic.jsonconfig5.1 KB
scripts/tests/fixtures/fidelity/ledger-legacy-dev.jsonconfig18.3 KB
scripts/tests/fixtures/fidelity/ledger-verify.jsonconfig9.1 KB
scripts/tests/fixtures/fidelity/polish-edits.jsonconfig303 B
scripts/tests/fixtures/fidelity/report-bad.htmlother821 B
scripts/tests/fixtures/fidelity/report-good.htmlother2.4 KB
scripts/tests/fixtures/fidelity/sources/S4.htmlother680 B
scripts/tests/fixtures/fidelity/sources/S4/acronyms.jsonconfig36 B
scripts/tests/fixtures/fidelity/sources/S4/meta.jsonconfig256 B
scripts/tests/fixtures/fidelity/sources/S4/sentences.jsonlother623 B
scripts/tests/fixtures/fidelity/sources/S4/text.txtmarkdown300 B
scripts/tests/fixtures/fidelity/sources/S5/acronyms.jsonconfig3 B
scripts/tests/fixtures/fidelity/sources/S5/meta.jsonconfig235 B
scripts/tests/fixtures/fidelity/sources/S5/sentences.jsonlother53 B
scripts/tests/fixtures/fidelity/sources/S5/text.txtmarkdown10 B
scripts/tests/fixtures/fidelity/sources/S9.txtmarkdown128 B
scripts/tests/fixtures/good-report.htmlother2.7 KB
scripts/tests/fixtures/reference-report.htmlother2.5 KB

scripts/report-tools-4.test.ts

View on GitHub
import { describe, expect, onTestFinished, test } from "bun:test"
import { createHash } from "node:crypto"
import { copyFileSync, existsSync, mkdtempSync, mkdirSync, readFileSync, rmSync, writeFileSync } from "node:fs"
import { tmpdir } from "node:os"
import { delimiter, join } from "node:path"
import { PROMOTION } from "./fact-commands-meaning.mjs"
import { writeFidelityRecord } from "./fidelity-records.mjs"
import { PAIR_KINDS } from "./fact-pairs.mjs"
import { VERDICT_SCHEMA } from "./meaning-check.mjs"
import { POLISH_MARKUP_REASON } from "./polish-apply.mjs"
import { COMMANDS, run } from "./report-tools.mjs"
import {
  SCRIPT,
  FIXTURES,
  sessionDir,
  nodeWithoutBun,
  defectsFile,
  FIDELITY,
  sha256,
  CliRow,
  CliJson,
  nodeJson,
  fidelitySession,
  verify,
  codesOf,
  Pair,
  pairedSession,
  verdicts,
  calibrationRows,
  runLines,
  PolishJson,
  polishSession,
  polishApply,
  setField,
  fillTemplate,
  textSource,
  ledgerRow,
} from "./tests/report-tools-support"

describe("fidelity delivery barrier", () => {
  /**
   * The locked brief has meaning check on, so a deliverable session also carries a clean meaning record:
   * one edition's (fidelity-meaning-defects.<format>.json), or without a format the legacy session record.
   */
  const meaningRan = (dir: string, report = "report.html", format?: string) =>
    writeFidelityRecord(
      join(dir, format === undefined ? "fidelity-meaning-defects.json" : `fidelity-meaning-defects.${format}.json`),
      "meaning",
      { artifact_sha256: sha256(join(dir, report)), report: join(dir, report), defects: [] },
    )

  async function deliveredSession(codes: string[]) {
    const { dir, s } = fidelitySession()
    nodeJson(["fact", "fill", join(dir, "report.src.html"), "--out", join(dir, "report.html"), ...s])
    meaningRan(dir)
    const record = (list: string[]) =>
      writeFidelityRecord(join(dir, "fidelity-defects.json"), "fidelity", {
        artifact_sha256: sha256(join(dir, "report.html")),
        report: join(dir, "report.html"),
        defects: list.map((code) => ({ code, message: code })),
      })
    record(codes)
    await run(["outcome", "init", "--session-dir", dir, "--promised", "html"])
    await run([
      "outcome",
      "set",
      "html",
      "delivered",
      "--path",
      join(dir, "report.html"),
      "--verified-by",
      join(dir, "fidelity-defects.json"),
      "--session-dir",
      dir,
    ])
    const decide = [
      "repair",
      "decide",
      "--state",
      join(dir, "repair-state.json"),
      "--defects",
      join(dir, "fidelity-defects.json"),
      "--artifact-bytes",
      "4096",
      "--renders",
      "1",
      "--session-dir",
      dir,
    ]
    await run(decide)
    const decision = await run(decide)
    return { dir, record, decision }
  }

  test("#given a clean meaning record #when the report is edited and fact verify re-run #then the stale meaning record refuses, and a fresh one passes", async () => {
    // given: meaning check on, readers clean, the edition verified and delivered
    const { dir, s } = pairedSession()
    const report = join(dir, "report.html")
    const clean = [
      { pair_id: "P1", verdict: "ok" },
      { pair_id: "P2", verdict: "ok" },
    ]
    const readers = () =>
      nodeJson([
        "fact",
        "meaning-check",
        "--pairs",
        join(dir, "pairs.json"),
        "--verdicts",
        verdicts(dir, "cheap.json", "cheap", clean),
        "--verdicts",
        verdicts(dir, "strong.json", "strong", clean),
        ...s,
      ])
    expect(readers().code).toBe(0)
    expect(verify(dir, "report.html").code).toBe(0)
    await run(["outcome", "init", "--session-dir", dir, "--promised", "html"])
    await run([
      "outcome",
      "set",
      "html",
      "delivered",
      "--path",
      report,
      "--verified-by",
      join(dir, "fidelity-defects.json"),
      "--session-dir",
      dir,
    ])
    const first = await run(["outcome", "verify", "--session-dir", dir])
    // when: draft 2 (a repair rewrite) is re-verified by fact verify only
    writeFileSync(report, `${readFileSync(report, "utf8")}\n<!-- draft 2 -->\n`)
    expect(verify(dir, "report.html").code).toBe(0)
    const stale = await run(["outcome", "verify", "--session-dir", dir])
    // when: the meaning readers run again on draft 2
    expect(nodeJson(["fact", "pairs", report, "--out", join(dir, "pairs.json"), ...s]).code).toBe(0)
    expect(readers().code).toBe(0)
    const fresh = await run(["outcome", "verify", "--session-dir", dir])
    // then
    expect(first.exitCode).toBe(0)
    expect(stale.exitCode).toBe(1)
    expect(stale.json.problems).toContainEqual(
      expect.objectContaining({
        code: "edition_unverified",
        path: join(dir, "fidelity-meaning-defects.json"),
        message: expect.stringContaining("meaning record"),
      }),
    )
    expect(fresh.exitCode).toBe(0)
  })

  test("#given an unregistered appendix value #when verified #then untraceable_number and outcome verify refuses", async () => {
    const { dir, s } = fidelitySession()
    nodeJson(["fact", "fill", join(dir, "report.src.html"), "--out", join(dir, "report.html"), ...s])
    const html = readFileSync(join(dir, "report.html"), "utf8").replace(
      "<h2>How",
      "<h2>Appendix</h2>\n<p>Revenue grew 12% [S4].</p>\n<h2>How",
    )
    writeFileSync(join(dir, "report.html"), html)
    const checked = verify(dir, "report.html")
    await run(["outcome", "init", "--session-dir", dir, "--promised", "html"])
    await run([
      "outcome",
      "set",
      "html",
      "delivered",
      "--path",
      join(dir, "report.html"),
      "--verified-by",
      join(dir, "fidelity-defects.json"),
      "--session-dir",
      dir,
    ])
    const outcome = await run(["outcome", "verify", "--session-dir", dir])
    expect(codesOf(checked.json)).toContain("untraceable_number")
    expect(outcome.exitCode).toBe(1)
    expect(outcome.json.problems.map((p: { code: string }) => p.code)).toContain("fidelity_unresolved")
  })

  for (const code of ["untraceable_number", "unbound_sentence"]) {
    test(`#given ${code} left after repair delivers on exhaustion #when verified and finished #then both refuse, and an empty record passes`, async () => {
      const { dir, record, decision } = await deliveredSession([code])
      const refused = await run(["outcome", "verify", "--session-dir", dir])
      const finish = await run(["outcome", "finish", "--session-dir", dir])
      record([])
      const passed = await run(["outcome", "verify", "--session-dir", dir])
      const finished = await run(["outcome", "finish", "--session-dir", dir])
      expect(decision.json.decision.action).toBe("deliver")
      expect(refused.exitCode).toBe(1)
      expect(JSON.stringify(refused.json.problems)).toContain(`fidelity_unresolved: ${code}`)
      expect(finish.exitCode).toBe(1)
      expect(passed.exitCode).toBe(0)
      expect(finished.exitCode).toBe(0)
    })
  }

  test("#given a clean main report and an inline edition #when the edition lacks or mismatches its verify record #then edition_unverified, and its own record passes", async () => {
    // given
    const { dir, s } = fidelitySession()
    // a stylesheet and an image, so the inline edition's bytes differ from report.html
    writeFileSync(join(dir, "report.css"), "body { margin: 0 auto; max-width: 42rem; }")
    writeFileSync(
      join(dir, "report.src.html"),
      readFileSync(join(dir, "report.src.html"), "utf8")
        .replace("</title>", '</title><link rel="stylesheet" href="report.css">')
        .replace(
          "<h2>Findings</h2>",
          '<h2>Findings</h2>\n<img src="assets/bridge.png" alt="The bridge from the south bank">',
        ),
    )
    nodeJson(["fact", "fill", join(dir, "report.src.html"), "--out", join(dir, "report.html"), ...s])
    expect(verify(dir, "report.html").code).toBe(0)
    meaningRan(dir)
    expect(
      nodeJson([
        "fact",
        "fill",
        join(dir, "report.src.html"),
        "--inline",
        "--out",
        join(dir, "report.inline.html"),
        ...s,
      ]).code,
    ).toBe(0)
    const inline = readFileSync(join(dir, "report.inline.html"), "utf8")
    expect(inline).toContain("<style>body { margin: 0 auto; max-width: 42rem; }</style>")
    expect(inline).toContain(`src="${join(dir, "assets", "bridge.png")}"`)
    expect(sha256(join(dir, "report.inline.html"))).not.toBe(sha256(join(dir, "report.html")))
    // html keeps the legacy session meaning record; the byte-different inline edition needs its own
    meaningRan(dir, "report.inline.html", "pdf")
    await run(["outcome", "init", "--session-dir", dir, "--promised", "html,pdf"])
    await run([
      "outcome",
      "set",
      "html",
      "delivered",
      "--path",
      join(dir, "report.html"),
      "--verified-by",
      join(dir, "fidelity-defects.json"),
      "--session-dir",
      dir,
    ])
    const problems = async () => {
      const result = await run(["outcome", "verify", "--session-dir", dir])
      return { exitCode: result.exitCode, codes: result.json.problems.map((p: { code: string }) => p.code) }
    }
    // when: no --verified-by
    await run(["outcome", "set", "pdf", "delivered", "--path", join(dir, "report.inline.html"), "--session-dir", dir])
    const missing = await problems()
    // when: a record for different bytes
    expect(verify(dir, "report.inline.html", ["--out", join(dir, "fidelity-inline.json")]).code).toBe(0)
    writeFileSync(join(dir, "report.inline.html"), inline.replace("320,000 mm", "330,000 mm"))
    await run([
      "outcome",
      "set",
      "pdf",
      "delivered",
      "--path",
      join(dir, "report.inline.html"),
      "--verified-by",
      join(dir, "fidelity-inline.json"),
      "--session-dir",
      dir,
    ])
    const altered = await problems()
    // when: restored to the verified bytes
    writeFileSync(join(dir, "report.inline.html"), inline)
    const matched = await problems()
    // then
    expect({ missing, altered, matched }).toEqual({
      missing: { exitCode: 1, codes: ["edition_unverified"] },
      altered: { exitCode: 1, codes: ["edition_unverified", "edition_unverified"] },
      matched: { exitCode: 0, codes: [] },
    })
  })
})
finishing-a-development-branchobra/superpowersUse when implementation is complete, all tests pass, and you need to decide how to integrate the workStars: 322kUpdated Claude CodeCodexVerifiedInstall
systematic-debuggingobra/superpowersUse when encountering any bug, test failure, or unexpected behavior, before proposing fixesStars: 322kUpdated Claude CodeCodexVerifiedInstall
test-driven-developmentobra/superpowersUse when implementing any feature or bugfix, before writing implementation codeStars: 322kUpdated Claude CodeCodexVerifiedInstall
skill-creatoranthropics/skillsCreate new skills, modify and improve existing skills, and measure skill performance. Use when users want to create a skill from scratch, edit, or optimize an existing skill, run evals to test a skill, benchmark skill performance with variance analysis, or optimize a skill's description for better triggering accuracy.Stars: 198kUpdated Claude CodeCodexVerifiedInstall