Skip to content

code-yeongyu/oh-my-openagent / packages/shared-skills/skills/ulw-research

ulw-research

Unverified

Runs maximum-saturation research with a cooperating team, claim-graph gating, and a cited, QA'd deliverable. Use when the user explicitly asks for research or a deep investigation, including any 'ulw' research wording.

FileKindSize
AGENTS.mdmarkdown9.2 KB
ATTRIBUTION.mdmarkdown2.4 KB
SKILL.mdskill md42.2 KB
references/deliverable-phase.mdmarkdown49.1 KB
references/fact-ledger-grammar.mdmarkdown6.8 KB
references/fact-ledger.mdmarkdown24.4 KB
references/fidelity-claim-kinds.mdmarkdown5.2 KB
references/markdown-blocks.mdmarkdown721 B
references/report-gates.mdmarkdown32.0 KB
references/report-visualization.mdmarkdown15.4 KB
references/research-collection.mdmarkdown26.8 KB
references/research-delivery.mdmarkdown14.3 KB
references/unit-rules.mdmarkdown16.3 KB
scripts/claim-kinds.mjsscript11.2 KB
scripts/claim-kinds.test.tsscript13.5 KB
scripts/claim-prefix.test.tsscript4.9 KB
scripts/claims-index.mjsscript5.3 KB
scripts/claims-index.test.tsscript5.7 KB
scripts/cli-support.mjsscript4.1 KB
scripts/cli-support.test.tsscript4.3 KB
scripts/contracts-validation.test.tsscript3.3 KB
scripts/contracts.mjsscript26.1 KB
scripts/contracts.test.tsscript7.9 KB
scripts/conversion-altered.test.tsscript11.0 KB
scripts/conversion-originals.test.tsscript22.7 KB
scripts/conversion-probe-classes.test.tsscript45.2 KB
scripts/conversion-probe.mjsscript13.5 KB
scripts/conversion-probe.test.tsscript11.6 KB
scripts/copy-returns-fidelity-policy.test.tsscript10.4 KB
scripts/copy-returns-polish.test.tsscript12.1 KB
scripts/copy-returns.test.tsscript10.6 KB
scripts/css-hiding.mjsscript9.1 KB
scripts/css-lite.mjsscript7.6 KB
scripts/css-lite.test.tsscript6.4 KB
scripts/delivery-barrier-meaning.test.tsscript12.3 KB
scripts/delivery-barrier.test.tsscript11.4 KB
scripts/design-spec.mjsscript7.2 KB
scripts/design-spec.test.tsscript6.7 KB
scripts/entities.mjsscript2.5 KB
scripts/entry-guard.mjsscript794 B
scripts/fact-commands-fill.mjsscript6.6 KB
scripts/fact-commands-meaning.mjsscript12.6 KB
scripts/fact-commands-polish.mjsscript10.3 KB
scripts/fact-commands-verify.mjsscript12.6 KB
scripts/fact-commands.mjsscript13.8 KB
scripts/fact-derive-2.test.tsscript7.2 KB
scripts/fact-derive.mjsscript4.9 KB
scripts/fact-derive.test.tsscript10.8 KB
scripts/fact-expr.mjsscript4.5 KB
scripts/fact-fill.mjsscript11.7 KB
scripts/fact-fill.test.tsscript10.7 KB
scripts/fact-ledger-grammar.test.tsscript11.8 KB
scripts/fact-ledger-kinds.mjsscript16.5 KB
scripts/fact-ledger-kinds.test.tsscript9.3 KB
scripts/fact-ledger-legacy.test.tsscript8.9 KB
scripts/fact-ledger-schema.mjsscript11.9 KB
scripts/fact-ledger-schema.test.tsscript1.5 KB
scripts/fact-ledger.mjsscript5.5 KB
scripts/fact-ledger.test.tsscript9.7 KB
scripts/fact-locate.mjsscript12.1 KB
scripts/fact-locate.test.tsscript7.2 KB
scripts/fact-pairs.mjsscript8.3 KB
scripts/fact-pairs.test.tsscript6.6 KB
scripts/fact-recompute.mjsscript4.8 KB
scripts/fact-unit-dimensions-2.test.tsscript8.4 KB
scripts/fact-unit-dimensions.test.tsscript11.9 KB
scripts/fact-unit-rules.test.tsscript8.9 KB
scripts/fidelity-binding.mjsscript6.7 KB
scripts/fidelity-binding.test.tsscript4.0 KB
scripts/fidelity-brief.mjsscript6.4 KB
scripts/fidelity-brief.test.tsscript7.8 KB
scripts/fidelity-claims.mjsscript5.1 KB
scripts/fidelity-csv.mjsscript1.1 KB
scripts/fidelity-lexicon.mjsscript8.1 KB
scripts/fidelity-lexicon.test.tsscript6.0 KB
scripts/fidelity-originals.mjsscript9.9 KB
scripts/fidelity-policy.mjsscript10.1 KB
scripts/fidelity-records.mjsscript13.4 KB
scripts/fidelity-snapshot-readability.mjsscript2.2 KB
scripts/fidelity-sources.mjsscript4.3 KB
scripts/fidelity-state.mjsscript2.1 KB
scripts/fidelity-state.test.tsscript1.7 KB
scripts/fidelity-trace.mjsscript6.1 KB
scripts/fidelity-trace.test.tsscript3.3 KB
scripts/fidelity-value-unit.mjsscript13.3 KB
scripts/fidelity-values.mjsscript16.1 KB
scripts/fidelity-values.test.tsscript15.8 KB
scripts/format-extract-css.mjsscript5.1 KB
scripts/format-extract.mjsscript10.3 KB
scripts/format-extract.test.tsscript11.2 KB
scripts/gates-context.test.tsscript2.6 KB
scripts/gates-fidelity.mjsscript6.3 KB
scripts/gates-fidelity.test.tsscript3.3 KB
scripts/gates-figures.mjsscript9.9 KB
scripts/gates-layout.mjsscript6.6 KB
scripts/gates-layout.test.tsscript12.4 KB
scripts/gates-static-headings.test.tsscript961 B
scripts/gates-static.mjsscript8.1 KB
scripts/gates-static.test.tsscript14.9 KB
scripts/gates-structure.mjsscript4.7 KB
scripts/gates-text.mjsscript7.2 KB
scripts/glossary-vocabulary.test.tsscript1.7 KB
scripts/html-foreign-object.mjsscript2.8 KB
scripts/html-lite.mjsscript9.7 KB
scripts/html-lite.test.tsscript7.9 KB
scripts/html-markup.mjsscript7.0 KB
scripts/html-text-map.mjsscript4.8 KB
scripts/html-text-map.test.tsscript15.2 KB
scripts/layout-probe.mjsscript4.6 KB
scripts/layout-probe.test.tsscript4.2 KB
scripts/lexicon.mjsscript2.6 KB
scripts/lexicon.test.tsscript3.2 KB
scripts/markdown-closers.mjsscript4.9 KB
scripts/md-lite-boundaries.test.tsscript2.2 KB
scripts/md-lite.mjsscript7.8 KB
scripts/md-lite.test.tsscript10.3 KB
scripts/meaning-check.mjsscript9.7 KB
scripts/meaning-check.test.tsscript12.0 KB
scripts/number-grammar.mjsscript2.1 KB
scripts/number-grammar.test.tsscript1.8 KB
scripts/numerals.mjsscript12.0 KB
scripts/numerals.test.tsscript6.1 KB
scripts/outcome-start.mjsscript3.8 KB
scripts/outcome-start.test.tsscript5.0 KB
scripts/outcome.mjsscript10.5 KB
scripts/outcome.test.tsscript12.8 KB
scripts/page-source-locator.test.tsscript11.7 KB
scripts/particles-ko.mjsscript4.8 KB
scripts/particles-ko.test.tsscript4.3 KB
scripts/placeholder.mjsscript9.3 KB
scripts/placeholder.test.tsscript3.8 KB
scripts/polish-apply.mjsscript6.8 KB
scripts/polish-apply.test.tsscript19.7 KB
scripts/polish-diff.mjsscript1.7 KB
scripts/polish-diff.test.tsscript10.1 KB
scripts/polish-markup.test.tsscript14.0 KB
scripts/polish-partial.test.tsscript2.5 KB
scripts/polish-project.mjsscript5.8 KB
scripts/polish-rules.mjsscript9.8 KB
scripts/rational.mjsscript5.2 KB
scripts/rational.test.tsscript1.9 KB
scripts/raw-decode.mjsscript4.5 KB
scripts/raw-locator.mjsscript2.4 KB
scripts/raw-snapshot.test.tsscript7.3 KB
scripts/references-fences.test.tsscript1.2 KB
scripts/repair-tracker.mjsscript7.5 KB
scripts/repair-tracker.test.tsscript10.8 KB
scripts/report-tools-2.test.tsscript16.1 KB
scripts/report-tools-3.test.tsscript9.3 KB
scripts/report-tools-4.test.tsscript10.1 KB
scripts/report-tools-5.test.tsscript14.6 KB
scripts/report-tools-commands.mjsscript12.9 KB
scripts/report-tools.mjsscript2.6 KB
scripts/report-tools.test.tsscript12.1 KB
scripts/sentence-split.mjsscript3.0 KB
scripts/sentence-split.test.tsscript4.5 KB
scripts/snapshot-readability.test.tsscript7.0 KB
scripts/source-commands.mjsscript12.4 KB
scripts/source-integrity.test.tsscript18.1 KB
scripts/source-refresh.mjsscript5.2 KB
scripts/source-snapshot.mjsscript9.9 KB
scripts/source-snapshot.test.tsscript6.3 KB
scripts/source-view.mjsscript5.0 KB
scripts/sources-citation.mjsscript12.1 KB
scripts/sources-citation.test.tsscript14.8 KB
scripts/tests/contracts-support.tsscript3.5 KB
scripts/tests/delivery-barrier-session.tsscript3.3 KB
scripts/tests/derive-clock.tsscript341 B
scripts/tests/fact-derive-support.tsscript1.9 KB
scripts/tests/fact-unit-dimensions-support.tsscript1.5 KB
scripts/tests/fact-unit-rules-support.tsscript16.8 KB
scripts/tests/fidelity-values-support.tsscript1.6 KB
scripts/tests/fixtures/assets/figure-1.svgother141 B
scripts/tests/fixtures/bad-report.htmlother2.1 KB
scripts/tests/fixtures/boxes.jsonconfig3.2 KB
scripts/tests/fixtures/conversion-probe.htmlother485 B
scripts/tests/fixtures/design-spec.mdmarkdown458 B
scripts/tests/fixtures/fidelity-brief-locked.mdmarkdown571 B
scripts/tests/fixtures/fidelity-brief-pending.mdmarkdown574 B
scripts/tests/fixtures/fidelity/assets/share.csvother40 B
scripts/tests/fixtures/fidelity/claim-graph.mdmarkdown449 B
scripts/tests/fixtures/fidelity/gen-legacy-dev.mjsscript5.0 KB
scripts/tests/fixtures/fidelity/ledger-basic.jsonconfig5.1 KB
scripts/tests/fixtures/fidelity/ledger-legacy-dev.jsonconfig18.3 KB
scripts/tests/fixtures/fidelity/ledger-verify.jsonconfig9.1 KB
scripts/tests/fixtures/fidelity/polish-edits.jsonconfig303 B
scripts/tests/fixtures/fidelity/report-bad.htmlother821 B
scripts/tests/fixtures/fidelity/report-good.htmlother2.4 KB
scripts/tests/fixtures/fidelity/sources/S4.htmlother680 B
scripts/tests/fixtures/fidelity/sources/S4/acronyms.jsonconfig36 B
scripts/tests/fixtures/fidelity/sources/S4/meta.jsonconfig256 B
scripts/tests/fixtures/fidelity/sources/S4/sentences.jsonlother623 B
scripts/tests/fixtures/fidelity/sources/S4/text.txtmarkdown300 B
scripts/tests/fixtures/fidelity/sources/S5/acronyms.jsonconfig3 B
scripts/tests/fixtures/fidelity/sources/S5/meta.jsonconfig235 B
scripts/tests/fixtures/fidelity/sources/S5/sentences.jsonlother53 B
scripts/tests/fixtures/fidelity/sources/S5/text.txtmarkdown10 B
scripts/tests/fixtures/fidelity/sources/S9.txtmarkdown128 B
scripts/tests/fixtures/good-report.htmlother2.7 KB
scripts/tests/fixtures/reference-report.htmlother2.5 KB

scripts/conversion-altered.test.ts

View on GitHub
import { describe, expect, onTestFinished, test } from "bun:test"
import { copyFileSync, existsSync, mkdtempSync, readFileSync, rmSync, writeFileSync } from "node:fs"
import { tmpdir } from "node:os"
import { join } from "node:path"

import { CliError } from "./cli-support.mjs"
import { DEFECT_CODES } from "./contracts.mjs"
import { run } from "./report-tools.mjs"
import { writeSnapshot } from "./source-snapshot.mjs"

type Json = Record<string, unknown> & { data?: Record<string, unknown>; error?: string }
const PAGE = "<p>USD 4.2<sup>2</sup> billion in revenue.</p><p>Staff grew to 1,250 people.</p>"

function session() {
  const dir = mkdtempSync(join(tmpdir(), "conversion-altered-"))
  onTestFinished(() => rmSync(dir, { recursive: true, force: true }))
  return dir
}

async function snapshot(dir: string, html = PAGE) {
  const file = join(dir, "page.html")
  writeFileSync(file, html)
  return (await run(["source", "snapshot", "--id", "S1", "--html", file, "--session-dir", dir])) as {
    exitCode: number
    json: Json
    summary: string
  }
}

describe("the conversion probe result is consumed", () => {
  test("#given a page whose conversion altered a number #when snapshotted #then the JSON and the summary report it", async () => {
    const result = await snapshot(session())
    expect(result.exitCode).toBe(0)
    expect(result.json.data?.conversion_altered_numbers).toEqual(["4.22"])
    expect(result.summary).toContain("1 altered")
  })

  test("#given an altered 4.22 in conversion.json #when fact add --find locates it #then it refuses with conversion_altered_number and writes no row", async () => {
    const dir = session()
    await snapshot(dir)
    const result = (await run([
      "fact",
      "add",
      "--source",
      "S1",
      "--find",
      "USD",
      "--label",
      "usd_bn",
      "--session-dir",
      dir,
      "--json",
    ])) as { exitCode: number; json: Json }
    expect(result.exitCode).toBe(1)
    expect(result.json.error).toBe("conversion_altered_number")
    expect(existsSync(join(dir, "fact-ledger.json"))).toBe(false)
    expect(DEFECT_CODES.conversion_altered_number).toMatchObject({ severity: "blocker", integrity: true })
  })

  test("#given an unaltered number in the same snapshot #when fact add --find locates it #then it registers", async () => {
    const dir = session()
    await snapshot(dir)
    const result = (await run([
      "fact",
      "add",
      "--source",
      "S1",
      "--find",
      "Staff grew to",
      "--label",
      "staff",
      "--session-dir",
      dir,
      "--json",
    ])) as { exitCode: number; json: Json }
    expect(result.exitCode).toBe(0)
    expect((result.json.data?.row as { value: string }).value).toBe("1250")
  })

  test("#given a non-ISO observed_at #when writeSnapshot runs #then it throws before writing anything", () => {
    const dir = join(session(), "sources")
    expect(() =>
      writeSnapshot(dir, "S1", { path: "p.html", html: PAGE, extractor: "model", observed_at: "yesterday" }),
    ).toThrow(TypeError)
    expect(existsSync(join(dir, "S1"))).toBe(false)
  })

  test("#given an image named chart-109.png beside a glued 10<sup>9</sup> #when fact add --find locates it #then it refuses and registers nothing", async () => {
    const dir = session()
    const snap = await snapshot(dir, '<p>Output reached 10<sup>9</sup> kWh</p><p><img src="chart-109.png"></p>')
    expect(snap.json.data?.conversion_altered_numbers).toEqual(["109"])
    const result = (await run([
      "fact",
      "add",
      "--source",
      "S1",
      "--find",
      "Output reached",
      "--label",
      "output",
      "--session-dir",
      dir,
      "--json",
    ])) as { exitCode: number; json: Json }
    expect(result.exitCode).toBe(1)
    expect(result.json.error).toBe("conversion_altered_number")
    expect(existsSync(join(dir, "fact-ledger.json"))).toBe(false)
  })
})

test("#given a genuine 4.22 beside a glued 4.2<sup>2</sup> #when fact add --find locates the genuine one #then the refusal names the --replace recovery", async () => {
  const dir = session()
  await snapshot(dir, "<p>USD 4.2<sup>2</sup> billion in revenue.</p><p>Margin was 4.22 points.</p>")
  const result = (await run([
    "fact",
    "add",
    "--source",
    "S1",
    "--find",
    "Margin was",
    "--label",
    "margin",
    "--session-dir",
    dir,
    "--json",
  ])) as { exitCode: number; json: Json & { message?: string } }
  expect(result.exitCode).toBe(1)
  expect(result.json.error).toBe("conversion_altered_number")
  expect(result.json.message).toContain("source snapshot --id S1 --text <verified.txt> --replace")
})

describe("the documented recovery: source snapshot --replace with a verified text", () => {
  const s = (dir: string) => ["--session-dir", dir]

  test("#given a refused 4.22 #when the verified text replaces S1 #then fact add registers 4.2 billion and the filled report verifies clean", async () => {
    const dir = session()
    await snapshot(dir)
    const verified = join(dir, "verified.txt")
    writeFileSync(verified, "USD 4.2 billion in revenue.\nStaff grew to 1,250 people.\n")
    const replaced = (await run(["source", "snapshot", "--id", "S1", "--text", verified, "--replace", ...s(dir)])) as {
      exitCode: number
      json: Json
    }
    expect(replaced.exitCode).toBe(0)
    expect(existsSync(join(dir, "sources", "S1", "conversion.json"))).toBe(false)
    const added = (await run([
      "fact",
      "add",
      "--source",
      "S1",
      "--find",
      "USD",
      "--label",
      "usd_bn",
      ...s(dir),
      "--json",
    ])) as { exitCode: number; json: Json }
    expect(added.exitCode).toBe(0)
    expect((added.json.data?.row as { value: string }).value).toBe("4200000000")
    copyFileSync(join(import.meta.dir, "tests", "fixtures", "fidelity-brief-locked.md"), join(dir, "brief.md"))
    writeFileSync(
      join(dir, "report.src.html"),
      [
        '<!doctype html><html lang="en"><head><meta charset="utf-8"><title>Revenue</title></head><body><h1>Revenue</h1>',
        "<h2>Findings</h2><p>Revenue was {{F1:usd_bn}} [S1].</p>",
        "<h2>How this report was made</h2><p>Collected from one cited public page [S1].</p>",
        '<h2>Sources</h2><ol><li id="s1">[S1] Revenue page, retrieved 2026-10-01.</li></ol></body></html>',
      ].join("\n"),
    )
    const filled = (await run([
      "fact",
      "fill",
      join(dir, "report.src.html"),
      "--out",
      join(dir, "report.html"),
      ...s(dir),
    ])) as { exitCode: number }
    expect(filled.exitCode).toBe(0)
    const verifiedReport = (await run([
      "fact",
      "verify",
      join(dir, "report.html"),
      "--sources",
      join(dir, "sources"),
      "--brief",
      join(dir, "brief.md"),
      ...s(dir),
    ])) as { exitCode: number; json: { defects?: unknown[] } }
    expect(verifiedReport.json.defects).toEqual([])
    expect(verifiedReport.exitCode).toBe(0)
  })

  test("#given an active row pinning S1 #when --replace runs #then it refuses with snapshot_pinned and keeps the old text", async () => {
    const dir = session()
    await snapshot(dir)
    await run(["fact", "add", "--source", "S1", "--find", "Staff grew to", "--label", "staff", ...s(dir), "--json"])
    const verified = join(dir, "verified.txt")
    writeFileSync(verified, "USD 4.2 billion in revenue.\n")
    const replaced = (await run(["source", "snapshot", "--id", "S1", "--text", verified, "--replace", ...s(dir)])) as {
      exitCode: number
      json: Json
    }
    expect(replaced.exitCode).toBe(1)
    expect(replaced.json.error).toBe("snapshot_pinned")
    expect(existsSync(join(dir, "sources", "S1", "conversion.json"))).toBe(true)
  })
})

test("#given --html whose conversion altered 4.22 #when fact add is refused, the verified text replaces S1, and the row is added, filled and verified #then the replacement is declared text over the kept raw.bin and every step passes", async () => {
  const dir = session()
  const s = ["--session-dir", dir]
  await snapshot(dir)
  const refused = (await run([
    "fact",
    "add",
    "--source",
    "S1",
    "--find",
    "USD",
    "--label",
    "usd_bn",
    ...s,
    "--json",
  ])) as { exitCode: number; json: Json }
  expect([refused.exitCode, refused.json.error]).toEqual([1, "conversion_altered_number"])
  const verified = join(dir, "verified.txt")
  writeFileSync(verified, "USD 4.2 billion in revenue.\nStaff grew to 1,250 people.\n")
  const replaced = (await run(["source", "snapshot", "--id", "S1", "--text", verified, "--replace", ...s])) as {
    exitCode: number
    json: Json
  }
  expect([replaced.exitCode, replaced.json.data?.text_source, replaced.json.data?.kind]).toEqual([
    0,
    "declared",
    "page",
  ])
  expect(existsSync(join(dir, "sources", "S1", "raw.bin"))).toBe(true)
  const added = (await run([
    "fact",
    "add",
    "--source",
    "S1",
    "--find",
    "USD",
    "--label",
    "usd_bn",
    ...s,
    "--json",
  ])) as { exitCode: number; json: Json & { message?: string } }
  expect([added.exitCode, added.json.error, added.json.message]).toEqual([0, undefined, undefined])
  const row = added.json.data?.row as { value: string; locator: { artifact: string; unit: string } }
  expect([row.value, row.locator.artifact, row.locator.unit]).toEqual(["4200000000", "text.txt", "bytes"])
  copyFileSync(join(import.meta.dir, "tests", "fixtures", "fidelity-brief-locked.md"), join(dir, "brief.md"))
  writeFileSync(
    join(dir, "report.src.html"),
    [
      '<!doctype html><html lang="en"><head><meta charset="utf-8"><title>Revenue</title></head><body><h1>Revenue</h1>',
      "<h2>Findings</h2><p>Revenue was {{F1:usd_bn}} [S1].</p>",
      "<h2>How this report was made</h2><p>Collected from one cited public page [S1].</p>",
      '<h2>Sources</h2><ol><li id="s1">[S1] Revenue page, retrieved 2026-10-01.</li></ol></body></html>',
    ].join("\n"),
  )
  expect(
    (
      (await run(["fact", "fill", join(dir, "report.src.html"), "--out", join(dir, "report.html"), ...s])) as {
        exitCode: number
      }
    ).exitCode,
  ).toBe(0)
  const report = (await run([
    "fact",
    "verify",
    join(dir, "report.html"),
    "--sources",
    join(dir, "sources"),
    "--brief",
    join(dir, "brief.md"),
    ...s,
  ])) as { exitCode: number; json: { defects?: unknown[] } }
  expect([report.exitCode, report.json.defects]).toEqual([0, []])
  expect(
    (
      JSON.parse(readFileSync(join(dir, "fidelity-defects.json"), "utf8")) as { defects: { code: string }[] }
    ).defects.map((d) => d.code),
  ).not.toContain("snapshot_not_raw")
})

test("#given a malformed conversion.json #when fact add reads it #then it is a usage error naming the file, not a crash", async () => {
  const dir = session()
  await snapshot(dir)
  writeFileSync(join(dir, "sources", "S1", "conversion.json"), "{not json")
  const added = run([
    "fact",
    "add",
    "--source",
    "S1",
    "--find",
    "Staff grew to",
    "--label",
    "staff",
    "--session-dir",
    dir,
    "--json",
  ])
  await expect(added).rejects.toBeInstanceOf(CliError)
  await expect(added).rejects.toThrow(/conversion\.json/)
})
finishing-a-development-branchobra/superpowersUse when implementation is complete, all tests pass, and you need to decide how to integrate the workStars: 322kUpdated Claude CodeCodexVerifiedInstall
systematic-debuggingobra/superpowersUse when encountering any bug, test failure, or unexpected behavior, before proposing fixesStars: 322kUpdated Claude CodeCodexVerifiedInstall
test-driven-developmentobra/superpowersUse when implementing any feature or bugfix, before writing implementation codeStars: 322kUpdated Claude CodeCodexVerifiedInstall
skill-creatoranthropics/skillsCreate new skills, modify and improve existing skills, and measure skill performance. Use when users want to create a skill from scratch, edit, or optimize an existing skill, run evals to test a skill, benchmark skill performance with variance analysis, or optimize a skill's description for better triggering accuracy.Stars: 198kUpdated Claude CodeCodexVerifiedInstall