Skip to content

ilien-dev/quiron / .claude/skills/upstream-sync

upstream-sync

Verified

Weekly intake of improvements from the reference repos (humanizer, stop-slop, no-ai-slop, avoid-ai-writing, slop-score, antislop-sampler, unslop, humanize) into quirón. Pulls their latest, proposes candidates, implements and measures the ones the owner approves, and opens a PR for the next version. Run it when the owner asks for the weekly upstream sync.

FileKindSize
SKILL.mdskill md11.1 KB
sync.pyscript10.2 KB
test_sync.pyscript10.2 KB
tried.jsonconfig37.4 KB
upstream.jsonconfig1.4 KB

tried.json

View on GitHub
{
 "_doc": "Every candidate /upstream-sync measured, shipped or not. Search it before proposing: sync.py tried WORD.",
 "tried": [
  {
   "id": "curly-apostrophes",
   "date": "2026-11-04",
   "source": "theclaymethod/unslop@17ed39c scripts/banned_phrase_scan.py",
   "kind": "check",
   "target": "audit.py run()",
   "what": "read curly apostrophes as straight ones before the CHECKS regexes",
   "outcome": "shipped",
   "measured": "evaluate.py, held-out split",
   "result": "checklist AUC blog gpt 0.830->0.854, opus 0.753->0.746 (one human post now trips A4), sonnet 0.997->0.996; fiction gpt 0.911->0.922",
   "reason": "pooled AUC up, no new FAIL on humans",
   "retry_if": "-"
  },
  {
   "id": "lexicon-surprisingly",
   "date": "2026-11-04",
   "source": "conorbronsdon/avoid-ai-writing@ccc8fc4 detector/patterns.js CONFIDENCE_CALIBRATION",
   "kind": "lexicon",
   "target": "ai-lean.txt",
   "what": "surprisingly",
   "outcome": "shipped",
   "measured": "evaluate.py, held-out split",
   "result": "B1 FAIL gpt 43%->50%, lexicon AUC sonnet 0.857->0.861, humans 0%",
   "reason": "passed per-entry rule (<=4% human, >=10% AI train)",
   "retry_if": "-"
  },
  {
   "id": "a3-the-real-x-is",
   "date": "2026-11-04",
   "source": "theclaymethod/unslop@17ed39c taboo-phrases.md",
   "kind": "check",
   "target": "A3",
   "what": "the real \\w+ (?:is|isn't|was)",
   "outcome": "shipped",
   "measured": "evaluate.py, held-out split",
   "result": "A3 on sonnet 0%->14%, T1 sonnet 93%->100%, humans unchanged",
   "reason": "AUC up, no human flagged",
   "retry_if": "-"
  },
  {
   "id": "contrast-any-subject",
   "date": "2026-11-04",
   "source": "sam-paech/slop-score@289264a js/regexes-stage1.js RE_SIMPLE_BE_NOT_IT_BE (#8), also #2 #3 #4 #5",
   "kind": "check",
   "target": "A1",
   "what": "'The hardest part wasn't X. It was Y.' with any subject",
   "outcome": "rejected",
   "measured": "evaluate.py + eval/e2e dev (20 titles) and test (18), 2 rewrites per title, 2 Opus + 1 GPT judges",
   "result": "checklist AUC 0.860->0.873 (passes detection); e2e Opus dev 32.0->34.0 worse 12/20 p=0.28, test 26.7->26.1 p=0.36",
   "reason": "same family as A1c: catches AI but rewrites get worse",
   "retry_if": "a different way to steer rewrites away from it, with its own e2e"
  },
  {
   "id": "not-x-but-y-plain",
   "date": "2026-11-04",
   "source": "sam-paech/slop-score@289264a RE_NOT_BUT; sam-paech/antislop-sampler@0ae330e slop_regexes.txt",
   "kind": "check",
   "target": "A1b",
   "what": "plain 'not X, but Y'",
   "outcome": "rejected",
   "measured": "evaluate.py, held-out split",
   "result": "A1b on held-out humans 12.5%->27.5%, AUC 0.860->0.848",
   "reason": "humans use it",
   "retry_if": "a guard that drops plain concessions ('isn't expensive, but')"
  },
  {
   "id": "not-x-but-y-narrow",
   "date": "2026-11-04",
   "source": "own narrowing of sam-paech/slop-score@289264a RE_NOT_BUT",
   "kind": "check",
   "target": "A1b",
   "what": "is not a X, but a Y",
   "outcome": "rejected",
   "measured": "evaluate.py, held-out split",
   "result": "no hits on any set",
   "reason": "no signal",
   "retry_if": "-"
  },
  {
   "id": "negation-chain",
   "date": "2026-11-04",
   "source": "conorbronsdon/avoid-ai-writing@ccc8fc4 NEGATION_CHAIN",
   "kind": "check",
   "target": "A1",
   "what": "'No X, no Y, no Z' and 'didn't X, didn't Y'",
   "outcome": "rejected",
   "measured": "evaluate.py, held-out split",
   "result": "blog opus 0.746->0.756 (1 text); fiction: one held-out human story trips A1, opus 0.571->0.562",
   "reason": "fiction humans use it, blog gain is one text",
   "retry_if": "-"
  },
  {
   "id": "proximity-gate-a1",
   "date": "2026-11-04",
   "source": "conorbronsdon/avoid-ai-writing@ccc8fc4 negativeParallelismIssues",
   "kind": "check",
   "target": "A1",
   "what": "count 'isn't X, it's Y' only with a second frame within 2 sentences",
   "outcome": "rejected",
   "measured": "evaluate.py, held-out split",
   "result": "AUC down in blog (0.860->0.857) and fiction (0.805->0.789)",
   "reason": "loses AI hits",
   "retry_if": "-"
  },
  {
   "id": "chatbot-residue-wider",
   "date": "2026-11-04",
   "source": "harshaneel/humanize@9c3dec3; blader/humanizer@0ef9fe5; conorbronsdon/avoid-ai-writing@ccc8fc4 CHATBOT_ARTIFACTS, SYCOPHANTIC, REASONING_ARTIFACTS",
   "kind": "check",
   "target": "A21",
   "what": "would you like me to, do you want me to, absolutely!, let me think step by step",
   "outcome": "rejected",
   "measured": "evaluate.py, held-out split",
   "result": "no hits in blog; 'do you want me to' FAILs human fiction dialogue (any FAIL 2.5%->7.5%)",
   "reason": "flags human dialogue",
   "retry_if": "a corpus of chat or agent output"
  },
  {
   "id": "self-identification",
   "date": "2026-11-04",
   "source": "conorbronsdon/avoid-ai-writing@ccc8fc4 CUTOFF_DISCLAIMERS",
   "kind": "check",
   "target": "A22",
   "what": "as an AI language model, my training data goes up to",
   "outcome": "rejected",
   "measured": "evaluate.py, held-out split",
   "result": "no hits on any set",
   "reason": "no signal in 2026 posts",
   "retry_if": "texts that contain it"
  },
  {
   "id": "ai-tool-markup",
   "date": "2026-11-04",
   "source": "conorbronsdon/avoid-ai-writing@ccc8fc4 AI_CITATION_MARKUP, AI_UTM_SOURCE, ZERO_WIDTH_RE",
   "kind": "check",
   "target": "new FAIL",
   "what": "oaicite/citeturn markup, utm_source=chatgpt, zero-width characters",
   "outcome": "not-measurable",
   "measured": "evaluate.py, held-out split",
   "result": "eval/ai has none",
   "reason": "AUC cannot rise",
   "retry_if": "assistant samples with web-search output"
  },
  {
   "id": "worth-noting",
   "date": "2026-11-04",
   "source": "harshaneel/humanize@9c3dec3; blader/humanizer@0ef9fe5",
   "kind": "check",
   "target": "B3",
   "what": "it's worth noting, worth mentioning",
   "outcome": "rejected",
   "measured": "evaluate.py, held-out split",
   "result": "no change on test (hits only 4% of AI train)",
   "reason": "no gain",
   "retry_if": "-"
  },
  {
   "id": "quote-masking",
   "date": "2026-11-04",
   "source": "theclaymethod/unslop@17ed39c mask_ignored_spans; conorbronsdon/avoid-ai-writing@ccc8fc4 detector README",
   "kind": "check",
   "target": "audit.py",
   "what": "skip quoted spans in TELL regexes",
   "outcome": "rejected",
   "measured": "evaluate.py, held-out split",
   "result": "no change",
   "reason": "no gain",
   "retry_if": "-"
  },
  {
   "id": "phrase-families",
   "date": "2026-11-04",
   "source": "theclaymethod/unslop@17ed39c taboo-phrases.md; conorbronsdon/avoid-ai-writing@ccc8fc4 PERFORMED_INSIGHT, STAGED_DISCOVERY, NOVELTY_INFLATION, RHETORICAL_QUESTIONS; hardikpandya/stop-slop@8da1f03",
   "kind": "check",
   "target": "new TELL",
   "what": "data tells a story; why does this matter; worth a look; what nobody tells you; sit with that; that's not nothing",
   "outcome": "rejected",
   "measured": "evaluate.py, held-out split",
   "result": "0-2 texts per set; combined AUC 0.860->0.858; the performed-insight family fires on skill rewrites",
   "reason": "no gain",
   "retry_if": "-"
  },
  {
   "id": "hedge-stack",
   "date": "2026-11-04",
   "source": "conorbronsdon/avoid-ai-writing@ccc8fc4 HEDGE_STACK",
   "kind": "check",
   "target": "A9",
   "what": "could/may/might + potentially/eventually/ultimately",
   "outcome": "rejected",
   "measured": "evaluate.py, held-out split",
   "result": "train AUC down, human train 4.2%->5.9%",
   "reason": "humans",
   "retry_if": "-"
  },
  {
   "id": "significance-openers",
   "date": "2026-11-04",
   "source": "conorbronsdon/avoid-ai-writing@ccc8fc4 FORMULAIC_OPENERS, SIGNIFICANCE_INFLATION, TEMPLATE_PHRASES; blader/humanizer@0ef9fe5 section 13",
   "kind": "check",
   "target": "A12",
   "what": "in the ever-evolving landscape of, watershed moment, a significant step toward, in today's",
   "outcome": "rejected",
   "measured": "evaluate.py, held-out split",
   "result": "AUC 0.860->0.856, a held-out human hit",
   "reason": "no gain",
   "retry_if": "-"
  },
  {
   "id": "vague-attribution",
   "date": "2026-11-04",
   "source": "conorbronsdon/avoid-ai-writing@ccc8fc4 VAGUE_ATTRIBUTIONS",
   "kind": "check",
   "target": "A16",
   "what": "studies show, research suggests",
   "outcome": "rejected",
   "measured": "evaluate.py, held-out split",
   "result": "no hits",
   "reason": "no signal",
   "retry_if": "-"
  },
  {
   "id": "copula-swap",
   "date": "2026-11-04",
   "source": "conorbronsdon/avoid-ai-writing@ccc8fc4 docs/research/hape-2026-11; blader/humanizer@0ef9fe5 section 18",
   "kind": "check",
   "target": "A17",
   "what": "represents a, stands as, marks/features/offers a",
   "outcome": "rejected",
   "measured": "evaluate.py, held-out split",
   "result": "A17 on humans 2.5%->7.5-10%, AUC down",
   "reason": "humans",
   "retry_if": "-"
  },
  {
   "id": "titlecase-function-word",
   "date": "2026-11-04",
   "source": "conorbronsdon/avoid-ai-writing@ccc8fc4 title-case filter",
   "kind": "check",
   "target": "A19",
   "what": "count a heading only with a capitalised function word, 4+ tokens",
   "outcome": "rejected",
   "measured": "evaluate.py, held-out split",
   "result": "AUC 0.860->0.818, A19 on AI 64%->0%",
   "reason": "kills the check",
   "retry_if": "-"
  },
  {
   "id": "ultimately-overall-closer",
   "date": "2026-11-04",
   "source": "petergyang/no-ai-slop@000650b",
   "kind": "check",
   "target": "A26",
   "what": "last paragraph opening Ultimately, / Overall,",
   "outcome": "rejected",
   "measured": "evaluate.py, held-out split",
   "result": "no hits",
   "reason": "no signal",
   "retry_if": "-"
  },
  {
   "id": "self-answered-question",
   "date": "2026-11-04",
   "source": "blader/humanizer@0ef9fe5 section 4; petergyang/no-ai-slop@000650b",
   "kind": "check",
   "target": "new TELL",
   "what": "'Honestly? It depends.'",
   "outcome": "rejected",
   "measured": "evaluate.py, held-out split",
   "result": "humans 5-7%, AI 2%",
   "reason": "humans more than AI",
   "retry_if": "-"
  },
  {
   "id": "a5-a24-wider",
   "date": "2026-11-04",
   "source": "blader/humanizer@0ef9fe5 sections 5 and 25",
   "kind": "check",
   "target": "A5, A24",
   "what": "you might think... but; compiled from; the table below compares",
   "outcome": "rejected",
   "measured": "evaluate.py, held-out split",
   "result": "no hits",
   "reason": "no signal",
   "retry_if": "-"
  },
  {
   "id": "paren-hedge",
   "date": "2026-11-04",
   "source": "conorbronsdon/avoid-ai-writing@ccc8fc4 PARENTHETICAL_HEDGE",
   "kind": "check",
   "target": "new TELL",
   "what": "(notably ...), (or more precisely ...)",
   "outcome": "rejected",
   "measured": "evaluate.py, held-out split",
   "result": "no hits",
   "reason": "no signal",
   "retry_if": "-"
  },
  {
   "id": "fillers",
   "date": "2026-11-04",
   "source": "conorbronsdon/avoid-ai-writing@ccc8fc4 FILLERS, TRANSITIONS",
   "kind": "check",
   "target": "new TELL",
   "what": "in terms of, the reality is that, when it comes to, that being said",
   "outcome": "rejected",
   "measured": "evaluate.py, held-out split",
   "result": "14-20% of human posts",
   "reason": "humans",
   "retry_if": "-"
  },
  {
   "id": "bullet-noun-lists",
   "date": "2026-11-04",
   "source": "conorbronsdon/avoid-ai-writing@ccc8fc4 bullet-np-list",
   "kind": "check",
   "target": "new TELL",
   "what": "5+ bullets of bare noun phrases",
   "outcome": "rejected",
   "measured": "evaluate.py, held-out split",
   "result": "train AUC down (0.861->0.854)",
   "reason": "no gain on train",
   "retry_if": "-"
  },
  {
   "id": "blog-wordlists",
   "date": "2026-11-04",
   "source": "sam-paech/slop-score@289264a data/slop_list.json; sam-paech/antislop-sampler@0ae330e slop_words_2025-04-07.json; conorbronsdon/avoid-ai-writing@ccc8fc4 TIER1-3; theclaymethod/unslop@17ed39c; hardikpandya/stop-slop@8da1f03; blader/humanizer@0ef9fe5",
   "kind": "lexicon",
   "target": "ai-lean.txt",
   "what": "2,779 entries not already in quiron",
   "outcome": "rejected",
   "measured": "evaluate.py, held-out split",
   "result": "1 of 2,779 passed (surprisingly, shipped)",
   "reason": "the rest fail <=4% human / >=10% AI",
   "retry_if": "a newer list mined from 2026+ models"
  },
  {
   "id": "fiction-wordlist",
   "date": "2026-11-04",
   "source": "sam-paech/antislop-sampler@0ae330e slop_words_2025-04-07.json; sam-paech/slop-score@289264a creative segment",
   "kind": "lexicon",
   "target": "ai-lean-fiction.txt",
   "what": "29 words passing <=5%/>=8% on train",
   "outcome": "rejected",
   "measured": "evaluate.py, held-out split",
   "result": "B1 FAIL held-out human stories 0%->3%",
   "reason": "humans",
   "retry_if": "-"
  },
  {
   "id": "fiction-wordlist-strict",
   "date": "2026-11-04",
   "source": "sam-paech/antislop-sampler@0ae330e",
   "kind": "lexicon",
   "target": "ai-lean-fiction.txt",
   "what": "crouched, deliberate, hollow, tightened, tremble(ing), who'd (<=2%/>=10%)",
   "outcome": "rejected",
   "measured": "~/corpus/fiction-fresh (WritingPrompts offsets 120000-200000) + 30 fresh AI stories, shipped bands",
   "result": "fresh data (117 new human stories, 30 new AI): lexicon AUC 0.649->0.702, human any-FAIL 8.5%->9.4%",
   "reason": "one more human flagged",
   "retry_if": "-"
  },
  {
   "id": "fiction-phrases",
   "date": "2026-11-04",
   "source": "sam-paech/antislop-sampler@0ae330e slop_phrases_2025-04-07.json + slop_phrase_prob_adjustments.json",
   "kind": "lexicon",
   "target": "A29",
   "what": "2,529 phrases",
   "outcome": "rejected",
   "measured": "evaluate.py, held-out split",
   "result": "0 passed; 13 appear in any AI train story",
   "reason": "no signal",
   "retry_if": "-"
  },
  {
   "id": "preview-fulfil",
   "date": "2026-11-04",
   "source": "theclaymethod/unslop@17ed39c scripts/silhouette_scan.py preview_fulfillment",
   "kind": "feature",
   "target": "aimeter",
   "what": "share of paragraphs whose first content word is in the intro",
   "outcome": "rejected",
   "measured": "feature screen + eval/e2e dev (20 titles) and test (18), 2 rewrites per title, 2 Opus + 1 GPT judges",
   "result": "AI-side AUC blog 0.879->0.881, es 0.829->0.849 (Spanish stopwords); e2e Opus dev 32.0->33.8 p=0.45, test 26.7->29.0 p=0.21",
   "reason": "rewrites worse",
   "retry_if": "-"
  },
  {
   "id": "heading-preview",
   "date": "2026-11-04",
   "source": "theclaymethod/unslop@17ed39c silhouette_scan.py",
   "kind": "feature",
   "target": "aimeter",
   "what": "heading words appearing in the intro",
   "outcome": "rejected",
   "measured": "evaluate.py, held-out split",
   "result": "es AI-side AUC 0.829->0.818",
   "reason": "worse in Spanish",
   "retry_if": "-"
  },
  {
   "id": "callback",
   "date": "2026-11-04",
   "source": "theclaymethod/unslop@17ed39c silhouette_scan.py m_callback_content",
   "kind": "feature",
   "target": "aimeter",
   "what": "content words in the first third, absent in the middle, back in the last",
   "outcome": "rejected",
   "measured": "evaluate.py, held-out split",
   "result": "blog: one held-out human now C1 FAIL; fiction no direction",
   "reason": "humans",
   "retry_if": "-"
  },
  {
   "id": "summary-sandwich",
   "date": "2026-11-04",
   "source": "theclaymethod/unslop@17ed39c silhouette_scan.py",
   "kind": "feature",
   "target": "aimeter",
   "what": "first/last paragraph bigram overlap",
   "outcome": "rejected",
   "measured": "evaluate.py, held-out split",
   "result": "test AUC < 0.5",
   "reason": "no signal",
   "retry_if": "-"
  },
  {
   "id": "staccato-run",
   "date": "2026-11-04",
   "source": "theclaymethod/unslop@17ed39c scripts/readability_metrics.py",
   "kind": "feature",
   "target": "aimeter",
   "what": "longest run of sentences of 5 words or fewer",
   "outcome": "rejected",
   "measured": "evaluate.py, held-out split",
   "result": "fiction: a human C1 FAIL, AI-side AUC 0.983->0.973; blog no direction",
   "reason": "humans",
   "retry_if": "-"
  },
  {
   "id": "specific-anchors",
   "date": "2026-11-04",
   "source": "harshaneel/humanize@9c3dec3 step 2; petergyang/no-ai-slop@000650b portability test",
   "kind": "feature",
   "target": "aimeter",
   "what": "numbers + mid-sentence proper nouns + links per 1k words",
   "outcome": "rejected",
   "measured": "evaluate.py, held-out split",
   "result": "blog AUC 0.68/0.81/0.61 but human overshot 1.25->1.30; no direction in fiction or es",
   "reason": "more overshoot; would push rewriters to invent specifics",
   "retry_if": "-"
  },
  {
   "id": "ngram-repetition",
   "date": "2026-11-04",
   "source": "sam-paech/slop-score@289264a repetitionScore",
   "kind": "feature",
   "target": "aimeter",
   "what": "over-used content bigrams/trigrams against human train",
   "outcome": "rejected",
   "measured": "evaluate.py, held-out split",
   "result": "blog AI-side AUC up, fiction 0.983->0.977, es 0.829->0.818, human overshot up",
   "reason": "worse in two registers",
   "retry_if": "-"
  },
  {
   "id": "dialogue-frequency",
   "date": "2026-11-04",
   "source": "sam-paech/slop-score@289264a calculateDialogueFrequency",
   "kind": "feature",
   "target": "aimeter (fiction)",
   "what": "quote marks per 1k characters",
   "outcome": "rejected",
   "measured": "evaluate.py, held-out split",
   "result": "fiction: no direction (AUC 0.59)",
   "reason": "no signal",
   "retry_if": "-"
  },
  {
   "id": "avoid-stylometry",
   "date": "2026-11-04",
   "source": "conorbronsdon/avoid-ai-writing@ccc8fc4 patterns.js lines 2715-3115",
   "kind": "feature",
   "target": "aimeter",
   "what": "bold_1k, para_cv_std, para_punct_cv, para_sent_cv, fw_trigram_entropy",
   "outcome": "rejected",
   "measured": "evaluate.py, held-out split",
   "result": "near chance or more human overshoot (para_punct_cv gpt AUC 0.41)",
   "reason": "no signal",
   "retry_if": "-"
  },
  {
   "id": "factdiff-lost",
   "date": "2026-11-04",
   "source": "theclaymethod/unslop@17ed39c validate_preservation.py; conorbronsdon/avoid-ai-writing@ccc8fc4 validate.js",
   "kind": "method",
   "target": "factdiff.py",
   "what": "warn on numbers, negations and conditionals lost from the notes",
   "outcome": "rejected",
   "measured": "evaluate.py, held-out split",
   "result": "fired on 10 of 20 rewrites, nearly all list counters, ports and IDs; negations and conditionals grow from terse notes",
   "reason": "noise",
   "retry_if": "-"
  },
  {
   "id": "copy-gate",
   "date": "2026-11-04",
   "source": "theclaymethod/unslop@17ed39c voice_score.py copy_gate",
   "kind": "method",
   "target": "factdiff.py --sample",
   "what": "4-gram overlap > 0.35 or shared run > 120 chars with the voice sample",
   "outcome": "rejected",
   "measured": "19 dev rewrites with sample.md, base snapshot",
   "result": "7 of 19 rewrites with a sample tripped it, all the author's own sign-off also in the notes; 0 without a sample",
   "reason": "false positives only",
   "retry_if": "-"
  },
  {
   "id": "no-skill-arm",
   "date": "2026-11-04",
   "source": "theclaymethod/unslop@17ed39c evals/CORE-BENCHMARK.md",
   "kind": "method",
   "target": "eval/e2e",
   "what": "same rewriter, same notes, one-sentence instruction instead of the skill",
   "outcome": "measured",
   "measured": "eval/e2e dev (20 titles) and test (18), 2 rewrites per title, 2 Opus + 1 GPT judges",
   "result": "skill better: Opus dev 32.0 vs 44.0 p=0.001, test 26.7 vs 32.1 p=0.011; GPT agrees",
   "reason": "recorded in numbers.md",
   "retry_if": "rerun when SKILL.md changes a lot"
  },
  {
   "id": "human-as-input",
   "date": "2026-11-04",
   "source": "theclaymethod/unslop@17ed39c core_metrics.py clean_noop_rate",
   "kind": "method",
   "target": "eval/e2e",
   "what": "14 human posts rewritten as if they were drafts",
   "outcome": "measured",
   "measured": "harness judge, 2 Opus + 1 GPT",
   "result": "P(AI) Opus 6.0->7.5 p=0.056, GPT 6.4->7.9 p=0.09; 2 of 16 not rewritten (asked for notes)",
   "reason": "recorded in numbers.md: the loop costs a little on human text",
   "retry_if": "a do-no-harm rule, judged the same way"
  },
  {
   "id": "binoculars-raidar",
   "date": "2026-11-04",
   "source": "harshaneel/humanize@9c3dec3 .github/benchmark, references/research.md",
   "kind": "method",
   "target": "eval",
   "what": "Binoculars lift, self-rewrite distance",
   "outcome": "not-measurable",
   "measured": "evaluate.py, held-out split",
   "result": "-",
   "reason": "needs a model, not stdlib; Part D already covers perplexity detectors",
   "retry_if": "-"
  },
  {
   "id": "stock-phrases",
   "date": "2026-09",
   "source": "references/numbers.md",
   "kind": "various",
   "target": "-",
   "what": "stock 2-4 word phrase lists chosen on train",
   "outcome": "rejected",
   "measured": "see references/numbers.md, 'Checks measured and not shipped'",
   "result": "see numbers.md",
   "reason": "see numbers.md",
   "retry_if": "new evidence"
  },
  {
   "id": "length-verbosity",
   "date": "2026-09",
   "source": "references/numbers.md",
   "kind": "various",
   "target": "-",
   "what": "length as verbosity",
   "outcome": "rejected",
   "measured": "see references/numbers.md, 'Checks measured and not shipped'",
   "result": "see numbers.md",
   "reason": "see numbers.md",
   "retry_if": "new evidence"
  },
  {
   "id": "negated-setup-a1c",
   "date": "2026-09",
   "source": "references/numbers.md",
   "kind": "various",
   "target": "-",
   "what": "negated setup A1c inside the loop (kept as --review item)",
   "outcome": "rejected",
   "measured": "see references/numbers.md, 'Checks measured and not shipped'",
   "result": "see numbers.md",
   "reason": "see numbers.md",
   "retry_if": "new evidence"
  },
  {
   "id": "semantic-redundancy",
   "date": "2026-09",
   "source": "references/numbers.md",
   "kind": "various",
   "target": "-",
   "what": "the same claim twice within three sentences",
   "outcome": "rejected",
   "measured": "see references/numbers.md, 'Checks measured and not shipped'",
   "result": "see numbers.md",
   "reason": "see numbers.md",
   "retry_if": "new evidence"
  },
  {
   "id": "stylometry-2024-2026",
   "date": "2026-09",
   "source": "references/numbers.md",
   "kind": "various",
   "target": "-",
   "what": "concessives, downtoners, adjective pairs, synthetic negation, ', which' relatives, asides, particle openers, prescriptive last paragraph",
   "outcome": "rejected",
   "measured": "see references/numbers.md, 'Checks measured and not shipped'",
   "result": "see numbers.md",
   "reason": "see numbers.md",
   "retry_if": "new evidence"
  },
  {
   "id": "claude-chat-words",
   "date": "2026-09",
   "source": "references/numbers.md",
   "kind": "various",
   "target": "-",
   "what": "load-bearing, footgun, blast radius, the crux, the tell",
   "outcome": "rejected",
   "measured": "see references/numbers.md, 'Checks measured and not shipped'",
   "result": "see numbers.md",
   "reason": "see numbers.md",
   "retry_if": "new evidence"
  },
  {
   "id": "worked-example",
   "date": "2026-09",
   "source": "references/numbers.md",
   "kind": "various",
   "target": "-",
   "what": "worked before/after example in SKILL.md",
   "outcome": "rejected",
   "measured": "see references/numbers.md, 'Checks measured and not shipped'",
   "result": "see numbers.md",
   "reason": "see numbers.md",
   "retry_if": "new evidence"
  },
  {
   "id": "judge-reason-rules",
   "date": "2026-09",
   "source": "references/numbers.md",
   "kind": "various",
   "target": "-",
   "what": "colon lead-ins, clipped comments, code retold; letting the notes set the length",
   "outcome": "rejected",
   "measured": "see references/numbers.md, 'Checks measured and not shipped'",
   "result": "see numbers.md",
   "reason": "see numbers.md",
   "retry_if": "new evidence"
  },
  {
   "id": "condensed-skill",
   "date": "2026-09",
   "source": "references/numbers.md",
   "kind": "various",
   "target": "-",
   "what": "condensed SKILL.md",
   "outcome": "rejected",
   "measured": "see references/numbers.md, 'Checks measured and not shipped'",
   "result": "see numbers.md",
   "reason": "see numbers.md",
   "retry_if": "new evidence"
  },
  {
   "id": "placeholders-dates",
   "date": "2026-09",
   "source": "references/numbers.md",
   "kind": "various",
   "target": "-",
   "what": "placeholders and date notes as checklist items",
   "outcome": "rejected",
   "measured": "see references/numbers.md, 'Checks measured and not shipped'",
   "result": "see numbers.md",
   "reason": "see numbers.md",
   "retry_if": "new evidence"
  },
  {
   "id": "samples-2026-11",
   "date": "2026-11-12",
   "source": "research November 2026 (Graphite AI Tells: 55-72% of tells are version-specific)",
   "kind": "method",
   "target": "eval/ai",
   "what": "the same titles written again by Opus 5.5, Sonnet 5.5, Haiku 5.5, Fable 5.2, GPT-6.1 and GPT-6.1 Terra, with a manifest",
   "outcome": "measured",
   "measured": "evaluate.py on the three registers, old and new groups side by side",
   "result": "checklist clean, blog: Sonnet 0% (Sept) -> Sonnet 5.5 79%, Opus 5.5 79%, Fable 5.2 93%, GPT-6.1 7%; A8 dashes Sonnet 100% -> Sonnet 5.5 14%, humans 22%",
   "reason": "recorded in numbers.md; the checklist sees less of each new Claude model",
   "retry_if": "rerun with each new model generation"
  },
  {
   "id": "cheap-judge-panel",
   "date": "2026-11-12",
   "source": "this repo, eval/e2e",
   "kind": "method",
   "target": "eval/e2e/harness.py",
   "what": "Sonnet 5.5 and GPT-6.1 Terra as blind judges in place of Opus 5.5 and GPT-5.6",
   "outcome": "measured",
   "measured": "58 texts already judged by Opus: 18 human, 20 rewrites, 20 drafts",
   "result": "Sonnet 4.8 / 12.4 / 79.2, Terra 6.3 / 46.1 / 91.9, Opus 5.9 / 32.2 / 87.8; r with Opus 0.96 overall, 0.67 and 0.55 on rewrites",
   "reason": "JUDGE and GPT_MODEL in harness.py; documented in eval/e2e/README.md",
   "retry_if": "-"
  },
  {
   "id": "judge-noise",
   "date": "2026-11-12",
   "source": "this repo, eval/e2e",
   "kind": "method",
   "target": "eval/e2e/report.py --noise",
   "what": "rep-against-rep and judge-against-judge spread of one snapshot",
   "outcome": "measured",
   "measured": "cached rewrites of base, c18, pf, noskill, sbase",
   "result": "set mean moves up to 3.1 points between reps (Opus panel), 2.1 (Sonnet panel); per-title sd 5 to 14; judge-judge sd 3 to 10",
   "reason": "a difference under about 3 points between versions is not a result",
   "retry_if": "-"
  },
  {
   "id": "bands-both-months",
   "date": "2026-11-12",
   "source": "this repo, eval/ai/*/train-2026-11",
   "kind": "feature",
   "target": "bands.json, bands-es.json, bands-fiction.json, AI_REF",
   "what": "AI medians and directions from September and November training texts together; human edges kept",
   "outcome": "shipped",
   "measured": "evaluate.py, held-out split, ai-train both months",
   "result": "blog: humans 100% clean both, AI-side mean on humans 0.93 -> 0.75, six directions dropped (ly adverbs, questions, repeated openers, semicolons, em dashes, participles); es: humans failing C1 7% -> 5%, clean 91% -> 93%; fiction: Opus C1 10% -> 30%, Sonnet 5.5 0% -> 20%, humans clean 97% both",
   "reason": "fewer humans on the AI side, no loss on the November models",
   "retry_if": "-"
  },
  {
   "id": "lexicon-november-2026",
   "date": "2026-11-12",
   "source": "Graphite AI Tells (CC BY 4.0), Wikipedia Signs of AI writing mid-2026 list, eval/lexicon-pool-blog.tsv",
   "kind": "lexicon",
   "target": "ai-lean.txt",
   "what": "practical, quietly, deliberate/deliberately, preserve",
   "outcome": "shipped",
   "measured": "evaluate.py, held-out split, ai-train both months",
   "result": "B1 FAIL Opus 5.5 7% -> 14%, Sonnet 5.5 14% -> 29%, GPT-6.1 21% -> 36%, Terra 14% -> 29%, humans 0%; lexicon AUC Opus 5.5 0.60 -> 0.72, GPT-6.1 0.72 -> 0.89; B1 fires on 0 of 188 cached rewrites",
   "reason": "each passed the per-entry rule on train-2026-11 (<=4% human, >=10% AI)",
   "retry_if": "-"
  },
  {
   "id": "lexicon-matters",
   "date": "2026-11-12",
   "source": "Graphite AI Tells; Wikipedia mid-2026 list",
   "kind": "lexicon",
   "target": "ai-lean.txt",
   "what": "matters",
   "outcome": "rejected",
   "measured": "evaluate.py, held-out split, ai-train both months",
   "result": "3% of human training posts, 38% of train-2026-11, but 5% of held-out humans; with it one held-out human post fails T1",
   "reason": "flags a human",
   "retry_if": "a form narrower than the bare word"
  },
  {
   "id": "lexicon-technical-nouns-2026",
   "date": "2026-11-12",
   "source": "eval/lexicon-pool-blog.tsv on train-2026-11",
   "kind": "lexicon",
   "target": "ai-lean.txt",
   "what": "handling, infrastructure, integration, aim, tone",
   "outcome": "rejected",
   "measured": "evaluate.py, held-out split, ai-train both months",
   "result": "pass the per-entry rule (2-3% human, 10-19% AI)",
   "reason": "field vocabulary, removed before for the same reason; aim and tone in 0-14% of held-out AI groups",
   "retry_if": "-"
  },
  {
   "id": "lexicon-es-fiction-2026",
   "date": "2026-11-12",
   "source": "eval/lexicon-pool-es.tsv, eval/lexicon-pool-fiction.tsv on train-2026-11",
   "kind": "lexicon",
   "target": "ai-lean-es.txt, ai-lean-fiction.txt",
   "what": "the per-entry rule again on the November texts",
   "outcome": "rejected",
   "measured": "evaluate.py, held-out split, ai-train both months",
   "result": "fiction: no entry passes; es: reciente and combinacion pass on training, 11% and 6% of held-out humans",
   "reason": "nothing admissible",
   "retry_if": "a larger Spanish pool"
  },
  {
   "id": "e4-bold-labels-es",
   "date": "2026-11-12",
   "source": "Giammatteo & Carranza 2026 (Exlibris); A18",
   "kind": "check",
   "target": "CHECKS_ES E4",
   "what": "a list item that opens with a bold label, as a Spanish TELL",
   "outcome": "shipped",
   "measured": "evaluate.py, Spanish held-out split",
   "result": "humans 14%, Opus 5.5 60%, Sonnet 5.5 40%, Fable 5.2 70%, GPT 0%; checklist AUC Opus 5.5 0.70 -> 0.82, Fable 5.2 0.71 -> 0.88, GPT-6.1 0.39 -> 0.33; humans clean 93% both",
   "reason": "AUC up on every Claude group, no new human FAIL",
   "retry_if": "-"
  },
  {
   "id": "a3c-real-actual",
   "date": "2026-11-12",
   "source": "reader reports October 2026 (r/ClaudeAI, Hacker News): real / actual as emphasis",
   "kind": "check",
   "target": "new TELL A3c",
   "what": "the|a|any|no + real|actual + noun",
   "outcome": "rejected",
   "measured": "evaluate.py, held-out split, ai-train both months",
   "result": "humans 15%, Opus 5.5 43%, Sonnet 5.5 50%, Fable 5.2 50%, GPT-6.1 29%; checklist AUC Opus 5.5 0.71 -> 0.74; one held-out human post now fails T1 (clean 100% -> 97%); 12% of the rewrites, under the human rate",
   "reason": "flags a human",
   "retry_if": "as a rate, not a TELL"
  },
  {
   "id": "graphite-opus55-phrases",
   "date": "2026-11-12",
   "source": "Graphite AI Tells, Opus 5.5 update (zero-human trigrams)",
   "kind": "check",
   "target": "A12 or claude-lean.txt",
   "what": "this matters because, taken together these, the takeaway is, just as importantly, helps to understand, in plain terms, bringing it all",
   "outcome": "rejected",
   "measured": "share of texts, 160 human posts and every eval/ai/blog group",
   "result": "0% of humans and 0% to 14% of any group, 2% of train-2026-11",
   "reason": "they belong to the article prompt Graphite used, not to posts written from a title",
   "retry_if": "samples from an article-from-brief prompt"
  },
  {
   "id": "contrast-2026-forms",
   "date": "2026-11-12",
   "source": "Graphite AI Tells; reader reports",
   "kind": "check",
   "target": "audit.py --review",
   "what": "not simply/merely, rather than merely/simply/relying/treating, less like X more like Y, is more than a X, without sacrificing/losing",
   "outcome": "rejected",
   "measured": "share of texts, same groups",
   "result": "each in 0% to 7% of November groups and 0% to 2% of humans (rather than merely: 29% of September Sonnet only)",
   "reason": "too rare in the current models to act on",
   "retry_if": "-"
  },
  {
   "id": "es-orthotypography",
   "date": "2026-11-12",
   "source": "Giammatteo & Carranza 2026 (Exlibris)",
   "kind": "check",
   "target": "CHECKS_ES",
   "what": "Title Case headings, capital after the colon of a list label, colon after a bare verb, comma before the final y; contrast variants (no solo... sino, no se limita a, semicolon form); ahi radica",
   "outcome": "rejected",
   "measured": "share of texts, 245 human posts and every eval/ai/es group",
   "result": "Title Case 5% human, 0% AI; capital after colon 23% human, 0-60% AI; colon after verb 19% human, 0-20% AI; comma before y 15% human, 0-50% AI; contrast variants 0-6% human, 0-10% November AI; ahi radica in no text",
   "reason": "human rates too high or the pattern absent from the models",
   "retry_if": "-"
  },
  {
   "id": "order-and-ending-from-notes",
   "date": "2026-11-12",
   "source": "SlopShape arXiv:2609.15369 (ending restates thesis, synthesis stage, thesis before first section)",
   "kind": "various",
   "target": "SKILL.md, build the post from the notes",
   "what": "before writing, take the order, the ending, the dates and links from the notes; add no stage the notes lack",
   "outcome": "rejected",
   "measured": "eval/e2e, Sonnet 5.5 rewriter, 2 Sonnet 5.5 judges + 1 GPT-6.1 Terra judge, dev (20 titles) and test (18), 2 rewrites per title",
   "result": "dev: Sonnet 15.0 -> 13.1 (worse 5/20, p=0.018), Terra 50.0 -> 46.3 (p=0.098); test: 13.2 -> 12.3 (p=0.64), 49.6 -> 46.7 (p=0.31); pooled 38 titles -1.5 (p=0.061) and -3.4 (p=0.048); overshot 1.83 -> 2.03 (worse on 18 titles, better on 9, p=0.19); factdiff fails 3 -> 5 of 76",
   "reason": "gain inside the rep noise, not significant on test, overshot not rarer",
   "retry_if": "a rewriter that restructures without overshooting"
  },
  {
   "id": "undo-overshoot",
   "date": "2026-11-12",
   "source": "this repo: rewrites overshoot on ly adverbs, word length, long words, nominalizations",
   "kind": "various",
   "target": "SKILL.md Workflow step 4",
   "what": "on top of order-and-ending: read the overshot rows and put back the exact word or adverb taken out",
   "outcome": "rejected",
   "measured": "eval/e2e, Sonnet 5.5 rewriter, 2 Sonnet 5.5 judges + 1 GPT-6.1 Terra judge, dev (20 titles) and test (18), 2 rewrites per title",
   "result": "overshot 1.83 -> 2.19, worse on 19 of 38 titles, better on 6 (p=0.008); dev Terra -11.5 (p=0.001) not repeated on test (Sonnet +0.0, Terra -2.1)",
   "reason": "the instruction raised what it was meant to lower",
   "retry_if": "-"
  },
  {
   "id": "do-no-harm-rule",
   "date": "2026-11-12",
   "source": "Shan, Lee & Hao arXiv:2608.27855; ledger human-as-input",
   "kind": "various",
   "target": "SKILL.md",
   "what": "measure the draft first; with no notes and no FAIL, change only a ruled-against TELL",
   "outcome": "rejected",
   "measured": "eval/e2e hum (16 human posts, no notes) and devnn (20 AI drafts, no notes), Sonnet 5.5 rewriter, same panel, 1 rewrite each",
   "result": "human posts: originals 5.5 / 6.4, current skill 6.5 / 8.2, with the rule 5.7 / 6.9 (Sonnet -0.8 p=0.15, Terra -1.3 p=0.31, worse on 2 of 16); AI drafts: 67.0 -> 65.2 (p=0.34), 81.7 -> 82.5 (p=0.60)",
   "reason": "no measurable gain; with Sonnet 5.5 the loop costs a human text about one point",
   "retry_if": "a larger human set"
  },
  {
   "id": "factdiff-quotes",
   "date": "2026-11-12",
   "source": "Wang, Zhu & Chen 2026 (humanizer audit: at most 4 of 15 quotes kept verbatim)",
   "kind": "method",
   "target": "factdiff.py",
   "what": "list quoted spans of four words or more that are in no source",
   "outcome": "rejected",
   "measured": "76 cached Sonnet rewrites against draft and notes",
   "result": "43 quotes, 8 flagged, 6 of them the text between two quoted spans",
   "reason": "mostly noise",
   "retry_if": "a quote parser that pairs marks"
  },
  {
   "id": "shared-openings",
   "date": "2026-11-12",
   "source": "SlopBench arXiv:2609.33905 (same-prompt opener repetition)",
   "kind": "method",
   "target": "eval/e2e/report.py",
   "what": "share of rewrites of different titles that open on the same words",
   "outcome": "not-measurable",
   "measured": "40 cached rewrites, 40 no-skill rewrites, 160 human posts",
   "result": "most common three-word opening: 4 of 40 rewrites, 2 of 40 no-skill, 8 of 160 human",
   "reason": "different titles share no opening; the measure needs several outputs of one prompt",
   "retry_if": "a set with repeated prompts"
  },
  {
   "id": "package-1.4.0-e2e",
   "date": "2026-11-12",
   "source": "this repo",
   "kind": "method",
   "target": "eval/e2e",
   "what": "bands from both months, four lexicon words and E4 together, against the version before them",
   "outcome": "measured",
   "measured": "eval/e2e, Sonnet 5.5 rewriter, 2 Sonnet 5.5 judges + 1 GPT-6.1 Terra judge, dev and test (2 rewrites per title) and es (1)",
   "result": "dev Sonnet +0.5 (p=0.72), Terra -2.3 (p=0.43); test +0.1 (p=0.67), -1.7 (p=0.74); es +0.5 (p=0.55), -0.8 (p=0.80); overshot +0.16 per text (p=0.15)",
   "reason": "rewrites judged the same; the changes act on detection",
   "retry_if": "-"
  },
  {
   "id": "work-registers",
   "date": "2026-11-12",
   "source": "reader reports 2026 on PR descriptions, commit messages and READMEs; ledger entries blocked on missing samples",
   "kind": "feature",
   "target": "bands-pr.json, bands-commit.json, bands-readme.json, bands-email.json",
   "what": "four band files from pre-ChatGPT human texts (GitHub API, AESLC) and November 2026 assistant texts on the same titles",
   "outcome": "shipped",
   "measured": "evaluate.py, held-out split, per register",
   "result": "held-out humans clean 98% pr, 97% commit, 100% readme, 98% email; GPT-6.1 clean 43%, 0%, 0%, 12%; Claude models clean 67% to 100%; 5 to 9 held-out assistant texts per model",
   "reason": "new registers measured; humans within the 5% ceiling",
   "retry_if": "larger held-out groups; samples written from a diff; an end-to-end set for these registers"
  }
 ]
}
slack-gif-creatoranthropics/skillsKnowledge and utilities for creating animated GIFs optimized for Slack. Provides constraints, validation tools, and animation concepts. Use when users request animated GIFs for Slack like "make me a GIF of X doing Y for Slack."Stars: 197kUpdated Claude CodeCodexVerifiedInstall
ponytailDietrichGebert/ponytailLazy senior dev mode for any coding task: the smallest change that fully solves it, and a reply a busy human understands in one read.Stars: 194kUpdated Claude CodeCodexVerifiedInstall
ponytail-debtDietrichGebert/ponytailHarvest every shortcut: comment into one debt ledger, so deferrals get tracked instead of forgotten. One-shot report.Stars: 194kUpdated Claude CodeCodexVerifiedInstall
ponytail-debtDietrichGebert/ponytailList every `shortcut:` comment (and older `ponytail:` ones) as a debt ledger. One-shot report, changes nothing. Use for "ponytail debt", "what did ponytail defer", "list the shortcuts", /ponytail-debt.Stars: 194kUpdated Claude CodeCodexVerifiedInstall