Skip to content

ericrisco/rsc-harness / skills/training-data

training-data

Verified

Use when assembling or curating the corpus a fine-tune trains on — turning raw examples into the JSONL shape a trainer expects (instruction, conversational, preference-pair or binary-label), matching the data to the model's chat template, generating synthetic or distilled examples, deduplicating and decontaminating against eval sets, and quality-filtering. NOT cleaning tabular rows, nulls and dtypes (that is `data-cleaning`), NOT building a retrieval corpus of chunks and embeddings (that is `embeddings-search`), NOT running the trainer or picking hyperparameters (that is `finetuning`).

FileKindSize
SKILL.mdskill md14.4 KB
evals/README.mdmarkdown1.0 KB
evals/cases.yamlconfig3.5 KB
references/formats.mdmarkdown5.1 KB
references/synthesis-dedup-quality.mdmarkdown6.4 KB

evals/README.md

View on GitHub
# Evals for the `training-data` skill

Routing + capability checks read from `cases.yaml` by the skill eval harness — no network, no
model calls, nothing to install. The `should_trigger` prompts must select this skill: they cover
format-by-trainer (DPO), converting raw pairs to `messages`, the non-obvious "model never stops /
I hand-formatted the chat tokens" template-mismatch case, synthetic-data + dedup, decontamination
against benchmarks, and a Catalan quality-filtering prompt. The `should_not_trigger` prompts must
route to the named real sibling instead — `data-cleaning` (tabular rows), `embeddings-search`
(retrieval corpus), `finetuning` / `unsloth` (running the trainer + export), `prompt-engineering`
(inference prompt craft). The single `capability` case is a rubric: a good answer to the
support-transcript scenario must hit every `must_include` bullet — the messages/JSONL shape, chat-
template rendering via `apply_chat_template`, dedup + decontamination, LIMA quality-over-quantity,
and the license/provenance + distillation-ToS guardrail.
slack-gif-creatoranthropics/skillsKnowledge and utilities for creating animated GIFs optimized for Slack. Provides constraints, validation tools, and animation concepts. Use when users request animated GIFs for Slack like "make me a GIF of X doing Y for Slack."Stars: 198kUpdated Claude CodeCodexVerifiedInstall
ponytailDietrichGebert/ponytailLazy senior dev mode for any coding task: the smallest change that fully solves it, and a reply a busy human understands in one read.Stars: 194kUpdated Claude CodeCodexVerifiedInstall
ponytail-debtDietrichGebert/ponytailHarvest every shortcut: comment into one debt ledger, so deferrals get tracked instead of forgotten. One-shot report.Stars: 194kUpdated Claude CodeCodexVerifiedInstall
ponytail-debtDietrichGebert/ponytailList every `shortcut:` comment (and older `ponytail:` ones) as a debt ledger. One-shot report, changes nothing. Use for "ponytail debt", "what did ponytail defer", "list the shortcuts", /ponytail-debt.Stars: 194kUpdated Claude CodeCodexVerifiedInstall