ericrisco/rsc-harness / skills/training-data
training-data
VerifiedUse when assembling or curating the corpus a fine-tune trains on — turning raw examples into the JSONL shape a trainer expects (instruction, conversational, preference-pair or binary-label), matching the data to the model's chat template, generating synthetic or distilled examples, deduplicating and decontaminating against eval sets, and quality-filtering. NOT cleaning tabular rows, nulls and dtypes (that is `data-cleaning`), NOT building a retrieval corpus of chunks and embeddings (that is `embeddings-search`), NOT running the trainer or picking hyperparameters (that is `finetuning`).
| File | Kind | Size |
|---|---|---|
| SKILL.md | skill md | 14.4 KB |
| evals/README.md | markdown | 1.0 KB |
| evals/cases.yaml | config | 3.5 KB |
| references/formats.md | markdown | 5.1 KB |
| references/synthesis-dedup-quality.md | markdown | 6.4 KB |
evals/README.md
View on GitHub# Evals for the `training-data` skill
Routing + capability checks read from `cases.yaml` by the skill eval harness — no network, no
model calls, nothing to install. The `should_trigger` prompts must select this skill: they cover
format-by-trainer (DPO), converting raw pairs to `messages`, the non-obvious "model never stops /
I hand-formatted the chat tokens" template-mismatch case, synthetic-data + dedup, decontamination
against benchmarks, and a Catalan quality-filtering prompt. The `should_not_trigger` prompts must
route to the named real sibling instead — `data-cleaning` (tabular rows), `embeddings-search`
(retrieval corpus), `finetuning` / `unsloth` (running the trainer + export), `prompt-engineering`
(inference prompt craft). The single `capability` case is a rubric: a good answer to the
support-transcript scenario must hit every `must_include` bullet — the messages/JSONL shape, chat-
template rendering via `apply_chat_template`, dedup + decontamination, LIMA quality-over-quantity,
and the license/provenance + distillation-ToS guardrail.
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| slack-gif-creatoranthropics/skillsKnowledge and utilities for creating animated GIFs optimized for Slack. Provides constraints, validation tools, and animation concepts. Use when users request animated GIFs for Slack like "make me a GIF of X doing Y for Slack." | Stars: 198k | Updated | Claude CodeCodex | Verified | Install |
| ponytailDietrichGebert/ponytailLazy senior dev mode for any coding task: the smallest change that fully solves it, and a reply a busy human understands in one read. | Stars: 194k | Updated | Claude CodeCodex | Verified | Install |
| ponytail-debtDietrichGebert/ponytailHarvest every shortcut: comment into one debt ledger, so deferrals get tracked instead of forgotten. One-shot report. | Stars: 194k | Updated | Claude CodeCodex | Verified | Install |
| ponytail-debtDietrichGebert/ponytailList every `shortcut:` comment (and older `ponytail:` ones) as a debt ledger. One-shot report, changes nothing. Use for "ponytail debt", "what did ponytail defer", "list the shortcuts", /ponytail-debt. | Stars: 194k | Updated | Claude CodeCodex | Verified | Install |