richfrem/agent-plugins-skills / plugins/dev-utils/.apm/skills/managing-huggingface-assets
managing-huggingface-assets
VerifiedSets up, downloads from and uploads to HuggingFace repositories with credential hygiene and exponential backoff. Use to validate HuggingFace credentials and dataset structure, download files, snapshots or model weights, or upload files, folders, learning snapshots and JSONL traces. Not for searching the Hub or other storage providers.
| File | Kind | Size |
|---|---|---|
| SKILL.md | skill md | 2.7 KB |
| evals/evals.json | config | 2.1 KB |
| references/acceptance-criteria.md | markdown | 2.2 KB |
| references/download.md | markdown | 1.7 KB |
| references/fallback-tree.md | markdown | 3.4 KB |
| references/init.md | markdown | 1.4 KB |
| references/upload.md | markdown | 2.1 KB |
| scripts/hf_config.py | script | 6.2 KB |
| scripts/hf_download.pyexecutable | script | 6.5 KB |
| scripts/hf_init.py | script | 2.7 KB |
| scripts/hf_upload.py | script | 13.2 KB |
references/upload.md
View on GitHub# HuggingFace upload (`upload` mode)
Persists files, folders, soul learning snapshots, and semantic caches to HuggingFace repositories with exponential backoff.
## Critical Constraints
- **Credential Hygiene**: Consume `HUGGING_FACE_TOKEN` exclusively via environment variables; never embed tokens.
- **Rate-Limit Resilience**: Requests retry with exponential backoff (up to 5 attempts) on rate limits or connectivity issues.
- **Remote Structure Standards**: Conform to ADR 081 layout conventions (`lineage/`, `data/`, `metadata/`).
- **Upload Scope**: Dedicated to uploading and persisting assets. For downloading models or datasets, use the `download` mode.
## Dependencies
Requires Python 3.8+ (standard library only).
## Quick start
```bash
# Upload a single file
python3 scripts/hf_upload.py \
--file lineage/sealed_trace.md \
--remote-path lineage/sealed_trace.md
# Upload an entire directory
python3 scripts/hf_upload.py \
--folder ./data \
--remote-path data/
# Check the plan without uploading (works without credentials)
python3 scripts/hf_upload.py --file README.md --dry-run
```
Options: `--remote-path` (default: the file name, or the repo root for `--folder`; leading `/` is stripped and `..` is rejected), `--commit-message`, `--dry-run`. The command exits 0 on success and 1 on failure, printing the error to stderr. The credentials come from the environment variables named in [init.md](init.md); `HUGGING_FACE_USERNAME` and `HUGGING_FACE_DATASET_PATH` are required in addition to the token.
## Workflow
1. **Phase 1: Environment & Token Check**: Validate `HUGGING_FACE_TOKEN` and dataset repository write permissions.
2. **Phase 2: Remote Target Path Definition**: Ensure remote path maps to ADR 081 structure (`lineage/`, `data/`, `metadata/`).
3. **Phase 3: Execution with Backoff**: Call `hf_upload.py` CLI or Python library (`upload_file`, `upload_soul_snapshot`, `append_to_jsonl`).
4. **Phase 4: Remote Confirmation**: Validate `HFUploadResult.success` and report destination URL.
## Verification
```bash
# Verify CLI help and script loading
python3 scripts/hf_upload.py --help
```
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| slack-gif-creatoranthropics/skillsKnowledge and utilities for creating animated GIFs optimized for Slack. Provides constraints, validation tools, and animation concepts. Use when users request animated GIFs for Slack like "make me a GIF of X doing Y for Slack." | Stars: 198k | Updated | Claude CodeCodex | Verified | Install |
| ponytailDietrichGebert/ponytailLazy senior dev mode for any coding task: the smallest change that fully solves it, and a reply a busy human understands in one read. | Stars: 194k | Updated | Claude CodeCodex | Verified | Install |
| ponytail-debtDietrichGebert/ponytailHarvest every shortcut: comment into one debt ledger, so deferrals get tracked instead of forgotten. One-shot report. | Stars: 194k | Updated | Claude CodeCodex | Verified | Install |
| ponytail-debtDietrichGebert/ponytailList every `shortcut:` comment (and older `ponytail:` ones) as a debt ledger. One-shot report, changes nothing. Use for "ponytail debt", "what did ponytail defer", "list the shortcuts", /ponytail-debt. | Stars: 194k | Updated | Claude CodeCodex | Verified | Install |