ericrisco/rsc-harness / skills/together-fireworks
together-fireworks
VerifiedUse when calling open-weight LLMs on Together AI or Fireworks AI's OpenAI-compatible endpoints — `base_url` plus namespaced model id, the cheapest model that clears the bar, per-1M-token cost math, serverless vs batch vs dedicated. NOT renting GPUs to self-host weights (that is `runpod`), NOT running a model locally for free (that is `ollama`).
| File | Kind | Size |
|---|---|---|
| SKILL.md | skill md | 13.1 KB |
| evals/README.md | markdown | 1.0 KB |
| evals/cases.yaml | config | 3.4 KB |
| references/batch-and-tuning.md | markdown | 3.5 KB |
| references/models-and-pricing.md | markdown | 6.8 KB |
| scripts/verify.shexecutable | script | 6.3 KB |
evals/cases.yaml
View on GitHubskill: together-fireworks
should_trigger:
- prompt: "Wire up the OpenAI SDK to call DeepSeek on Together AI."
why: Core job — point the OpenAI SDK at api.together.ai with the right base_url and namespaced model id.
- prompt: "My Fireworks call returns 404 model not found, here's my code."
why: Non-obvious — the classic bare-model-name bug; the fix is the accounts/fireworks/models/ namespace, squarely this skill.
- prompt: "Cut our open-model inference bill in half for a 200k-row classification job."
why: Batch-discount trigger — offline volume + cost; routes to the 50%-off batch decision, not generic cost tracking.
- prompt: "¿Qué modelo open source uso en Fireworks y cuánto me cuesta por millón de tokens?"
why: Spanish + model choice + per-1M cost — the pick-the-model decision table is this skill.
- prompt: "We're on GPT-4 but want a cheaper open-weights endpoint, same code if possible."
why: Migration trigger — OpenAI-compatible host means change base_url + key + model id only.
- prompt: "Should I use serverless or dedicated on Fireworks for 50 QPS sustained?"
why: Serving-mode decision (serverless vs batch vs dedicated) is a core section of this skill.
- prompt: "Abaratar la factura d'inferència fent servir batch a Together."
why: Catalan + the Together-native-Batch-API gotcha — not the OpenAI Batch endpoint.
should_not_trigger:
- prompt: "Spin up an A100 pod and run vLLM myself."
route_to: runpod
why: Raw GPU self-host — you manage the box; this skill is a per-token hosted endpoint.
- prompt: "Run Llama locally on my Mac with no API cost."
route_to: ollama
why: Local/offline, zero marginal cost; together-fireworks is cloud pay-per-token.
- prompt: "Generate images with FLUX on a hosted endpoint."
route_to: fal
why: Media generation, not text/chat/embeddings LLM inference.
- prompt: "Deploy a model from the Hugging Face hub as an inference endpoint."
route_to: huggingface
why: HF hub + HF Inference Endpoints, a different host with its own ids.
- prompt: "Help me write a better system prompt for my chatbot."
route_to: prompt-engineering
why: Prompt design, not the hosting endpoint where tokens are billed.
- prompt: "Build the retrieval + reranking pipeline for my docs."
route_to: rag
why: A pipeline built on top of inference, not the inference endpoint itself.
capability:
- scenario: >
A user has a 500,000-document text classification job, no real-time latency
requirement, and a tight budget. Recommend a provider, a model with its exact
id, a serving mode, and estimate the cost.
must_include:
- Picks batch inference and states it is ~50% off serverless on both providers.
- Names a cheap small model with a concrete namespaced id from a stable (non-projected) row (e.g. openai/gpt-oss-20b on Together, or a Fireworks <4B/4B-16B tier id) — not a fast-moving flagship.
- Applies the cost formula (in_tokens*in_price + out_tokens*out_price)/1e6 with the $/1M numbers as read off the provider page on 2026-06-02 and the 0.5 batch multiplier; any flagship/(projected) figure is flagged "re-read the page before quoting".
- Uses the correct base_url and a namespaced model id (no bare model name).
- Notes that Together uses its native Batch API (JSONL upload), not the OpenAI /v1/batches endpoint.
- Prioritizes model choice (cheap small model) over serving mode as the bigger cost lever.
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| slack-gif-creatoranthropics/skillsKnowledge and utilities for creating animated GIFs optimized for Slack. Provides constraints, validation tools, and animation concepts. Use when users request animated GIFs for Slack like "make me a GIF of X doing Y for Slack." | Stars: 198k | Updated | Claude CodeCodex | Verified | Install |
| ponytailDietrichGebert/ponytailLazy senior dev mode for any coding task: the smallest change that fully solves it, and a reply a busy human understands in one read. | Stars: 194k | Updated | Claude CodeCodex | Verified | Install |
| ponytail-debtDietrichGebert/ponytailHarvest every shortcut: comment into one debt ledger, so deferrals get tracked instead of forgotten. One-shot report. | Stars: 194k | Updated | Claude CodeCodex | Verified | Install |
| ponytail-debtDietrichGebert/ponytailList every `shortcut:` comment (and older `ponytail:` ones) as a debt ledger. One-shot report, changes nothing. Use for "ponytail debt", "what did ponytail defer", "list the shortcuts", /ponytail-debt. | Stars: 194k | Updated | Claude CodeCodex | Verified | Install |