Skip to content

ericrisco/rsc-harness / skills/together-fireworks

together-fireworks

Verified

Use when calling open-weight LLMs on Together AI or Fireworks AI's OpenAI-compatible endpoints — `base_url` plus namespaced model id, the cheapest model that clears the bar, per-1M-token cost math, serverless vs batch vs dedicated. NOT renting GPUs to self-host weights (that is `runpod`), NOT running a model locally for free (that is `ollama`).

FileKindSize
SKILL.mdskill md13.1 KB
evals/README.mdmarkdown1.0 KB
evals/cases.yamlconfig3.4 KB
references/batch-and-tuning.mdmarkdown3.5 KB
references/models-and-pricing.mdmarkdown6.8 KB
scripts/verify.shexecutablescript6.3 KB

evals/cases.yaml

View on GitHub
skill: together-fireworks

should_trigger:
  - prompt: "Wire up the OpenAI SDK to call DeepSeek on Together AI."
    why: Core job — point the OpenAI SDK at api.together.ai with the right base_url and namespaced model id.
  - prompt: "My Fireworks call returns 404 model not found, here's my code."
    why: Non-obvious — the classic bare-model-name bug; the fix is the accounts/fireworks/models/ namespace, squarely this skill.
  - prompt: "Cut our open-model inference bill in half for a 200k-row classification job."
    why: Batch-discount trigger — offline volume + cost; routes to the 50%-off batch decision, not generic cost tracking.
  - prompt: "¿Qué modelo open source uso en Fireworks y cuánto me cuesta por millón de tokens?"
    why: Spanish + model choice + per-1M cost — the pick-the-model decision table is this skill.
  - prompt: "We're on GPT-4 but want a cheaper open-weights endpoint, same code if possible."
    why: Migration trigger — OpenAI-compatible host means change base_url + key + model id only.
  - prompt: "Should I use serverless or dedicated on Fireworks for 50 QPS sustained?"
    why: Serving-mode decision (serverless vs batch vs dedicated) is a core section of this skill.
  - prompt: "Abaratar la factura d'inferència fent servir batch a Together."
    why: Catalan + the Together-native-Batch-API gotcha — not the OpenAI Batch endpoint.

should_not_trigger:
  - prompt: "Spin up an A100 pod and run vLLM myself."
    route_to: runpod
    why: Raw GPU self-host — you manage the box; this skill is a per-token hosted endpoint.
  - prompt: "Run Llama locally on my Mac with no API cost."
    route_to: ollama
    why: Local/offline, zero marginal cost; together-fireworks is cloud pay-per-token.
  - prompt: "Generate images with FLUX on a hosted endpoint."
    route_to: fal
    why: Media generation, not text/chat/embeddings LLM inference.
  - prompt: "Deploy a model from the Hugging Face hub as an inference endpoint."
    route_to: huggingface
    why: HF hub + HF Inference Endpoints, a different host with its own ids.
  - prompt: "Help me write a better system prompt for my chatbot."
    route_to: prompt-engineering
    why: Prompt design, not the hosting endpoint where tokens are billed.
  - prompt: "Build the retrieval + reranking pipeline for my docs."
    route_to: rag
    why: A pipeline built on top of inference, not the inference endpoint itself.

capability:
  - scenario: >
      A user has a 500,000-document text classification job, no real-time latency
      requirement, and a tight budget. Recommend a provider, a model with its exact
      id, a serving mode, and estimate the cost.
    must_include:
      - Picks batch inference and states it is ~50% off serverless on both providers.
      - Names a cheap small model with a concrete namespaced id from a stable (non-projected) row (e.g. openai/gpt-oss-20b on Together, or a Fireworks <4B/4B-16B tier id) — not a fast-moving flagship.
      - Applies the cost formula (in_tokens*in_price + out_tokens*out_price)/1e6 with the $/1M numbers as read off the provider page on 2026-06-02 and the 0.5 batch multiplier; any flagship/(projected) figure is flagged "re-read the page before quoting".
      - Uses the correct base_url and a namespaced model id (no bare model name).
      - Notes that Together uses its native Batch API (JSONL upload), not the OpenAI /v1/batches endpoint.
      - Prioritizes model choice (cheap small model) over serving mode as the bigger cost lever.
slack-gif-creatoranthropics/skillsKnowledge and utilities for creating animated GIFs optimized for Slack. Provides constraints, validation tools, and animation concepts. Use when users request animated GIFs for Slack like "make me a GIF of X doing Y for Slack."Stars: 198kUpdated Claude CodeCodexVerifiedInstall
ponytailDietrichGebert/ponytailLazy senior dev mode for any coding task: the smallest change that fully solves it, and a reply a busy human understands in one read.Stars: 194kUpdated Claude CodeCodexVerifiedInstall
ponytail-debtDietrichGebert/ponytailHarvest every shortcut: comment into one debt ledger, so deferrals get tracked instead of forgotten. One-shot report.Stars: 194kUpdated Claude CodeCodexVerifiedInstall
ponytail-debtDietrichGebert/ponytailList every `shortcut:` comment (and older `ponytail:` ones) as a debt ledger. One-shot report, changes nothing. Use for "ponytail debt", "what did ponytail defer", "list the shortcuts", /ponytail-debt.Stars: 194kUpdated Claude CodeCodexVerifiedInstall