xberg-io/liter-llm / .ai-rulez/skills/e2e-fixtures
e2e-fixtures
Verifiedliter-llm e2e fixture schema: per-category fixture files, call names, mock provider responses, env and skip, and assertion types. Use when adding or editing a liter-llm e2e fixture.
SKILL.md
View on GitHub---
type: Reference
title: E2E Fixtures
description: "liter-llm e2e fixture schema: per-category fixture files, call names, mock provider responses, env and skip, and assertion types. Use when adding or editing a liter-llm e2e fixture."
paths:
- "fixtures/**"
- "e2e/**"
x-ai-rulez:
kind: skill
id: e2e-fixtures
metadata:
name: e2e-fixtures
---
# liter-llm E2E Fixtures
- One fixture object per file, `fixtures/<category>/<id>.json`. `fixtures/schema.json` still requires an `api` field that no fixture carries; the generator reads `call`, so follow existing fixtures, not the schema.
- Categories match the directory (`smoke`, `chat`, `streaming`, `error-handling`, `proxy`, `files`, `batches`, `rerank`, `embed`, ...); the exception is `providers/`, whose fixtures carry the test kind as `category` (`smoke`, `error-handling`, `streaming`, `tool-calling`), not the directory.
- Fields: `id`, `description`, `category`, `docs {topic, stem, title}`, `tags`, `call`, `input`, `mock_response {status, body}`, `assertions`, and optionally `env`, `skip {languages, reason}`, `requirements`.
- `call` names an API: `chat` is the default; named calls include `chat_stream`, `embed`, `rerank`, `image_generate`, `list_models`, `moderate`, `search`, `create_response`, `speech`, `transcribe`, `ocr`, `create_batch` (full set in `alef.toml`). `input` is the request body.
- Assertion types in use: `equals`, `not_error`, `error`, `count_equals`, `count_min`, `not_empty`, `is_true`, `greater_than`, `contains`. `error` takes the error kind as `value` (for example `Authentication`); assert the HTTP status with `field: error.status_code`.
- Loop: `mise run e2e:generate` then `alef test --e2e` (one binding: `alef test --lang <lang> --e2e`, or `mise run <lang>:e2e:test` where the task exists); `alef lint` lints the generated suites.
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| slack-gif-creatoranthropics/skillsKnowledge and utilities for creating animated GIFs optimized for Slack. Provides constraints, validation tools, and animation concepts. Use when users request animated GIFs for Slack like "make me a GIF of X doing Y for Slack." | Stars: 198k | Updated | Claude CodeCodex | Verified | Install |
| ponytailDietrichGebert/ponytailLazy senior dev mode for any coding task: the smallest change that fully solves it, and a reply a busy human understands in one read. | Stars: 196k | Updated | Claude CodeCodex | Verified | Install |
| ponytail-debtDietrichGebert/ponytailHarvest every shortcut: comment into one debt ledger, so deferrals get tracked instead of forgotten. One-shot report. | Stars: 196k | Updated | Claude CodeCodex | Verified | Install |
| ponytail-debtDietrichGebert/ponytailList every `shortcut:` comment (and older `ponytail:` ones) as a debt ledger. One-shot report, changes nothing. Use for "ponytail debt", "what did ponytail defer", "list the shortcuts", /ponytail-debt. | Stars: 196k | Updated | Claude CodeCodex | Verified | Install |