Skip to content

xberg-io/liter-llm / .ai-rulez/skills/e2e-fixtures

e2e-fixtures

Verified

liter-llm e2e fixture schema: per-category fixture files, call names, mock provider responses, env and skip, and assertion types. Use when adding or editing a liter-llm e2e fixture.

FileKindSize
SKILL.mdskill md1.8 KB
index.mdmarkdown223 B
---
type: Reference
title: E2E Fixtures
description: "liter-llm e2e fixture schema: per-category fixture files, call names, mock provider responses, env and skip, and assertion types. Use when adding or editing a liter-llm e2e fixture."
paths:
  - "fixtures/**"
  - "e2e/**"
x-ai-rulez:
  kind: skill
  id: e2e-fixtures
  metadata:
    name: e2e-fixtures
---

# liter-llm E2E Fixtures

- One fixture object per file, `fixtures/<category>/<id>.json`. `fixtures/schema.json` still requires an `api` field that no fixture carries; the generator reads `call`, so follow existing fixtures, not the schema.
- Categories match the directory (`smoke`, `chat`, `streaming`, `error-handling`, `proxy`, `files`, `batches`, `rerank`, `embed`, ...); the exception is `providers/`, whose fixtures carry the test kind as `category` (`smoke`, `error-handling`, `streaming`, `tool-calling`), not the directory.
- Fields: `id`, `description`, `category`, `docs {topic, stem, title}`, `tags`, `call`, `input`, `mock_response {status, body}`, `assertions`, and optionally `env`, `skip {languages, reason}`, `requirements`.
- `call` names an API: `chat` is the default; named calls include `chat_stream`, `embed`, `rerank`, `image_generate`, `list_models`, `moderate`, `search`, `create_response`, `speech`, `transcribe`, `ocr`, `create_batch` (full set in `alef.toml`). `input` is the request body.
- Assertion types in use: `equals`, `not_error`, `error`, `count_equals`, `count_min`, `not_empty`, `is_true`, `greater_than`, `contains`. `error` takes the error kind as `value` (for example `Authentication`); assert the HTTP status with `field: error.status_code`.
- Loop: `mise run e2e:generate` then `alef test --e2e` (one binding: `alef test --lang <lang> --e2e`, or `mise run <lang>:e2e:test` where the task exists); `alef lint` lints the generated suites.
slack-gif-creatoranthropics/skillsKnowledge and utilities for creating animated GIFs optimized for Slack. Provides constraints, validation tools, and animation concepts. Use when users request animated GIFs for Slack like "make me a GIF of X doing Y for Slack."Stars: 198kUpdated Claude CodeCodexVerifiedInstall
ponytailDietrichGebert/ponytailLazy senior dev mode for any coding task: the smallest change that fully solves it, and a reply a busy human understands in one read.Stars: 196kUpdated Claude CodeCodexVerifiedInstall
ponytail-debtDietrichGebert/ponytailHarvest every shortcut: comment into one debt ledger, so deferrals get tracked instead of forgotten. One-shot report.Stars: 196kUpdated Claude CodeCodexVerifiedInstall
ponytail-debtDietrichGebert/ponytailList every `shortcut:` comment (and older `ponytail:` ones) as a debt ledger. One-shot report, changes nothing. Use for "ponytail debt", "what did ponytail defer", "list the shortcuts", /ponytail-debt.Stars: 196kUpdated Claude CodeCodexVerifiedInstall