devorb1t/windmill / .agents/skills/ai-chat
ai-chat
VerifiedGuidance for improving the Windmill AI chat (copilot), especially global mode — tools, prompts, and context-window discipline. Use when editing chat tools, system prompts, or tool-result shapes under frontend/src/lib/components/copilot/chat, or when changing how the chat manages its context window.
Always benchmark before and after
No context or behavior change ships without an ai_evals A/B on the affected mode.
Add or adjust cases for exactly what you changed — see the ai-evals skill for
authoring and the full run reference.
Run the affected mode before your change and after, same model(s), same cases.
Measure the window first, and cumulative second
Optimize finalContextTokens (window occupancy — what drives overflow and
compaction), then cumulative prompt tokens.
Context discipline
The dominant fixed cost is per-iteration overhead: the system prompt plus every tool schema is re-sent on every loop iteration. So:
- Every tool and every parameter is a permanent tax. Justify each one and measure it; an extra "locate" round-trip can cost more than the reads it saves. Strip dead params rather than leaving them in the schema.
- Tool results return the minimum. Never echo content the model already has. The
canonical mistake: a write tool that returns the whole edited artifact right after
the model authored it — return
{ success, message }instead. When you touch a shared write helper (e.g.finishAppDraftWriteinglobal/core.ts), re-check this invariant for all the write tools routing through it — the echo has regressed before via a shared refactor.
Prompts and tool descriptions are part of the surface
The system prompt and tool descriptions steer behavior as much as the tools themselves, and are benchmarkable the same way. A description that advertises truncation makes the model self-limit; the path-conventions block changes where drafts land. Treat prompt/description edits as real changes and A/B them — a pure-prompt change is a legitimate, measurable improvement.
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| brainstormingobra/superpowersYou MUST use this before any creative work - creating features, building components, adding functionality, modifying behavior, or planning anything new, in software or out of it (a talk, a business, a renovation). | Stars: 319k | Updated | Claude CodeCodex | Verified | Install |
| brand-guidelinesanthropics/skillsApplies Anthropic's official brand colors and typography to any sort of artifact that may benefit from having Anthropic's look-and-feel. Use it when brand colors or style guidelines, visual formatting, or company design standards apply. | Stars: 196k | Updated | Claude CodeCodex | Verified | Install |
| frontend-designanthropics/skillsGuidance for distinctive, intentional visual design when building new UI or reshaping an existing one. Helps with aesthetic direction, typography, and making choices that don't read as templated defaults. | Stars: 196k | Updated | Claude CodeCodex | Verified | Install |
| mcp-builderanthropics/skillsGuide for creating high-quality MCP (Model Context Protocol) servers that enable LLMs to interact with external services through well-designed tools. Use when building MCP servers to integrate external APIs or services, whether in Python (FastMCP) or Node/TypeScript (MCP SDK). | Stars: 196k | Updated | Claude CodeCodex | Verified | Install |