Skip to content

HK-hub/AgentSkills / ax-audit

ax-audit

Verified

Audits agentic applications for architecture and trust: tool parity, tool granularity, context injection, completion signals, approval gates, confidence cues, escape hatches, intent handshakes, memory visibility, and adaptive canvases. Produces a ship-readiness verdict plus an AX Relationship Summary. Use when reviewing agentic feature PRs or asking "is this agent-native", "AX review", "critique this AI feature", "does this earn user trust", or "audit this for AX". For traditional frontend UX use ui-audit.

FileKindSize
SKILL.mdskill md8.7 KB
references/agent-native-principles.mdmarkdown3.6 KB
references/ax-evolution-curve.mdmarkdown3.0 KB
references/feature-playbooks.mdmarkdown6.7 KB
references/output-format.mdmarkdown4.8 KB
references/ship-readiness.mdmarkdown5.5 KB
rules-arch/_sections.mdmarkdown1.8 KB
rules-arch/_template.mdmarkdown2.2 KB
rules-arch/comm-no-approval-gate.mdmarkdown3.2 KB
rules-arch/comm-no-completion-signal.mdmarkdown2.9 KB
rules-arch/comm-no-progress-visibility.mdmarkdown2.7 KB
rules-arch/context-no-checkpoint-resume.mdmarkdown2.8 KB
rules-arch/context-no-injection.mdmarkdown2.6 KB
rules-arch/context-starvation.mdmarkdown2.6 KB
rules-arch/granularity-static-api-mapping.mdmarkdown2.9 KB
rules-arch/granularity-workflow-shaped-tool.mdmarkdown2.8 KB
rules-arch/parity-crud-incomplete.mdmarkdown2.5 KB
rules-arch/parity-no-tool-parity.mdmarkdown2.3 KB
rules-arch/parity-orphan-ui-action.mdmarkdown2.4 KB
rules-ax/_sections.mdmarkdown2.9 KB
rules-ax/_template.mdmarkdown2.5 KB
rules-ax/comm-no-generative-momentum.mdmarkdown2.6 KB
rules-ax/comm-no-intent-handshake.mdmarkdown3.1 KB
rules-ax/comm-no-progress-signal.mdmarkdown2.8 KB
rules-ax/context-memory-not-visible.mdmarkdown3.0 KB
rules-ax/context-no-adaptive-canvas.mdmarkdown2.9 KB
rules-ax/context-under-contextual.mdmarkdown2.9 KB
rules-ax/control-no-approval-gate.mdmarkdown2.8 KB
rules-ax/control-no-escape-hatch.mdmarkdown2.7 KB
rules-ax/control-over-conversational.mdmarkdown2.3 KB
rules-ax/trust-no-confidence-cues.mdmarkdown2.5 KB
rules-ax/trust-no-escalation-path.mdmarkdown2.6 KB
rules-ax/trust-no-uncertainty-markers.mdmarkdown2.5 KB

rules-arch/comm-no-completion-signal.md

View on GitHub
---
title: Agent completion detected by heuristic instead of explicit signal
slug: comm-no-completion-signal
category: comm
defaultTier: release-blocker
surfaces: agent-tool-execution, agent-dashboard
agent-native-principle: Parity (agent-UI communication)
detection: code-auditable
related: comm-no-progress-visibility
---

## Agent completion detected by heuristic instead of explicit signal

Orchestrator detects "done" by counting idle iterations, checking output files, or waiting for a timeout. A thinking pause looks like completion; slow API calls trigger premature termination. Violates Parity: the UI must receive an explicit signal, not guess.

## What goes wrong

Agent researches a complex question. Makes 3 tool calls, then pauses 8 seconds composing a response. Orchestrator counts 2 idle iterations, hits `maxIdleIterations: 2`, terminates. User sees a truncated answer.

## Detection

**Surfaces:** agent-tool-execution, agent-dashboard

**Static signals:**
1. Find the orchestrator control loop that decides continue/stop.
2. Check for idle-counting, timeout-based completion, or file-existence as termination.
3. Flag any heuristic used as the primary completion signal.

**Concrete commands:**
```bash
rg '(consecutiveIdle|noToolCall|idleCount|maxIdle)' --type=ts src/
rg '(setTimeout|setInterval)' --type=ts -A 5 src/ | rg '(done|complete|finish|terminate)'
rg '(stop_reason|end_turn|shouldContinue)' --type=ts src/
```

**False-positive guards:**
- Skip files with `// ax-audit-ignore:comm-no-completion-signal`.
- Skip timeout logic alongside an explicit signal (both `stop_reason` AND `setTimeout`).
- Skip test files and fixtures.

## Fix

```tsx
// before: heuristic completion
let idle = 0;
while (idle < 3) {
  const res = await llm.chat(messages);
  if (!res.toolCalls.length) { idle++; continue; }
  idle = 0;
  await executeTools(res.toolCalls, messages);
}

// after: explicit signal via stop_reason or completion tool
while (true) {
  const res = await llm.chat(messages);
  if (res.stopReason === "end_turn") return { status: "complete", content: res.content };
  for (const tc of res.toolCalls) {
    if (tc.name === "task_complete") return { status: "complete", summary: tc.args.summary };
    messages.push({ role: "tool", content: await executeTool(tc) });
  }
}
```

## Default tier and overrides

**Defaults to:** `release-blocker`

| Surface | Tier |
|---|---|
| Agent tool execution | release-blocker |
| Agent dashboard | release-blocker |
| Agent chat | fix-this-sprint |
| Agent config | backlog |

## Examples

**Anti-pattern (fails):** `while (noToolCalls < 2)`: thinking pause triggers premature termination.

**Applied (passes):** `if (res.stopReason === "end_turn") return res.content`: explicit model signal.

## Suppression

```tsx
// ax-audit-ignore:comm-no-completion-signal, timeout is safety net, primary signal is stop_reason
const SAFETY_TIMEOUT = 120_000;
```
rea-analysis-optimizationmorluto/reaOptimize REA providers and shared analysis workflows for agent context, latency, CPU, and memory while preserving correctness and Evidence. Use for analysis bottlenecks and cache or query design; CI/test-suite optimization belongs to rea-ci-tests-audit.Stars: 472kUpdated Claude CodeCodexVerifiedInstall
rea-ci-tests-auditmorluto/reaAudit REA CI and test suites for correctness, fixture drift, false passes, and measured performance; use for suite or workflow investigations and efficiency changes, rather than ordinary feature testing or a single test failure.Stars: 472kUpdated Claude CodeCodexVerifiedInstall
rea-tool-designmorluto/reaAudit, investigate, design, or change REA investigation tools, CLI/MCP contracts, provider capabilities, and Evidence semantics.Stars: 472kUpdated Claude CodeCodexVerifiedInstall
ponytail-auditDietrichGebert/ponytailQuality audit of the whole repo: bugs, security, real load, missing tests, speed, and what to delete. Most important first.Stars: 194kUpdated Claude CodeCodexVerifiedInstall