code-yeongyu/oh-my-openagent / .agents/skills/codex-qa
codex-qa
VerifiedQA the omo Codex Light edition (lazycodex / packages/omo-codex) itself, in strict isolation so ONLY our plugin is exercised, never the user's real ~/.codex. The first-party method drives the real `codex app-server` against an isolated CODEX_HOME plus a LOCAL mock model (no real API call), and proves a plugin hook fired by asserting hook/started + hook/completed notifications. Also: isolated install verification, per-component hook probes, a tmux TUI smoke, and runtime log observation (RUST_LOG / logs SQLite / /debug-config). Ships tested helper scripts each with a --self-test. Use whenever someone changes anything under packages/omo-codex or wants to QA, smoke-test, verify, or debug the Codex plugin, its hooks/components, the installer/config.toml, the app-server flow, or the Codex TUI. Triggers: codex qa, qa codex, codex-qa, test codex plugin, verify codex hook, codex app-server, lazycodex qa, isolated CODEX_HOME, prove codex hook fired, codex tui test.
| File | Kind | Size |
|---|---|---|
| SKILL.md | skill md | 7.6 KB |
| references/app-server.md | markdown | 3.0 KB |
| references/components-hooks.md | markdown | 2.7 KB |
| references/docker-qa.md | markdown | 2.6 KB |
| references/install-verify.md | markdown | 2.6 KB |
| references/isolation.md | markdown | 2.5 KB |
| references/logging-debug.md | markdown | 2.6 KB |
| scripts/app-server-drive.shexecutable | script | 3.1 KB |
| scripts/hook-unit-probe.shexecutable | script | 3.0 KB |
| scripts/install-verify.shexecutable | script | 2.5 KB |
| scripts/lib/app-server-client.mjs | script | 6.3 KB |
| scripts/lib/app-server-client.test.js | script | 1.9 KB |
| scripts/lib/common.shexecutable | script | 7.1 KB |
| scripts/lib/mock-model.mjs | script | 2.1 KB |
| scripts/lsp-e2e.shexecutable | script | 150.9 KB |
| scripts/tui-smoke.shexecutable | script | 2.9 KB |
scripts/app-server-drive.sh
View on GitHub#!/usr/bin/env bash
# app-server-drive.sh - FIRST-PARTY codex QA: drive a real `codex app-server`
# turn against an ISOLATED CODEX_HOME + a LOCAL mock model, and read the
# structured notification stream. This is how you prove the omo plugin behaves
# in a live Codex session without scripting the TUI and without a real API call.
#
# Modes:
# --self-test Bare isolated home (no plugin). Proves the driver works: a
# turn runs and the assistant message comes back from the mock.
# Fast; no install.
# --plugin Install THIS repo's local omo build into the isolated home,
# then drive a turn and PROVE the plugin hooks fire by asserting
# hook/completed notifications for the expected events.
# Heavier (runs install-local).
#
# Options (any mode):
# --prompt <text> user message (default: "say hello"; --plugin defaults to
# "ulw: say hello" so the ultrawork userPromptSubmit hook fires)
# --expect <ev,...> hook eventNames that MUST complete (default in --plugin:
# "sessionStart,userPromptSubmit")
# --keep do not delete the isolated home (for inspection)
#
# The captured JSON summary IS the evidence; redirect it into .omo/evidence/.
SCRIPT_DIR="$(cd "$(dirname "${BASH_SOURCE[0]}")" && pwd)"
. "$SCRIPT_DIR/lib/common.sh"
cqa_drive() {
local plugin="$1" prompt="$2" expect="$3"
cqa_require codex node jq || return 1
cqa_guard_real_home
cqa_mk_isolated_home
if [ "$plugin" = "1" ]; then
cqa_log "installing local omo build into $CODEX_HOME (this builds the plugin)..."
if ! cqa_install_local_omo; then
cqa_log "install failed; tail:"; tail -20 "$CQA_HOME_ROOT/install.log" >&2 2>/dev/null
return 1
fi
grep -q 'omo@sisyphuslabs' "$CODEX_HOME/config.toml" || { cqa_fail "omo not enabled in isolated config.toml"; return 1; }
fi
cqa_start_mock || return 1
local out
out="$(EXPECT_HOOK="$expect" PROMPT="$prompt" DEADLINE_MS="${DEADLINE_MS:-90000}" \
node "$SCRIPT_DIR/lib/app-server-client.mjs")"
local rc=$?
printf '%s\n' "$out"
cqa_assert_real_home_unchanged || rc=1
if [ "$rc" -eq 0 ]; then
cqa_pass "app-server turn completed; assistant text: $(printf '%s' "$out" | jq -r '.assistantText')"
[ -n "$expect" ] && cqa_pass "hooks fired: $(printf '%s' "$out" | jq -r '[.hooks[]|select(.method=="hook/completed")|.eventName]|unique|join(", ")')"
else
cqa_log "missing hooks: $(printf '%s' "$out" | jq -rc '.missingHooks? // []')"
fi
return "$rc"
}
MODE="--self-test"; PROMPT=""; EXPECT=""; KEEP=0
while [ $# -gt 0 ]; do
case "$1" in
--self-test|--plugin) MODE="$1"; shift ;;
--prompt) PROMPT="$2"; shift 2 ;;
--expect) EXPECT="$2"; shift 2 ;;
--keep) KEEP=1; shift ;;
-h|--help) sed -n '2,33p' "${BASH_SOURCE[0]}" | sed 's/^# \{0,1\}//'; exit 0 ;;
*) cqa_log "unknown option: $1"; shift ;;
esac
done
if [ "$KEEP" = "1" ]; then trap - EXIT; fi
if [ "$MODE" = "--plugin" ]; then
cqa_drive 1 "${PROMPT:-ulw: say hello}" "${EXPECT:-sessionStart,userPromptSubmit}"
else
cqa_drive 0 "${PROMPT:-say hello}" "$EXPECT"
fi
exit $?
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| finishing-a-development-branchobra/superpowersUse when implementation is complete, all tests pass, and you need to decide how to integrate the work | Stars: 321k | Updated | Claude CodeCodex | Verified | Install |
| systematic-debuggingobra/superpowersUse when encountering any bug, test failure, or unexpected behavior, before proposing fixes | Stars: 321k | Updated | Claude CodeCodex | Verified | Install |
| test-driven-developmentobra/superpowersUse when implementing any feature or bugfix, before writing implementation code | Stars: 321k | Updated | Claude CodeCodex | Verified | Install |
| skill-creatoranthropics/skillsCreate new skills, modify and improve existing skills, and measure skill performance. Use when users want to create a skill from scratch, edit, or optimize an existing skill, run evals to test a skill, benchmark skill performance with variance analysis, or optimize a skill's description for better triggering accuracy. | Stars: 197k | Updated | Claude CodeCodex | Verified | Install |