Skip to content

code-yeongyu/oh-my-openagent / .agents/skills/codex-qa

codex-qa

Verified

QA the omo Codex Light edition (lazycodex / packages/omo-codex) itself, in strict isolation so ONLY our plugin is exercised, never the user's real ~/.codex. The first-party method drives the real `codex app-server` against an isolated CODEX_HOME plus a LOCAL mock model (no real API call), and proves a plugin hook fired by asserting hook/started + hook/completed notifications. Also: isolated install verification, per-component hook probes, a tmux TUI smoke, and runtime log observation (RUST_LOG / logs SQLite / /debug-config). Ships tested helper scripts each with a --self-test. Use whenever someone changes anything under packages/omo-codex or wants to QA, smoke-test, verify, or debug the Codex plugin, its hooks/components, the installer/config.toml, the app-server flow, or the Codex TUI. Triggers: codex qa, qa codex, codex-qa, test codex plugin, verify codex hook, codex app-server, lazycodex qa, isolated CODEX_HOME, prove codex hook fired, codex tui test.

FileKindSize
SKILL.mdskill md7.6 KB
references/app-server.mdmarkdown3.0 KB
references/components-hooks.mdmarkdown2.7 KB
references/docker-qa.mdmarkdown2.6 KB
references/install-verify.mdmarkdown2.6 KB
references/isolation.mdmarkdown2.5 KB
references/logging-debug.mdmarkdown2.6 KB
scripts/app-server-drive.shexecutablescript3.1 KB
scripts/hook-unit-probe.shexecutablescript3.0 KB
scripts/install-verify.shexecutablescript2.5 KB
scripts/lib/app-server-client.mjsscript6.3 KB
scripts/lib/app-server-client.test.jsscript1.9 KB
scripts/lib/common.shexecutablescript7.1 KB
scripts/lib/mock-model.mjsscript2.1 KB
scripts/lsp-e2e.shexecutablescript150.9 KB
scripts/tui-smoke.shexecutablescript2.9 KB

scripts/hook-unit-probe.sh

View on GitHub
#!/usr/bin/env bash
# hook-unit-probe.sh - deterministic, binary-free proof that a single omo
# component's hook logic fires. Pipes a synthetic Codex hook event (the exact
# stdin shape Codex sends) into the component's cached dist/cli.js and asserts
# its stdout - no codex process, no model, no network. Fast and exact.
#
# Use this to pin a specific component's behavior; use app-server-drive.sh
# --plugin to prove the app-server actually WIRES that hook in a live turn.
#
#   --self-test                 install local omo (if needed), then assert the
#                               ultrawork component injects <ultrawork-mode> on
#                               an "ulw" UserPromptSubmit. (default)
#   --component <name> --event <kebab-event> [--prompt <text>]
#                               run an arbitrary component/event by hand against
#                               an already-installed isolated CODEX_HOME ($CODEX_HOME).

SCRIPT_DIR="$(cd "$(dirname "${BASH_SOURCE[0]}")" && pwd)"
. "$SCRIPT_DIR/lib/common.sh"

cqa_plugin_root() {
  ls -d "$CODEX_HOME"/plugins/cache/sisyphuslabs/omo/*/ 2>/dev/null | head -1
}

cqa_run_component() {
  local comp="$1" event="$2" prompt="$3" root cli
  root="$(cqa_plugin_root)"; [ -n "$root" ] || { cqa_fail "no installed omo under $CODEX_HOME"; return 1; }
  cli="$root/components/$comp/dist/cli.js"
  [ -f "$cli" ] || { cqa_fail "component cli missing: $cli"; return 1; }
  local payload
  payload="$(jq -nc --arg p "$prompt" --arg cwd "${QA_CWD:-$PWD}" \
    '{hook_event_name:"UserPromptSubmit",prompt:$p,cwd:$cwd,session_id:"cqa-unit",model:"mock-model"}')"
  printf '%s' "$payload" | PLUGIN_ROOT="$root" PLUGIN_DATA="$CODEX_HOME/plugins/data/omo-$comp" node "$cli" hook "$event"
}

cqa_self_test() {
  cqa_require codex node jq || return 1
  cqa_guard_real_home
  cqa_mk_isolated_home
  cqa_log "installing local omo into $CODEX_HOME ..."
  cqa_install_local_omo || { tail -20 "$CQA_HOME_ROOT/install.log" >&2; return 1; }
  local out
  out="$(cqa_run_component ultrawork user-prompt-submit "ulw: do the thing")"
  cqa_assert_real_home_unchanged || return 1
  if printf '%s' "$out" | jq -e '.hookSpecificOutput.additionalContext | test("ultrawork-mode")' >/dev/null 2>&1; then
    cqa_pass "ultrawork UserPromptSubmit injected <ultrawork-mode> on an ulw prompt"
    return 0
  fi
  cqa_log "FAIL: ultrawork did not inject ultrawork-mode; got: $out"; return 1
}

MODE="self"; COMP=""; EVENT=""; PROMPT="ulw: do the thing"
while [ $# -gt 0 ]; do
  case "$1" in
    --self-test) MODE="self"; shift ;;
    --component) MODE="manual"; COMP="$2"; shift 2 ;;
    --event) EVENT="$2"; shift 2 ;;
    --prompt) PROMPT="$2"; shift 2 ;;
    -h|--help) sed -n '2,18p' "${BASH_SOURCE[0]}" | sed 's/^# \{0,1\}//'; exit 0 ;;
    *) cqa_log "unknown option: $1"; shift ;;
  esac
done

if [ "$MODE" = "manual" ]; then
  [ -n "$COMP" ] && [ -n "$EVENT" ] || { cqa_log "manual mode needs --component and --event"; exit 2; }
  cqa_run_component "$COMP" "$EVENT" "$PROMPT"
  exit $?
fi
cqa_self_test
exit $?
finishing-a-development-branchobra/superpowersUse when implementation is complete, all tests pass, and you need to decide how to integrate the workStars: 319kUpdated Claude CodeCodexVerifiedInstall
systematic-debuggingobra/superpowersUse when encountering any bug, test failure, or unexpected behavior, before proposing fixesStars: 319kUpdated Claude CodeCodexVerifiedInstall
test-driven-developmentobra/superpowersUse when implementing any feature or bugfix, before writing implementation codeStars: 319kUpdated Claude CodeCodexVerifiedInstall
skill-creatoranthropics/skillsCreate new skills, modify and improve existing skills, and measure skill performance. Use when users want to create a skill from scratch, edit, or optimize an existing skill, run evals to test a skill, benchmark skill performance with variance analysis, or optimize a skill's description for better triggering accuracy.Stars: 197kUpdated Claude CodeCodexVerifiedInstall