Skip to content

olaafrossi/FoamPilot / .claude/skills/gstack

gstack

Flagged

Fast headless browser for QA testing and site dogfooding. Navigate pages, interact with elements, verify state, diff before/after, take annotated screenshots, test responsive layouts, forms, uploads, dialogs, and capture bug evidence. Use when asked to open or test a site, verify a deployment, dogfood a user flow, or file a bug with screenshots.

FileKindSize
.env.exampleother171 B
.github/actionlint.yamlconfig82 B
.github/docker/Dockerfile.ciother2.7 KB
.github/workflows/actionlint.ymlconfig176 B
.github/workflows/ci-image.ymlconfig1.0 KB
.github/workflows/evals-periodic.ymlconfig3.8 KB
.github/workflows/evals.ymlconfig8.1 KB
.github/workflows/skill-docs.ymlconfig1.2 KB
.gitignoreother243 B
AGENTS.mdmarkdown2.5 KB
ARCHITECTURE.mdmarkdown21.4 KB
BROWSER.mdmarkdown23.1 KB
CHANGELOG.mdmarkdown146.8 KB
CLAUDE.mdmarkdown19.2 KB
CONTRIBUTING.mdmarkdown17.6 KB
DESIGN.mdmarkdown4.4 KB
ETHOS.mdmarkdown7.3 KB
LICENSEother1.0 KB
README.mdmarkdown23.8 KB
SKILL.mdskill md26.1 KB
SKILL.md.tmplother7.8 KB
TODOS.mdmarkdown33.9 KB
VERSIONother9 B
actionlint.yamlconfig56 B
agents/openai.yamlconfig351 B
bun.lockother18.0 KB
conductor.jsonconfig87 B
design/prototype.tsscript5.4 KB
design/src/auth.tsscript1.7 KB
design/src/brief.tsscript1.9 KB
design/src/check.tsscript3.0 KB
design/src/cli.tsscript8.9 KB
design/src/commands.tsscript3.0 KB
design/src/compare.tsscript19.1 KB
design/src/design-to-code.tsscript3.0 KB
design/src/diff.tsscript3.3 KB
design/src/evolve.tsscript5.0 KB
design/src/gallery.tsscript7.0 KB
design/src/generate.tsscript4.0 KB
design/src/iterate.tsscript5.4 KB
design/src/memory.tsscript6.0 KB
design/src/serve.tsscript7.4 KB
design/src/session.tsscript1.8 KB
design/src/variants.tsscript8.4 KB
design/test/feedback-roundtrip.test.tsscript12.6 KB
design/test/gallery.test.tsscript5.0 KB
design/test/serve.test.tsscript12.6 KB
docs/designs/CHROME_VS_CHROMIUM_EXPLORATION.mdmarkdown4.0 KB
docs/designs/CONDUCTOR_CHROME_SIDEBAR_INTEGRATION.mdmarkdown3.5 KB
docs/designs/CONDUCTOR_SESSION_API.mdmarkdown3.9 KB
docs/designs/DESIGN_SHOTGUN.mdmarkdown22.5 KB
docs/designs/DESIGN_TOOLS_V1.mdmarkdown36.0 KB
docs/designs/ML_PROMPT_INJECTION_KILLER.mdmarkdown20.7 KB
docs/designs/SELF_LEARNING_V0.mdmarkdown5.5 KB
docs/images/github-2013.pngbinary61.9 KB
docs/images/github-2026.pngbinary59.1 KB
docs/skills.mdmarkdown45.3 KB
extension/background.jsscript8.1 KB
extension/content.cssother2.5 KB
extension/content.jsscript4.7 KB
extension/icons/icon-128.pngbinary2.8 KB
extension/icons/icon-16.pngbinary400 B
extension/icons/icon-48.pngbinary1.1 KB
extension/manifest.jsonconfig749 B
extension/popup.htmlother2.3 KB
extension/popup.jsscript1.7 KB
extension/sidepanel.cssother17.1 KB
extension/sidepanel.htmlother3.3 KB
extension/sidepanel.jsscript23.6 KB
lib/worktree.tsscript9.2 KB
package.jsonmanifest3.7 KB
pw-test-node.mjsscript147 B
scripts/analytics.tsscript5.3 KB
scripts/dev-skill.tsscript2.4 KB
scripts/discover-skills.tsscript1.2 KB
scripts/eval-compare.tsscript3.0 KB
scripts/eval-list.tsscript3.5 KB
scripts/eval-select.tsscript3.1 KB
scripts/eval-summary.tsscript6.5 KB
scripts/eval-watch.tsscript5.4 KB
scripts/gen-skill-docs.tsscript19.8 KB
scripts/resolvers/browse.tsscript4.3 KB
scripts/resolvers/codex-helpers.tsscript5.0 KB
scripts/resolvers/confidence.tsscript1.6 KB
scripts/resolvers/constants.tsscript2.7 KB
scripts/resolvers/design.tsscript44.8 KB
scripts/resolvers/index.tsscript3.1 KB
scripts/resolvers/learnings.tsscript3.9 KB
scripts/resolvers/preamble.tsscript27.7 KB
scripts/resolvers/review.tsscript47.1 KB
scripts/resolvers/testing.tsscript27.3 KB
scripts/resolvers/types.tsscript1.1 KB
scripts/resolvers/utility.tsscript15.5 KB
scripts/skill-check.tsscript7.1 KB
setupexecutablescript24.4 KB
supabase/config.shscript420 B
supabase/functions/community-pulse/index.tsscript4.1 KB
supabase/functions/telemetry-ingest/index.tsscript4.1 KB
supabase/functions/update-check/index.tsscript1.1 KB
supabase/migrations/001_telemetry.sqlother3.2 KB
supabase/migrations/002_tighten_rls.sqlother1.7 KB
supabase/verify-rls.shexecutablescript5.3 KB
test/analytics.test.tsscript10.2 KB
test/audit-compliance.test.tsscript3.9 KB
test/codex-e2e.test.tsscript8.0 KB
test/fixtures/coverage-audit-fixture.tsscript2.7 KB
test/fixtures/eval-baselines.jsonconfig388 B
test/fixtures/qa-eval-checkout-ground-truth.jsonconfig1.6 KB
test/fixtures/qa-eval-ground-truth.jsonconfig1.5 KB
test/fixtures/qa-eval-spa-ground-truth.jsonconfig1.6 KB
test/fixtures/review-eval-design-slop.cssother1.5 KB
test/fixtures/review-eval-design-slop.htmlother1.3 KB
test/fixtures/review-eval-enum-diff.rbscript986 B
test/fixtures/review-eval-enum.rbscript759 B
test/fixtures/review-eval-vuln.rbscript406 B
test/gemini-e2e.test.tsscript6.7 KB
test/gen-skill-docs.test.tsscript93.2 KB
test/global-discover.test.tsscript6.4 KB
test/helpers/codex-session-runner.tsscript9.4 KB
test/helpers/e2e-helpers.tsscript11.3 KB
test/helpers/eval-store.test.tsscript19.8 KB
test/helpers/eval-store.tsscript24.6 KB
test/helpers/gemini-session-runner.test.tsscript4.4 KB
test/helpers/gemini-session-runner.tsscript6.0 KB
test/helpers/llm-judge.tsscript4.2 KB
test/helpers/observability.test.tsscript9.9 KB
test/helpers/session-runner.test.tsscript3.7 KB
test/helpers/session-runner.tsscript11.8 KB
test/helpers/skill-parser.tsscript5.6 KB
test/helpers/touchfiles.tsscript18.7 KB
test/hook-scripts.test.tsscript13.6 KB
test/learnings.test.tsscript12.0 KB
test/review-log.test.tsscript2.7 KB
test/skill-e2e-bws.test.tsscript12.5 KB
test/skill-e2e-cso.test.tsscript8.7 KB
test/skill-e2e-deploy.test.tsscript17.6 KB
test/skill-e2e-design.test.tsscript24.4 KB
test/skill-e2e-learnings.test.tsscript5.1 KB
test/skill-e2e-plan.test.tsscript27.6 KB
test/skill-e2e-qa-bugs.test.tsscript8.1 KB
test/skill-e2e-qa-workflow.test.tsscript15.4 KB
test/skill-e2e-review.test.tsscript28.7 KB
test/skill-e2e-sidebar.test.tsscript9.6 KB
test/skill-e2e-workflow.test.tsscript21.0 KB
test/skill-e2e.test.tsscript131.7 KB
test/skill-llm-eval.test.tsscript36.7 KB
test/skill-parser.test.tsscript5.3 KB
test/skill-routing-e2e.test.tsscript25.8 KB
test/skill-validation.test.tsscript59.5 KB
test/telemetry.test.tsscript15.5 KB
test/touchfiles.test.tsscript11.9 KB
test/uninstall.test.tsscript6.2 KB
test/worktree.test.tsscript9.2 KB
ws-test.tsscript692 B

test/gemini-e2e.test.ts

View on GitHub
/**
 * Gemini CLI E2E tests — verify skills work when invoked by Gemini CLI.
 *
 * Spawns `gemini -p` with stream-json output in the repo root (where
 * .agents/skills/ already exists), parses JSONL events, and validates
 * structured results. Follows the same pattern as codex-e2e.test.ts.
 *
 * Prerequisites:
 * - `gemini` binary installed (npm install -g @google/gemini-cli)
 * - Gemini authenticated via ~/.gemini/ config or GEMINI_API_KEY env var
 * - EVALS=1 env var set (same gate as Claude E2E tests)
 *
 * Skips gracefully when prerequisites are not met.
 */

import { describe, test, expect, beforeAll, afterAll } from 'bun:test';
import { runGeminiSkill } from './helpers/gemini-session-runner';
import type { GeminiResult } from './helpers/gemini-session-runner';
import { EvalCollector } from './helpers/eval-store';
import { selectTests, detectBaseBranch, getChangedFiles, GLOBAL_TOUCHFILES } from './helpers/touchfiles';
import { createTestWorktree, harvestAndCleanup } from './helpers/e2e-helpers';
import * as path from 'path';

const ROOT = path.resolve(import.meta.dir, '..');

// --- Prerequisites check ---

const GEMINI_AVAILABLE = (() => {
  try {
    const result = Bun.spawnSync(['which', 'gemini']);
    return result.exitCode === 0;
  } catch { return false; }
})();

const evalsEnabled = !!process.env.EVALS;

// Skip all tests if gemini is not available or EVALS is not set.
const SKIP = !GEMINI_AVAILABLE || !evalsEnabled;

const describeGemini = SKIP ? describe.skip : describe;

// Log why we're skipping (helpful for debugging CI)
if (!evalsEnabled) {
  // Silent — same as Claude E2E tests, EVALS=1 required
} else if (!GEMINI_AVAILABLE) {
  process.stderr.write('\nGemini E2E: SKIPPED — gemini binary not found (install: npm i -g @google/gemini-cli)\n');
}

// --- Diff-based test selection ---

// Gemini E2E touchfiles — keyed by test name, same pattern as Codex E2E
const GEMINI_E2E_TOUCHFILES: Record<string, string[]> = {
  'gemini-discover-skill':  ['.agents/skills/**', 'test/helpers/gemini-session-runner.ts'],
  'gemini-review-findings': ['review/**', '.agents/skills/gstack-review/**', 'test/helpers/gemini-session-runner.ts'],
};

let selectedTests: string[] | null = null; // null = run all

if (evalsEnabled && !process.env.EVALS_ALL) {
  const baseBranch = process.env.EVALS_BASE
    || detectBaseBranch(ROOT)
    || 'main';
  const changedFiles = getChangedFiles(baseBranch, ROOT);

  if (changedFiles.length > 0) {
    const selection = selectTests(changedFiles, GEMINI_E2E_TOUCHFILES, GLOBAL_TOUCHFILES);
    selectedTests = selection.selected;
    process.stderr.write(`\nGemini E2E selection (${selection.reason}): ${selection.selected.length}/${Object.keys(GEMINI_E2E_TOUCHFILES).length} tests\n`);
    if (selection.skipped.length > 0) {
      process.stderr.write(`  Skipped: ${selection.skipped.join(', ')}\n`);
    }
    process.stderr.write('\n');
  }
  // If changedFiles is empty (e.g., on main branch), selectedTests stays null -> run all
}

/** Skip an individual test if not selected by diff-based selection. */
function testIfSelected(testName: string, fn: () => Promise<void>, timeout: number) {
  const shouldRun = selectedTests === null || selectedTests.includes(testName);
  (shouldRun ? test.concurrent : test.skip)(testName, fn, timeout);
}

// --- Eval result collector ---

const evalCollector = evalsEnabled && !SKIP ? new EvalCollector('e2e-gemini') : null;

/** DRY helper to record a Gemini E2E test result into the eval collector. */
function recordGeminiE2E(name: string, result: GeminiResult, passed: boolean) {
  evalCollector?.addTest({
    name,
    suite: 'gemini-e2e',
    tier: 'e2e',
    passed,
    duration_ms: result.durationMs,
    cost_usd: 0, // Gemini doesn't report cost in USD; tokens are tracked
    output: result.output?.slice(0, 2000),
    turns_used: result.toolCalls.length, // approximate: tool calls as turns
    exit_reason: result.exitCode === 0 ? 'success' : `exit_code_${result.exitCode}`,
  });
}

/** Print cost summary after a Gemini E2E test. */
function logGeminiCost(label: string, result: GeminiResult) {
  const durationSec = Math.round(result.durationMs / 1000);
  console.log(`${label}: ${result.tokens} tokens, ${result.toolCalls.length} tool calls, ${durationSec}s`);
}

// Finalize eval results on exit
afterAll(async () => {
  if (evalCollector) {
    await evalCollector.finalize();
  }
});

// --- Tests ---

describeGemini('Gemini E2E', () => {
  let testWorktree: string;

  beforeAll(() => {
    testWorktree = createTestWorktree('gemini');
  });

  afterAll(() => {
    harvestAndCleanup('gemini');
  });

  testIfSelected('gemini-discover-skill', async () => {
    // Run Gemini in an isolated worktree (has .agents/skills/ copied from ROOT)
    const result = await runGeminiSkill({
      prompt: 'List any skills or instructions you have available. Just list the names.',
      timeoutMs: 60_000,
      cwd: testWorktree,
    });

    logGeminiCost('gemini-discover-skill', result);

    // Gemini should have produced some output
    const passed = result.exitCode === 0 && result.output.length > 0;
    recordGeminiE2E('gemini-discover-skill', result, passed);

    expect(result.exitCode).toBe(0);
    expect(result.output.length).toBeGreaterThan(0);
    // The output should reference skills in some form
    const outputLower = result.output.toLowerCase();
    expect(
      outputLower.includes('review') || outputLower.includes('gstack') || outputLower.includes('skill'),
    ).toBe(true);
  }, 120_000);

  testIfSelected('gemini-review-findings', async () => {
    // Run gstack-review skill via Gemini on worktree (isolated from main working tree)
    const result = await runGeminiSkill({
      prompt: 'Run the gstack-review skill on this repository. Review the current branch diff and report your findings.',
      timeoutMs: 540_000,
      cwd: testWorktree,
    });

    logGeminiCost('gemini-review-findings', result);

    // Should produce structured review-like output
    const output = result.output;
    const passed = result.exitCode === 0 && output.length > 50;
    recordGeminiE2E('gemini-review-findings', result, passed);

    expect(result.exitCode).toBe(0);
    expect(output.length).toBeGreaterThan(50);

    // Review output should contain some review-like content
    const outputLower = output.toLowerCase();
    const hasReviewContent =
      outputLower.includes('finding') ||
      outputLower.includes('issue') ||
      outputLower.includes('review') ||
      outputLower.includes('change') ||
      outputLower.includes('diff') ||
      outputLower.includes('clean') ||
      outputLower.includes('no issues') ||
      outputLower.includes('p1') ||
      outputLower.includes('p2');
    expect(hasReviewContent).toBe(true);
  }, 600_000);
});
finishing-a-development-branchobra/superpowersUse when implementation is complete, all tests pass, and you need to decide how to integrate the workStars: 321kUpdated Claude CodeCodexVerifiedInstall
systematic-debuggingobra/superpowersUse when encountering any bug, test failure, or unexpected behavior, before proposing fixesStars: 321kUpdated Claude CodeCodexVerifiedInstall
test-driven-developmentobra/superpowersUse when implementing any feature or bugfix, before writing implementation codeStars: 321kUpdated Claude CodeCodexVerifiedInstall
skill-creatoranthropics/skillsCreate new skills, modify and improve existing skills, and measure skill performance. Use when users want to create a skill from scratch, edit, or optimize an existing skill, run evals to test a skill, benchmark skill performance with variance analysis, or optimize a skill's description for better triggering accuracy.Stars: 197kUpdated Claude CodeCodexVerifiedInstall