Skip to content

ahstn/oceans-llm / .agents/skills/verify-oceans-admin

verify-oceans-admin

Verified

Verify the Oceans LLM admin control plane and backend gateway against the real local stack, seeded demo data, and bounded live providers when required. Use for user-path checks of sign-in, models, API keys, observability, usage costs, spend controls, batches, agent sessions, request logs, Anthropic Messages thinking and effort compatibility, MCP registry and tool access, OpenRouter routing, guardrails, and Skills storage.

FileKindSize
SKILL.mdskill md29.0 KB
examples/mcp-candidates.jsonconfig3.0 KB
features/README.mdmarkdown10.0 KB
features/account-onboarding.mdmarkdown4.3 KB
features/agent-harnesses.mdmarkdown4.3 KB
features/agent-plugins.mdmarkdown1005 B
features/agent-sessions.mdmarkdown3.9 KB
features/anthropic-messages.mdmarkdown20.7 KB
features/api-keys.mdmarkdown6.5 KB
features/attribution.mdmarkdown13.9 KB
features/audit-log.mdmarkdown4.9 KB
features/backend-gateway.mdmarkdown5.2 KB
features/batch-requests.mdmarkdown4.2 KB
features/design-system.mdmarkdown4.6 KB
features/guardrails.mdmarkdown7.0 KB
features/harness-integration.mdmarkdown7.8 KB
features/identity.mdmarkdown4.2 KB
features/image-generation.mdmarkdown7.3 KB
features/leaderboard.mdmarkdown3.3 KB
features/live-llm-requests.mdmarkdown12.6 KB
features/mcp-client-oauth.mdmarkdown9.9 KB
features/mcp-ownership.mdmarkdown7.4 KB
features/mcp.mdmarkdown19.6 KB
features/models.mdmarkdown8.2 KB
features/password-sign-in.mdmarkdown8.3 KB
features/profile.mdmarkdown2.5 KB
features/rate-limits.mdmarkdown6.0 KB
features/request-logs.mdmarkdown8.6 KB
features/review-agent.mdmarkdown3.7 KB
features/routing.jsonconfig33.6 KB
features/service-tiers.mdmarkdown6.3 KB
features/skills.mdmarkdown9.8 KB
features/spend-controls.mdmarkdown7.3 KB
features/usage-costs.mdmarkdown3.7 KB
features/workspace-connections.mdmarkdown6.1 KB
scripts/check-messages.mjsexecutablescript2.4 KB
scripts/check-messages.test.mjsscript3.0 KB
scripts/control-oceans-adminexecutablescript25.3 KB
scripts/control-oceans-admin.test.mjsscript7.6 KB
scripts/drive-backend-gateway.mjsexecutablescript12.5 KB
scripts/drive-harness-integration.mjsscript6.6 KB
scripts/drive-mcp.mjsscript13.0 KB
scripts/drive-models.mjsscript12.9 KB
scripts/drive-observability.mjsscript16.8 KB
scripts/drive-profile.mjsscript8.2 KB
scripts/drive-service-tiers.mjsexecutablescript20.1 KB
scripts/drive-skills.mjsscript27.2 KB
scripts/mcp-browser.mjsscript26.5 KB
scripts/mcp-canary.mjsscript18.8 KB
scripts/mcp-candidates.mjsscript3.5 KB
scripts/mcp-verification.test.mjsscript10.2 KB
scripts/messages-regressions.mjsscript15.8 KB
scripts/plan-verification.mjsscript5.2 KB
scripts/plan-verification.test.mjsscript6.1 KB
scripts/proof-cli.mjsscript11.1 KB
scripts/proof.mjsscript9.2 KB
scripts/proof.test.mjsscript10.4 KB

features/batch-requests.md

View on GitHub
# Batch requests

Batch Requests lists the gateway batch jobs visible to the signed-in user: every job for platform administrators, and only the user's own jobs for everyone else. Each row shows created time, model and batch ID, provider and endpoint, caller, status, progress, and cost. Users can filter by creation date and status, and platform administrators can also filter by user and service account. A row opens a `Batch responses` sheet with a summary and paginated normalized results. Cancellable batches can be cancelled after confirmation. While any listed batch is active, the list refreshes every five seconds.

## Sub-features

- `batches-list` shows the `Batch list` card, a `N batches in the current scope` count, and a desktop table or mobile cards.
- `batches-filter` applies `Created from`, `Created through`, status, user, and service-account filters through URL search.
- `batches-detail` opens `Batch responses` with a summary, a `Response` or `Error` block per `custom_id`, and `Request payload`.
- `batches-cancel` asks `Cancel this batch?` before cancelling a queued, validating, in-progress, or finalizing batch.
- `batches-poll` refreshes the list every 5 s while an active batch is visible, and on `Refresh`.

## How to get to it (user POV)

- Sign in and choose `Batch Requests` under `Observability`.
- Open `/admin/batches` directly, optionally with `?status=completed` or other filter params.
- Choose `View` on a table row, or `View responses` on a mobile card, to open that batch's responses.

## Driving it with control-oceans-admin

Preconditions:

- `control-oceans-admin doctor` passes.
- `mise run dev-stack` seeded two `openai-fast` batches:
  - `Completed`: 2 of 2, from a seeded user key, custom IDs `retention-summary` and `risk-review`.
  - `Queued`: 0 of 3, from `Local CI Runner`.
- You are signed in as `admin@local`. The sidebar entry requires the `request_logs` page. The platform-admin role unlocks all-caller scope and the user and service-account filters.

- **Open.** Choose the `Batch Requests` link. The `Batch requests` heading, `Batch list` card, `2 batches in the current scope`, and `batch-desktop-table` are visible.
- **Filter.** Open `batch-filter-status`, choose `Completed`, then `Apply filters`. The URL gains `status=completed` and the count reads `1 batch in the current scope`. Choose `Clear` to return to 2.
- **Owner filters.** `batch-filter-user` and `batch-filter-service-account` list the seeded users and `Local CI Runner`. Applying `Local CI Runner` leaves only the queued row.
- **Detail.** Choose `View` in the `Completed` row. The `Batch responses` sheet shows `Batch ID`, `Status` `Completed`, `Progress` `2 of 2`, and `Showing 1-2 of 2 responses.`, with two `Succeeded` results. Expand `Request payload` on one of them.
- **Cancel dialog.** Choose `Cancel` in the `Queued` row. When `Cancel this batch?` opens, choose `Keep batch`. The dialog closes and the row still reads `Queued`.
- **API parity.** With the same session, fetch `GET /api/v1/batches?page=1&page_size=30` and `GET /api/v1/batches/{batch_id}/results?page=1&page_size=100`. `total`, `status`, `request_count`, and the result `custom_id` values must match the list and sheet. These responses have no `data` envelope.
- **Proof.** Capture the list, the filtered count, the detail sheet, and the open cancel dialog. Record both batch IDs.

## Gotchas

- Confirming `Cancel batch` can't be undone. The seed only re-creates a batch whose idempotency key is absent, so a cancelled demo batch stays cancelled. Cancel only with operator approval, then restore with `mise run //gateway:reset-local-demo`.
- The queued demo batch keeps the list polling every 5 s. Wait for the expected state, not for network idle.
- Every row has its own `View` and `Cancel` buttons, so scope clicks to the row that contains the model or batch ID.
- Below the `md` breakpoint, `batch-mobile-list` replaces the table and the button reads `View responses`.
- The page header's section label reads `Control Plane`, but the sidebar group is `Observability`.
- The status, user, and service-account selects have no programmatic label. Use their `data-testid` values instead.
- `Created through` without `Created from`, or an end date before the start date, shows an alert and disables `Apply filters`.
reverse-engineer-anythingmorluto/reaReverse engineer native, managed, Electron/JavaScript, packaged, firmware, and browser targets with REA, and build agent environments (AgentEnv bundles) of web applications from a live instance or a capture, and of Linux desktop apps with a task from a request. Use shipped-artifact or requested runtime evidence to explain features, compare versions, decompile code, or guide a reconstruction. Skip REA for ordinary source-repository architecture analysis.Stars: 471kUpdated Claude CodeCodexVerifiedInstall
diagnosing-superpowersobra/superpowersUse when a superpowers session went wrong and your human partner wants to know why — repeated work, ignored plans, stumbles, poor results, a skill that didn't fire, "it took too long", "why is it so expensive", "what is it doing" — or wants to build a bug report for the superpowers maintainers, for the current session or a past one identified by id or path, on any harness.Stars: 322kUpdated Claude CodeCodexVerifiedInstall
dispatching-parallel-agentsobra/superpowersUse when facing 2+ independent tasks that can be worked on without shared state or sequential dependenciesStars: 322kUpdated Claude CodeCodexVerifiedInstall
executing-plansobra/superpowersUse when executing an implementation plan in the current session as the implementer yourself — your human partner chose inline execution, or no subagent tool is availableStars: 322kUpdated Claude CodeCodexVerifiedInstall