Skip to content

ahstn/oceans-llm / .agents/skills/verify-oceans-admin

verify-oceans-admin

Verified

Verify the Oceans LLM admin control plane and backend gateway against the real local stack, seeded demo data, and bounded live providers when required. Use for user-path checks of sign-in, models, API keys, observability, usage costs, spend controls, batches, agent sessions, request logs, Anthropic Messages thinking and effort compatibility, MCP registry and tool access, OpenRouter routing, guardrails, and Skills storage.

FileKindSize
SKILL.mdskill md29.0 KB
examples/mcp-candidates.jsonconfig3.0 KB
features/README.mdmarkdown10.0 KB
features/account-onboarding.mdmarkdown4.3 KB
features/agent-harnesses.mdmarkdown4.3 KB
features/agent-plugins.mdmarkdown1005 B
features/agent-sessions.mdmarkdown3.9 KB
features/anthropic-messages.mdmarkdown20.7 KB
features/api-keys.mdmarkdown6.5 KB
features/attribution.mdmarkdown13.9 KB
features/audit-log.mdmarkdown4.9 KB
features/backend-gateway.mdmarkdown5.2 KB
features/batch-requests.mdmarkdown4.2 KB
features/design-system.mdmarkdown4.6 KB
features/guardrails.mdmarkdown7.0 KB
features/harness-integration.mdmarkdown7.8 KB
features/identity.mdmarkdown4.2 KB
features/image-generation.mdmarkdown7.3 KB
features/leaderboard.mdmarkdown3.3 KB
features/live-llm-requests.mdmarkdown12.6 KB
features/mcp-client-oauth.mdmarkdown9.9 KB
features/mcp-ownership.mdmarkdown7.4 KB
features/mcp.mdmarkdown19.6 KB
features/models.mdmarkdown8.2 KB
features/password-sign-in.mdmarkdown8.3 KB
features/profile.mdmarkdown2.5 KB
features/rate-limits.mdmarkdown6.0 KB
features/request-logs.mdmarkdown8.6 KB
features/review-agent.mdmarkdown3.7 KB
features/routing.jsonconfig33.6 KB
features/service-tiers.mdmarkdown6.3 KB
features/skills.mdmarkdown9.8 KB
features/spend-controls.mdmarkdown7.3 KB
features/usage-costs.mdmarkdown3.7 KB
features/workspace-connections.mdmarkdown6.1 KB
scripts/check-messages.mjsexecutablescript2.4 KB
scripts/check-messages.test.mjsscript3.0 KB
scripts/control-oceans-adminexecutablescript25.3 KB
scripts/control-oceans-admin.test.mjsscript7.6 KB
scripts/drive-backend-gateway.mjsexecutablescript12.5 KB
scripts/drive-harness-integration.mjsscript6.6 KB
scripts/drive-mcp.mjsscript13.0 KB
scripts/drive-models.mjsscript12.9 KB
scripts/drive-observability.mjsscript16.8 KB
scripts/drive-profile.mjsscript8.2 KB
scripts/drive-service-tiers.mjsexecutablescript20.1 KB
scripts/drive-skills.mjsscript27.2 KB
scripts/mcp-browser.mjsscript26.5 KB
scripts/mcp-canary.mjsscript18.8 KB
scripts/mcp-candidates.mjsscript3.5 KB
scripts/mcp-verification.test.mjsscript10.2 KB
scripts/messages-regressions.mjsscript15.8 KB
scripts/plan-verification.mjsscript5.2 KB
scripts/plan-verification.test.mjsscript6.1 KB
scripts/proof-cli.mjsscript11.1 KB
scripts/proof.mjsscript9.2 KB
scripts/proof.test.mjsscript10.4 KB

scripts/check-messages.test.mjs

View on GitHub
import assert from 'node:assert/strict'
import test from 'node:test'
import fs from 'node:fs/promises'
import os from 'node:os'
import path from 'node:path'
import { execFileSync } from 'node:child_process'
import { assessResults, requiredChecks, regressionFingerprint } from './messages-regressions.mjs'
import { assessProof, buildEnvelope } from './proof.mjs'

const passed = requiredChecks.map(([, name]) => `test suite::${name} ... ok`).join('\n')

test('Messages gate requires every named regression and a successful Rust process', () => {
  assert.equal(assessResults(passed, 0).verdict, 'pass')
  assert.equal(assessResults(passed, 1).verdict, 'fail')
  assert.equal(assessResults(passed, null).verdict, 'fail')
})

test('empty filters, ignored tests and missing regressions cannot produce a passing gate', () => {
  assert.equal(assessResults('test result: ok. 0 passed', 0).verdict, 'fail')
  assert.equal(assessResults(passed.replace(' ... ok', ' ... ignored'), 0).verdict, 'fail')
  assert.equal(assessResults(passed.split('\n').slice(1).join('\n'), 0).verdict, 'fail')
})

test('offline fingerprints include test assertions and suite dependencies', async () => {
  const root = await fs.mkdtemp(path.join(os.tmpdir(), 'messages-fingerprint-'))
  try {
    execFileSync('git', ['init', '-q', root])
    await fs.mkdir(path.join(root, 'crates/gateway-service'), { recursive: true })
    const file = path.join(root, 'crates/gateway-service/request_tests.rs')
    await fs.writeFile(file, 'assert_eq!(actual, expected);')
    const before = regressionFingerprint(root).sourceHash
    await fs.writeFile(file, '// assertion removed')
    assert.notEqual(regressionFingerprint(root).sourceHash, before)
  } finally { await fs.rm(root, { recursive: true, force: true }) }
})

test('manual Messages proof cannot hide a missing, failed, incomplete or stale gate', async () => {
  const evidenceDir = await fs.mkdtemp(path.join(os.tmpdir(), 'messages-evidence-'))
  const file = path.join(evidenceDir, 'messages-regressions.json')
  try {
    const proof = buildEnvelope({ featureIds: ['anthropic-messages'],
      checks: [{ id: 'live-response', status: 'pass' }], artifacts: ['messages-regressions.json'] })
    proof.launchSourceHash = proof.sourceHash
    const assess = () => assessProof(proof, { evidenceDir, requireCurrent: true }).join('\n')
    assert.match(assess(), /missing or unreadable/)
    const good = { schemaVersion: 1, ...regressionFingerprint(), ...assessResults(passed, 0) }
    await fs.writeFile(file, JSON.stringify(good))
    assert.equal(assess(), '')
    for (const replacement of [
      null,
      { ...good, verdict: 'fail' },
      { ...good, checks: 'invalid' },
      { ...good, checks: [null] },
      { ...good, checks: good.checks.slice(1) },
      { ...good, sourceHash: 'stale' },
    ]) {
      await fs.writeFile(file, JSON.stringify(replacement))
      assert.match(assess(), /did not pass|stale: Messages/)
    }
  } finally { await fs.rm(evidenceDir, { recursive: true, force: true }) }
})
reverse-engineer-anythingmorluto/reaReverse engineer native, managed, Electron/JavaScript, packaged, firmware, and browser targets with REA, and build agent environments (AgentEnv bundles) of web applications from a live instance or a capture, and of Linux desktop apps with a task from a request. Use shipped-artifact or requested runtime evidence to explain features, compare versions, decompile code, or guide a reconstruction. Skip REA for ordinary source-repository architecture analysis.Stars: 471kUpdated Claude CodeCodexVerifiedInstall
diagnosing-superpowersobra/superpowersUse when a superpowers session went wrong and your human partner wants to know why — repeated work, ignored plans, stumbles, poor results, a skill that didn't fire, "it took too long", "why is it so expensive", "what is it doing" — or wants to build a bug report for the superpowers maintainers, for the current session or a past one identified by id or path, on any harness.Stars: 322kUpdated Claude CodeCodexVerifiedInstall
dispatching-parallel-agentsobra/superpowersUse when facing 2+ independent tasks that can be worked on without shared state or sequential dependenciesStars: 322kUpdated Claude CodeCodexVerifiedInstall
executing-plansobra/superpowersUse when executing an implementation plan in the current session as the implementer yourself — your human partner chose inline execution, or no subagent tool is availableStars: 322kUpdated Claude CodeCodexVerifiedInstall