Skip to content

aipoch/open-science / resources/skills/skill-creator

skill-creator

Verified

Create, revise, evaluate, publish, and improve Open-Science Skills through the native JavaScript host.skills composer. Use when the user wants a reusable workflow, an existing Skill changed, test cases or benchmarks for a Skill, or better Skill triggering.

scripts/run-loop.js

View on GitHub
'use strict'
/* eslint-disable @typescript-eslint/explicit-function-return-type */

const splitEvalSet = (queries, trainRatio = 0.6) => {
  if (!Array.isArray(queries) || queries.length < 2) {
    throw new Error('splitEvalSet requires at least two trigger cases.')
  }
  const trainSize = Math.max(
    1,
    Math.min(queries.length - 1, Math.round(queries.length * trainRatio))
  )
  return { train: queries.slice(0, trainSize), test: queries.slice(trainSize) }
}

const runLoop = async ({ hostSkills, evalId }) => {
  if (typeof hostSkills?.evals?.run !== 'function') {
    throw new Error('host.skills.evals.run is unavailable in this runtime.')
  }
  if (!evalId) throw new Error('evalId is required.')
  return hostSkills.evals.run(evalId)
}

module.exports = { runLoop, splitEvalSet }
finishing-a-development-branchobra/superpowersUse when implementation is complete, all tests pass, and you need to decide how to integrate the workStars: 322kUpdated Claude CodeCodexVerifiedInstall
systematic-debuggingobra/superpowersUse when encountering any bug, test failure, or unexpected behavior, before proposing fixesStars: 322kUpdated Claude CodeCodexVerifiedInstall
test-driven-developmentobra/superpowersUse when implementing any feature or bugfix, before writing implementation codeStars: 322kUpdated Claude CodeCodexVerifiedInstall
skill-creatoranthropics/skillsCreate new skills, modify and improve existing skills, and measure skill performance. Use when users want to create a skill from scratch, edit, or optimize an existing skill, run evals to test a skill, benchmark skill performance with variance analysis, or optimize a skill's description for better triggering accuracy.Stars: 197kUpdated Claude CodeCodexVerifiedInstall