Skip to content

LeoYeAI/agent-master-skills / skills/autoresearch-agent

autoresearch-agent

Verified

Autonomous experiment loop that optimizes any file by a measurable metric. Inspired by Karpathy's autoresearch. The agent edits a target file, runs a fixed evaluation, keeps improvements (git commit), discards failures (git reset), and loops indefinitely. Use when: user wants to optimize code speed, reduce bundle/image size, improve test pass rate, optimize prompts, improve content quality (headlines, copy, CTR), or run any measurable improvement loop. Requires: a target file, an evaluation command that outputs a metric, and a git repo.

evaluators/memory_usage.py

View on GitHub
#!/usr/bin/env python3
"""Measure peak memory usage of a command.
DO NOT MODIFY after experiment starts — this is the fixed evaluator."""

import platform
import subprocess
import sys

# --- CONFIGURE THESE ---
COMMAND = "python src/module.py"  # Command to measure
# --- END CONFIG ---

system = platform.system()

if system == "Linux":
    # Use /usr/bin/time for peak RSS
    result = subprocess.run(
        f"/usr/bin/time -v {COMMAND}",
        shell=True, capture_output=True, text=True, timeout=300
    )
    output = result.stderr
    for line in output.splitlines():
        if "Maximum resident set size" in line:
            kb = int(line.split(":")[-1].strip())
            mb = kb / 1024
            print(f"peak_mb: {mb:.1f}")
            print(f"peak_kb: {kb}")
            sys.exit(0)
    print("Could not parse memory from /usr/bin/time output", file=sys.stderr)
    sys.exit(1)

elif system == "Darwin":
    # macOS: use /usr/bin/time -l
    result = subprocess.run(
        f"/usr/bin/time -l {COMMAND}",
        shell=True, capture_output=True, text=True, timeout=300
    )
    output = result.stderr
    for line in output.splitlines():
        if "maximum resident set size" in line.lower():
            # macOS reports in bytes
            val = int(line.strip().split()[0])
            kb = val / 1024
            mb = val / (1024 * 1024)
            print(f"peak_mb: {mb:.1f}")
            print(f"peak_kb: {int(kb)}")
            sys.exit(0)
    print("Could not parse memory from time output", file=sys.stderr)
    sys.exit(1)

else:
    print(f"Unsupported platform: {system}. Use Linux or macOS.", file=sys.stderr)
    sys.exit(1)
finishing-a-development-branchobra/superpowersUse when implementation is complete, all tests pass, and you need to decide how to integrate the workStars: 322kUpdated Claude CodeCodexVerifiedInstall
systematic-debuggingobra/superpowersUse when encountering any bug, test failure, or unexpected behavior, before proposing fixesStars: 322kUpdated Claude CodeCodexVerifiedInstall
test-driven-developmentobra/superpowersUse when implementing any feature or bugfix, before writing implementation codeStars: 322kUpdated Claude CodeCodexVerifiedInstall
skill-creatoranthropics/skillsCreate new skills, modify and improve existing skills, and measure skill performance. Use when users want to create a skill from scratch, edit, or optimize an existing skill, run evals to test a skill, benchmark skill performance with variance analysis, or optimize a skill's description for better triggering accuracy.Stars: 198kUpdated Claude CodeCodexVerifiedInstall