a5c-ai/babysitter / library/specializations/data-science-ml/skills/ray-distributed-trainer
ray-distributed-trainer
VerifiedDistributed computing skill using Ray for parallel training, hyperparameter search, and resource management.
ray-distributed-trainer
Overview
Distributed computing skill using Ray for parallel training, hyperparameter search, and resource management across clusters.
Capabilities
- Ray Train for distributed training
- Ray Tune for hyperparameter search at scale
- Cluster resource management
- Fault tolerance and checkpointing
- Actor-based parallelism
- Integration with PyTorch and TensorFlow
- Elastic training support
- Multi-node orchestration
Target Processes
- Distributed Training Orchestration
- AutoML Pipeline Orchestration
- Model Training Pipeline
Tools and Libraries
- Ray
- Ray Train
- Ray Tune
- Ray Cluster
Input Schema
{
"type": "object",
"required": ["mode", "config"],
"properties": {
"mode": {
"type": "string",
"enum": ["train", "tune", "cluster"],
"description": "Ray operation mode"
},
"config": {
"type": "object",
"properties": {
"numWorkers": { "type": "integer" },
"useGpu": { "type": "boolean" },
"resourcesPerWorker": {
"type": "object",
"properties": {
"cpu": { "type": "number" },
"gpu": { "type": "number" }
}
}
}
},
"trainConfig": {
"type": "object",
"properties": {
"trainerPath": { "type": "string" },
"framework": { "type": "string", "enum": ["pytorch", "tensorflow", "xgboost"] },
"scalingConfig": { "type": "object" }
}
},
"tuneConfig": {
"type": "object",
"properties": {
"searchSpace": { "type": "object" },
"scheduler": { "type": "string" },
"numSamples": { "type": "integer" },
"metric": { "type": "string" },
"mode": { "type": "string", "enum": ["min", "max"] }
}
}
}
}
Output Schema
{
"type": "object",
"required": ["status", "results"],
"properties": {
"status": {
"type": "string",
"enum": ["success", "error", "partial"]
},
"results": {
"type": "object",
"properties": {
"bestConfig": { "type": "object" },
"bestMetric": { "type": "number" },
"numTrials": { "type": "integer" },
"completedTrials": { "type": "integer" }
}
},
"checkpointPath": {
"type": "string"
},
"clusterStatus": {
"type": "object",
"properties": {
"numNodes": { "type": "integer" },
"totalCpu": { "type": "number" },
"totalGpu": { "type": "number" }
}
},
"trainingTime": {
"type": "number"
}
}
}
Usage Example
{
kind: 'skill',
title: 'Distributed hyperparameter tuning',
skill: {
name: 'ray-distributed-trainer',
context: {
mode: 'tune',
config: {
numWorkers: 4,
useGpu: true,
resourcesPerWorker: { cpu: 2, gpu: 1 }
},
tuneConfig: {
searchSpace: {
lr: { type: 'loguniform', min: 1e-5, max: 1e-1 },
batchSize: { type: 'choice', values: [16, 32, 64] }
},
scheduler: 'asha',
numSamples: 100,
metric: 'val_loss',
mode: 'min'
}
}
}
}
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| reverse-engineer-anythingmorluto/reaReverse engineer native, managed, Electron/JavaScript, packaged, firmware, and browser targets with REA, and build agent environments (AgentEnv bundles) of web applications from a live instance or a capture, and of Linux desktop apps with a task from a request. Use shipped-artifact or requested runtime evidence to explain features, compare versions, decompile code, or guide a reconstruction. Skip REA for ordinary source-repository architecture analysis. | Stars: 467k | Updated | Claude CodeCodex | Verified | Install |
| diagnosing-superpowersobra/superpowersUse when a superpowers session went wrong and your human partner wants to know why — repeated work, ignored plans, stumbles, poor results, a skill that didn't fire, "it took too long", "why is it so expensive", "what is it doing" — or wants to build a bug report for the superpowers maintainers, for the current session or a past one identified by id or path, on any harness. | Stars: 319k | Updated | Claude CodeCodex | Verified | Install |
| dispatching-parallel-agentsobra/superpowersUse when facing 2+ independent tasks that can be worked on without shared state or sequential dependencies | Stars: 319k | Updated | Claude CodeCodex | Verified | Install |
| executing-plansobra/superpowersUse when executing an implementation plan in the current session as the implementer yourself — your human partner chose inline execution, or no subagent tool is available | Stars: 319k | Updated | Claude CodeCodex | Verified | Install |