ray-distributed-trainer
Distributed computing skill using Ray for parallel training, hyperparameter search, and resource management.
它会碰到什么
扫了多少2 个文本文件,5 KB
它会碰到什么不碰外部(只输出文字)
命中总数0 处
命中统计严重 0 · 高 0 · 中 0 · 低 0
这一栏是扫描器报的事实,不是结论。命中多不等于有毒(安全工具、规则库、示例脚本本来就会包含危险写法),命中少也不等于干净。它和你手上的凭据、文件、网络有什么关系,需要你自己看。
技能内容
ray-distributed-trainer
Overview
Distributed computing skill using Ray for parallel training, hyperparameter search, and resource management across clusters.
Capabilities
- Ray Train for distributed training
- Ray Tune for hyperparameter search at scale
- Cluster resource management
- Fault tolerance and checkpointing
- Actor-based parallelism
- Integration with PyTorch and TensorFlow
- Elastic training support
- Multi-node orchestration
Target Processes
- Distributed Training Orchestration
- AutoML Pipeline Orchestration
- Model Training Pipeline
Tools and Libraries
- Ray
- Ray Train
- Ray Tune
- Ray Cluster
Input Schema
{
"type": "object",
"required": ["mode", "config"],
"properties": {
"mode": {
"type": "string",
"enum": ["train", "tune", "cluster"],
"description": "Ray operation mode"
},
"config": {
"type": "object",
"properties": {
"numWorkers": { "type": "integer" },
"useGpu": { "type": "boolean" },
"resourcesPerWorker": {
"type": "object",
"properties": {
"cpu": { "type": "number" },
"gpu": { "type": "number" }
}
}
}
},
"trainConfig": {
"type": "object",
"properties": {
"trainerPath": { "type": "string" },
"framework": { "type": "string", "enum": ["pytorch", "tensorflow", "xgboost"] },
"scalingConfig": { "type": "object" }
}
},
"tuneConfig": {
"type": "object",
"properties": {
"searchSpace": { "type": "object" },
"scheduler": { "type": "string" },
"numSamples": { "type": "integer" },
"metric": { "type": "string" },
"mode": { "type": "string", "enum": ["min", "max"] }
}
}
}
}
Output Schema
{
"type": "object",
"required": ["status", "results"],
"properties": {
"status": {
"type": "string",
"enum": ["success", "error", "partial"]
},
"results": {
"type": "object",
"properties": {
"bestConfig": { "type": "object" },
"bestMetric": { "type": "number" },
"numTrials": { "type": "integer" },
"completedTrials": { "type": "integer" }
}
},
"checkpointPath": {
"type": "string"
},
"clusterStatus": {
"type": "object",
"properties": {
"numNodes": { "type": "integer" },
"totalCpu": { "type": "number" },
"totalGpu": { "type": "number" }
}
},
"trainingTime": {
"type": "number"
}
}
}
Usage Example
{
kind: 'skill',
title: 'Distributed hyperparameter tuning',
skill: {
name: 'ray-distributed-trainer',
context: {
mode: 'tune',
config: {
numWorkers: 4,
useGpu: true,
resourcesPerWorker: { cpu: 2, gpu: 1 }
},
tuneConfig: {
searchSpace: {
lr: { type: 'loguniform', min: 1e-5, max: 1e-1 },
batchSize: { type: 'choice', values: [16, 32, 64] }
},
scheduler: 'asha',
numSamples: 100,
metric: 'val_loss',
mode: 'min'
}
}
}
}想直接用这个技能?
本站把开放许可(MIT / Apache 等)的技能按仓库打包整理到网盘,点一下转存到你自己的网盘,不用一个个从 GitHub 拉。许可未声明的技能只给原始仓库链接,不打包。
它属于哪个仓库
星标★ 1,796
本站分层T1
该仓技能数2115
原文件路径
library/specializations/data-science-ml/skills/ray-distributed-trainer/SKILL.md