zrwangems/dsh-zrwang-plugin / ars/skills/academic-paper-reviewer
academic-paper-reviewer
Flagged模拟同行评审:期刊匹配审稿人 + 3 位动态领域审稿人 + 魔鬼代言人,输出编辑决定(接收/小修/大修/拒稿)与返修路线图,可做方法论专项评审与再审核验。Triggers: review paper, peer review, manuscript review, check methodology, re-review | 审稿, 同行评审, 评审论文, 检查方法, 复审。只做评审,不改写稿件。
_shared/benchmark_report.schema.json
View on GitHub{
"$schema": "https://json-schema.org/draft/2020-12/schema",
"$id": "https://github.com/Imbad0202/academic-research-skills/shared/benchmark_report.schema.json",
"title": "ARS Benchmark Report",
"type": "object",
"required": [
"ars_version",
"task_definition",
"human_baseline",
"ars_run",
"metrics",
"caveats"
],
"properties": {
"ars_version": {
"type": "string",
"pattern": "^\\d+\\.\\d+\\.\\d+$",
"description": "Exact ARS version the benchmark was run against"
},
"task_definition": {
"type": "object",
"required": ["description", "task_type", "outcome_gradable"],
"properties": {
"description": { "type": "string", "minLength": 1 },
"task_type": { "enum": ["outcome-gradable", "open-ended"] },
"outcome_gradable": { "type": "boolean" }
}
},
"human_baseline": {
"type": "object",
"required": ["sample_size", "author_independence", "hours_spent", "recruitment", "tools_allowed"],
"properties": {
"sample_size": { "type": "integer", "minimum": 1 },
"author_independence": {
"enum": ["author-conducted", "author-blinded", "third-party-conducted"],
"description": "author-conducted means the benchmark creators also did the human baseline (downward bias risk)"
},
"hours_spent": { "type": "number", "minimum": 0 },
"recruitment": { "type": "string", "minLength": 1 },
"tools_allowed": {
"type": "array",
"items": { "type": "string", "minLength": 1 },
"minItems": 1
}
}
},
"ars_run": {
"type": "object",
"required": ["hours_spent", "cost_usd", "skills_used", "data_access_level_declared"],
"properties": {
"hours_spent": { "type": "number", "minimum": 0 },
"cost_usd": { "type": "number", "minimum": 0 },
"skills_used": {
"type": "array",
"items": { "type": "string" },
"minItems": 1
},
"data_access_level_declared": {
"enum": ["raw", "redacted", "verified_only"]
}
}
},
"metrics": {
"type": "object",
"required": ["primary_metric", "primary_metric_value", "scoring_independence"],
"properties": {
"primary_metric": { "type": "string", "minLength": 1 },
"primary_metric_value": { "type": "number" },
"scoring_independence": {
"enum": ["authors-scored", "third-party-scored", "blind-scored", "self-scored"]
}
}
},
"caveats": {
"type": "array",
"items": { "type": "string", "minLength": 1 },
"minItems": 1,
"description": "Known limitations. Empty array not permitted — honest disclosure required."
}
}
}
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| add-product-e2e-evalpaperclipai/paperclipAdd or extend a Paperclip full-stack runner E2E workflow, fixture, matcher, or report evidence path for local or Daytona execution. | Stars: 115k | Updated | Claude CodeCodex | Verified | Install |
| add-runner-evalpaperclipai/paperclipAdd or extend a Paperclip Runner protocol evaluation definition, roster, assertion, or report fixture with provenance and narrow validation. | Stars: 115k | Updated | Claude CodeCodex | Verified | Install |
| diagnose-why-work-stoppedpaperclipai/paperclipCompatibility entry point for failed, stalled, looping, or over-recovered Paperclip work. Use fix-failed-paperclip-run for the full diagnosis, regression, repair, real verification, and green-PR workflow; honor an explicitly requested diagnosis-only scope. | Stars: 115k | Updated | Claude CodeCodex | Verified | Install |
| fix-failed-paperclip-runpaperclipai/paperclipDiagnose and fix failed, stuck, slow, or incorrectly blocked Paperclip tasks and runs. Use with a task/run URL or failure report to trace the root cause, prove a regression red then green, check second-order effects, verify the real workflow, and deliver a PR with passing checks. | Stars: 115k | Updated | Claude CodeCodex | Verified | Install |