Skip to content

K-Dense-AI/scientific-agent-skills / skills/scholar-evaluation

scholar-evaluation

Verified

Provides qualitative-first, evidence-traceable developmental review of scholarly works and audit low-stakes research-assessment rubrics with optional local quality controls. Never use for ranking people or consequential decisions.

assets/ratings_template.csv

View on GitHub
evaluation_id,work_id,rater_id,criterion_id,status,score
EVALUATION-SYNTHETIC-A,WORK-SYNTHETIC-A,RATER-SYNTHETIC-1,question_scope,rated,3
EVALUATION-SYNTHETIC-A,WORK-SYNTHETIC-A,RATER-SYNTHETIC-2,question_scope,rated,4
EVALUATION-SYNTHETIC-A,WORK-SYNTHETIC-A,RATER-SYNTHETIC-1,literature_contribution,rated,2
EVALUATION-SYNTHETIC-A,WORK-SYNTHETIC-A,RATER-SYNTHETIC-2,literature_contribution,rated,3
EVALUATION-SYNTHETIC-A,WORK-SYNTHETIC-A,RATER-SYNTHETIC-1,method_design,rated,3
EVALUATION-SYNTHETIC-A,WORK-SYNTHETIC-A,RATER-SYNTHETIC-2,method_design,rated,3
EVALUATION-SYNTHETIC-A,WORK-SYNTHETIC-A,RATER-SYNTHETIC-1,analysis_claims,rated,2
EVALUATION-SYNTHETIC-A,WORK-SYNTHETIC-A,RATER-SYNTHETIC-2,analysis_claims,rated,3
EVALUATION-SYNTHETIC-A,WORK-SYNTHETIC-A,RATER-SYNTHETIC-1,transparency_integrity,rated,3
EVALUATION-SYNTHETIC-A,WORK-SYNTHETIC-A,RATER-SYNTHETIC-2,transparency_integrity,rated,3
EVALUATION-SYNTHETIC-B,WORK-SYNTHETIC-B,RATER-SYNTHETIC-1,question_scope,rated,2
EVALUATION-SYNTHETIC-B,WORK-SYNTHETIC-B,RATER-SYNTHETIC-2,question_scope,rated,2
EVALUATION-SYNTHETIC-B,WORK-SYNTHETIC-B,RATER-SYNTHETIC-1,literature_contribution,rated,3
EVALUATION-SYNTHETIC-B,WORK-SYNTHETIC-B,RATER-SYNTHETIC-2,literature_contribution,rated,2
EVALUATION-SYNTHETIC-B,WORK-SYNTHETIC-B,RATER-SYNTHETIC-1,method_design,rated,2
EVALUATION-SYNTHETIC-B,WORK-SYNTHETIC-B,RATER-SYNTHETIC-2,method_design,rated,3
EVALUATION-SYNTHETIC-B,WORK-SYNTHETIC-B,RATER-SYNTHETIC-1,analysis_claims,missing,
EVALUATION-SYNTHETIC-B,WORK-SYNTHETIC-B,RATER-SYNTHETIC-2,analysis_claims,rated,2
EVALUATION-SYNTHETIC-B,WORK-SYNTHETIC-B,RATER-SYNTHETIC-1,transparency_integrity,not_applicable,
EVALUATION-SYNTHETIC-B,WORK-SYNTHETIC-B,RATER-SYNTHETIC-2,transparency_integrity,not_applicable,
rea-analysis-optimizationmorluto/reaOptimize REA providers and shared analysis workflows for agent context, latency, CPU, and memory while preserving correctness and Evidence. Use for analysis bottlenecks and cache or query design; CI/test-suite optimization belongs to rea-ci-tests-audit.Stars: 472kUpdated Claude CodeCodexVerifiedInstall
rea-ci-tests-auditmorluto/reaAudit REA CI and test suites for correctness, fixture drift, false passes, and measured performance; use for suite or workflow investigations and efficiency changes, rather than ordinary feature testing or a single test failure.Stars: 472kUpdated Claude CodeCodexVerifiedInstall
rea-tool-designmorluto/reaAudit, investigate, design, or change REA investigation tools, CLI/MCP contracts, provider capabilities, and Evidence semantics.Stars: 472kUpdated Claude CodeCodexVerifiedInstall
ponytail-auditDietrichGebert/ponytailQuality audit of the whole repo: bugs, security, real load, missing tests, speed, and what to delete. Most important first.Stars: 194kUpdated Claude CodeCodexVerifiedInstall