K-Dense-AI/scientific-agent-skills / skills/scholar-evaluation
scholar-evaluation
VerifiedProvides qualitative-first, evidence-traceable developmental review of scholarly works and audit low-stakes research-assessment rubrics with optional local quality controls. Never use for ranking people or consequential decisions.
| File | Kind | Size |
|---|---|---|
| SKILL.md | skill md | 12.1 KB |
| assets/evaluation_template.json | config | 1.3 KB |
| assets/evidence_manifest_template.json | config | 1.8 KB |
| assets/process_checklist_template.json | config | 2.1 KB |
| assets/ratings_template.csv | other | 1.7 KB |
| assets/rubric_template.json | config | 11.9 KB |
| references/evaluation_framework.md | markdown | 10.4 KB |
| references/local_tooling.md | markdown | 9.1 KB |
| references/responsible_assessment.md | markdown | 9.6 KB |
| references/security_validation.md | markdown | 4.2 KB |
| references/source_ledger.md | markdown | 13.8 KB |
| scripts/_common.py | script | 35.6 KB |
| scripts/calculate_scores.py | script | 1.8 KB |
| scripts/check_process.py | script | 8.1 KB |
| scripts/check_traceability.py | script | 8.9 KB |
| scripts/generate_report_scaffold.py | script | 9.4 KB |
| scripts/summarize_agreement.py | script | 11.1 KB |
| scripts/validate_rubric.py | script | 1.7 KB |
| scripts/weight_sensitivity.py | script | 10.0 KB |
assets/process_checklist_template.json
View on GitHub{
"schema_version": "2.0",
"process_id": "PROCESS-SYNTHETIC-001",
"purpose": "developmental_review_of_scholarly_work",
"unit_of_assessment": "scholarly_work",
"data_classification": "synthetic",
"high_impact_use": false,
"committee": {
"qualified_members_confirmed": false,
"training_completed": false,
"accountable_owner_role": "",
"training_record_ref": ""
},
"conflicts": {
"disclosure_process_confirmed": false,
"recusal_process_confirmed": false,
"record_ref": ""
},
"appeals": {
"process_confirmed": false,
"process_ref": "",
"notice_ref": ""
},
"accessibility": {
"accommodations_process_confirmed": false,
"accessible_materials_confirmed": false,
"process_ref": ""
},
"data_protection": {
"purpose_limitation_confirmed": false,
"data_minimisation_confirmed": false,
"access_controls_confirmed": false,
"retention_schedule_confirmed": false,
"raw_private_documents_excluded_from_tool_outputs": false,
"review_ref": ""
},
"rubric_quality": {
"construct_documented": false,
"rubric_provenance_documented": false,
"content_validity_documented": false,
"rater_training_documented": false,
"agreement_reviewed": false,
"inter_rater_reliability_reviewed": false,
"uncertainty_recorded": false,
"missing_and_not_applicable_supported": false,
"evidence_traceability_checked": false,
"weight_sensitivity_reviewed": false,
"quality_record_ref": ""
},
"fairness": {
"stakeholder_review_completed": false,
"disciplinary_context_reviewed": false,
"subgroup_bias_review_completed": false,
"protected_attributes_excluded_from_scoring": false,
"bias_review_ref": ""
},
"decision_controls": {
"no_automated_decision": false,
"no_person_ranking": false,
"no_decision_recommendation": false,
"qualified_human_accountability": false
},
"monitoring": {
"rater_drift_reviewed": false,
"unintended_consequences_reviewed": false,
"periodic_revision_scheduled": false,
"review_record_ref": "",
"revision_owner_role": ""
}
}
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| rea-analysis-optimizationmorluto/reaOptimize REA providers and shared analysis workflows for agent context, latency, CPU, and memory while preserving correctness and Evidence. Use for analysis bottlenecks and cache or query design; CI/test-suite optimization belongs to rea-ci-tests-audit. | Stars: 472k | Updated | Claude CodeCodex | Verified | Install |
| rea-ci-tests-auditmorluto/reaAudit REA CI and test suites for correctness, fixture drift, false passes, and measured performance; use for suite or workflow investigations and efficiency changes, rather than ordinary feature testing or a single test failure. | Stars: 472k | Updated | Claude CodeCodex | Verified | Install |
| rea-tool-designmorluto/reaAudit, investigate, design, or change REA investigation tools, CLI/MCP contracts, provider capabilities, and Evidence semantics. | Stars: 472k | Updated | Claude CodeCodex | Verified | Install |
| ponytail-auditDietrichGebert/ponytailQuality audit of the whole repo: bugs, security, real load, missing tests, speed, and what to delete. Most important first. | Stars: 194k | Updated | Claude CodeCodex | Verified | Install |