aiskillstore/marketplace / skills/92bilal26/content-evaluation-framework
content-evaluation-framework
VerifiedThis skill should be used when evaluating the quality of book chapters, lessons, or educational content. It provides a systematic 6-category rubric with weighted scoring (Technical Accuracy 30%, Pedagogical Effectiveness 25%, Writing Quality 20%, Structure & Organization 15%, AI-First Teaching 10%, Constitution Compliance Pass/Fail) and multi-tier assessment (Excellent/Good/Needs Work/Insufficient). Use this during iterative drafting, after content completion, on-demand review requests, or before validation phases.
| File | Kind | Size |
|---|---|---|
| SKILL.md | skill md | 11.9 KB |
| references/constitution-checklist.md | markdown | 18.6 KB |
| references/evaluation-template.md | markdown | 14.0 KB |
| references/rubric-details.md | markdown | 25.6 KB |
| skill-report.json | config | 34.2 KB |
references/evaluation-template.md
View on GitHub# Content Evaluation Report
**Content Evaluated**: [File path to content]
**Evaluation Date**: [YYYY-MM-DD]
**Evaluator**: [Name or "AI Evaluation Framework"]
**Chapter/Lesson**: [Chapter X, Lesson Y or Section Title]
**Content Type**: [Technical / Conceptual / Hybrid]
---
## Executive Summary
**Overall Verdict**: ⬜ Pass / ⬜ Conditional Pass / ⬜ Fail
**Overall Weighted Score**: [X.X]% — **[Excellent / Good / Needs Work / Insufficient]**
**Constitution Compliance**: ✅ Pass / ❌ Fail
**Ready for Publication**: ⬜ Yes / ⬜ Yes, with minor revisions / ⬜ No, requires significant revision
**Quick Summary**:
[1-2 sentence summary of content quality and readiness]
---
## Category Scores (Weighted)
| Category | Score | Tier | Weight | Contribution to Final Score |
|----------|-------|------|--------|----------------------------|
| **Technical Accuracy** | [X]% | [Tier] | 30% | [X.X]% |
| **Pedagogical Effectiveness** | [X]% | [Tier] | 25% | [X.X]% |
| **Writing Quality** | [X]% | [Tier] | 20% | [X.X]% |
| **Structure & Organization** | [X]% | [Tier] | 15% | [X.X]% |
| **AI-First Teaching** | [X]% | [Tier] | 10% | [X.X]% |
| **Constitution Compliance** | N/A | Pass/Fail | N/A | GATE |
| | | | **TOTAL** | **[X.X]%** |
**Score Calculation**:
```
Final Score = (Technical × 0.30) + (Pedagogical × 0.25) + (Writing × 0.20) +
(Structure × 0.15) + (AI-First × 0.10)
= ([score] × 0.30) + ([score] × 0.25) + ([score] × 0.20) +
([score] × 0.15) + ([score] × 0.10)
= [X.X]%
```
---
## Constitution Compliance Status
### Overall Verdict: ✅ Pass / ❌ Fail
**Critical Items Summary**:
- Principle 1 (AI-First Teaching): ✅ Pass / ❌ Fail
- Principle 2 (Spec-Kit): ✅ Pass / ❌ Fail
- Principle 3 (Python 3.13+): ✅ Pass / ❌ Fail / ⬜ N/A
- Principle 4 (Test-First): ✅ Pass / ❌ Fail / ⬜ N/A
- Principle 5 (Progressive Complexity): ✅ Pass / ❌ Fail
- Principle 6 (Consistent Structure): ✅ Pass / ❌ Fail
- Principle 7 (Technical Accuracy): ✅ Pass / ❌ Fail
- Principle 8 (Accessibility): ✅ Pass / ❌ Fail
- Book Gaps Checklist: ✅ Pass / ❌ Fail
- ALWAYS/NEVER Rules: ✅ Pass / ❌ Fail
- Domain Skills Application: ✅ Pass / ❌ Fail
- Output Style Compliance: ✅ Pass / ❌ Fail
**Constitutional Violations** (if any):
- [List specific violations with evidence]
- [Quote passages that violate principles]
- [Note which principle(s) violated]
**Constitutional Strengths**:
- [List areas of strong constitutional adherence]
- [Quote exemplary passages]
- [Note which principles exemplified]
**See detailed checklist in Appendix A for full constitutional evaluation.**
---
## Detailed Category Findings
### 1. Technical Accuracy (30% weight) — [Score]% ([Tier])
**Overall Assessment**:
[2-3 sentence summary of technical accuracy]
**Strengths**:
- [Specific strength with evidence/quote]
- [Specific strength with evidence/quote]
- [Specific strength with evidence/quote]
**Weaknesses**:
- [Specific issue with evidence/quote and line number if applicable]
- [Specific issue with evidence/quote and line number if applicable]
- [Specific issue with evidence/quote and line number if applicable]
**Evidence**:
- **Code Quality**: [Assessment with examples]
- **Explanations**: [Assessment with examples]
- **Examples**: [Assessment with examples]
**Recommendations**:
1. [Specific, actionable recommendation]
2. [Specific, actionable recommendation]
3. [Specific, actionable recommendation]
---
### 2. Pedagogical Effectiveness (25% weight) — [Score]% ([Tier])
**Overall Assessment**:
[2-3 sentence summary of pedagogical effectiveness]
**Strengths**:
- [Specific strength with evidence/quote]
- [Specific strength with evidence/quote]
- [Specific strength with evidence/quote]
**Weaknesses**:
- [Specific issue with evidence/quote and line number if applicable]
- [Specific issue with evidence/quote and line number if applicable]
- [Specific issue with evidence/quote and line number if applicable]
**Evidence**:
- **Learning Design**: [Assessment with examples]
- **Concept Scaffolding**: [Assessment with examples]
- **Exercises & Practice**: [Assessment with examples]
- **Assessment**: [Assessment with examples]
**Recommendations**:
1. [Specific, actionable recommendation]
2. [Specific, actionable recommendation]
3. [Specific, actionable recommendation]
---
### 3. Writing Quality (20% weight) — [Score]% ([Tier])
**Overall Assessment**:
[2-3 sentence summary of writing quality]
**Strengths**:
- [Specific strength with evidence/quote]
- [Specific strength with evidence/quote]
- [Specific strength with evidence/quote]
**Weaknesses**:
- [Specific issue with evidence/quote and line number if applicable]
- [Specific issue with evidence/quote and line number if applicable]
- [Specific issue with evidence/quote and line number if applicable]
**Evidence**:
- **Readability**: [Assessment - Flesch-Kincaid grade level, sentence length, paragraph structure]
- **Clarity & Precision**: [Assessment with examples]
- **Voice & Tone**: [Assessment with examples]
- **Inclusive Language**: [Assessment with examples]
**Readability Metrics** (if available):
- Flesch-Kincaid Grade Level: [X.X]
- Average Sentence Length: [X] words
- Paragraph Length: [Assessment]
**Recommendations**:
1. [Specific, actionable recommendation]
2. [Specific, actionable recommendation]
3. [Specific, actionable recommendation]
---
### 4. Structure & Organization (15% weight) — [Score]% ([Tier])
**Overall Assessment**:
[2-3 sentence summary of structure and organization]
**Strengths**:
- [Specific strength with evidence/quote]
- [Specific strength with evidence/quote]
- [Specific strength with evidence/quote]
**Weaknesses**:
- [Specific issue with evidence/quote and line number if applicable]
- [Specific issue with evidence/quote and line number if applicable]
- [Specific issue with evidence/quote and line number if applicable]
**Evidence**:
- **Document Structure**: [Assessment with examples]
- **Opening Hook**: [Assessment with examples]
- **Content Flow**: [Assessment with examples]
- **Word Count**: [Actual count] words ([Target range] expected)
- **Closing**: [Assessment with examples]
**Recommendations**:
1. [Specific, actionable recommendation]
2. [Specific, actionable recommendation]
3. [Specific, actionable recommendation]
---
### 5. AI-First Teaching (10% weight) — [Score]% ([Tier])
**Overall Assessment**:
[2-3 sentence summary of AI-first teaching integration]
**Strengths**:
- [Specific strength with evidence/quote]
- [Specific strength with evidence/quote]
- [Specific strength with evidence/quote]
**Weaknesses**:
- [Specific issue with evidence/quote and line number if applicable]
- [Specific issue with evidence/quote and line number if applicable]
- [Specific issue with evidence/quote and line number if applicable]
**Evidence**:
- **Learning WITH AI Philosophy**: [Assessment with examples]
- **AI Exercise Quality**: [Assessment with examples]
- **Responsible AI Use**: [Assessment with examples]
- **Integration**: [Assessment with examples]
**Recommendations**:
1. [Specific, actionable recommendation]
2. [Specific, actionable recommendation]
3. [Specific, actionable recommendation]
---
## Overall Strengths
**What This Content Does Well**:
1. **[Strength Category]**: [Specific strength with evidence]
- Quote: "[Exemplary passage]"
- Why this matters: [Explanation]
2. **[Strength Category]**: [Specific strength with evidence]
- Quote: "[Exemplary passage]"
- Why this matters: [Explanation]
3. **[Strength Category]**: [Specific strength with evidence]
- Quote: "[Exemplary passage]"
- Why this matters: [Explanation]
---
## Areas for Improvement (Prioritized)
### Critical Issues (Blocking Publication)
**Issue 1: [Title]** — ⚠️ HIGH PRIORITY
- **Category Affected**: [Category name]
- **Current State**: [Describe current problematic state with evidence]
- **Why This Matters**: [Impact on learners/quality]
- **Required Action**: [Specific revision needed]
- **Success Criteria**: [How to verify fix]
**Issue 2: [Title]** — ⚠️ HIGH PRIORITY
- **Category Affected**: [Category name]
- **Current State**: [Describe current problematic state with evidence]
- **Why This Matters**: [Impact on learners/quality]
- **Required Action**: [Specific revision needed]
- **Success Criteria**: [How to verify fix]
---
### Important Issues (Should Address Before Publication)
**Issue 3: [Title]** — 🔶 MEDIUM PRIORITY
- **Category Affected**: [Category name]
- **Current State**: [Describe current state with evidence]
- **Suggested Action**: [Specific revision recommendation]
- **Expected Improvement**: [How this will enhance content]
**Issue 4: [Title]** — 🔶 MEDIUM PRIORITY
- **Category Affected**: [Category name]
- **Current State**: [Describe current state with evidence]
- **Suggested Action**: [Specific revision recommendation]
- **Expected Improvement**: [How this will enhance content]
---
### Enhancement Opportunities (Nice to Have)
**Enhancement 1: [Title]** — 🟢 LOW PRIORITY
- **Category Affected**: [Category name]
- **Suggestion**: [Optional improvement idea]
- **Benefit**: [Potential enhancement to content]
**Enhancement 2: [Title]** — 🟢 LOW PRIORITY
- **Category Affected**: [Category name]
- **Suggestion**: [Optional improvement idea]
- **Benefit**: [Potential enhancement to content]
---
## Actionable Next Steps
**Immediate Actions** (Required for Publication):
1. [ ] [Specific action with target section/line]
2. [ ] [Specific action with target section/line]
3. [ ] [Specific action with target section/line]
**Short-Term Actions** (Recommended Before Publication):
1. [ ] [Specific action with target section/line]
2. [ ] [Specific action with target section/line]
3. [ ] [Specific action with target section/line]
**Long-Term Enhancements** (Optional Improvements):
1. [ ] [Specific action with target section/line]
2. [ ] [Specific action with target section/line]
3. [ ] [Specific action with target section/line]
---
## Comparison to Quality Thresholds
### Minimum Acceptance Threshold (75% Good or Better)
| Requirement | Target | Actual | Status |
|-------------|--------|--------|--------|
| Constitution Compliance | Pass (gate) | [Pass/Fail] | [✅/❌] |
| Overall Weighted Score | ≥ 75% | [X.X]% | [✅/❌] |
| No category below 50% | All ≥ 50% | [Assessment] | [✅/❌] |
**Verdict**: ⬜ Meets Minimum / ⬜ Does Not Meet Minimum
---
### Recommended for Publication (82% Good or Better)
| Requirement | Target | Actual | Status |
|-------------|--------|--------|--------|
| Constitution Compliance | Pass (gate) | [Pass/Fail] | [✅/❌] |
| Overall Weighted Score | ≥ 82% | [X.X]% | [✅/❌] |
| Technical Accuracy | ≥ 75% | [X]% | [✅/❌] |
| Pedagogical Effectiveness | ≥ 75% | [X]% | [✅/❌] |
**Verdict**: ⬜ Recommended for Publication / ⬜ Not Yet Ready
---
### Exemplary Content (90% Excellent)
| Requirement | Target | Actual | Status |
|-------------|--------|--------|--------|
| Overall Weighted Score | ≥ 90% | [X.X]% | [✅/❌] |
| At least 3 categories Excellent | ≥ 3 at 90%+ | [X] categories | [✅/❌] |
| No categories below Good | All ≥ 75% | [Assessment] | [✅/❌] |
**Verdict**: ⬜ Exemplary Content / ⬜ Good But Not Exemplary
---
## Final Recommendation
### Publication Readiness
**Status**: ⬜ Ready to Publish / ⬜ Ready with Minor Edits / ⬜ Requires Significant Revision / ⬜ Not Ready
**Rationale**:
[2-3 sentences explaining publication readiness decision based on scores, constitution compliance, and threshold analysis]
**Estimated Revision Time**:
- Critical issues: [X] hours
- Important issues: [X] hours
- Total estimated revision: [X] hours
**Next Steps**:
1. [Most critical action]
2. [Second most critical action]
3. [Third action or re-evaluation trigger]
---
## Encouragement & Recognition
**What the Author/Team Should Be Proud Of**:
[2-3 sentences recognizing effort, highlighting specific strengths, and encouraging continued work]
**Areas of Growth Demonstrated**:
[1-2 sentences noting improvement or progress if applicable]
**Looking Forward**:
[1-2 sentences about next steps and encouragement for revision or next content unit]
---
## Appendix A: Detailed Constitutional Checklist
[Include complete constitutional checklist from `references/constitution-checklist.md` with all items marked]
---
## Appendix B: Detailed Rubric Reference
**For detailed tier criteria for each category, refer to**:
`references/rubric-details.md`
---
## Evaluation Metadata
**Framework Version**: Content Evaluation Framework v1.0
**Constitution Version**: CoLearning Python Constitution v2.2.0
**Evaluation Date**: [YYYY-MM-DD]
**Evaluation Duration**: [X] minutes
**Files Consulted**:
- Content file: [path]
- Spec file: [path or N/A]
- Plan file: [path or N/A]
- Constitution: `.specify/memory/constitution.md`
- Rubric details: `references/rubric-details.md`
- Constitution checklist: `references/constitution-checklist.md`
---
**End of Evaluation Report**
---
## Notes for Report Generators
**When filling out this template:**
1. **Be specific**: Always include quotes, line numbers, and concrete examples
2. **Be objective**: Base assessments on rubric criteria, not personal preference
3. **Be actionable**: Recommendations should be concrete and implementable
4. **Be encouraging**: Recognize strengths and frame criticism constructively
5. **Be thorough**: Complete all sections fully; don't skip or abbreviate
6. **Be consistent**: Use the rubric-details.md criteria for all tier assignments
7. **Be evidence-based**: Every score and verdict must have supporting evidence cited
**Report Quality Checklist**:
- [ ] All scores have supporting evidence with quotes or examples
- [ ] Constitutional violations (if any) are documented with specific passages
- [ ] Recommendations are actionable with clear success criteria
- [ ] Strengths are recognized and celebrated
- [ ] Priority levels are appropriate for impact on learners
- [ ] Thresholds are accurately calculated and compared
- [ ] Final recommendation is clear and justified
- [ ] Encouragement section is genuine and specific
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| reverse-engineer-anythingmorluto/reaReverse engineer native, managed, Electron/JavaScript, packaged, firmware, and browser targets with REA, and build agent environments (AgentEnv bundles) of web applications from a live instance or a capture, and of Linux desktop apps with a task from a request. Use shipped-artifact or requested runtime evidence to explain features, compare versions, decompile code, or guide a reconstruction. Skip REA for ordinary source-repository architecture analysis. | Stars: 471k | Updated | Claude CodeCodex | Verified | Install |
| diagnosing-superpowersobra/superpowersUse when a superpowers session went wrong and your human partner wants to know why — repeated work, ignored plans, stumbles, poor results, a skill that didn't fire, "it took too long", "why is it so expensive", "what is it doing" — or wants to build a bug report for the superpowers maintainers, for the current session or a past one identified by id or path, on any harness. | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| dispatching-parallel-agentsobra/superpowersUse when facing 2+ independent tasks that can be worked on without shared state or sequential dependencies | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| executing-plansobra/superpowersUse when executing an implementation plan in the current session as the implementer yourself — your human partner chose inline execution, or no subagent tool is available | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |