Skip to content

aiskillstore/marketplace / skills/92bilal26/content-evaluation-framework

content-evaluation-framework

Verified

This skill should be used when evaluating the quality of book chapters, lessons, or educational content. It provides a systematic 6-category rubric with weighted scoring (Technical Accuracy 30%, Pedagogical Effectiveness 25%, Writing Quality 20%, Structure & Organization 15%, AI-First Teaching 10%, Constitution Compliance Pass/Fail) and multi-tier assessment (Excellent/Good/Needs Work/Insufficient). Use this during iterative drafting, after content completion, on-demand review requests, or before validation phases.

FileKindSize
SKILL.mdskill md11.9 KB
references/constitution-checklist.mdmarkdown18.6 KB
references/evaluation-template.mdmarkdown14.0 KB
references/rubric-details.mdmarkdown25.6 KB
skill-report.jsonconfig34.2 KB

references/evaluation-template.md

View on GitHub
# Content Evaluation Report

**Content Evaluated**: [File path to content]
**Evaluation Date**: [YYYY-MM-DD]
**Evaluator**: [Name or "AI Evaluation Framework"]
**Chapter/Lesson**: [Chapter X, Lesson Y or Section Title]
**Content Type**: [Technical / Conceptual / Hybrid]

---

## Executive Summary

**Overall Verdict**: ⬜ Pass / ⬜ Conditional Pass / ⬜ Fail

**Overall Weighted Score**: [X.X]% — **[Excellent / Good / Needs Work / Insufficient]**

**Constitution Compliance**: ✅ Pass / ❌ Fail

**Ready for Publication**: ⬜ Yes / ⬜ Yes, with minor revisions / ⬜ No, requires significant revision

**Quick Summary**:
[1-2 sentence summary of content quality and readiness]

---

## Category Scores (Weighted)

| Category | Score | Tier | Weight | Contribution to Final Score |
|----------|-------|------|--------|----------------------------|
| **Technical Accuracy** | [X]% | [Tier] | 30% | [X.X]% |
| **Pedagogical Effectiveness** | [X]% | [Tier] | 25% | [X.X]% |
| **Writing Quality** | [X]% | [Tier] | 20% | [X.X]% |
| **Structure & Organization** | [X]% | [Tier] | 15% | [X.X]% |
| **AI-First Teaching** | [X]% | [Tier] | 10% | [X.X]% |
| **Constitution Compliance** | N/A | Pass/Fail | N/A | GATE |
| | | | **TOTAL** | **[X.X]%** |

**Score Calculation**:
```
Final Score = (Technical × 0.30) + (Pedagogical × 0.25) + (Writing × 0.20) +
              (Structure × 0.15) + (AI-First × 0.10)
            = ([score] × 0.30) + ([score] × 0.25) + ([score] × 0.20) +
              ([score] × 0.15) + ([score] × 0.10)
            = [X.X]%
```

---

## Constitution Compliance Status

### Overall Verdict: ✅ Pass / ❌ Fail

**Critical Items Summary**:
- Principle 1 (AI-First Teaching): ✅ Pass / ❌ Fail
- Principle 2 (Spec-Kit): ✅ Pass / ❌ Fail
- Principle 3 (Python 3.13+): ✅ Pass / ❌ Fail / ⬜ N/A
- Principle 4 (Test-First): ✅ Pass / ❌ Fail / ⬜ N/A
- Principle 5 (Progressive Complexity): ✅ Pass / ❌ Fail
- Principle 6 (Consistent Structure): ✅ Pass / ❌ Fail
- Principle 7 (Technical Accuracy): ✅ Pass / ❌ Fail
- Principle 8 (Accessibility): ✅ Pass / ❌ Fail
- Book Gaps Checklist: ✅ Pass / ❌ Fail
- ALWAYS/NEVER Rules: ✅ Pass / ❌ Fail
- Domain Skills Application: ✅ Pass / ❌ Fail
- Output Style Compliance: ✅ Pass / ❌ Fail

**Constitutional Violations** (if any):
- [List specific violations with evidence]
- [Quote passages that violate principles]
- [Note which principle(s) violated]

**Constitutional Strengths**:
- [List areas of strong constitutional adherence]
- [Quote exemplary passages]
- [Note which principles exemplified]

**See detailed checklist in Appendix A for full constitutional evaluation.**

---

## Detailed Category Findings

### 1. Technical Accuracy (30% weight) — [Score]% ([Tier])

**Overall Assessment**:
[2-3 sentence summary of technical accuracy]

**Strengths**:
- [Specific strength with evidence/quote]
- [Specific strength with evidence/quote]
- [Specific strength with evidence/quote]

**Weaknesses**:
- [Specific issue with evidence/quote and line number if applicable]
- [Specific issue with evidence/quote and line number if applicable]
- [Specific issue with evidence/quote and line number if applicable]

**Evidence**:
- **Code Quality**: [Assessment with examples]
- **Explanations**: [Assessment with examples]
- **Examples**: [Assessment with examples]

**Recommendations**:
1. [Specific, actionable recommendation]
2. [Specific, actionable recommendation]
3. [Specific, actionable recommendation]

---

### 2. Pedagogical Effectiveness (25% weight) — [Score]% ([Tier])

**Overall Assessment**:
[2-3 sentence summary of pedagogical effectiveness]

**Strengths**:
- [Specific strength with evidence/quote]
- [Specific strength with evidence/quote]
- [Specific strength with evidence/quote]

**Weaknesses**:
- [Specific issue with evidence/quote and line number if applicable]
- [Specific issue with evidence/quote and line number if applicable]
- [Specific issue with evidence/quote and line number if applicable]

**Evidence**:
- **Learning Design**: [Assessment with examples]
- **Concept Scaffolding**: [Assessment with examples]
- **Exercises & Practice**: [Assessment with examples]
- **Assessment**: [Assessment with examples]

**Recommendations**:
1. [Specific, actionable recommendation]
2. [Specific, actionable recommendation]
3. [Specific, actionable recommendation]

---

### 3. Writing Quality (20% weight) — [Score]% ([Tier])

**Overall Assessment**:
[2-3 sentence summary of writing quality]

**Strengths**:
- [Specific strength with evidence/quote]
- [Specific strength with evidence/quote]
- [Specific strength with evidence/quote]

**Weaknesses**:
- [Specific issue with evidence/quote and line number if applicable]
- [Specific issue with evidence/quote and line number if applicable]
- [Specific issue with evidence/quote and line number if applicable]

**Evidence**:
- **Readability**: [Assessment - Flesch-Kincaid grade level, sentence length, paragraph structure]
- **Clarity & Precision**: [Assessment with examples]
- **Voice & Tone**: [Assessment with examples]
- **Inclusive Language**: [Assessment with examples]

**Readability Metrics** (if available):
- Flesch-Kincaid Grade Level: [X.X]
- Average Sentence Length: [X] words
- Paragraph Length: [Assessment]

**Recommendations**:
1. [Specific, actionable recommendation]
2. [Specific, actionable recommendation]
3. [Specific, actionable recommendation]

---

### 4. Structure & Organization (15% weight) — [Score]% ([Tier])

**Overall Assessment**:
[2-3 sentence summary of structure and organization]

**Strengths**:
- [Specific strength with evidence/quote]
- [Specific strength with evidence/quote]
- [Specific strength with evidence/quote]

**Weaknesses**:
- [Specific issue with evidence/quote and line number if applicable]
- [Specific issue with evidence/quote and line number if applicable]
- [Specific issue with evidence/quote and line number if applicable]

**Evidence**:
- **Document Structure**: [Assessment with examples]
- **Opening Hook**: [Assessment with examples]
- **Content Flow**: [Assessment with examples]
- **Word Count**: [Actual count] words ([Target range] expected)
- **Closing**: [Assessment with examples]

**Recommendations**:
1. [Specific, actionable recommendation]
2. [Specific, actionable recommendation]
3. [Specific, actionable recommendation]

---

### 5. AI-First Teaching (10% weight) — [Score]% ([Tier])

**Overall Assessment**:
[2-3 sentence summary of AI-first teaching integration]

**Strengths**:
- [Specific strength with evidence/quote]
- [Specific strength with evidence/quote]
- [Specific strength with evidence/quote]

**Weaknesses**:
- [Specific issue with evidence/quote and line number if applicable]
- [Specific issue with evidence/quote and line number if applicable]
- [Specific issue with evidence/quote and line number if applicable]

**Evidence**:
- **Learning WITH AI Philosophy**: [Assessment with examples]
- **AI Exercise Quality**: [Assessment with examples]
- **Responsible AI Use**: [Assessment with examples]
- **Integration**: [Assessment with examples]

**Recommendations**:
1. [Specific, actionable recommendation]
2. [Specific, actionable recommendation]
3. [Specific, actionable recommendation]

---

## Overall Strengths

**What This Content Does Well**:

1. **[Strength Category]**: [Specific strength with evidence]
   - Quote: "[Exemplary passage]"
   - Why this matters: [Explanation]

2. **[Strength Category]**: [Specific strength with evidence]
   - Quote: "[Exemplary passage]"
   - Why this matters: [Explanation]

3. **[Strength Category]**: [Specific strength with evidence]
   - Quote: "[Exemplary passage]"
   - Why this matters: [Explanation]

---

## Areas for Improvement (Prioritized)

### Critical Issues (Blocking Publication)

**Issue 1: [Title]** — ⚠️ HIGH PRIORITY
- **Category Affected**: [Category name]
- **Current State**: [Describe current problematic state with evidence]
- **Why This Matters**: [Impact on learners/quality]
- **Required Action**: [Specific revision needed]
- **Success Criteria**: [How to verify fix]

**Issue 2: [Title]** — ⚠️ HIGH PRIORITY
- **Category Affected**: [Category name]
- **Current State**: [Describe current problematic state with evidence]
- **Why This Matters**: [Impact on learners/quality]
- **Required Action**: [Specific revision needed]
- **Success Criteria**: [How to verify fix]

---

### Important Issues (Should Address Before Publication)

**Issue 3: [Title]** — 🔶 MEDIUM PRIORITY
- **Category Affected**: [Category name]
- **Current State**: [Describe current state with evidence]
- **Suggested Action**: [Specific revision recommendation]
- **Expected Improvement**: [How this will enhance content]

**Issue 4: [Title]** — 🔶 MEDIUM PRIORITY
- **Category Affected**: [Category name]
- **Current State**: [Describe current state with evidence]
- **Suggested Action**: [Specific revision recommendation]
- **Expected Improvement**: [How this will enhance content]

---

### Enhancement Opportunities (Nice to Have)

**Enhancement 1: [Title]** — 🟢 LOW PRIORITY
- **Category Affected**: [Category name]
- **Suggestion**: [Optional improvement idea]
- **Benefit**: [Potential enhancement to content]

**Enhancement 2: [Title]** — 🟢 LOW PRIORITY
- **Category Affected**: [Category name]
- **Suggestion**: [Optional improvement idea]
- **Benefit**: [Potential enhancement to content]

---

## Actionable Next Steps

**Immediate Actions** (Required for Publication):
1. [ ] [Specific action with target section/line]
2. [ ] [Specific action with target section/line]
3. [ ] [Specific action with target section/line]

**Short-Term Actions** (Recommended Before Publication):
1. [ ] [Specific action with target section/line]
2. [ ] [Specific action with target section/line]
3. [ ] [Specific action with target section/line]

**Long-Term Enhancements** (Optional Improvements):
1. [ ] [Specific action with target section/line]
2. [ ] [Specific action with target section/line]
3. [ ] [Specific action with target section/line]

---

## Comparison to Quality Thresholds

### Minimum Acceptance Threshold (75% Good or Better)

| Requirement | Target | Actual | Status |
|-------------|--------|--------|--------|
| Constitution Compliance | Pass (gate) | [Pass/Fail] | [✅/❌] |
| Overall Weighted Score | ≥ 75% | [X.X]% | [✅/❌] |
| No category below 50% | All ≥ 50% | [Assessment] | [✅/❌] |

**Verdict**: ⬜ Meets Minimum / ⬜ Does Not Meet Minimum

---

### Recommended for Publication (82% Good or Better)

| Requirement | Target | Actual | Status |
|-------------|--------|--------|--------|
| Constitution Compliance | Pass (gate) | [Pass/Fail] | [✅/❌] |
| Overall Weighted Score | ≥ 82% | [X.X]% | [✅/❌] |
| Technical Accuracy | ≥ 75% | [X]% | [✅/❌] |
| Pedagogical Effectiveness | ≥ 75% | [X]% | [✅/❌] |

**Verdict**: ⬜ Recommended for Publication / ⬜ Not Yet Ready

---

### Exemplary Content (90% Excellent)

| Requirement | Target | Actual | Status |
|-------------|--------|--------|--------|
| Overall Weighted Score | ≥ 90% | [X.X]% | [✅/❌] |
| At least 3 categories Excellent | ≥ 3 at 90%+ | [X] categories | [✅/❌] |
| No categories below Good | All ≥ 75% | [Assessment] | [✅/❌] |

**Verdict**: ⬜ Exemplary Content / ⬜ Good But Not Exemplary

---

## Final Recommendation

### Publication Readiness

**Status**: ⬜ Ready to Publish / ⬜ Ready with Minor Edits / ⬜ Requires Significant Revision / ⬜ Not Ready

**Rationale**:
[2-3 sentences explaining publication readiness decision based on scores, constitution compliance, and threshold analysis]

**Estimated Revision Time**:
- Critical issues: [X] hours
- Important issues: [X] hours
- Total estimated revision: [X] hours

**Next Steps**:
1. [Most critical action]
2. [Second most critical action]
3. [Third action or re-evaluation trigger]

---

## Encouragement & Recognition

**What the Author/Team Should Be Proud Of**:
[2-3 sentences recognizing effort, highlighting specific strengths, and encouraging continued work]

**Areas of Growth Demonstrated**:
[1-2 sentences noting improvement or progress if applicable]

**Looking Forward**:
[1-2 sentences about next steps and encouragement for revision or next content unit]

---

## Appendix A: Detailed Constitutional Checklist

[Include complete constitutional checklist from `references/constitution-checklist.md` with all items marked]

---

## Appendix B: Detailed Rubric Reference

**For detailed tier criteria for each category, refer to**:
`references/rubric-details.md`

---

## Evaluation Metadata

**Framework Version**: Content Evaluation Framework v1.0
**Constitution Version**: CoLearning Python Constitution v2.2.0
**Evaluation Date**: [YYYY-MM-DD]
**Evaluation Duration**: [X] minutes

**Files Consulted**:
- Content file: [path]
- Spec file: [path or N/A]
- Plan file: [path or N/A]
- Constitution: `.specify/memory/constitution.md`
- Rubric details: `references/rubric-details.md`
- Constitution checklist: `references/constitution-checklist.md`

---

**End of Evaluation Report**

---

## Notes for Report Generators

**When filling out this template:**

1. **Be specific**: Always include quotes, line numbers, and concrete examples
2. **Be objective**: Base assessments on rubric criteria, not personal preference
3. **Be actionable**: Recommendations should be concrete and implementable
4. **Be encouraging**: Recognize strengths and frame criticism constructively
5. **Be thorough**: Complete all sections fully; don't skip or abbreviate
6. **Be consistent**: Use the rubric-details.md criteria for all tier assignments
7. **Be evidence-based**: Every score and verdict must have supporting evidence cited

**Report Quality Checklist**:
- [ ] All scores have supporting evidence with quotes or examples
- [ ] Constitutional violations (if any) are documented with specific passages
- [ ] Recommendations are actionable with clear success criteria
- [ ] Strengths are recognized and celebrated
- [ ] Priority levels are appropriate for impact on learners
- [ ] Thresholds are accurately calculated and compared
- [ ] Final recommendation is clear and justified
- [ ] Encouragement section is genuine and specific
reverse-engineer-anythingmorluto/reaReverse engineer native, managed, Electron/JavaScript, packaged, firmware, and browser targets with REA, and build agent environments (AgentEnv bundles) of web applications from a live instance or a capture, and of Linux desktop apps with a task from a request. Use shipped-artifact or requested runtime evidence to explain features, compare versions, decompile code, or guide a reconstruction. Skip REA for ordinary source-repository architecture analysis.Stars: 471kUpdated Claude CodeCodexVerifiedInstall
diagnosing-superpowersobra/superpowersUse when a superpowers session went wrong and your human partner wants to know why — repeated work, ignored plans, stumbles, poor results, a skill that didn't fire, "it took too long", "why is it so expensive", "what is it doing" — or wants to build a bug report for the superpowers maintainers, for the current session or a past one identified by id or path, on any harness.Stars: 322kUpdated Claude CodeCodexVerifiedInstall
dispatching-parallel-agentsobra/superpowersUse when facing 2+ independent tasks that can be worked on without shared state or sequential dependenciesStars: 322kUpdated Claude CodeCodexVerifiedInstall
executing-plansobra/superpowersUse when executing an implementation plan in the current session as the implementer yourself — your human partner chose inline execution, or no subagent tool is availableStars: 322kUpdated Claude CodeCodexVerifiedInstall