ZeKaiNie/universal-examprep-skill / full
universal-exam-cram-coach-full
Verified帮助学生在临考前进行结构化极速复习:解析课程资料/大纲/重点,按章节生成 wiki 知识库与标准题库,组织针对性刷题与判分,并记录复习进度和错题。当用户即将考试、需要快速复习计划、练习题、错题复盘或考前小抄时使用(关键词:期末/备考/复习/刷题/划重点/错题;exam, cram, study plan, quiz, review)。不适用于长期学习规划、与考试无关的写作或编程任务。
benchmark/docs/materials_sources.en.md
View on GitHub# Materials Sources
English · [中文](materials_sources.md)
This benchmark **does not use any private or school course materials**. It uses only **public open courses from top universities** (3 STEM + 3 humanities courses, covering algorithms, mathematics, physics, philosophy, psychology, and history).
The materials are only **downloaded locally for testing**; they are **not redistributed and not committed to this repository** (see `benchmark/.gitignore`), and they are **credited with source + hyperlink** here and in the report.
| # | Course | Institution | Subject | Source of materials/gold | Link |
| :- | :-- | :-- | :-- | :-- | :-- |
| 1 | 6.006 Introduction to Algorithms (Spring 2020) | MIT OpenCourseWare | Algorithms | Lecture notes + **official solutions** to problem sets/exams as gold | https://ocw.mit.edu/courses/6-006-introduction-to-algorithms-spring-2020/ |
| 2 | 18.06 / 18.06SC Linear Algebra (G. Strang) | MIT OpenCourseWare | Linear Algebra | Lecture notes + **official exam solutions** | https://ocw.mit.edu/courses/18-06sc-linear-algebra-fall-2011/ |
| 3 | 8.01SC Classical Mechanics (Fall 2016) | MIT OpenCourseWare | Physics (mechanics) | Lecture notes + problem sets (with solutions) | https://ocw.mit.edu/courses/8-01sc-classical-mechanics-fall-2016/ |
| 4 | PHIL 176 Death (S. Kagan) | Open Yale Courses | Philosophy | Facts from the lecture transcripts as gold (supporting span annotated) | https://oyc.yale.edu/death/phil-176 |
| 5 | PSYC 110 Introduction to Psychology (P. Bloom) | Open Yale Courses | Psychology | Facts from the lecture transcripts as gold | https://oyc.yale.edu/introduction-psychology/psyc-110 |
| 6 | HIST 116 The American Revolution (J. Freeman) | Open Yale Courses | History | Facts from the lecture transcripts as gold | https://oyc.yale.edu/history/hist-116 |
## How the gold (reference answers) is set, and how that keeps it fair
- **The three STEM courses**: questions and reference answers come directly from MIT OCW's **official problem-set/exam solutions**. They are authoritative, not written by us. Calculation questions are scored deterministically by a program.
- **The three humanities courses**: fact/definition questions are picked from the lecture transcripts, and the reference answer is **the sentence the transcript states explicitly** (the original wording is recorded in the gold as `supporting_span`), not something we made up.
- **Blind testing**: the generator that "answers" (each Claude model) sees only the question and the course materials and **cannot see the reference answer**; only after it answers is it scored against the official solution or transcript text. This measures real ability, not memorized answers.
- **Out-of-scope probes**: each course adds a few questions that "the materials do not cover at all," to see whether the model honestly abstains (this best shows the skill's anti-hallucination behavior).
## Copyright / License
- **MIT OpenCourseWare**: CC BY-NC-SA (Attribution-NonCommercial-ShareAlike).
- **Open Yale Courses**: CC BY-NC-SA 3.0.
- This project is for **non-commercial research/evaluation** use, follows the attribution requirement (this file is the attribution), and **does not redistribute** the original materials in the repository.
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| receiving-code-reviewobra/superpowersUse when receiving code review feedback, before implementing suggestions, especially if feedback seems unclear or technically questionable - requires technical rigor and verification, not performative agreement or blind implementation | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| requesting-code-reviewobra/superpowersUse when completing tasks, implementing major features, or before merging to verify work meets requirements | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| using-git-worktreesobra/superpowersUse when starting feature work that needs isolation from current workspace or before executing implementation plans - ensures an isolated workspace exists via native tools or git worktree fallback | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| verification-before-completionobra/superpowersUse when about to claim work is complete, fixed, or passing, before committing or creating PRs - requires running verification commands and confirming output before making any success claims; evidence before assertions always | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |