aiskillstore/marketplace / skills/92bilal26/quiz-generator
quiz-generator
VerifiedGenerate 50-question interactive quizzes using the Quiz component with randomized batching. Use when creating end-of-chapter assessments. Displays 15-20 questions per session with immediate feedback. NOT for static markdown quizzes.
| File | Kind | Size |
|---|---|---|
| SKILL.md | skill md | 6.1 KB |
| references/answer-distribution.md | markdown | 8.0 KB |
| references/bias-detection-checklist.md | markdown | 10.7 KB |
| references/example-quiz.md | markdown | 9.7 KB |
| references/file-naming.md | markdown | 7.3 KB |
| references/generation-process.md | markdown | 12.5 KB |
| references/option-length-validation.md | markdown | 10.8 KB |
| references/pitfalls-and-solutions.md | markdown | 19.9 KB |
| references/quality-checklist.md | markdown | 16.9 KB |
| scripts/redistribute_answers.py | script | 7.7 KB |
| scripts/redistribute_answers_v2.py | script | 16.2 KB |
| skill-report.json | config | 54.7 KB |
references/answer-distribution.md
View on GitHub# Answer Distribution - Randomization and Verification (v4.0)
This document details how to randomize correct answers across 50 questions and verify even distribution to prevent pattern-based guessing.
---
## Why This Matters
**The Problem:** If correct answers follow patterns (0,1,2,3,0,1,2,3...) or cluster heavily in one index (mostly 2), students can guess patterns instead of understanding material.
**The Solution:** Randomize correct answer indices (0-3) and verify even distribution across ALL 50 questions. Indices 0/1/2/3 should each appear 12-13 times.
---
## Distribution Targets (v4.0 - 50 Questions)
### Standard for All Quizzes
```
Index 0 correct: 12-13 times (24-26%)
Index 1 correct: 12-13 times (24-26%)
Index 2 correct: 12-13 times (24-26%)
Index 3 correct: 12-13 times (24-26%)
Total: 50 questions
Max consecutive same: 2
```
**Ideal distributions:**
- ✅ 0(13) 1(13) 2(12) 3(12) = 50 total (perfect)
- ✅ 0(12) 1(13) 2(12) 3(13) = 50 total (acceptable)
- ✅ 0(13) 1(12) 2(13) 3(12) = 50 total (perfect)
**Acceptable variance (±1 from 12-13):**
- ✅ 0(14) 1(12) 2(13) 3(11) = 50 total (within ±1)
- ✅ 0(12) 1(12) 2(13) 3(13) = 50 total (within range)
**Avoid (uneven distributions):**
- ❌ 0(20) 1(10) 2(10) 3(10) = 50 total (uneven)
- ❌ 0(25) 1(15) 2(5) 3(5) = 50 total (very uneven)
- ❌ 0(18) 1(18) 2(7) 3(7) = 50 total (clustered on 0/1)
---
## How to Randomize (Step-by-Step)
### Step 1: Write Questions Without Worrying About Position
Focus on content quality first:
- Write the question
- Determine correct answer
- Create meaningful distractors
- Don't think about which position (a/b/c/d) is correct yet
**Example (initial draft):**
```
Q1: Why is discipline important with AI?
✓ Correct: AI amplifies practices; discipline+AI = force multiplier
✗ Distractor 1: AI requires stricter coding standards
✗ Distractor 2: All software needs discipline equally
✗ Distractor 3: Discipline prevents AI from functioning
```
### Step 2: After Writing ALL Questions, List Correct Answers
Create a tracking table:
```
Q1: [position TBD]
Q2: [position TBD]
Q3: [position TBD]
...
Q25: [position TBD]
```
### Step 3: Assign Positions Randomly
Use a random approach (shuffle, dice, online randomizer, mental randomness):
```
Q1: b
Q2: a
Q3: d
Q4: c
Q5: a
Q6: d
Q7: b
Q8: c
Q9: a
Q10: b
... (continue for all 25 questions)
```
**Important:** Don't force patterns. True randomness means some clustering is OK (e.g., b, b, a is fine; b, b, b is NOT).
### Step 4: Place Correct Answer in Assigned Position
Rearrange options so correct answer appears in the assigned position:
**Example for Q1 (assigned position: b):**
```
Q1: Why is discipline important with AI?
a) AI requires stricter coding standards [distractor]
b) AI amplifies practices; discipline+AI = force multiplier [CORRECT]
c) All software needs discipline equally [distractor]
d) Discipline prevents AI from functioning [distractor]
```
### Step 5: Verify Distribution
Count how many times each letter appears as correct:
```
a: 7 times
b: 6 times
c: 7 times
d: 5 times
Total: 25 ✅
```
Check distribution targets (for 25 questions: 6-7 per letter ideal).
### Step 6: Check for Consecutive Same Answers
Scan for 3+ consecutive same answers:
```
Q1: b
Q2: a
Q3: a [OK - only 2 consecutive]
Q4: c
Q5: d
Q6: d [OK - only 2 consecutive]
Q7: d [NOT OK - 3 consecutive d's]
Q8: b
```
**Fix:** If you find 3+ consecutive, swap positions with nearby questions to break the pattern.
---
## Verification Methods
### Method 1: Manual Count (Recommended)
1. List all 25 correct answers in sequence: `b, a, d, c, a, d, b, c, a, b, ...`
2. Tally each letter:
- Count all `a`s: 7
- Count all `b`s: 6
- Count all `c`s: 7
- Count all `d`s: 5
3. Verify total = 25
4. Check distribution is relatively even (±1 variance acceptable)
### Method 2: Table Format
| Letter | Count | Percentage | Target | Status |
|--------|-------|------------|--------|--------|
| a | 7 | 28% | 24-28% | ✅ Pass |
| b | 6 | 24% | 24-28% | ✅ Pass |
| c | 7 | 28% | 24-28% | ✅ Pass |
| d | 5 | 20% | 20-24% | ✅ Pass |
| Total | 25 | 100% | 100% | ✅ Pass |
### Method 3: Visual Pattern Check
Write out all correct answers in sequence and scan visually:
```
b a d c a d b c a b c d a b c d a c b d a c b d c
Visual check:
✅ No obvious repeating pattern (not a,b,c,d,a,b,c,d...)
✅ Letters appear mixed
✅ No long runs of same letter
```
---
## Common Patterns to Avoid
### ❌ Pattern 1: Alphabetical Cycling
```
Q1: a
Q2: b
Q3: c
Q4: d
Q5: a
Q6: b
Q7: c
Q8: d
... (repeating a,b,c,d,a,b,c,d)
Problem: Obvious pattern; students will notice
```
### ❌ Pattern 2: Heavy Clustering
```
a: 10 times
b: 5 times
c: 5 times
d: 5 times
Problem: Uneven distribution; students may learn "when in doubt, pick a"
```
### ❌ Pattern 3: Long Consecutive Runs
```
Q10: c
Q11: c
Q12: c
Q13: c
Q14: c [5 consecutive c's]
Problem: Students may avoid c after seeing pattern
```
### ❌ Pattern 4: Positional Bias by Topic
```
All Lesson 1 questions: correct answer is a
All Lesson 2 questions: correct answer is b
All Lesson 3 questions: correct answer is c
Problem: Students can identify lessons and guess accordingly
```
---
## Fixing Distribution Issues
### Issue 1: Uneven Distribution After Randomization
**Problem:** After randomizing, you have a(10) b(5) c(5) d(5).
**Fix:**
1. Identify questions where correct answer is `a`
2. Select 3 questions and change correct answer to b/c/d
3. Rearrange options in those questions accordingly
4. Re-verify distribution
### Issue 2: Too Many Consecutive Same Answers
**Problem:** You have 4 consecutive `b` answers (Q15-Q18).
**Fix:**
1. Swap the correct answer position for Q17 with a nearby question (Q20)
2. Rearrange options in both questions accordingly
3. Re-verify there are no 3+ consecutive patterns
### Issue 3: Obvious Pattern Emerges
**Problem:** First 10 questions follow a,b,c,d,a,b,c,d,a,b pattern.
**Fix:**
1. Shuffle the first 10 questions' correct answer positions
2. Use a random generator or shuffle manually
3. Re-verify distribution is still even after shuffle
---
## Validation Checklist
Before finalizing quiz:
**Distribution Checks:**
- [ ] Counted correct answers manually for all questions
- [ ] Each letter (a/b/c/d) appears roughly equal times:
- For 20 Qs: ~5 per letter (20-30%)
- For 25 Qs: 6-7 per letter (24-28%)
- For 30 Qs: 7-8 per letter (23-27%)
- [ ] Total equals expected question count (20, 25, or 30)
- [ ] Distribution variance is within acceptable range (±1 from target)
**Pattern Checks:**
- [ ] No obvious repeating pattern (not a,b,c,d,a,b,c,d...)
- [ ] No 3+ consecutive same answer positions
- [ ] Maximum 2 consecutive same answer positions
- [ ] Answers appear randomly shuffled (no alphabetical or reverse patterns)
**Positional Bias Checks:**
- [ ] Correct answer not clustered by lesson/topic
- [ ] Each lesson has mixed answer positions
- [ ] No single position dominates early/middle/late questions
---
## Example: Good Distribution
### 50-Question Quiz Distribution (v4.0)
**Correct answers by question (using index 0/1/2/3 notation):**
```
Q1-10: 1,0,2,3,0,1,2,0,1,3
Q11-20: 2,1,3,0,1,2,0,3,1,2
Q21-30: 0,3,1,2,0,1,3,2,0,1
Q31-40: 2,3,0,1,2,0,3,1,2,0
Q41-50: 1,3,2,0,1,2,3,0,1,3
```
**Tally:**
- Index 0: 13 times = 26% ✅
- Index 1: 13 times = 26% ✅
- Index 2: 12 times = 24% ✅
- Index 3: 12 times = 24% ✅
- Total: 50 questions = 100% ✅
**Pattern Check:**
- ✅ No 3+ consecutive same indices
- ✅ Appears randomly distributed (no a,b,c,d,a,b,c,d pattern)
- ✅ Even distribution across 0/1/2/3 (12-13 per index)
- ✅ No obvious pattern when reading sequentially: 1,0,2,3,0,1,2,0,1,3,2,1,3,0,1,2,0,3,1,2,0,3,1,2,0,1,3,2,0,1,2,3,0,1,2,0,3,1,2,0,1,3,2,0,1,2,3,0,1,3
- ✅ Longest run of same: 2 consecutive (no 3+ same indices)
---
**Keywords for grep:** distribution, randomization, answer-key, correct-answer, pattern, consecutive, verify, validation, even-distribution, a-b-c-d, position
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| brainstormingobra/superpowersYou MUST use this before any creative work - creating features, building components, adding functionality, modifying behavior, or planning anything new, in software or out of it (a talk, a business, a renovation). | Stars: 323k | Updated | Claude CodeCodex | Verified | Install |
| brand-guidelinesanthropics/skillsApplies Anthropic's official brand colors and typography to any sort of artifact that may benefit from having Anthropic's look-and-feel. Use it when brand colors or style guidelines, visual formatting, or company design standards apply. | Stars: 198k | Updated | Claude CodeCodex | Verified | Install |
| frontend-designanthropics/skillsGuidance for distinctive, intentional visual design when building new UI or reshaping an existing one. Helps with aesthetic direction, typography, and making choices that don't read as templated defaults. | Stars: 198k | Updated | Claude CodeCodex | Verified | Install |
| mcp-builderanthropics/skillsGuide for creating high-quality MCP (Model Context Protocol) servers that enable LLMs to interact with external services through well-designed tools. Use when building MCP servers to integrate external APIs or services, whether in Python (FastMCP) or Node/TypeScript (MCP SDK). | Stars: 198k | Updated | Claude CodeCodex | Verified | Install |