GarethManning/education-agent-skills / skills/original-frameworks/dispositional-knowledge-assessment-designer
dispositional-knowledge-assessment-designer
VerifiedDesign multi-informant assessment approaches for dispositional competencies like curiosity or resilience. Use when assessing character strengths or competencies that written tests cannot capture.
| File | Kind | Size |
|---|---|---|
| SKILL.md | skill md | 54.9 KB |
| agents/openai.yaml | config | 43 B |
| references/worked-agency-assessment.md | markdown | 25.4 KB |
references/worked-agency-assessment.md
View on GitHub## Example Output
**Scenario:** *Competency name: "Agency" / Competency definition: "The ability to initiate, plan, and complete meaningful work with increasing independence and purpose" / Band: "Band D (ages 12–14)" / Band descriptors: "I can identify opportunities for action and take responsibility for planning and executing my own projects, seeking support when needed and adapting my approach based on feedback and changing conditions" / Assessment context: "End of term, feeding into a developmental review session with student, teacher, and parents present" / School feedback structure: "Developmental review — a 30-minute session at the end of each term where the student, their mentor teacher, and their parents/caregivers meet. The student leads the session, presenting evidence of their learning and development. The teacher provides feedback and the family asks questions and shares their perspective."*
---
## Dispositional Assessment Design: Agency — Band D
**Competency:** Agency
**Definition:** The ability to initiate, plan, and complete meaningful work with increasing independence and purpose
**Band:** Band D (ages 12–14)
**Assessment context:** End of term, feeding into developmental review session with student, mentor teacher, and parents
**Implementation workload:** Illustrative full design: 163–223 minutes per student per term; approximately 68–93 hours for 25 students. Assumes individual observation twice weekly across 10–12 weeks, caregiver invitation and response, and an agency segment within an existing review. Draft-design review time is separate; check staffing and shared observation opportunities before adoption.
### 1. Observation Protocol
**What to notice:**
The following are prompts for your attention across the term — patterns to watch for, not boxes to tick. You will not see all of these in every student or every context. Notice what IS there and what ISN'T.
1. **Initiation without prompting.** Does the student identify what needs to be done and begin without waiting for instruction? This might look like: starting research before the project brief is fully explained, noticing a problem in the group's plan and raising it, or proposing an alternative approach when the current one isn't working. The key distinction: doing what was asked independently (compliance) vs. identifying what needs to happen and acting on it (agency).
2. **Planning that adapts.** Does the student make plans AND revise them when conditions change? Watch for the difference between rigid planning (sticks to the original plan even when it's clearly not working) and adaptive planning (adjusts timelines, methods, or scope based on what they're learning as they go). Band D agency includes the metacognitive capacity to evaluate one's own plan.
3. **Support-seeking as strength.** Does the student seek help strategically — identifying what they need, who can provide it, and asking at the right moment? This is distinct from dependence (asking for help at every decision point) and from false independence (struggling alone when help would be productive). Band D agency means knowing when you need support and having the confidence to ask for it.
4. **Ownership language.** Listen to how the student talks about their work. "My project" vs "the project." "I decided to..." vs "We had to..." "I'm not happy with this section yet" vs "Is this good enough?" The shift from passive to agentic language often precedes the shift in behaviour — or reveals that agency is present even when the student doesn't recognise it.
5. **Response to setback.** What happens when something goes wrong — an experiment fails, a plan falls apart, feedback is critical? Band D agency includes the capacity to treat setbacks as information rather than failure. Watch for: the student who rethinks their approach vs the student who abandons the project or waits for the teacher to rescue them.
6. **Scope of concern.** Does the student's agency extend beyond their own work? Do they notice when the group needs something, when a resource could help someone else, when the project could serve a wider purpose? Band D agency at its fullest includes stewardship — acting for the benefit of something beyond oneself.
**When and how to observe:**
- **Frequency:** Deliberately attend to agency at least twice per week during project sessions. This does not mean formal observation — it means intentionally watching for 5 minutes with these prompts in mind.
- **Richest contexts:** Open-ended project phases (when there is no teacher-defined next step), moments of difficulty or ambiguity, transitions between project stages, and any moment when the student has genuine choice about what to do next.
- **Recording format:** Brief dated notes — 1–3 sentences maximum. "14 March: S. noticed the water sensor data didn't match expectations. Instead of asking me, went back to check calibration procedure, found the error, recalibrated, and retested. Told the group what happened without being asked." Keep notes in a running document or physical notebook. Timestamps matter more than detail — you are building a pattern over time.
**Negative-space indicators:**
Notice when a student consistently does NOT initiate, does NOT adapt plans, does NOT seek support, or does NOT take ownership of setbacks. Absence of agency in contexts where it could reasonably be expected is evidence too. A student who shows strong agency in science but never initiates in collaborative writing is telling you something about context-dependence — not about a lack of agency.
### 2. Student Self-Reflection Tool
**For the student:**
*These questions are designed for Band D — ages 12–14. They assume metacognitive capacity and invite the student to interpret their own patterns, not just report events.*
**Reflect on your agency this term. Take your time — there are no right answers. What matters is that you think honestly about your own patterns.**
1. **Think about a moment this term when you took action on something that mattered to you — without being asked or told to.** What was the situation? What did you do? What made you decide to act rather than wait?
2. **Think about a time when your plan wasn't working.** What happened? What did you do? Looking back, would you handle it differently now?
3. **When you need help with something, what do you usually do?** How do you decide when to figure it out yourself vs when to ask someone? Has this changed over the term?
4. **Where is your agency strongest right now?** In which contexts — subjects, types of work, group settings — do you find it easiest to take initiative and own your work? Where is it hardest? Why do you think there's a difference?
5. **If you compared yourself now to yourself at the start of the term, what has shifted in how you approach your work?** This might be something big or something subtle. If nothing has shifted, that's worth reflecting on too.
**Teacher guidance for using this tool:**
- Give the student the reflection prompts 2–3 days before the developmental review session. They should have time to think, not answer under pressure.
- These can be written responses, audio recordings, or conversation notes — whatever format the student is most comfortable with. The medium doesn't matter; the quality of reflection does.
- Do NOT grade the reflections. Read them for evidence — stories, examples, and patterns that either confirm or complicate your observations.
- If a student's self-reflection contradicts your observations, this is valuable information, not an error. It may reveal that the student experiences their agency differently from how you see it — or that agency manifests differently in contexts you don't observe.
### 3. Parent/Caregiver Input Guide (Optional)
**Introduction for families:**
*Dear families,*
*As part of our end-of-term reflections, we'd love to know what you notice about [student name]'s growing independence and initiative — what we call "agency." Agency is about taking responsibility for meaningful work: starting things, planning, adapting when things don't go as expected, and seeking help when it's needed.*
*We're not asking you to assess or score anything. We're asking what you NOTICE at home and in the community. Your perspective helps us see the full picture — you see [student name] in contexts we don't.*
*Any observations you can share are welcome. If now isn't a good time to respond, that's completely fine — we have other evidence sources and your child's assessment will be complete without this.*
**Questions:**
1. Does [student name] take on projects, tasks, or responsibilities at home or in the community without being asked? Can you give a recent example?
2. When [student name] encounters something difficult — homework, a personal challenge, a new skill — what do they typically do? (e.g., ask for help immediately, try to work it out alone, give up, find a creative workaround?)
3. Have you noticed any changes in [student name]'s independence or initiative this term — either at home or in how they talk about school?
4. Is there anything about how [student name] approaches their own projects or responsibilities that you think we should know about?
**Note on use:**
Parent input will be used alongside teacher observations and the student's own reflections to build a full developmental picture. It will be shared at the developmental review session with the student present — there are no secrets. If something feels sensitive, please note that and the mentor teacher will handle it with care. Not all families will respond, and that is genuinely fine — the assessment approach is designed to work with or without this input.
### 4. Synthesis Guide
**Bringing evidence together:**
Before the developmental review session, the mentor teacher gathers three evidence sources:
1. **Teacher observation notes** — the running record from across the term (from the Observation Protocol above)
2. **Student self-reflection** — the written or recorded responses to the reflection prompts
3. **Parent/caregiver input** — if provided
The synthesis process:
**Step 1: Read all sources independently.** Read each source on its own first, without cross-referencing. Note the 2–3 strongest themes from each source separately.
**Step 2: Identify convergence.** Where do sources agree? If the teacher sees the student initiating research independently, the student identifies "starting my own experiments" as a strength, and the parent reports "she's been setting up her own study schedule at home without us asking" — that is convergent evidence of agency in initiation.
**Step 3: Identify divergence.** Where do sources disagree? This is the most informative step. Common divergence patterns for agency:
- Teacher sees strong agency; student reports feeling uncertain → the student may be performing agency outwardly while experiencing insecurity inwardly. This is developmentally normal at Band D and suggests the student needs affirmation, not pushing.
- Student reports strong agency; teacher sees dependence → the student may have a self-image of independence that doesn't yet match their enacted behaviour. This is not dishonesty — it's aspirational self-concept, which is a precursor to development.
- Parent sees agency at home; teacher sees passivity at school → agency may be context-dependent, possibly related to perceived safety, social dynamics, or task type at school.
**Step 4: Name the pattern.** Write a developmental narrative (3–5 sentences) that describes where the student is, what the evidence shows, and what the trajectory looks like. Example: "Priya shows strong agency in self-directed research — she consistently identifies her own questions, plans investigation steps, and adapts when data doesn't match predictions. Her agency is less visible in collaborative contexts, where she tends to defer to more assertive group members rather than advocating for her own ideas. Both she and her parents identify a similar pattern at home: strong independence in solo pursuits, less confidence in group settings. The developmental edge for next term is agency in the presence of others."
**Handling contradictions:**
Contradictions between sources are diagnostic information. They typically reveal one of three things:
1. **Context-dependence** — the disposition genuinely manifests differently in different settings. This is the most common explanation and is developmentally normal.
2. **Perception gap** — the student, teacher, or parent perceives the disposition differently from how it is enacted. This is also normal and can be explored in the developmental conversation.
3. **Developmental transition** — the student is in the process of developing the disposition, and their behaviour is inconsistent because they are between developmental levels. Inconsistency during transition is a feature, not a bug.
Do NOT resolve contradictions by averaging or by privileging one source. Name the contradiction and explore it in the developmental conversation.
**Sufficient evidence threshold:**
Minimum evidence for a well-grounded developmental conversation: at least three to five independent observation notes from different contexts over at least four weeks, showing a consistent pattern or a meaningful and recurring inconsistency. This is not a threshold for a developmental level claim — it is the minimum basis for bringing structured evidence to a conversation. A single impressive moment is an event, not a pattern.
Parent input is valuable but NOT required for sufficiency. If evidence is below this minimum, the developmental narrative should note limited evidence explicitly: "Based on the observations I have, I see [pattern] — but I have limited data and this picture may be incomplete."
A single lapse does not negate a developmental trajectory, just as a single exceptional day does not establish one. Development is a pattern over time, visible only across multiple independent observations.
**Contextual variation:**
A student may demonstrate Band D agency in science projects and Band B agency in collaborative writing. This is NORMAL. Dispositional development is not uniform across all contexts.
The synthesis should NAME this variation specifically: "Shows Band D agency in self-directed investigation; approaching Band C in collaborative decision-making." Do NOT average these into a single band level. The contextual variation IS the developmental picture — and it points to where the next development opportunity lies.
### 5. Developmental Conversation Guide
**What to share at Band D:**
Band D students (ages 12–14) are ready for full transparency. Share:
- Your observation patterns — what you noticed, when, in what contexts
- Their self-reflection themes — what stood out to you in their responses
- Any parent input — read it together, not in advance
- The convergence AND the divergence — where sources agree and where they don't
Invite them to LEAD the interpretation: "Here's what I've gathered from multiple sources. What patterns do you see? What surprises you? What rings true?"
At Band D, the student should be developing the capacity to assess their own dispositional development. Your role shifts from "I'll tell you where you are" to "Let's look at this evidence together and make sense of it." This is coaching, not grading.
**What to hold back at Band D:**
Even with full transparency, avoid:
- Comparative language: "You're further along than most students" or "Some of your peers are more consistent." Development is individual, not competitive.
- Labelling: "You're a Band D agency student." The band descriptors are vocabulary for talking about development, not identity categories.
- Deficit framing: "You still need to work on..." Instead: "Where do you want to take this next?"
**Coaching questions for Band D:**
1. "Looking at all of this evidence together — your reflections, my observations, what your family shared — what patterns do you notice about your agency right now?"
2. "You mentioned that [specific example from self-reflection]. I noticed something similar when [specific observation]. What do you think is behind that pattern?"
3. "Where do you feel most agentic — most like you're driving your own learning? Where does that feel harder? What's different about those contexts?"
4. "If you imagine yourself at the end of next term, what would you want your agency to look like? What would be different from now?"
**Using band descriptors as vocabulary:**
The band descriptor for Agency at Band D reads: *"I can identify opportunities for action and take responsibility for planning and executing my own projects, seeking support when needed and adapting my approach based on feedback and changing conditions."*
Use this as shared language, not as a checklist:
- "This descriptor talks about 'adapting your approach based on feedback.' I've seen you do that really naturally in your science work — when the sensor data was off, you went back and recalibrated without being asked. Where else do you think you do this? Where is it harder?"
- "The descriptor mentions 'seeking support when needed.' In your reflection, you talked about preferring to figure things out alone. What do you think — is that independence, or is there sometimes a cost to not asking?"
NEVER: "You've met 4 out of 5 elements of the Band D descriptor." This turns vocabulary into criteria and the conversation into a grading exercise.
**Goal-setting:**
Close the conversation by asking the student to identify one thing they want to work on — in their own words.
- "Based on everything we've talked about today, what's one aspect of your agency you want to develop next term?"
- The student states the goal. The teacher writes it down. Both keep a copy.
- The goal should be specific enough to notice ("I want to speak up more in group planning sessions") but not so specific it becomes a checklist item.
- At the start of next term's developmental conversation, open by revisiting this goal: "Last time you said you wanted to [goal]. How has that gone?"
### 6. Integration with Feedback Structures
**Integration with the developmental review session:**
The developmental review is a 30-minute session where the student, mentor teacher, and parents/caregivers meet, with the student leading. Here is how to integrate the dispositional assessment:
**Before the session (teacher preparation — 20 minutes):**
- Complete the synthesis (Steps 1–4 above). Write the 3–5 sentence developmental narrative.
- Identify 2–3 specific observation moments to share as concrete examples.
- Prepare your coaching questions — choose 2 from the list above that feel most relevant to this student.
**During the session (suggested structure for the agency portion — 8–10 minutes of the 30):**
1. **Student presents** (3 minutes): The student shares their self-reflection — what they notice about their agency this term, with specific examples. They may use their written reflection as notes.
2. **Teacher responds** (2 minutes): Share 1–2 specific observation moments. "I want to add something I noticed — [specific dated example]. This stood out to me because [connection to pattern]." Then share one point of convergence: "What's interesting is that your family noticed something similar at home — [parent observation]."
3. **Family responds** (2 minutes): Parents/caregivers share their perspective. The teacher may gently prompt: "You mentioned in your written input that [observation]. Could you tell us more about that?"
4. **Exploration together** (2 minutes): The teacher asks one coaching question that invites all three parties to reflect: "Where do you all see [student]'s agency growing? Where is the next edge?"
5. **Goal** (1 minute): The student states one agency goal for next term, in their own words. Everyone hears it.
**What the developmental review session should NOT include:**
- A band level or score for agency. The family should leave understanding their child's developmental pattern, not their rating.
- Comparison to other students or to a class average.
- A teacher monologue about the student's strengths and weaknesses. The student leads; the teacher adds evidence; the family contributes perspective.
**If no formal feedback structure exists:**
- Use the developmental conversation (Section 5) as a standalone 15-minute meeting between teacher and student, at least once per term.
- Share the developmental narrative with parents/caregivers in written form if a face-to-face session is not possible, along with the student's self-reflection and goal.
- Keep the observation notes and synthesis as part of the student's portfolio — these are the evidence base for any future conversations about dispositional development.
### Time and Workload Estimate
**Observation:** 5 minutes of deliberate noticing plus 1–2 minutes recording per occasion, twice per week for 10–12 weeks: (5 + 1–2) × 2 × 10–12 = **120–168 minutes per student per term**. This assumes individual observation time; if a classroom episode supports observations of several students, explain the shared allocation and avoid counting the same time twice. Sustainability must be checked locally.
**Student self-reflection:** 5 minutes of teacher time to distribute the prompts. 10 minutes to read each student's responses. **Total per student: 15 minutes.**
**Parent input:** Illustratively, 5 minutes to invite input plus 5 minutes to read a response: **10 minutes per student if both occur, 5 if invited with no response, zero if no invitation is made.** A shared class invitation may reduce the per-student allocation. Do not seek input where inappropriate or unsafe.
**Synthesis:** 15–20 minutes per student to complete the four-step synthesis and write the developmental narrative. **This is the most demanding step.** It cannot be reduced without losing quality. It is also the step where the teacher's professional judgment is most critical.
**Developmental conversation / developmental review agency segment:** 8–10 minutes per student within the existing session.
**Illustrative total per student per term: 163–223 minutes** = observation/recording 120–168 + self-reflection administration/reading 15 + caregiver invitation/response 10 + synthesis 15–20 + conversation 8–10. For 25 students, this is **4,075–5,575 minutes, approximately 68–93 hours**. With no caregiver invitation or response, subtract 10 minutes per student. Draft-design review, initial setup and staff moderation may add time; shared administration/observation may reduce it. These are explicit planning assumptions, not measured costs or evidence that this design is more valid than alternatives. Check feasibility before adopting the full plan.
**Sustainability strategies:**
- Not every competency needs this full approach every term. Rotate: assess agency in depth in Term 1, collaboration in Term 2, self-regulation in Term 3.
- Observation notes can be integrated into existing practice — noticing while circulating during project work, not as a separate task.
- If the workload is genuinely unsustainable, the minimum viable approach is: teacher observations + student self-reflection + developmental conversation. Omit caregiver collection where unsuitable, and use a brief synthesis of teacher observations and student reflection to prepare the conversation. Keep all six design sections available, marking caregiver participation optional; do not treat a reduced implementation as the full triangulated process.
---
## Evaluative Expertise and New Teacher Induction
Observation protocols scaffold the development of evaluative expertise but cannot substitute for it. Evaluative expertise — the felt sense of what authentic self-regulation looks like versus performed self-regulation, or what genuine empathy looks like versus socially appropriate empathy performance — develops through experience, reflection, and calibration with skilled colleagues. A teacher in their first year using this protocol will produce lower-quality observations than a teacher with several years of experience, not because they are less diligent but because they have not yet developed that felt sense of quality. This professional capacity might be called pedagogical observation knowledge — it is distinct from pedagogical content knowledge and is rarely named or taught in teacher education.
Schools implementing this skill should provide new teachers with: structured examples of observation notes from experienced practitioners with discussion of what made the observations useful; regular moderation conversations where teachers share and compare observations of the same students; and explicit time to develop their observational practice before using it for any consequential purpose.
---
## Observer Positionality and Professional Reflexivity
Teacher observation of student dispositions is shaped by the teacher's own relationship to those dispositions. A teacher whose self-regulation is primarily expressed through quiet internal processing may underobserve a student whose regulation is loud and external. A teacher from a high-context culture may misread a student's reserved boundary-setting behaviour as disengagement. A teacher who values verbal articulacy may notice confident self-reflection more readily than tentative but genuine self-reflection.
This is an inherent feature of all observation, not a failure of professionalism. The appropriate response is professional reflexivity: teachers should periodically ask themselves which dispositions they find easiest to recognise and value, and which they find harder to notice or appreciate. Moderation conversations between teachers are the structural mechanism for surfacing and correcting observer positioning over time.
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| finishing-a-development-branchobra/superpowersUse when implementation is complete, all tests pass, and you need to decide how to integrate the work | Stars: 323k | Updated | Claude CodeCodex | Verified | Install |
| systematic-debuggingobra/superpowersUse when encountering any bug, test failure, or unexpected behavior, before proposing fixes | Stars: 323k | Updated | Claude CodeCodex | Verified | Install |
| test-driven-developmentobra/superpowersUse when implementing any feature or bugfix, before writing implementation code | Stars: 323k | Updated | Claude CodeCodex | Verified | Install |
| skill-creatoranthropics/skillsCreate new skills, modify and improve existing skills, and measure skill performance. Use when users want to create a skill from scratch, edit, or optimize an existing skill, run evals to test a skill, benchmark skill performance with variance analysis, or optimize a skill's description for better triggering accuracy. | Stars: 198k | Updated | Claude CodeCodex | Verified | Install |