brycewang-stanford/Auto-Empirical-Research-Skills / skills/24-Imbad0202-academic-research-skills/deep-research
deep-research
VerifiedUniversal deep research agent team. 13-agent pipeline for rigorous academic research on any topic. 7 modes: full research, quick brief, paper review, lit-review, fact-check, Socratic guided research dialogue, and systematic review with optional meta-analysis. Covers research question formulation, Socratic mentoring, methodology design, systematic literature search, source verification, cross-source synthesis, risk of bias assessment, meta-analysis, APA 7.0 report compilation, editorial review, devil's advocate challenges, ethics review, and post-research literature monitoring. Triggers on: research, deep research, literature review, systematic review, meta-analysis, PRISMA, evidence synthesis, fact-check, guide my research, help me think through, 研究, 深度研究, 文獻回顧, 文獻探討, 系統性回顧, 後設分析, 事實查核, 引導我的研究, 幫我釐清, 幫我想想, 我不確定要研究什麼, 研究方向, 研究主題.
references/socratic_questioning_framework.md
View on GitHub# Socratic Questioning Framework — Academic Research Application
## Overview
Socratic Questioning originates from the dialogue-based teaching method of the ancient Greek philosopher Socrates. Its core is not about imparting knowledge, but about helping the interlocutor discover blind spots, contradictions, and deep-seated assumptions in their own thinking through systematic questioning. This framework applies this method to the context of academic research guidance.
---
## 6 Core Question Types
### Type 1: Clarification Questions
**Purpose**: Ensure the interlocutor truly understands the concepts they are using
| Question Pattern | Usage Context |
|---------|---------|
| What do you mean by "X"? | When the user uses vague or polysemous terms |
| Can you give a specific example? | When abstract descriptions need concretization |
| Can you put it another way? | To confirm mutual understanding |
| How is this different from Y? | To distinguish similar concepts |
| What does X include? What does it exclude? | To define scope |
### Type 2: Probing Assumptions
**Purpose**: Reveal hidden premises and assumptions
| Question Pattern | Usage Context |
|---------|---------|
| What are you assuming? | When the user's reasoning skips certain premises |
| Is this assumption justified? | When the reasonableness of a premise needs verification |
| What if this assumption doesn't hold? | To test the robustness of reasoning |
| Why do you take this for granted? | When the user is overconfident about a premise |
| Does anyone disagree with this premise? Why? | To introduce different perspectives |
### Type 3: Probing Rationale and Evidence
**Purpose**: Probe the basis and evidence foundation of reasoning
| Question Pattern | Usage Context |
|---------|---------|
| What is your evidence? | When the user makes unsupported assertions |
| How do you know this is true? | When distinguishing facts from opinions is needed |
| What other evidence supports or contradicts this? | To broaden the evidence horizon |
| Is this evidence sufficient? | To evaluate the match between evidence and conclusions |
| How would you respond to doubts about data reliability? | To test the solidity of evidence |
### Type 4: Questioning Viewpoints and Perspectives
**Purpose**: Introduce alternative viewpoints to break the limitations of a single perspective
| Question Pattern | Usage Context |
|---------|---------|
| What would this look like from another perspective? | When the user is stuck in a single viewpoint |
| What would someone who disagrees say? | To introduce opposing thinking |
| If you were X (a different stakeholder), how would you see this? | Multi-stakeholder analysis |
| Why might others see this differently? | To understand the sources of viewpoint differences |
| Does another discipline frame this phenomenon differently? | Interdisciplinary thinking |
### Type 5: Probing Implications and Consequences
**Purpose**: Explore the logical consequences and practical impacts of reasoning
| Question Pattern | Usage Context |
|---------|---------|
| If this conclusion is correct, what does it imply? | To trace logical implications |
| What are the practical consequences? | To connect theory to practice |
| What are the best and worst case scenarios? | To assess impact range |
| Who benefits? Who is harmed? | Ethical dimension thinking |
| Where does this trend lead in the long run? | Extended thinking |
### Type 6: Questioning the Question
**Purpose**: Examine whether the question itself is worth asking and whether the framing is correct
| Question Pattern | Usage Context |
|---------|---------|
| Why does this question matter? | To return to research motivation |
| Is there a better way to frame this question? | To optimize question formulation |
| What is the question behind this question? | To excavate deeper concerns |
| What if we're asking the wrong question? | Fundamental reflection |
| What preconditions must exist to answer this? | To examine answerability |
---
## Academic Research Question Banks
### Research Question Clarification
1. Are you asking a "whether" question, a "how much" question, or a "why" question?
2. Can you state your research question in a single sentence? If it takes more than one sentence, it may need splitting.
3. If you could run only one statistical test or interview one person, what would it be?
4. Does your question imply an expected answer? If so, is that a question or a hypothesis?
5. Five years from now, what do you hope this research will have answered?
### Methodology Probing
1. Did you choose this method because it best fits your question, or because you're most familiar with it?
2. What alternative explanations can your design rule out? What can't it?
3. Would your conclusions hold with half your expected sample size?
4. Is your instrument actually measuring what you intend to measure? (validity)
5. Would another researcher get the same results using the same method? (reliability)
### Literature Positioning
1. What is the dominant narrative in this field? Are you supporting or challenging it?
2. If your research is a conversation, who are you responding to?
3. Are there decade-old studies now considered wrong? What does that tell you?
4. Do your cited sources share a common blind spot?
5. Have you deliberately searched for literature that contradicts your view?
### Analytical Reasoning
1. Is what you observe correlation or causation? How do you distinguish them?
2. Where does your analytical framework come from? Has it been criticized?
3. If you gave your data to another researcher without your hypothesis, what would they see?
4. Are there outliers that don't fit your theory? How do you handle them?
5. Have you tried to disprove your own hypothesis?
### Conclusions and Limitations
1. Does your conclusion go beyond what your evidence supports?
2. To what extent can your findings be generalized? Where do they not apply?
3. If you had to add a section "I might be wrong because...", what would it say?
4. Is your limitations section a genuine reflection or a formality?
5. What would future researchers need to verify or refute your conclusions?
### Contribution and Significance
1. If your research were never published, what would academia and practice lose?
2. Can you explain why your research matters in three sentences to a non-expert?
3. Is your research "filling a gap" or "changing understanding"? These differ in value.
4. Will your research still be cited in ten years? Why?
5. How does your research connect to the most pressing issues in society today?
---
## Questioning Strategies
### Strategy 1: Funnel Strategy
From open to focused, progressively narrowing scope.
```
Q1: "What aspects of higher education interest you?" (Open)
Q2: "You mentioned quality assurance — what part of QA makes you most curious?" (Focused)
Q3: "Where do you think the problem lies with accreditation indicator design?" (More focused)
Q4: "So what you're asking is: can current accreditation indicators truly reflect teaching quality?" (Precise)
```
### Strategy 2: Mirror Strategy
Restate the user's words, then follow up.
```
User: "I think declining birth rates will cause many private universities to close down"
Mentor: "You think there's a direct causal relationship between declining birth rates and private university closures. Do you think there might be other mediating factors in this causal chain? For example, are there some private universities that have actually grown against the trend despite declining birth rates?"
```
### Strategy 3: Counterfactual Strategy
Imagine the opposite situation to test reasoning.
```
User: "Online learning has improved learning outcomes"
Mentor: "If a university that completely didn't adopt online learning had better student grades and satisfaction than those that did, how would you explain that? Would this change your research question?"
```
### Strategy 4: Analogy Strategy
Use similar problems from other domains to inspire thinking.
```
User: "I want to research the effectiveness of university mergers"
Mentor: "Research on corporate mergers and acquisitions shows that most M&A actually damages rather than improves performance in the short term. Do you think university mergers might have a similar pattern? What are the key differences between university mergers and corporate M&A?"
```
### Strategy 5: Strategic Silence
Sometimes the best follow-up is waiting, giving the user space to think.
```
User: "I think... maybe... actually I'm not sure"
Mentor: "Take your time. You just said 'actually I'm not sure' — what exactly are you unsure about? Is it the question itself, or your position on the question?"
```
---
## Design Alignment with AI Learning Guidance Engines
The dialogue design principles of this framework are consistent with AI learning guidance engines:
| Design Principle | Socratic Mentor | ai-study-learn-engine |
|---------|-----------------|----------------------|
| Brief feedback | 1-2 sentences of affirmation/restatement | 1-2 sentences of indicator performance feedback |
| Data citation | Hint at literature directions | Cite specific indicator data |
| Focused follow-up | 1-2 precise questions | 1 learning guidance question |
| Response length limit | 200-400 words | 200-300 words |
| Insight extraction | [INSIGHT: ...] | [LEARNING: ...] |
| Convergence mechanism | 15-round limit | 10-round limit |
This consistency ensures a coherent experience when users switch between different tools.
---
## SCR Overlay Protocol
The SCR (State-Challenge-Reflect) overlay works ON TOP of existing Socratic questioning. It does not replace any existing mechanism; it adds a commitment-tracking layer that deepens the learning impact.
### Mapping to Socratic Functions
| SCR Phase | Socratic Function | Timing | Purpose |
|-----------|------------------|--------|---------|
| **State** (表態) | Clarifying + Probing | Before presenting data/evidence | Collect user's prediction or self-assessment |
| **Challenge** (挑戰) | Structuring + Challenging | After commitment collected | Present information that tests the commitment |
| **Reflect** (反思) | Probing + Structuring | After divergence revealed | Guide user to self-explain the gap |
### Design Constraints
1. The user never sees the words "SCR", "commitment gate", or "divergence reveal"
2. The experience feels like a natural Socratic dialogue that happens to ask for predictions before showing data
3. The mechanism is invisible; the learning is visible
4. Commitment questions should feel like natural warm-up questions, not formal assessments
5. If the user's commitment turns out to be accurate, acknowledge it and move on — no need to force divergence where none exists
### Integration with Convergence Signals
The new S5/C5 (Self-Calibration) signal tracks whether the user's commitments become more accurate over the dialogue. This signal:
- Strengthens convergence when present (user is both understanding AND self-aware)
- Does NOT block convergence when absent (understanding can exist without perfect self-calibration)
- Provides valuable coaching feedback at dialogue end
---
## References
- Paul, R., & Elder, L. (2007). *Critical Thinking: The Art of Socratic Questioning*. Journal of Developmental Education, 31(1), 36-37.
- Overholser, J. C. (1993). Elements of the Socratic method: I. Systematic questioning. Psychotherapy, 30(1), 67-74.
- Burbules, N. C. (1993). *Dialogue in Teaching: Theory and Practice*. Teachers College Press.
- Copeland, M. (2005). *Socratic Circles: Fostering Critical and Creative Thinking in Middle and High School*. Stenhouse Publishers.
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| writing-skillsobra/superpowersUse when creating new skills, editing existing skills, or verifying skills work before deployment | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| xlsxanthropics/skillsUse this skill any time a spreadsheet file is the primary input or output. This means any task where the user wants to: open, read, edit, or fix an existing .xlsx, .xlsm, .xltx, .csv, or .tsv file (e.g., adding columns, computing formulas, formatting, charting, cleaning messy data); create a new spreadsheet from scratch or from other data sources; or convert between tabular file formats. Trigger especially when the user references a spreadsheet file by name or path — even casually (like "the xlsx in my downloads") — and wants something done to it or produced from it. Also trigger for cleaning or restructuring messy tabular data files (malformed rows, misplaced headers, junk data) into proper spreadsheets. The deliverable must be a spreadsheet file. Do NOT trigger when the primary deliverable is a Word document, HTML report, standalone Python script, database pipeline, or Google Sheets API integration, even if tabular data is involved. | Stars: 198k | Updated | Claude CodeCodex | Verified | Install |
| shipping-and-launchaddyosmani/agent-skillsPrepares production launches. Use when preparing to deploy to production, or when asking what needs to be in place before shipping. Use when you need a pre-launch checklist, when setting up monitoring, when planning a staged rollout, or when you need a rollback strategy. | Stars: 119k | Updated | Claude CodeCodex | Verified | Install |
| childhoodthedotmack/claude-memBabysit a shipped release after merge, publication, or deployment. Verify published packages, production behavior, installed plugins, and late CI or user reports until the observation window is clean; use babysit for PR readiness before release. | Stars: 118k | Updated | Claude CodeCodex | Verified | Install |