Skip to content

brycewang-stanford/Auto-Empirical-Research-Skills / skills/24-Imbad0202-academic-research-skills/deep-research

deep-research

Verified

Universal deep research agent team. 13-agent pipeline for rigorous academic research on any topic. 7 modes: full research, quick brief, paper review, lit-review, fact-check, Socratic guided research dialogue, and systematic review with optional meta-analysis. Covers research question formulation, Socratic mentoring, methodology design, systematic literature search, source verification, cross-source synthesis, risk of bias assessment, meta-analysis, APA 7.0 report compilation, editorial review, devil's advocate challenges, ethics review, and post-research literature monitoring. Triggers on: research, deep research, literature review, systematic review, meta-analysis, PRISMA, evidence synthesis, fact-check, guide my research, help me think through, 研究, 深度研究, 文獻回顧, 文獻探討, 系統性回顧, 後設分析, 事實查核, 引導我的研究, 幫我釐清, 幫我想想, 我不確定要研究什麼, 研究方向, 研究主題.

FileKindSize
SKILL.mdskill md31.8 KB
agents/bibliography_agent.mdmarkdown3.6 KB
agents/devils_advocate_agent.mdmarkdown6.1 KB
agents/editor_in_chief_agent.mdmarkdown4.9 KB
agents/ethics_review_agent.mdmarkdown6.9 KB
agents/meta_analysis_agent.mdmarkdown14.6 KB
agents/monitoring_agent.mdmarkdown9.0 KB
agents/report_compiler_agent.mdmarkdown5.4 KB
agents/research_architect_agent.mdmarkdown6.9 KB
agents/research_question_agent.mdmarkdown6.9 KB
agents/risk_of_bias_agent.mdmarkdown9.4 KB
agents/socratic_mentor_agent.mdmarkdown21.2 KB
agents/source_verification_agent.mdmarkdown6.4 KB
agents/synthesis_agent.mdmarkdown6.0 KB
examples/exploratory_research.mdmarkdown6.9 KB
examples/fact_check_mode.mdmarkdown12.9 KB
examples/handoff_to_paper.mdmarkdown11.0 KB
examples/policy_analysis.mdmarkdown9.4 KB
examples/review_mode.mdmarkdown17.3 KB
examples/socratic_guided_research.mdmarkdown22.9 KB
examples/systematic_review.mdmarkdown7.7 KB
references/apa7_style_guide.mdmarkdown4.6 KB
references/equator_reporting_guidelines.mdmarkdown14.0 KB
references/ethics_checklist.mdmarkdown10.2 KB
references/failure_paths.mdmarkdown14.8 KB
references/interdisciplinary_bridges.mdmarkdown20.9 KB
references/irb_decision_tree.mdmarkdown11.5 KB
references/literature_monitoring_strategies.mdmarkdown9.6 KB
references/logical_fallacies.mdmarkdown10.4 KB
references/methodology_patterns.mdmarkdown17.0 KB
references/mode_selection_guide.mdmarkdown16.2 KB
references/preregistration_guide.mdmarkdown11.8 KB
references/socratic_questioning_framework.mdmarkdown11.4 KB
references/source_quality_hierarchy.mdmarkdown7.2 KB
references/systematic_review_toolkit.mdmarkdown18.7 KB
templates/evidence_assessment_template.mdmarkdown3.7 KB
templates/literature_matrix_template.mdmarkdown3.7 KB
templates/preregistration_template.mdmarkdown8.5 KB
templates/prisma_protocol_template.mdmarkdown8.8 KB
templates/prisma_report_template.mdmarkdown15.8 KB
templates/research_brief_template.mdmarkdown2.1 KB

examples/exploratory_research.md

View on GitHub
# Example: Exploratory Research — Full Pipeline

## User Request
```
Research the impact of AI on higher education quality assurance
```

## Phase 1: SCOPING

### research_question_agent Output

**Topic Area**: Artificial intelligence applications in higher education quality assurance

**Primary Research Question**:
> How are artificial intelligence technologies being integrated into higher education quality assurance processes, and what are the emerging benefits, risks, and institutional implications?

**FINER Assessment**:
| Criterion | Score | Justification |
|-----------|-------|---------------|
| Feasible | 4/5 | Growing literature base; accessible through academic databases |
| Interesting | 5/5 | Rapidly evolving area at intersection of two major sectors |
| Novel | 4/5 | Few comprehensive reviews exist; most studies are case-specific |
| Ethical | 4/5 | Raises important AI ethics questions but not inherently harmful |
| Relevant | 5/5 | Directly informs QA agency strategy and policy |
| **Average** | **4.4/5** | |

**Scope Boundaries**:
- In scope: AI/ML applications in institutional/program accreditation, learning analytics for QA, automated assessment, AI in self-evaluation
- Out of scope: AI in teaching/learning (unless directly connected to QA), AI plagiarism detection (separate literature), specific vendor products
- Key assumptions: Focus on post-secondary education; "quality assurance" includes both internal QA and external accreditation

**Sub-questions**:
1. What AI technologies are currently being applied or piloted in HE quality assurance?
2. What benefits and risks do stakeholders report from AI integration in QA?
3. What institutional and policy implications arise from AI-augmented QA processes?

### research_architect_agent Output

**Research Paradigm**: Pragmatist (mixed evidence types, applied orientation)
**Method**: Systematic literature review with thematic synthesis
**Data Strategy**: Secondary data (academic literature + grey literature from QA agencies)
**Analytical Framework**: Thematic analysis organized by sub-questions
**Validity Criteria**: Comprehensive search, transparent inclusion criteria, PRISMA reporting

### devils_advocate_agent — CHECKPOINT 1

**Verdict**: PASS (with minor notes)
- Minor: RQ is broad — consider whether "emerging" limits to recent literature only
- Minor: Define "quality assurance" explicitly (internal vs. external, process vs. outcome)
- Observation: Fast-moving field means any review may be quickly outdated

## Phase 2: INVESTIGATION

### bibliography_agent Output

**Search Strategy**: 4 databases (Scopus, Web of Science, ERIC, Google Scholar), keywords: "artificial intelligence" AND "quality assurance" AND "higher education", date range: 2019-2025, English and Chinese languages.

**PRISMA Flow**: 847 identified -> 612 after dedup -> 89 screened -> 31 full-text -> 22 included

**Annotated Bibliography** (excerpt):
1. **Zawacki-Richter, O., et al. (2019). Systematic review of research on artificial intelligence applications in higher education. *International Journal of Educational Technology in Higher Education*, *16*(1), 39. https://doi.org/10.1186/s41239-019-0171-0**
   - Relevance: Foundational mapping of AI in HE
   - Key Findings: AI predominantly used in profiling/prediction, assessment, adaptive learning
   - Quality: Level V (systematic review of descriptive studies)

2. **Sanchez-Prieto, J.C., et al. (2024). AI-enhanced quality assurance: A framework for European higher education. *Quality in Higher Education*, *30*(1), 45-62.**
   - Relevance: Directly addresses AI+QA intersection
   - Key Findings: Proposed framework with 4 dimensions; stakeholder acceptance varies
   - Quality: Level VI (framework paper with case illustrations)

[... 20 more sources ...]

### source_verification_agent Output

**Sources Reviewed**: 22 | **Verified**: 20 | **Flagged**: 2 | **Rejected**: 0

**Flagged**:
1. Source #14 — Moderate COI (author is CTO of an AI-QA startup)
2. Source #19 — Currency concern (2019 review may not reflect post-GPT developments)

## Phase 3: ANALYSIS

### synthesis_agent Output

**Key Themes**:
1. **AI Application Typology** (Strong evidence, 15 sources): Categorization, analytics, automation, prediction
2. **Benefits: Efficiency & Scale** (Moderate evidence, 9 sources): Reduced reviewer burden, faster turnaround, larger data processing
3. **Risks: Bias & Transparency** (Moderate evidence, 8 sources): Algorithmic bias, black-box decisions, accountability gaps
4. **Institutional Readiness** (Emerging evidence, 5 sources): Capacity building, infrastructure, cultural resistance
5. **Policy Frameworks** (Emerging evidence, 4 sources): Regulation, standards, governance models

**Key Contradiction**: Sources disagree on whether AI reduces or amplifies bias in QA — resolution depends on implementation design and oversight mechanisms.

**Knowledge Gaps**: Limited evidence from Global South; few longitudinal studies; no studies on student perception of AI in QA.

### devils_advocate_agent — CHECKPOINT 2

**Verdict**: PASS
- Minor: Technology-positive framing detected — ensure risks are given equal weight
- Observation: Most evidence comes from European/North American contexts

## Phase 4: COMPOSITION

### report_compiler_agent Output

[Full APA 7.0 report, ~5,200 words]

Title: Artificial Intelligence in Higher Education Quality Assurance: A Systematic Review of Applications, Benefits, Risks, and Institutional Implications

[Abstract, Introduction, Literature Review, Methodology, Findings (organized by 5 themes), Discussion, Limitations, Conclusion, References (22 sources)]

## Phase 5: REVIEW

### editor_in_chief_agent Output

**Verdict**: Minor Revision (Score: 3.7/5.0)
- Strength: Comprehensive search, well-organized themes
- Major: Discussion section needs stronger connection between findings and existing QA theory
- Minor: Some inconsistency in citation format (3 references)
- Minor: Abstract exceeds 250-word limit

### ethics_review_agent Output

**Verdict**: CLEARED
- AI disclosure present and accurate
- All references spot-checked (5/22 = 23%) — all verified
- Dual-use risk: Low
- Fair representation: Adequate (noted geographic limitation)

### devils_advocate_agent — CHECKPOINT 3

**Verdict**: PASS
- Observation: Conclusion recommendation #3 ("QA agencies should adopt AI tools") is stronger than evidence warrants — suggest hedging
- "So what?" test: Passed — clear implications for QA practice

## Phase 6: REVISION

### report_compiler_agent (Revision 1)

**Changes**:
1. Discussion section expanded with QA theory connections (Major, Editor)
2. 3 citation format errors corrected (Minor, Editor)
3. Abstract trimmed to 248 words (Minor, Editor)
4. Recommendation #3 hedged: "should consider piloting" (Observation, Devil's Advocate)

**Final Word Count**: 5,450 words
**Revision Loops Used**: 1 of 2

---

## Final Output Summary
- Full APA 7.0 report: 5,450 words
- 22 cited sources (Levels I-VII)
- 5 thematic findings
- 3 recommendations
- Ethics cleared
- 1 revision loop completed
writing-skillsobra/superpowersUse when creating new skills, editing existing skills, or verifying skills work before deploymentStars: 322kUpdated Claude CodeCodexVerifiedInstall
xlsxanthropics/skillsUse this skill any time a spreadsheet file is the primary input or output. This means any task where the user wants to: open, read, edit, or fix an existing .xlsx, .xlsm, .xltx, .csv, or .tsv file (e.g., adding columns, computing formulas, formatting, charting, cleaning messy data); create a new spreadsheet from scratch or from other data sources; or convert between tabular file formats. Trigger especially when the user references a spreadsheet file by name or path — even casually (like "the xlsx in my downloads") — and wants something done to it or produced from it. Also trigger for cleaning or restructuring messy tabular data files (malformed rows, misplaced headers, junk data) into proper spreadsheets. The deliverable must be a spreadsheet file. Do NOT trigger when the primary deliverable is a Word document, HTML report, standalone Python script, database pipeline, or Google Sheets API integration, even if tabular data is involved.Stars: 198kUpdated Claude CodeCodexVerifiedInstall
shipping-and-launchaddyosmani/agent-skillsPrepares production launches. Use when preparing to deploy to production, or when asking what needs to be in place before shipping. Use when you need a pre-launch checklist, when setting up monitoring, when planning a staged rollout, or when you need a rollback strategy.Stars: 119kUpdated Claude CodeCodexVerifiedInstall
childhoodthedotmack/claude-memBabysit a shipped release after merge, publication, or deployment. Verify published packages, production behavior, installed plugins, and late CI or user reports until the observation window is clean; use babysit for PR readiness before release.Stars: 118kUpdated Claude CodeCodexVerifiedInstall