brycewang-stanford/Auto-Empirical-Research-Skills / skills/14-luischanci-claude-code-research-starter/dot-claude/skills/devils-advocate
devils-advocate
VerifiedChallenge research design decisions, assumptions, and methodology choices with specific critical questions. Helps strengthen the paper before submission.
Devil's Advocate
Critically examine a research design, methodology, or assumption with 5-7 specific challenges.
Steps
-
Understand the target: Read
$ARGUMENTSand any relevant project files (CLAUDE.md, manuscript, estimation code). -
Generate 5-7 challenges from these categories:
- Identification: Could the causal claim be undermined by [specific threat]?
- Specification: What if the functional form is wrong? Alternative specifications?
- Data: Are there sample selection issues? Measurement error concerns?
- Methodology: Could a different estimator give different results? Why this method?
- Assumptions: Which assumptions are most vulnerable? What if they're violated?
- Robustness: What robustness checks are missing?
- External validity: Does this generalize beyond the sample?
-
For each challenge, provide:
- The question
- Why it matters
- Suggested resolution or robustness check
- Severity (Critical / Major / Minor)
-
Summary verdict: Strengths, critical changes needed, and suggested improvements.
Notes
- Be constructive, not destructive.
- Think like a skeptical referee at a top journal.
- Focus on the most impactful challenges first.
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| brainstormingobra/superpowersYou MUST use this before any creative work - creating features, building components, adding functionality, modifying behavior, or planning anything new, in software or out of it (a talk, a business, a renovation). | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| brand-guidelinesanthropics/skillsApplies Anthropic's official brand colors and typography to any sort of artifact that may benefit from having Anthropic's look-and-feel. Use it when brand colors or style guidelines, visual formatting, or company design standards apply. | Stars: 198k | Updated | Claude CodeCodex | Verified | Install |
| frontend-designanthropics/skillsGuidance for distinctive, intentional visual design when building new UI or reshaping an existing one. Helps with aesthetic direction, typography, and making choices that don't read as templated defaults. | Stars: 198k | Updated | Claude CodeCodex | Verified | Install |
| mcp-builderanthropics/skillsGuide for creating high-quality MCP (Model Context Protocol) servers that enable LLMs to interact with external services through well-designed tools. Use when building MCP servers to integrate external APIs or services, whether in Python (FastMCP) or Node/TypeScript (MCP SDK). | Stars: 198k | Updated | Claude CodeCodex | Verified | Install |