brycewang-stanford/Auto-Empirical-Research-Skills / skills/17-DAAF-Contribution-Community-daaf/dot-claude/skills/data-scientist
data-scientist
VerifiedData science methodology for Python research: EDA, validation, causal inference (IV, DiD, RD, synthetic control), clustering/PCA/UMAP, supervised ML, geospatial, visualization. Method selection guidance. For syntax, load tool-specific skills.
| File | Kind | Size |
|---|---|---|
| SKILL.md | skill md | 39.5 KB |
| references/causal-inference.md | markdown | 51.5 KB |
| references/code-documentation.md | markdown | 15.2 KB |
| references/data-documentation.md | markdown | 11.7 KB |
| references/descriptive-analysis.md | markdown | 68.3 KB |
| references/eda-checklist.md | markdown | 11.4 KB |
| references/exploratory-unsupervised.md | markdown | 39.2 KB |
| references/geospatial-analysis.md | markdown | 43.4 KB |
| references/geospatial-operations.md | markdown | 27.6 KB |
| references/research-questions.md | markdown | 10.8 KB |
| references/statistical-modeling.md | markdown | 43.1 KB |
| references/supervised-ml.md | markdown | 55.7 KB |
| references/survey-analysis.md | markdown | 37.8 KB |
| references/transformation-validation.md | markdown | 11.0 KB |
| references/visualization-design.md | markdown | 10.2 KB |
| references/visualization-execution.md | markdown | 11.3 KB |
references/visualization-execution.md
View on GitHub# Visualization Execution Standards
Practical standards for producing clean, accessible, publication-ready figures. This guide is tool-agnostic — load `plotnine` or `plotly` skills for implementation syntax.
## Color Palette Selection
Color is one of the most powerful — and most abused — visual channels. Use it deliberately.
### Palette Type Decision Tree
```
What kind of data are you coloring?
├─ Ordered / continuous (e.g., income, temperature)
│ ├─ Values go low → high
│ │ └─ Sequential palette (single hue, light → dark)
│ └─ Values diverge from a meaningful center (e.g., above/below average)
│ └─ Diverging palette (two hues from neutral midpoint)
├─ Categorical / unordered (e.g., regions, school types)
│ └─ Qualitative palette (distinct hues, similar lightness)
└─ Only one thing matters (highlight vs. context)
└─ Gray + one accent color
```
### Recommended Palettes
| Use Case | Palette | Why |
|----------|---------|-----|
| Sequential continuous | **viridis** | Perceptually uniform, colorblind-safe, prints in grayscale |
| Sequential, CVD-optimized | **cividis** | Blue-yellow range avoids red-green entirely |
| Sequential, high contrast | **inferno** | Wide luminance range; strong visual punch |
| Diverging (general) | **BrBG** (ColorBrewer) | Brown-teal avoids red-green; clear midpoint |
| Diverging (familiar) | **RdBu** (ColorBrewer) | Red-blue is intuitive for hot/cold, +/-; less CVD-safe than BrBG — use BrBG when accessibility is the priority |
| Categorical (≤8 groups) | **Okabe-Ito** | Purpose-built for color vision deficiency |
| Categorical (alternative) | **ColorBrewer Set2 / Dark2** | Tested for print, screen, and CVD |
| Highlight one thing | **gray + one saturated color** | Instant attention focus; no legend needed |
**Okabe-Ito hex values (in recommended order):** `#E69F00` (orange), `#56B4E9` (sky blue), `#009E73` (bluish green), `#F0E442` (yellow), `#0072B2` (blue), `#D55E00` (vermilion), `#CC79A7` (reddish purple), `#000000` (black). Use via `scale_color_manual()` in plotnine or `color_discrete_sequence` in plotly.
### Color Restraint
- **Maximum useful categories: 5-7.** Beyond that, viewers can't reliably distinguish colors. Group small categories into "Other," use faceting, or label directly.
- **Gray is your best friend.** Set everything to gray by default, then add color only where it encodes information or draws attention. This is the single most effective technique for directing focus.
- **Never use rainbow/jet.** It's perceptually non-uniform (false bright bands at yellow/cyan), colorblind-hostile, and doesn't convert to grayscale meaningfully.
- **Muted fills, vivid accents.** Use desaturated colors for large areas (bars, choropleth). Reserve saturated colors for small elements that need to stand out.
## Colorblind Accessibility
~8% of males and ~0.5% of females have color vision deficiency. In a room of 50 people, 2-4 statistically cannot distinguish your red-green color scheme.
### The Golden Rule: Redundant Encoding
**Never rely on color alone.** Always pair color with at least one other visual channel:
- **Shape** — circles, squares, triangles in scatter plots (limit to 3-4)
- **Line style** — solid, dashed, dotted for line charts
- **Direct labels** — text on chart elements eliminates color lookup entirely
- **Pattern/texture** — hatching in bar fills (use sparingly)
- **Position** — facet into small multiples instead of overlaying colored series
### The Quick Test: "Get It Right in Black & White"
Convert your chart to grayscale. If you lose information, your design relies too heavily on hue. Fix by:
1. Ensuring lightness varies across your palette (not just hue)
2. Adding redundant encoding
3. Switching to a perceptually uniform palette (viridis family)
### What to Avoid
- Red vs. green (the most common problem by far)
- Any palette where two colors differ only in hue at similar lightness
- More than 3-4 colors without redundant encoding as backup
### Testing Tools
- **Coblis** (color-blindness.com) — upload an image, simulate CVD types
- **Color Oracle** (colororacle.org) — desktop full-screen CVD filter
- **ColorBrewer** (colorbrewer2.org) — interactive picker with "colorblind safe" filter
- **Grayscale print test** — the simplest and often most revealing check
## Labeling Philosophy
### Direct Labeling vs. Legends
**Prefer direct labeling.** Legends force the reader into a lookup loop: see a color → travel to legend → decode → travel back → repeat. Each round-trip costs cognitive effort.
| Situation | Recommendation |
|-----------|---------------|
| Line chart, 2-4 series | Label at end of each line (right side) — no legend needed |
| Bar chart, few categories | Label bars directly with values or category names |
| Scatter, highlighted points | Annotate the points |
| Many categories (>5) | Legend may be necessary, but consider faceting first |
| Small multiples | Shared legend is fine — panel labels do the main work |
**Legend placement when needed:** Inside the plot area (corner with no data) is better than outside. Top-of-chart horizontal legends work for 2-4 items. Avoid bottom-of-chart placement.
### Titles
| Style | Example | When to Use |
|-------|---------|-------------|
| **Descriptive** | "Per-Pupil Expenditure by State, 2022" | Exploratory analysis, technical reports |
| **Declarative** | "Spending Gaps Widened After 2019" | Presentations, policy briefs, stakeholder reports |
**Subtitles** provide methodology context: "Source: CCD 2015-2022, public schools only. N = 13,194 districts."
**Source notes** go at the bottom-left, in smaller gray text. Always include them.
### Axis Labels
- **Always include units.** "$K per pupil" is better than leaving it ambiguous.
- **Abbreviate large numbers.** 1K, 10K, 1M, 1B — readers process these faster than full numbers.
- **If you rotate labels, rotate the chart.** Angled tick labels on the x-axis are almost always a sign you should switch to a horizontal bar chart. This single change often transforms a cluttered chart into a clean one.
- **Axis breaks are risky.** Truncating the y-axis on a bar chart misrepresents magnitude. For line/dot charts, non-zero baselines are acceptable if clearly labeled.
### Annotation
Annotations are where the analyst adds value beyond what the data alone shows. Use them sparingly but strategically:
- **Reference lines** — horizontal lines for averages, targets, benchmarks. Label directly: "National avg: 42%"
- **Event annotations** — on time series, mark inflection points: "Policy X enacted," "COVID-19 closures"
- **Callouts** — brief text pointing to a specific data element. One short sentence max.
- **Strategic highlighting** — bold or saturate the focal element; gray out everything else
**Default limit:** 1-2 annotations per chart. Time series with multiple relevant events may warrant 3-4, but each must earn its place. If you need more than 4, consider splitting into panels.
## Typography & Layout
### Font Selection
**Sans-serif for all chart text.** Sans-serif letterforms have less visual noise, making numbers and short labels easier to parse at small sizes. Recommended: Inter, Source Sans Pro, Roboto, Lato, Helvetica/Arial.
### Size Hierarchy
| Element | Print Size | Screen Size | Weight |
|---------|-----------|-------------|--------|
| Title | 14-18 pt | 16-20 px | Bold |
| Subtitle | 11-14 pt | 13-16 px | Italic or regular |
| Axis labels | 10-12 pt | 11-13 px | Regular |
| Tick labels | 8-10 pt | 9-11 px | Regular |
| Annotations | 8-10 pt | 9-11 px | Regular |
| Source note | 7-8 pt | 10-11 px | Regular, gray |
**Minimum readable size:** Nothing below ~7 pt in print or ~9 px on screen.
### Aspect Ratios
| Chart Type | Recommended Ratio | Why |
|------------|-------------------|-----|
| Time series | ~16:9 or wider | Spreads temporal data; slopes are easier to perceive |
| Scatter plot | ~4:3 or 1:1 | Equal perception in both dimensions |
| Bar chart | Driven by category count | Horizontal bars can be taller; vertical bars wider |
### Whitespace
Leave adequate margins. Don't crowd labels against edges. Internal padding between data and axes prevents points from sitting on the axis line. Whitespace is not wasted — it aids comprehension.
## Export Standards
| Context | DPI | Format | Notes |
|---------|-----|--------|-------|
| Screen / web | 72-150 | PNG | Retina displays benefit from 2x (144-192) |
| Presentations | 150 | PNG | Balance quality and file size |
| Print / publication | 300+ | PNG or PDF | 300 DPI is the standard minimum |
| Scalable / archival | N/A | SVG or PDF | Vector; scales without quality loss |
**Never use JPEG for charts.** Lossy compression creates visible artifacts around sharp lines and text.
**Recommended defaults for reports:** PNG at 300 DPI, dimensions ~2100 × 1400 px for full-width figures.
## Project Consistency
Define visual standards once and apply them to every figure. Inconsistency across figures in a report is one of the most visible markers of amateur work.
### What to Standardize
| Element | Define Once |
|---------|-------------|
| Color palette | 5-8 named colors (primary, secondary, accent, sequential, diverging) |
| Font family | Single sans-serif family for all text |
| Font sizes | Mapping of element roles to sizes |
| Background | White (#FFFFFF) or very light gray (#F5F5F5) |
| Gridlines | Light gray, horizontal only (or none) |
| Axis lines | Left + bottom only; remove top and right borders |
| Source note format | Consistent placement, font, wording |
| DPI and dimensions | Single export resolution and figure size |
### The Theme Approach
Build a reusable theme or configuration that encodes these standards. Apply it to every figure. Both plotnine (via `theme()`) and plotly (via `layout(template=)`) support this pattern. Define once, apply everywhere.
### Consistency Checklist
- [ ] Same color means the same thing across all figures in the report
- [ ] Same font family and size hierarchy throughout
- [ ] Source notes in the same position and format
- [ ] Sequential/diverging palettes are consistent (same blue gradient = same meaning)
- [ ] Figure numbering follows a single sequence
- [ ] All figures exported at the same DPI and dimensions
## Figure Captions
**Caption placement:** Below the figure (standard in policy research).
**Self-contained:** A reader should understand the figure without reading surrounding text. Include: what is shown, units, time period, geographic scope, sample size.
**Example:**
> **Figure 3.** Distribution of per-pupil expenditure across U.S. school districts, 2022-23. Districts weighted by enrollment. Median = $14,200. Source: CCD. N = 13,194.
**Cross-referencing:** Refer to figures by number ("As shown in Figure 3"), never by position ("the chart below"). Position changes during editing.
## Key References
- Wilke, C. *Fundamentals of Data Visualization* (2019) — clauswilke.com/dataviz
- Knaflic, C.N. *Storytelling with Data* (2015)
- [Urban Institute Style Guide](https://urbaninstitute.github.io/graphics-styleguide/) — practical model for project consistency
- [Datawrapper Blog: Colorblindness](https://www.datawrapper.de/blog/colorblindness-part2) — practical accessibility guidance
- [ColorBrewer](https://colorbrewer2.org) — palette selection with CVD/print filters
- WCAG 2.1 — contrast ratio guidelines (4.5:1 text, 3:1 graphical elements)
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| reverse-engineer-anythingmorluto/reaReverse engineer native, managed, Electron/JavaScript, packaged, firmware, and browser targets with REA, and build agent environments (AgentEnv bundles) of web applications from a live instance or a capture, and of Linux desktop apps with a task from a request. Use shipped-artifact or requested runtime evidence to explain features, compare versions, decompile code, or guide a reconstruction. Skip REA for ordinary source-repository architecture analysis. | Stars: 472k | Updated | Claude CodeCodex | Verified | Install |
| diagnosing-superpowersobra/superpowersUse when a superpowers session went wrong and your human partner wants to know why — repeated work, ignored plans, stumbles, poor results, a skill that didn't fire, "it took too long", "why is it so expensive", "what is it doing" — or wants to build a bug report for the superpowers maintainers, for the current session or a past one identified by id or path, on any harness. | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| dispatching-parallel-agentsobra/superpowersUse when facing 2+ independent tasks that can be worked on without shared state or sequential dependencies | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| executing-plansobra/superpowersUse when executing an implementation plan in the current session as the implementer yourself — your human partner chose inline execution, or no subagent tool is available | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |