Skip to content

foryourhealth111-pixel/Vibe-Skills / bundled/skills/ml-data-leakage-guard

ml-data-leakage-guard

Verified

Detects and prevents data leakage in machine learning and mathematical modeling. Use after ML tasks involving data cleaning, feature engineering, data augmentation, algorithm development, normalization, missing value imputation, dimensionality reduction, feature selection, or time series modeling. Checks if features/statistics would be available at prediction time.

FileKindSize
SKILL.mdskill md13.2 KB
references/detection-strategies.mdmarkdown17.0 KB
references/index.mdmarkdown1.7 KB
references/leakage-patterns.mdmarkdown13.2 KB
references/temporal-leakage.mdmarkdown13.7 KB

references/index.md

View on GitHub
# ML Data Leakage Guard - References

Navigation guide for detailed leakage detection documentation.

## Core Documentation

### [leakage-patterns.md](leakage-patterns.md)
Comprehensive catalog of all common data leakage patterns with examples:
- Preprocessing leakage
- Feature engineering leakage
- Target leakage
- Temporal leakage
- Cross-validation leakage

### [temporal-leakage.md](temporal-leakage.md)
Time series and temporal data specific leakage issues:
- Future functions
- Incorrect time-based splits
- Rolling window leakage
- Lag feature construction

### [detection-strategies.md](detection-strategies.md)
Practical strategies for detecting leakage in existing code:
- Code review checklist
- Automated detection approaches
- Performance sanity checks
- Production validation

## Quick Links

- **For preprocessing issues**: See leakage-patterns.md → Preprocessing Leakage
- **For time series**: See temporal-leakage.md → Future Functions
- **For feature engineering**: See leakage-patterns.md → Feature Engineering Leakage
- **For code review**: See detection-strategies.md → Code Review Checklist

## The Golden Rule

At the exact moment of prediction in production:
- Can I access this value from the database?
- Can I compute this statistic using only information available up to that point?
- Does this feature require knowing the outcome I'm trying to predict?

If any answer is "NO", you have data leakage.

## Usage

These references provide detailed specifications and examples that supplement the Quick Reference in SKILL.md. Use them when you need:
- Detailed explanations of specific leakage types
- Edge case handling
- Domain-specific leakage patterns
- Debugging existing leakage issues
slack-gif-creatoranthropics/skillsKnowledge and utilities for creating animated GIFs optimized for Slack. Provides constraints, validation tools, and animation concepts. Use when users request animated GIFs for Slack like "make me a GIF of X doing Y for Slack."Stars: 198kUpdated Claude CodeCodexVerifiedInstall
ponytailDietrichGebert/ponytailLazy senior dev mode for any coding task: the smallest change that fully solves it, and a reply a busy human understands in one read.Stars: 194kUpdated Claude CodeCodexVerifiedInstall
ponytail-debtDietrichGebert/ponytailHarvest every shortcut: comment into one debt ledger, so deferrals get tracked instead of forgotten. One-shot report.Stars: 194kUpdated Claude CodeCodexVerifiedInstall
ponytail-debtDietrichGebert/ponytailList every `shortcut:` comment (and older `ponytail:` ones) as a debt ledger. One-shot report, changes nothing. Use for "ponytail debt", "what did ponytail defer", "list the shortcuts", /ponytail-debt.Stars: 194kUpdated Claude CodeCodexVerifiedInstall