foryourhealth111-pixel/Vibe-Skills / bundled/skills/ml-data-leakage-guard
ml-data-leakage-guard
VerifiedDetects and prevents data leakage in machine learning and mathematical modeling. Use after ML tasks involving data cleaning, feature engineering, data augmentation, algorithm development, normalization, missing value imputation, dimensionality reduction, feature selection, or time series modeling. Checks if features/statistics would be available at prediction time.
| File | Kind | Size |
|---|---|---|
| SKILL.md | skill md | 13.2 KB |
| references/detection-strategies.md | markdown | 17.0 KB |
| references/index.md | markdown | 1.7 KB |
| references/leakage-patterns.md | markdown | 13.2 KB |
| references/temporal-leakage.md | markdown | 13.7 KB |
references/index.md
View on GitHub# ML Data Leakage Guard - References
Navigation guide for detailed leakage detection documentation.
## Core Documentation
### [leakage-patterns.md](leakage-patterns.md)
Comprehensive catalog of all common data leakage patterns with examples:
- Preprocessing leakage
- Feature engineering leakage
- Target leakage
- Temporal leakage
- Cross-validation leakage
### [temporal-leakage.md](temporal-leakage.md)
Time series and temporal data specific leakage issues:
- Future functions
- Incorrect time-based splits
- Rolling window leakage
- Lag feature construction
### [detection-strategies.md](detection-strategies.md)
Practical strategies for detecting leakage in existing code:
- Code review checklist
- Automated detection approaches
- Performance sanity checks
- Production validation
## Quick Links
- **For preprocessing issues**: See leakage-patterns.md → Preprocessing Leakage
- **For time series**: See temporal-leakage.md → Future Functions
- **For feature engineering**: See leakage-patterns.md → Feature Engineering Leakage
- **For code review**: See detection-strategies.md → Code Review Checklist
## The Golden Rule
At the exact moment of prediction in production:
- Can I access this value from the database?
- Can I compute this statistic using only information available up to that point?
- Does this feature require knowing the outcome I'm trying to predict?
If any answer is "NO", you have data leakage.
## Usage
These references provide detailed specifications and examples that supplement the Quick Reference in SKILL.md. Use them when you need:
- Detailed explanations of specific leakage types
- Edge case handling
- Domain-specific leakage patterns
- Debugging existing leakage issues
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| slack-gif-creatoranthropics/skillsKnowledge and utilities for creating animated GIFs optimized for Slack. Provides constraints, validation tools, and animation concepts. Use when users request animated GIFs for Slack like "make me a GIF of X doing Y for Slack." | Stars: 198k | Updated | Claude CodeCodex | Verified | Install |
| ponytailDietrichGebert/ponytailLazy senior dev mode for any coding task: the smallest change that fully solves it, and a reply a busy human understands in one read. | Stars: 194k | Updated | Claude CodeCodex | Verified | Install |
| ponytail-debtDietrichGebert/ponytailHarvest every shortcut: comment into one debt ledger, so deferrals get tracked instead of forgotten. One-shot report. | Stars: 194k | Updated | Claude CodeCodex | Verified | Install |
| ponytail-debtDietrichGebert/ponytailList every `shortcut:` comment (and older `ponytail:` ones) as a debt ledger. One-shot report, changes nothing. Use for "ponytail debt", "what did ponytail defer", "list the shortcuts", /ponytail-debt. | Stars: 194k | Updated | Claude CodeCodex | Verified | Install |