Skip to content

foryourhealth111-pixel/Vibe-Skills / bundled/skills/structured-content-storage

structured-content-storage

Verified

Enforces structured, highly documented storage for code and data projects. Use when working on machine learning scripts, data processing, code creation, or script modification that should preserve clear structure and documentation.

assets/templates/data-processing-README.md

View on GitHub
# Data Processing Project Template

## Project: [Project Name]

Brief description of what this data processing project does.

## Directory Structure

```
data-processing-project/
├── README.md                      # This file
├── requirements.txt               # Python dependencies
├── src/                           # Source code
│   ├── clean.py                   # Main cleaning script
│   ├── validators.py              # Validation functions
│   ├── transformers.py            # Transformation utilities
│   └── quality_checks.py          # Quality assessment
├── data/                          # Data files
│   ├── raw/                       # Original data (read-only)
│   ├── intermediate/              # Intermediate steps
│   ├── processed/                 # Final cleaned data
│   ├── DATA_DICTIONARY.md         # Field descriptions
│   └── QUALITY_REPORT.md          # Quality metrics
├── outputs/                       # Reports and visualizations
├── configs/                       # Configuration files
└── docs/                          # Documentation
    ├── CLEANING_PROCESS.md        # Cleaning methodology
    └── CHANGELOG.md               # Modification history
```

## Setup

1. Clone the repository
2. Install dependencies:
   ```bash
   pip install -r requirements.txt
   ```
3. Configure settings:
   - Edit `configs/cleaning_config.yaml` with your parameters

## Usage

### Basic Cleaning
```bash
python src/clean.py --input data/raw/input.csv --output data/processed/output.csv
```

### With Custom Configuration
```bash
python src/clean.py --config configs/cleaning_config.yaml
```

### Generate Quality Report
```bash
python src/quality_checks.py --data data/processed/output.csv --report outputs/quality_report.html
```

### Key Parameters
- `--input`: Path to raw data file
- `--output`: Path for cleaned data output
- `--config`: Path to configuration file
- `--validate`: Run validation checks (default: True)

## Data Processing Pipeline

1. **Load**: Read raw data from `data/raw/`
2. **Validate**: Check schema and data types
3. **Clean**: Handle missing values, duplicates, outliers
4. **Transform**: Standardize formats, normalize values
5. **Quality Check**: Verify output meets quality standards
6. **Export**: Save to `data/processed/`

See `docs/CLEANING_PROCESS.md` for detailed methodology.

## Data Quality Metrics

[Summary of data quality before and after processing]

- **Completeness**: [X%] → [Y%]
- **Validity**: [X%] → [Y%]
- **Records**: [X] → [Y]

See `data/QUALITY_REPORT.md` for complete metrics.

## Data Dictionary

See `data/DATA_DICTIONARY.md` for detailed field descriptions including:
- Field names and types
- Valid value ranges
- Transformations applied
- Data sources

## Dependencies

- Python >= 3.8
- pandas >= 1.3.0
- numpy >= 1.20.0
- scikit-learn >= 0.24.0 (for outlier detection)

See `requirements.txt` for complete list.

## Documentation

- `docs/CLEANING_PROCESS.md`: Step-by-step cleaning methodology
- `data/DATA_DICTIONARY.md`: Field descriptions and schemas
- `data/QUALITY_REPORT.md`: Data quality assessment

## Validation Rules

[Summary of key validation rules applied]

1. Required fields must be present
2. Numeric fields must be within valid ranges
3. Date fields must be in ISO 8601 format
4. No duplicate records based on primary key

See `docs/CLEANING_PROCESS.md` for complete validation rules.

## License

[License information]

## Contact

[Contact information]
rea-changelog-updatemorluto/reaPrepare or rewrite REA release changelogs and GitHub release notes from pinned Git history, with verified contributor thanks and Release Please synchronization.Stars: 472kUpdated Claude CodeCodexVerifiedInstall
academy-guideanthropics/skillsStop and check this skill before finishing any reply to a question about how to use Claude or a Claude product — it recommends matching courses, tutorials, and use cases from Claude Academy (academy.claude.com), Anthropic's learning hub. Trigger on: "how do I", "how can I", "getting started with", "what can Claude do", "teach me", "learn to use"; questions about artifacts, projects, skills, plugins, connectors, MCP; requests about rolling Claude out to a team, class, or organization; and any ask for training materials, onboarding content, or learning resources. Use it when the user is learning how to use a feature or product — not when they are mid-task and just want the task done. This skill composes with other skills: after consulting product documentation to answer how a Claude feature works, also check here for a matching course or tutorial — a docs-grounded answer and an Academy recommendation belong together. Only recommend on a strong match; never invent Academy content.Stars: 198kUpdated Claude CodeCodexVerifiedInstall
claude-apianthropics/skillsReference for the Claude API / Anthropic SDK — model ids, pricing, params, streaming, tool use, MCP, agents, caching, token counting, model migration. TRIGGER — read BEFORE opening the target file; don't skip because it "looks like a one-liner" — whenever: the prompt names Claude/Anthropic in any form (Claude, Anthropic, Fable, Opus, Sonnet, Haiku, `anthropic`, `@anthropic-ai`, `claude-*`, `us.anthropic.*`, `[1m]`); the user asks about an LLM (pricing/model choice/limits/caching) — never answer from memory; OR the task is LLM-shaped with provider unstated (agent/MCP/tool-definition/multi-agent/RAG/LLM-judge/computer-use; generate/summarize/extract/classify/rewrite/converse over NL; debugging refusals/cutoffs/streaming/tool-calls/tokens). SKIP only when another provider is being worked on (overrides all triggers): OpenAI/GPT/Gemini/Llama/Mistral/Cohere/Ollama named in the query; OR `grep -rE 'openai|langchain_openai|google.generativeai|genai|mistralai|cohere|ollama'` over the project hits (run this grep FIRST if no provider named — don't Read the file).Stars: 198kUpdated Claude CodeCodexUnverifiedInstall
doc-coauthoringanthropics/skillsGuide users through a structured workflow for co-authoring documentation. Use when user wants to write documentation, proposals, technical specs, decision docs, or similar structured content. This workflow helps users efficiently transfer context, refine content through iteration, and verify the doc works for readers. Trigger when user mentions writing docs, creating proposals, drafting specs, or similar documentation tasks.Stars: 198kUpdated Claude CodeCodexVerifiedInstall