a5c-ai/babysitter / library/specializations/data-engineering-analytics/skills/incremental-model-strategy-selector
Incremental Model Strategy Selector
VerifiedSelects and configures optimal incremental model strategies
Incremental Model Strategy Selector
Overview
Selects and configures optimal incremental model strategies. This skill optimizes data transformation efficiency through proper incremental processing patterns.
Capabilities
- Incremental strategy selection (append, merge, delete+insert)
- Partition pruning optimization
- Unique key configuration
- On_schema_change handling
- Full refresh scheduling
- Lookback window optimization
- Late-arriving data handling
Input Schema
{
"modelCharacteristics": {
"sourceType": "string",
"updatePattern": "append|update|delete",
"volumeGB": "number",
"updateFrequency": "string"
},
"platform": "snowflake|bigquery|redshift",
"existingModel": "object"
}
Output Schema
{
"strategy": "append|merge|delete+insert",
"config": "object",
"partitionStrategy": "object",
"refreshSchedule": "object",
"dbtConfig": "object"
}
Target Processes
- Incremental Model Setup
- dbt Model Development
- Pipeline Migration
Usage Guidelines
- Analyze source data update patterns
- Measure data volume and update frequency
- Select strategy based on characteristics
- Configure appropriate lookback windows
Best Practices
- Use append for insert-only sources
- Use merge for sources with updates
- Configure partition pruning for large tables
- Schedule periodic full refreshes for data correction
- Handle late-arriving data with appropriate lookback
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| slack-gif-creatoranthropics/skillsKnowledge and utilities for creating animated GIFs optimized for Slack. Provides constraints, validation tools, and animation concepts. Use when users request animated GIFs for Slack like "make me a GIF of X doing Y for Slack." | Stars: 197k | Updated | Claude CodeCodex | Verified | Install |
| ponytailDietrichGebert/ponytailLazy senior dev mode for any coding task: the smallest change that fully solves it, and a reply a busy human understands in one read. | Stars: 194k | Updated | Claude CodeCodex | Verified | Install |
| ponytail-debtDietrichGebert/ponytailHarvest every shortcut: comment into one debt ledger, so deferrals get tracked instead of forgotten. One-shot report. | Stars: 194k | Updated | Claude CodeCodex | Verified | Install |
| ponytail-debtDietrichGebert/ponytailList every `shortcut:` comment (and older `ponytail:` ones) as a debt ledger. One-shot report, changes nothing. Use for "ponytail debt", "what did ponytail defer", "list the shortcuts", /ponytail-debt. | Stars: 194k | Updated | Claude CodeCodex | Verified | Install |