a5c-ai/babysitter / library/specializations/data-engineering-analytics/skills/incremental-model-strategy-selector
Incremental Model Strategy Selector
VerifiedSelects and configures optimal incremental model strategies
SKILL.md
View on GitHub---
name: Incremental Model Strategy Selector
description: Selects and configures optimal incremental model strategies
version: 1.0.0
category: Transformation
skillId: SK-DEA-019
allowed-tools:
- Read
- Write
- Edit
- Glob
- Grep
- Bash
graph:
domains: [domain:data-engineering]
specializations: [specialization:data-engineering-analytics]
skillAreas: [skill-area:dbt-modeling, skill-area:etl-pipelines]
roles: [role:analytics-engineer, role:data-engineer]
workflows: [workflow:data-pipeline-deployment]
---
# Incremental Model Strategy Selector
## Overview
Selects and configures optimal incremental model strategies. This skill optimizes data transformation efficiency through proper incremental processing patterns.
## Capabilities
- Incremental strategy selection (append, merge, delete+insert)
- Partition pruning optimization
- Unique key configuration
- On_schema_change handling
- Full refresh scheduling
- Lookback window optimization
- Late-arriving data handling
## Input Schema
```json
{
"modelCharacteristics": {
"sourceType": "string",
"updatePattern": "append|update|delete",
"volumeGB": "number",
"updateFrequency": "string"
},
"platform": "snowflake|bigquery|redshift",
"existingModel": "object"
}
```
## Output Schema
```json
{
"strategy": "append|merge|delete+insert",
"config": "object",
"partitionStrategy": "object",
"refreshSchedule": "object",
"dbtConfig": "object"
}
```
## Target Processes
- Incremental Model Setup
- dbt Model Development
- Pipeline Migration
## Usage Guidelines
1. Analyze source data update patterns
2. Measure data volume and update frequency
3. Select strategy based on characteristics
4. Configure appropriate lookback windows
## Best Practices
- Use append for insert-only sources
- Use merge for sources with updates
- Configure partition pruning for large tables
- Schedule periodic full refreshes for data correction
- Handle late-arriving data with appropriate lookback
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| slack-gif-creatoranthropics/skillsKnowledge and utilities for creating animated GIFs optimized for Slack. Provides constraints, validation tools, and animation concepts. Use when users request animated GIFs for Slack like "make me a GIF of X doing Y for Slack." | Stars: 198k | Updated | Claude CodeCodex | Verified | Install |
| ponytailDietrichGebert/ponytailLazy senior dev mode for any coding task: the smallest change that fully solves it, and a reply a busy human understands in one read. | Stars: 194k | Updated | Claude CodeCodex | Verified | Install |
| ponytail-debtDietrichGebert/ponytailHarvest every shortcut: comment into one debt ledger, so deferrals get tracked instead of forgotten. One-shot report. | Stars: 194k | Updated | Claude CodeCodex | Verified | Install |
| ponytail-debtDietrichGebert/ponytailList every `shortcut:` comment (and older `ponytail:` ones) as a debt ledger. One-shot report, changes nothing. Use for "ponytail debt", "what did ponytail defer", "list the shortcuts", /ponytail-debt. | Stars: 194k | Updated | Claude CodeCodex | Verified | Install |