Skip to content

a5c-ai/babysitter / library/specializations/data-engineering-analytics/skills/incremental-model-strategy-selector

Incremental Model Strategy Selector

Verified

Selects and configures optimal incremental model strategies

Incremental Model Strategy Selector

Overview

Selects and configures optimal incremental model strategies. This skill optimizes data transformation efficiency through proper incremental processing patterns.

Capabilities

  • Incremental strategy selection (append, merge, delete+insert)
  • Partition pruning optimization
  • Unique key configuration
  • On_schema_change handling
  • Full refresh scheduling
  • Lookback window optimization
  • Late-arriving data handling

Input Schema

{
  "modelCharacteristics": {
    "sourceType": "string",
    "updatePattern": "append|update|delete",
    "volumeGB": "number",
    "updateFrequency": "string"
  },
  "platform": "snowflake|bigquery|redshift",
  "existingModel": "object"
}

Output Schema

{
  "strategy": "append|merge|delete+insert",
  "config": "object",
  "partitionStrategy": "object",
  "refreshSchedule": "object",
  "dbtConfig": "object"
}

Target Processes

  • Incremental Model Setup
  • dbt Model Development
  • Pipeline Migration

Usage Guidelines

  1. Analyze source data update patterns
  2. Measure data volume and update frequency
  3. Select strategy based on characteristics
  4. Configure appropriate lookback windows

Best Practices

  • Use append for insert-only sources
  • Use merge for sources with updates
  • Configure partition pruning for large tables
  • Schedule periodic full refreshes for data correction
  • Handle late-arriving data with appropriate lookback
slack-gif-creatoranthropics/skillsKnowledge and utilities for creating animated GIFs optimized for Slack. Provides constraints, validation tools, and animation concepts. Use when users request animated GIFs for Slack like "make me a GIF of X doing Y for Slack."Stars: 197kUpdated Claude CodeCodexVerifiedInstall
ponytailDietrichGebert/ponytailLazy senior dev mode for any coding task: the smallest change that fully solves it, and a reply a busy human understands in one read.Stars: 194kUpdated Claude CodeCodexVerifiedInstall
ponytail-debtDietrichGebert/ponytailHarvest every shortcut: comment into one debt ledger, so deferrals get tracked instead of forgotten. One-shot report.Stars: 194kUpdated Claude CodeCodexVerifiedInstall
ponytail-debtDietrichGebert/ponytailList every `shortcut:` comment (and older `ponytail:` ones) as a debt ledger. One-shot report, changes nothing. Use for "ponytail debt", "what did ponytail defer", "list the shortcuts", /ponytail-debt.Stars: 194kUpdated Claude CodeCodexVerifiedInstall