Skip to content

a5c-ai/babysitter / library/specializations/code-migration-modernization/skills/data-migration-validator

data-migration-validator

Unverified

Validate data integrity during and after migration with comprehensive verification checks

Data Migration Validator Skill

Validates data integrity throughout the migration process with comprehensive verification checks and reconciliation reporting.

Purpose

Enable data validation for:

  • Row count validation
  • Checksum verification
  • Sample data comparison
  • Referential integrity checking
  • Business rule validation

Capabilities

1. Row Count Validation

  • Compare source/target counts
  • Track by table/partition
  • Identify discrepancies
  • Generate count reports

2. Checksum Verification

  • Calculate table checksums
  • Compare hash values
  • Identify data drift
  • Verify data consistency

3. Sample Data Comparison

  • Random sample selection
  • Field-by-field comparison
  • Statistical sampling
  • Confidence scoring

4. Referential Integrity Checking

  • Verify foreign keys
  • Check orphaned records
  • Validate relationships
  • Report violations

5. Business Rule Validation

  • Apply custom rules
  • Check data constraints
  • Verify transformations
  • Validate calculations

6. Reconciliation Reporting

  • Generate audit reports
  • Track discrepancies
  • Document exceptions
  • Provide sign-off reports

Tool Integrations

ToolPurposeIntegration Method
Great ExpectationsData validationLibrary
dbt testsTransform validationCLI
Custom SQLDatabase checksCLI
DataGripManual verificationGUI
Apache GriffinData qualityAPI

Output Schema

{
  "validationId": "string",
  "timestamp": "ISO8601",
  "results": {
    "rowCounts": {
      "tables": [
        {
          "name": "string",
          "source": "number",
          "target": "number",
          "match": "boolean"
        }
      ]
    },
    "checksums": {
      "tables": [],
      "overall": "string"
    },
    "samples": {
      "checked": "number",
      "matched": "number",
      "discrepancies": []
    },
    "referentialIntegrity": {
      "valid": "boolean",
      "violations": []
    },
    "businessRules": {
      "passed": "number",
      "failed": "number",
      "failures": []
    }
  },
  "summary": {
    "status": "passed|failed|warning",
    "score": "number"
  }
}

Integration with Migration Processes

  • database-schema-migration: Post-migration validation
  • cloud-migration: Data validation

Related Skills

  • schema-comparator: Pre-migration comparison
  • etl-pipeline-builder: Migration execution

Related Agents

  • data-integrity-validator: Orchestrates validation
  • database-migration-orchestrator: Uses for verification
slack-gif-creatoranthropics/skillsKnowledge and utilities for creating animated GIFs optimized for Slack. Provides constraints, validation tools, and animation concepts. Use when users request animated GIFs for Slack like "make me a GIF of X doing Y for Slack."Stars: 195kUpdated Claude CodeCodexVerifiedInstall
ponytailDietrichGebert/ponytailLazy senior dev mode for any coding task: the smallest change that fully solves it, and a reply a busy human understands in one read.Stars: 192kUpdated Claude CodeCodexVerifiedInstall
ponytail-debtDietrichGebert/ponytailHarvest every shortcut: comment into one debt ledger, so deferrals get tracked instead of forgotten. One-shot report.Stars: 192kUpdated Claude CodeCodexVerifiedInstall
ponytail-debtDietrichGebert/ponytailList every `shortcut:` comment (and older `ponytail:` ones) as a debt ledger. One-shot report, changes nothing. Use for "ponytail debt", "what did ponytail defer", "list the shortcuts", /ponytail-debt.Stars: 192kUpdated Claude CodeCodexVerifiedInstall