monte-carlo-data/mc-agent-toolkit / skills/push-ingestion
push-ingestion
VerifiedExpert guide for Monte Carlo's push ingestion model. Use this skill whenever a customer or engineer mentions: pushing data to Monte Carlo, the IngestionService, pycarlo push APIs, build me a collection script, push metadata/lineage/query logs, invocation_id tracing, custom lineage nodes or edges, deleting push tables, or any question about why pushed data is not showing up. Also trigger when they ask to generate code that collects metadata, table schema, row counts, freshness, lineage, or query history from any data warehouse or data source and sends it to Monte Carlo. If the user mentions any warehouse, database, or data platform alongside any Monte Carlo topic, this skill is almost certainly relevant.
README.md
View on GitHub# Push Ingestion Skill
Generate warehouse-specific collection scripts and push metadata, lineage, and query logs to Monte Carlo via the push ingestion API. Works with any data source — if a ready-made template doesn't exist, the skill derives collection queries from the warehouse's system catalog.
## What it does
When you discuss push ingestion in conversation, this skill automatically guides you through:
- Setting up the required API keys
- Generating collection scripts tailored to your warehouse
- Pushing metadata, lineage, and query logs to Monte Carlo
- Validating that pushed data is visible in the platform
- Managing custom lineage nodes and edges
- Deleting push-ingested tables when needed
## Prerequisites
- Claude Code or any MCP-capable editor
- Monte Carlo account with API access
- Two separate API keys:
1. **Ingestion key** — for pushing data (`montecarlo integrations create-key --scope Ingestion`)
2. **GraphQL API key** — for verification queries (create at https://getmontecarlo.com/settings/api)
- Access to your data warehouse
See [prerequisites.md](references/prerequisites.md) for full setup instructions.
## Setup
### Via the mc-agent-toolkit plugin (recommended)
Install the plugin for your editor — see the [main README](../../README.md) for instructions. The skill is bundled automatically.
### Standalone
Copy the skill to your local skills directory:
```bash
cp -r skills/push-ingestion ~/.claude/skills/push-ingestion
```
## Available slash commands
When installed via the Claude Code plugin, these slash commands are available:
| Command | Description |
|---|---|
| `/mc-build-metadata-collector` | Generate a metadata collection script for your warehouse |
| `/mc-build-lineage-collector` | Generate a lineage collection script |
| `/mc-build-query-log-collector` | Generate a query log collection script |
| `/mc-validate-metadata` | Verify pushed metadata via the Monte Carlo GraphQL API |
| `/mc-validate-lineage` | Verify pushed lineage via the Monte Carlo GraphQL API |
| `/mc-validate-query-logs` | Verify pushed query logs via the Monte Carlo GraphQL API |
| `/mc-create-lineage-node` | Create a custom lineage node |
| `/mc-create-lineage-edge` | Create a custom lineage edge |
| `/mc-delete-lineage-node` | Delete a custom lineage node |
| `/mc-delete-push-tables` | Delete push-ingested tables |
## Supported warehouses
The skill includes templates for common warehouses under `scripts/templates/`. For warehouses without templates, the Snowflake template is used as the canonical reference and adapted to the target warehouse's system catalog.
See the [SKILL.md](SKILL.md) for detailed workflow instructions and template usage.
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| deprecation-and-migrationaddyosmani/agent-skillsManages deprecation and migration. Use when removing old systems, APIs, or features. Use when migrating users from one implementation to another. Use when migrating a database schema in production, such as renaming or dropping a column without downtime (expand/contract). Use when deciding whether to maintain or sunset existing code. | Stars: 119k | Updated | Claude CodeCodex | Verified | Install |
| performance-optimizationaddyosmani/agent-skillsOptimizes application performance across frontend, backend, queries, and databases. Use when performance requirements exist, when you suspect performance regressions, when Core Web Vitals or load times need improvement, when N+1 query patterns need fixing, or when profiling reveals bottlenecks. | Stars: 119k | Updated | Claude CodeCodex | Verified | Install |
| agent-cost-reportthedotmack/claude-memBelievable agent cost report for any period, default the last 7 full days PT, not counting today. Measured tokens from Claude Code transcripts priced at OpenRouter list prices (ESTIMATED), measured provider spend when a sanctioned source exists, note-taker cost separate, Timing-style HTML/PDF plus report.json, line-items.csv, evidence.json. | Stars: 118k | Updated | Claude CodeCodex | Verified | Install |
| agent-cost-reportthedotmack/claude-memBelievable agent cost report for any period, default the last 7 full days PT, not counting today. Measured tokens from Claude Code transcripts priced at OpenRouter list prices (ESTIMATED), measured provider spend when a sanctioned source exists, note-taker cost separate, Timing-style HTML/PDF plus report.json, line-items.csv, evidence.json. | Stars: 118k | Updated | Claude CodeCodex | Verified | Install |