monte-carlo-data/mc-agent-toolkit / skills/prevent
monte-carlo-prevent
VerifiedShift-left safety net for dbt/SQL model edits. Runs change impact assessment before edits, generates SQL validation queries after, and executes them via `/mc-validate run`. Delegates health and monitor creation to peer skills.
| File | Kind | Size |
|---|---|---|
| README.md | markdown | 8.3 KB |
| SKILL.md | skill md | 19.0 KB |
| references/TROUBLESHOOTING.md | markdown | 1.5 KB |
| references/parameters.md | markdown | 1.0 KB |
| references/workflows.md | markdown | 36.6 KB |
| scripts/sandbox/classify_sandbox.py | script | 1.5 KB |
| scripts/sandbox/detect_hardcoded_db.py | script | 1.2 KB |
| scripts/sandbox/parse_profiles.py | script | 3.3 KB |
| scripts/sandbox/readonly_check.py | script | 2.3 KB |
| scripts/sandbox/substitute_placeholders.py | script | 3.7 KB |
| scripts/sandbox/tests/conftest.py | script | 256 B |
| scripts/sandbox/tests/test_classify_sandbox.py | script | 1.1 KB |
| scripts/sandbox/tests/test_detect_hardcoded_db.py | script | 1.6 KB |
| scripts/sandbox/tests/test_integration_smoke.py | script | 2.8 KB |
| scripts/sandbox/tests/test_parse_profiles.py | script | 3.1 KB |
| scripts/sandbox/tests/test_readonly_check.py | script | 3.9 KB |
| scripts/sandbox/tests/test_substitute_placeholders.py | script | 3.7 KB |
README.md
View on GitHub# Monte Carlo Prevent Skill
Bring Monte Carlo data observability into your editor — automatically, before you write a single line of code.
## What this does
When you reference a dbt model or table, Monte Carlo context comes to you: table health, active alerts, lineage, and downstream blast radius. Your AI editor uses that context to shape the code it writes — not just surface it. If you try to rename a column with 500 downstream dependents, the editor recommends a safe transition strategy and explains why, citing the specific MC data it found. When you add new logic, it generates and deploys the right monitor for your logic — validation, metric, comparison, or custom SQL — before you merge. When you're done with a change, it generates targeted validation queries — tailored to the specific columns, filters, and business logic you modified — so you can verify the change behaved as intended before merging.
## Editor & Stack Compatibility
The skill works with any AI editor that supports MCP and the Agent Skills format — including Claude Code, Cursor, and VS Code.
For data stacks, compatibility varies by how you work:
| Stack | Support | Notes |
|---|---|---|
| dbt + any MC-supported warehouse | ✅ Full | Optimized and tested |
| SQL-first, no dbt | 🟡 Partial | Core workflows work via explicit prompting; auto-triggers on file open coming soon |
| Databricks notebooks | 🟡 Partial | Health check, impact assessment, and alert triage work; file-based triggers coming soon |
| SQLMesh | 🟡 Partial | Core workflows work; native SQLMesh project structure support coming soon |
| PySpark / non-SQL pipelines | 🟠 Limited | Manual prompting only; broader support on the roadmap |
**Coming shortly:** Generic SQL file triggers, Databricks notebook support, and SQLMesh project structure support — so auto-activation works regardless of your transformation tool.
Core workflows — table health check, change impact assessment, alert triage, and monitor generation — work for any warehouse supported by Monte Carlo.
## Prerequisites
- Claude Code, Cursor, VS Code or any editors with MCP support
- Monte Carlo account with Editor role or above
- [MC CLI](https://docs.getmontecarlo.com/docs/using-the-cli) installed for monitor deployment (`pip install montecarlodata`)
## Setup
### Via the mc-agent-toolkit plugin (recommended)
Install the plugin for your editor — it bundles the skill, hooks, MCP server, and permissions automatically. See the [main README](../../README.md#installing-the-plugin-recommended) for editor-specific instructions.
### Standalone
1. Configure the Monte Carlo MCP server:
```
claude mcp add --transport http monte-carlo-mcp https://mcp.getmontecarlo.com/mcp
```
2. Install the skill:
```bash
npx skills add monte-carlo-data/mc-agent-toolkit --skill prevent
```
3. Authenticate: run `/mcp` in your editor, select `monte-carlo-mcp`, and complete the OAuth flow.
4. Verify: ask your editor "Test my Monte Carlo connection" — it should call `testConnection` and confirm.
<details>
<summary>Legacy: header-based auth (for MCP clients without HTTP transport)</summary>
If your MCP client doesn't support HTTP transport, use `.mcp.json.example` with `npx mcp-remote` and header-based authentication. See the [MCP server docs](https://docs.getmontecarlo.com/docs/mcp-server) for details.
</details>
## How to use it
Open your dbt project (or any data engineering codebase) in your editor. Describe the change you want to make — or reference a model file together with an edit (`@models/orders.sql add a column`). The skill activates automatically when you express change intent; no special commands needed.
### End-to-end flow
```mermaid
flowchart TD
A["Describe a<br/>change"] --> B["Fetch table<br/>context<br/>(silent)"]
B --> C["Impact<br/>assessment"]
C --> D{"Proceed?"}
D -- yes --> E["Edit<br/>applied"]
E --> P["Post-edit prompt:<br/>generate validation<br/>queries?<br/>add monitor?"]
P -- yes --> H["Generate<br/>validation queries"]
P -- yes --> G["Generate<br/>monitor"]
H --> R{"Run<br/>queries?"}
R -- yes --> S["Build & run"]
```
**Impact assessment** — Before any SQL edit (including filter changes, bugfixes, reverts, and parameter tweaks), prevent surfaces the change's blast radius: downstream models, active alerts, column exposure in recent queries, and monitor coverage. You get a risk tier (High / Medium / Low) and a recommendation tied to your specific change. If the data suggests your approach is risky, Claude proposes a safer alternative.
**Validation queries** — When you're ready to test a change, say "generate validation queries", "validate this change", or run `/mc-validate`. Prevent generates 3–5 targeted SQL queries based on what you actually changed — null checks, before/after row counts, distribution checks — saved to `validation/<table_name>_<timestamp>.sql` with inline comments describing a passing result.
**Monitor coverage** — After you finish an edit, if the impact assessment found a coverage gap, prevent prompts you to add a monitor. On yes, it hands off to `monte-carlo-monitoring-advisor` to produce a validation, metric, comparison, or custom SQL monitor as code.
**Validate in sandbox (`/mc-validate run`)** — Two-phase workflow. Run `/mc-validate` first to generate the queries, then `/mc-validate run` to execute them:
- **Build** — parses your `profiles.yml`, classifies the resolved database, and runs `dbt build --select <model>` into your dev database.
- **Execute** — substitutes `<YOUR_DEV_DATABASE>` in the generated SQL with a user-confirmed value, runs each query through the Snowflake MCP, and reports findings.
> ⚠️ **Heads up on prod vs. dev detection.** The build phase classifies your
> resolved target as `personal` / `dev` / `shared-dev` / `prod` / `unknown`
> from your `profiles.yml` and any hard-coded `{{ config(database=...) }}`,
> and hard-stops if it lands on `prod`. This is a safety net, not a
> guarantee — naming conventions vary across orgs and the classifier can be
> wrong (especially on `unknown`). **You are still responsible for confirming
> the target database before approving the build.** Read the value the skill
> surfaces and don't approve if it doesn't match where you intend to write.
**Invocation modes:**
| Command | What it does |
|---|---|
| `/mc-validate` | Default = generate. Runs query generation only. |
| `/mc-validate generate` | Explicit generate. Same as above. |
| `/mc-validate run` | Runs **Build + Execute**. Requires queries already generated. |
| `/mc-validate run --skip-build` | Runs **Execute only** — assumes you built manually. Requires queries already generated. |
| `/mc-validate run --dev-db <NAME>` | Same as `run`, bypasses the dev-database prompt in Execute. |
#### `/mc-validate run` prerequisites
The `run` subcommand only works if all three of the following are in place — otherwise the flow will fail mid-build with a confusing error. Verify before invoking:
- **dbt installed** and a `dbt_project.yml` discoverable from the changed model (the workflow walks up from the model file to find it).
- **`profiles.yml`** present (typically in `~/.dbt/profiles.yml`) with a working Snowflake target. The skill parses it to resolve your dev database.
- **Snowflake MCP server** registered in the editor session, with a tool that runs a SQL query — the skill looks for a Snowflake server among the session's tools by name and description, since each editor spells tool IDs differently. If it is missing at pre-flight, the run aborts before the build. If the server becomes unavailable while queries run, the substituted SQL is left on disk for you to run manually.
The `run` subcommand performs a connection pre-flight check before kicking off the build. If any prerequisite is missing, it aborts early and tells you what to fix — rather than failing after a partial build.
### Deploying generated monitors
When Claude generates a monitor, it saves the YAML to `monitors/<table>.yml`. Deploy with:
```bash
montecarlo monitors apply --dry-run # preview
montecarlo monitors apply --auto-yes # apply
```
Your project needs a `montecarlo.yml` config in the working directory:
```yaml
version: 1
namespace: <your-namespace>
default_resource: <your-warehouse-name>
```
## Troubleshooting
See [TROUBLESHOOTING.md](TROUBLESHOOTING.md) for common setup and runtime issues.
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| deprecation-and-migrationaddyosmani/agent-skillsManages deprecation and migration. Use when removing old systems, APIs, or features. Use when migrating users from one implementation to another. Use when migrating a database schema in production, such as renaming or dropping a column without downtime (expand/contract). Use when deciding whether to maintain or sunset existing code. | Stars: 119k | Updated | Claude CodeCodex | Verified | Install |
| performance-optimizationaddyosmani/agent-skillsOptimizes application performance across frontend, backend, queries, and databases. Use when performance requirements exist, when you suspect performance regressions, when Core Web Vitals or load times need improvement, when N+1 query patterns need fixing, or when profiling reveals bottlenecks. | Stars: 119k | Updated | Claude CodeCodex | Verified | Install |
| agent-cost-reportthedotmack/claude-memBelievable agent cost report for any period, default the last 7 full days PT, not counting today. Measured tokens from Claude Code transcripts priced at OpenRouter list prices (ESTIMATED), measured provider spend when a sanctioned source exists, note-taker cost separate, Timing-style HTML/PDF plus report.json, line-items.csv, evidence.json. | Stars: 118k | Updated | Claude CodeCodex | Verified | Install |
| agent-cost-reportthedotmack/claude-memBelievable agent cost report for any period, default the last 7 full days PT, not counting today. Measured tokens from Claude Code transcripts priced at OpenRouter list prices (ESTIMATED), measured provider spend when a sanctioned source exists, note-taker cost separate, Timing-style HTML/PDF plus report.json, line-items.csv, evidence.json. | Stars: 118k | Updated | Claude CodeCodex | Verified | Install |