monte-carlo-data/mc-agent-toolkit / skills/prevent
monte-carlo-prevent
VerifiedShift-left safety net for dbt/SQL model edits. Runs change impact assessment before edits, generates SQL validation queries after, and executes them via `/mc-validate run`. Delegates health and monitor creation to peer skills.
| File | Kind | Size |
|---|---|---|
| README.md | markdown | 8.3 KB |
| SKILL.md | skill md | 19.0 KB |
| references/TROUBLESHOOTING.md | markdown | 1.5 KB |
| references/parameters.md | markdown | 1.0 KB |
| references/workflows.md | markdown | 36.6 KB |
| scripts/sandbox/classify_sandbox.py | script | 1.5 KB |
| scripts/sandbox/detect_hardcoded_db.py | script | 1.2 KB |
| scripts/sandbox/parse_profiles.py | script | 3.3 KB |
| scripts/sandbox/readonly_check.py | script | 2.3 KB |
| scripts/sandbox/substitute_placeholders.py | script | 3.7 KB |
| scripts/sandbox/tests/conftest.py | script | 256 B |
| scripts/sandbox/tests/test_classify_sandbox.py | script | 1.1 KB |
| scripts/sandbox/tests/test_detect_hardcoded_db.py | script | 1.6 KB |
| scripts/sandbox/tests/test_integration_smoke.py | script | 2.8 KB |
| scripts/sandbox/tests/test_parse_profiles.py | script | 3.1 KB |
| scripts/sandbox/tests/test_readonly_check.py | script | 3.9 KB |
| scripts/sandbox/tests/test_substitute_placeholders.py | script | 3.7 KB |
scripts/sandbox/tests/test_substitute_placeholders.py
View on GitHub"""Tests for substitute_placeholders.py."""
import json
import subprocess
import sys
from pathlib import Path
SCRIPT = Path(__file__).resolve().parents[1] / "substitute_placeholders.py"
def _run(sql_path: Path, dev_db: str) -> tuple[int, dict, str]:
out = subprocess.run(
[sys.executable, str(SCRIPT), str(sql_path), "--dev-db", dev_db],
capture_output=True, text=True,
)
return out.returncode, json.loads(out.stdout or "{}"), out.stderr
SAMPLE = """-- Validation queries
SELECT *
FROM <YOUR_DEV_DATABASE>.prod.client_hub;
SELECT 'dev' AS source, COUNT(*) AS rows FROM <YOUR_DEV_DATABASE>.prod.client_hub
UNION ALL
SELECT 'prod' AS source, COUNT(*) AS rows FROM analytics.prod.client_hub;
"""
def test_substitutes_and_reports_literals(tmp_path):
src = tmp_path / "queries.sql"
src.write_text(SAMPLE)
code, data, _ = _run(src, "PERSONAL_ACHEN")
assert code == 0
assert data["dev_db"] == "PERSONAL_ACHEN"
assert data["replaced_count"] == 2
assert sorted(data["literal_databases"]) == ["analytics"]
out_path = Path(data["output_path"])
contents = out_path.read_text()
assert "<YOUR_DEV_DATABASE>" not in contents
assert "PERSONAL_ACHEN.prod.client_hub" in contents
assert "analytics.prod.client_hub" in contents
def test_no_placeholders_present(tmp_path):
src = tmp_path / "q.sql"
src.write_text("SELECT * FROM analytics.prod.orders;\n")
code, data, _ = _run(src, "PERSONAL_ACHEN")
assert code == 0
assert data["replaced_count"] == 0
assert data["literal_databases"] == ["analytics"]
def test_output_dir_is_run_subdir_by_default(tmp_path):
src = tmp_path / "q.sql"
src.write_text("SELECT 1 FROM <YOUR_DEV_DATABASE>.prod.t;\n")
_, data, _ = _run(src, "DEV_X")
out_path = Path(data["output_path"])
assert out_path.parent == src.parent / "run"
assert out_path.parent.exists()
assert out_path.name == "q.run.sql"
def test_explicit_output_path_respected(tmp_path):
src = tmp_path / "q.sql"
src.write_text("SELECT 1 FROM <YOUR_DEV_DATABASE>.prod.t;\n")
custom = tmp_path / "custom" / "elsewhere.sql"
result = subprocess.run(
[sys.executable, str(SCRIPT), str(src), "--dev-db", "DEV_X", "--output", str(custom)],
capture_output=True, text=True,
)
assert result.returncode == 0
data = json.loads(result.stdout)
out_path = Path(data["output_path"])
assert out_path == custom
assert out_path.exists()
def test_missing_file(tmp_path):
code, _, err = _run(tmp_path / "nope.sql", "PERSONAL_ACHEN")
assert code == 1
assert "not found" in err.lower()
def test_string_literal_db_ref_not_listed(tmp_path):
"""Regression: a db.schema.table inside a string literal must not be
reported as a literal database reference. Such text is data, not a ref."""
src = tmp_path / "q.sql"
src.write_text(
"SELECT * FROM <YOUR_DEV_DATABASE>.prod.t "
"WHERE meta = 'analytics.prod.client_hub';\n"
)
code, data, _ = _run(src, "PERSONAL_ACHEN")
assert code == 0
# The string-literal `'analytics.prod.client_hub'` is data; it must NOT
# surface as a real cross-database reference.
assert data["literal_databases"] == []
def test_string_literal_does_not_mask_real_ref(tmp_path):
"""A real cross-DB ref alongside a string-literal red herring should
still be reported."""
src = tmp_path / "q.sql"
src.write_text(
"SELECT * FROM <YOUR_DEV_DATABASE>.prod.t "
"JOIN analytics.prod.client_hub USING (id) "
"WHERE meta = 'staging.foo.bar';\n"
)
code, data, _ = _run(src, "PERSONAL_ACHEN")
assert code == 0
assert data["literal_databases"] == ["analytics"]
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| deprecation-and-migrationaddyosmani/agent-skillsManages deprecation and migration. Use when removing old systems, APIs, or features. Use when migrating users from one implementation to another. Use when migrating a database schema in production, such as renaming or dropping a column without downtime (expand/contract). Use when deciding whether to maintain or sunset existing code. | Stars: 119k | Updated | Claude CodeCodex | Verified | Install |
| performance-optimizationaddyosmani/agent-skillsOptimizes application performance across frontend, backend, queries, and databases. Use when performance requirements exist, when you suspect performance regressions, when Core Web Vitals or load times need improvement, when N+1 query patterns need fixing, or when profiling reveals bottlenecks. | Stars: 119k | Updated | Claude CodeCodex | Verified | Install |
| agent-cost-reportthedotmack/claude-memBelievable agent cost report for any period, default the last 7 full days PT, not counting today. Measured tokens from Claude Code transcripts priced at OpenRouter list prices (ESTIMATED), measured provider spend when a sanctioned source exists, note-taker cost separate, Timing-style HTML/PDF plus report.json, line-items.csv, evidence.json. | Stars: 118k | Updated | Claude CodeCodex | Verified | Install |
| agent-cost-reportthedotmack/claude-memBelievable agent cost report for any period, default the last 7 full days PT, not counting today. Measured tokens from Claude Code transcripts priced at OpenRouter list prices (ESTIMATED), measured provider spend when a sanctioned source exists, note-taker cost separate, Timing-style HTML/PDF plus report.json, line-items.csv, evidence.json. | Stars: 118k | Updated | Claude CodeCodex | Verified | Install |