DataWithBaraa/claude-code-data-engineering-skills / skills/big-review
big-review
VerifiedUse once a month, or when the platform feels slow, heavy or cluttered, to review the whole platform from the query logs and the repo, and propose improvements with effort and risk.
| File | Kind | Size |
|---|---|---|
| SKILL.md | skill md | 1.6 KB |
| references/big-review.html | other | 38.8 KB |
| references/fonts/BricolageGrotesque-700.woff2 | binary | 75.1 KB |
| references/fonts/JetBrainsMono-500.woff2 | binary | 30.6 KB |
references/big-review.html
View on GitHub<!DOCTYPE html>
<html lang="en">
<head>
<meta charset="utf-8">
<title>Big review, 2026-08</title>
<style>
@font-face{font-family:'Bricolage Grotesque';font-weight:200 800;font-display:block;src:url('fonts/BricolageGrotesque-700.woff2') format('woff2');}
@font-face{font-family:'JetBrains Mono';font-weight:100 800;font-display:block;src:url('fonts/JetBrainsMono-500.woff2') format('woff2');}
*{margin:0;padding:0;box-sizing:border-box;}
:root{--bg:#0f0a1e;--ink:#ece7f8;--ink-2:rgba(236,231,248,.72);--line:rgba(236,231,248,.14);--line-2:rgba(236,231,248,.08);
--purple:#8a63f2;--red:#ff8a73;--orange:#ffa657;--green:#5fe3a1;--gold:#ffd23f;
--gh-bg:#0d1117;--gh-head:#161b22;--gh-line:#30363d;--gh-text:#e6edf3;--gh-kw:#569cd6;--gh-fn:#d2a8ff;--gh-num:#79c0ff;--gh-cm:#8b949e;--gh-gutter:#6e7681;}
html{background:var(--bg);scroll-behavior:smooth;}
body{font-family:'Bricolage Grotesque',sans-serif;font-weight:400;color:var(--ink);background:var(--bg);font-size:20px;line-height:1.5;-webkit-font-smoothing:antialiased;}
.id,code{font-family:'JetBrains Mono',monospace;font-variant-ligatures:none;}
.id{font-size:.95em;color:var(--ink);white-space:nowrap;}
/* the navigation */
nav{position:fixed;top:0;left:0;bottom:0;width:260px;padding:44px 24px 40px 36px;border-right:1px solid var(--line);z-index:5;}
nav.rail{position:fixed;}
nav .brand{font-size:22px;font-weight:700;line-height:1.2;padding-left:14px;}
nav ul{list-style:none;margin-top:36px;}
nav li a{display:block;padding:10px 14px;border-radius:8px;font-size:20px;color:var(--ink-2);text-decoration:none;}
nav li a:hover{color:var(--ink);background:rgba(236,231,248,.05);}
nav li a.on{color:var(--ink);background:rgba(138,99,242,.2);}
/* the page */
main{margin-left:calc(260px + max(0px, (100vw - 1720px) / 2));padding:60px 60px 140px;max-width:1460px;}
h1{font-size:46px;font-weight:700;letter-spacing:-.02em;line-height:1.05;}
.kpis{margin-top:36px;margin-bottom:102px;display:grid;grid-template-columns:repeat(6,minmax(0,1fr));border-top:1px solid var(--line);border-bottom:1px solid var(--line);}
.kpi{padding:22px 20px 22px 0;}
.kpi + .kpi{border-left:1px solid var(--line);padding-left:22px;}
.kpi .l{font-size:19px;color:var(--ink-2);}
.kpi .v{margin-top:8px;font-size:36px;font-weight:700;line-height:1;letter-spacing:-.01em;}
.kpi .v.red{color:var(--red);}
/* a group is the space between nav entries; a screen is a title, one sentence, one chart or one table */
section.g{scroll-margin-top:40px;}
section.g + section.g{margin-top:120px;}
.s{margin-top:72px;scroll-margin-top:40px;}
.s h3{font-size:30px;font-weight:700;letter-spacing:-.01em;line-height:1.15;}
.s .one{margin-top:8px;font-size:22px;line-height:1.45;color:var(--ink);font-weight:600;max-width:1100px;text-wrap:pretty;}
.chart{margin-top:28px;}
/* charts */
svg text{font-family:'Bricolage Grotesque',sans-serif;}
svg .lbl{font-size:20px;fill:var(--ink);}
svg .lbl tspan.m{font-family:'JetBrains Mono',monospace;font-size:19px;}
svg .val{font-family:'JetBrains Mono',monospace;font-size:19px;fill:var(--ink);}
svg .bar{fill:var(--purple);} svg .bar.red{fill:var(--red);}
svg .axis{font-size:19px;font-weight:600;fill:var(--ink-2);}
/* tables */
table.t{width:100%;border-collapse:collapse;}
.t th{font-size:19px;font-weight:600;color:var(--ink-2);text-align:left;padding:0 40px 12px 0;border-bottom:1px solid var(--line);white-space:nowrap;}
.t th.grow{width:100%;}
.t td{padding:12px 40px 12px 0;border-bottom:1px solid var(--line-2);vertical-align:baseline;font-size:20px;line-height:1.45;white-space:nowrap;}
.t td.wrap,.t td.m.wrap{white-space:normal;}
.t td.m.wrap{text-wrap:balance;}
.t td.m{font-family:'JetBrains Mono',monospace;font-size:19px;white-space:nowrap;}
.t td.dim{color:var(--ink-2);}
.t th.num,.t td.num{text-align:right;}
.t td.num{font-family:'JetBrains Mono',monospace;font-size:19px;white-space:nowrap;}
.t td.no{font-family:'JetBrains Mono',monospace;font-size:19px;color:var(--ink-2);}
.t td.w{font-weight:600;white-space:nowrap;}
.t td.w.retire{color:var(--red);} .t td.w.archive,.t td.w.revisit,.t td.w.medium{color:var(--orange);} .t td.w.close,.t td.w.low,.t td.w.drop{color:var(--ink-2);}
.t td .rec{display:inline-block;margin-left:14px;font-size:18px;font-weight:600;padding:2px 10px;border-radius:6px;background:var(--gold);color:var(--bg);vertical-align:1px;}
/* code, GitHub dark */
.code{background:var(--gh-bg);border:1px solid var(--gh-line);border-radius:8px;font-family:'JetBrains Mono',monospace;font-variant-ligatures:none;font-size:18px;line-height:1.7;color:var(--gh-text);overflow:hidden;}
.code .hd{font-size:18px;color:var(--gh-cm);padding:8px 16px;border-bottom:1px solid var(--gh-line);background:var(--gh-head);}
.code .lines{padding:6px 0 8px;}
.ln{display:grid;grid-template-columns:60px minmax(0,1fr);}
.ln .num{text-align:right;padding-right:18px;color:var(--gh-gutter);}
.ln .src{white-space:pre;}
.kw{color:var(--gh-kw);} .fn{color:var(--gh-fn);} .nu{color:var(--gh-num);}
.t td.dim .id{color:inherit;}
.chart svg{display:block;}
/* the pipeline of checks */
.layers{display:flex;align-items:stretch;}
.layers .arr{flex:none;width:40px;align-self:center;color:var(--ink-2);}
.layer{flex:1;min-width:0;border:1px solid var(--plate-border);border-radius:10px;padding:16px 16px 18px;background:var(--plate);}
.layer .nm{font-family:'JetBrains Mono',monospace;font-size:19px;}
.layer .cnt{margin-top:8px;font-size:40px;font-weight:700;line-height:1;}
.layer.empty{border:2px dashed var(--red);background:none;padding:15px 15px 17px;}
.layer.empty .cnt{color:var(--red);}
svg .bar.dim{fill:rgba(236,231,248,.16);}
svg .tm{fill:#fff;}
svg .lbl.tm{font-weight:600;}
/* the ground, from the insight series: a radial purple ground, a faint grid, plates with a purple edge */
:root{--ground:#080513;--plate:linear-gradient(160deg,#1b1436 0%,#110c24 100%);--plate-border:rgba(138,99,242,.28);--red:#ff8a73;}
html{background:var(--ground);}
body{background:var(--ground);}
body{position:relative;min-height:100%;}
body::before{content:'';position:absolute;left:0;right:0;top:0;height:min(1600px,100%);z-index:0;pointer-events:none;
background:radial-gradient(1500px 900px at 50% 420px,#161033 0%,#0e0a1d 55%,rgba(8,5,19,0) 100%);}
body::after{content:'';position:fixed;inset:0;z-index:0;pointer-events:none;
background-image:linear-gradient(rgba(173,150,255,.05) 1.2px,transparent 1.2px),linear-gradient(90deg,rgba(173,150,255,.05) 1.2px,transparent 1.2px);
background-size:46px 46px;}
main,nav{position:relative;z-index:1;}
nav{position:fixed;}
</style>
</head>
<body>
<nav><div class="brand">Big review</div>
<ul><li><a href="#top">Usage</a></li><li><a href="#tables">Unused data</a></li><li><a href="#deadcode">Dead code</a></li><li><a href="#health">Code health</a></li><li><a href="#quality">Data quality</a></li><li><a href="#proposals">Proposals</a></li></ul></nav>
<main id="top">
<h1>Newvolt data platform, 2026-08</h1>
<div class="kpis"><div class="kpi"><div class="l">queries</div><div class="v">3,032</div></div><div class="kpi"><div class="l">rows scanned</div><div class="v">275 M</div></div><div class="kpi"><div class="l">unused tables</div><div class="v red">11</div></div><div class="kpi"><div class="l">unused functions</div><div class="v red">11</div></div><div class="kpi"><div class="l">gold layer checks</div><div class="v red">0</div></div><div class="kpi"><div class="l">proposals</div><div class="v">14</div></div></div>
<section class="g" id="usage">
<div class="s" id="u1"><h3>Top 10 tables by query count</h3><p class="one">30 % of all queries read <span class="id">obt_order_lines</span>.</p><div class="chart"><svg viewBox="0 0 1340 450" width="100%" role="img"><text x="0" y="28" class="lbl"><tspan class="m">obt_order_lines</tspan></text><rect x="272" y="10" width="760.0" height="26" rx="5.0" class="bar"/><text x="1046.0" y="28" class="val">923</text><text x="0" y="74" class="lbl"><tspan class="m">metric_trading</tspan></text><rect x="272" y="56" width="382.9" height="26" rx="5.0" class="bar"/><text x="668.9" y="74" class="val">465</text><text x="0" y="120" class="lbl"><tspan class="m">dim_products</tspan></text><rect x="272" y="102" width="276.7" height="26" rx="5.0" class="bar"/><text x="562.7" y="120" class="val">336</text><text x="0" y="166" class="lbl"><tspan class="m">dim_customers</tspan></text><rect x="272" y="148" width="189.4" height="26" rx="5.0" class="bar"/><text x="475.4" y="166" class="val">230</text><text x="0" y="212" class="lbl"><tspan class="m">shipments</tspan></text><rect x="272" y="194" width="164.7" height="26" rx="5.0" class="bar"/><text x="450.7" y="212" class="val">200</text><text x="0" y="258" class="lbl"><tspan class="m">fact_order_lines</tspan></text><rect x="272" y="240" width="164.7" height="26" rx="5.0" class="bar"/><text x="450.7" y="258" class="val">200</text><text x="0" y="304" class="lbl"><tspan class="m">web_events</tspan></text><rect x="272" y="286" width="132.6" height="26" rx="5.0" class="bar"/><text x="418.6" y="304" class="val">161</text><text x="0" y="350" class="lbl"><tspan class="m">tickets</tspan></text><rect x="272" y="332" width="98.8" height="26" rx="5.0" class="bar"/><text x="384.8" y="350" class="val">120</text><text x="0" y="396" class="lbl"><tspan class="m">returns</tspan></text><rect x="272" y="378" width="82.3" height="26" rx="5.0" class="bar"/><text x="368.3" y="396" class="val">100</text><text x="0" y="442" class="lbl"><tspan class="m">stock_daily</tspan></text><rect x="272" y="424" width="81.5" height="26" rx="5.0" class="bar"/><text x="367.5" y="442" class="val">99</text></svg></div></div>
<div class="s" id="u2"><h3>Top 10 slowest queries</h3><p class="one">The slowest query, sessions of one customer on <span class="id">web_events</span>, takes 3.8 seconds on average.</p><div class="chart"><svg viewBox="0 0 1340 450" width="100%" role="img"><text x="0" y="28" class="lbl">sessions of one customer on <tspan class="m">web_events</tspan></text><rect x="641" y="10" width="539.0" height="26" rx="5.0" class="bar red"/><text x="1194.0" y="28" class="val">3.8 s</text><text x="0" y="74" class="lbl">by <tspan class="m">channel</tspan> on <tspan class="m">fact_order_lines</tspan></text><rect x="641" y="56" width="207.6" height="26" rx="5.0" class="bar"/><text x="862.6" y="74" class="val">1.5 s</text><text x="0" y="120" class="lbl">by <tspan class="m">sales_day</tspan> and <tspan class="m">ship_country</tspan> on <tspan class="m">rpt_daily_sales_wide</tspan></text><rect x="641" y="102" width="201.6" height="26" rx="5.0" class="bar"/><text x="856.6" y="120" class="val">1.4 s</text><text x="0" y="166" class="lbl">by <tspan class="m">customer_type</tspan> on <tspan class="m">fact_order_lines</tspan></text><rect x="641" y="148" width="196.5" height="26" rx="5.0" class="bar"/><text x="851.5" y="166" class="val">1.4 s</text><text x="0" y="212" class="lbl">by <tspan class="m">order_month</tspan> and <tspan class="m">ship_country</tspan> on <tspan class="m">obt_order_lines</tspan></text><rect x="641" y="194" width="196.0" height="26" rx="5.0" class="bar"/><text x="851.0" y="212" class="val">1.4 s</text><text x="0" y="258" class="lbl">by <tspan class="m">year_month</tspan> on <tspan class="m">fact_order_lines</tspan></text><rect x="641" y="240" width="193.0" height="26" rx="5.0" class="bar"/><text x="848.0" y="258" class="val">1.4 s</text><text x="0" y="304" class="lbl">row count and latest date on <tspan class="m">orders</tspan></text><rect x="641" y="286" width="143.6" height="26" rx="5.0" class="bar"/><text x="798.6" y="304" class="val">1.0 s</text><text x="0" y="350" class="lbl">by <tspan class="m">home_country</tspan> and <tspan class="m">signup_channel</tspan> on <tspan class="m">dim_customers</tspan></text><rect x="641" y="332" width="48.8" height="26" rx="5.0" class="bar"/><text x="703.8" y="350" class="val">0.3 s</text><text x="0" y="396" class="lbl">by <tspan class="m">business_account_name</tspan> on <tspan class="m">dim_customers</tspan></text><rect x="641" y="378" width="48.7" height="26" rx="5.0" class="bar"/><text x="703.7" y="396" class="val">0.3 s</text><text x="0" y="442" class="lbl">new customers since a date on <tspan class="m">dim_customers</tspan></text><rect x="641" y="424" width="48.6" height="26" rx="5.0" class="bar"/><text x="703.6" y="442" class="val">0.3 s</text></svg></div></div>
<div class="s" id="u3"><h3>Rows scanned vs. queries per table</h3><p class="one">161 queries on <span class="id">web_events</span> scan almost as many rows as 923 queries on <span class="id">obt_order_lines</span>.</p><div class="chart"><svg viewBox="0 0 1340 372" width="100%"><text x="470" y="22" class="axis" text-anchor="end">rows scanned</text><text x="870" y="22" class="axis">queries</text><text x="670" y="70" class="lbl" text-anchor="middle"><tspan class="m">obt_order_lines</tspan></text><rect x="90.0" y="52" width="380.0" height="26" rx="5.0" class="bar"/><text x="78.0" y="70" class="val" text-anchor="end">89 M</text><rect x="870" y="52" width="380.0" height="26" rx="5.0" class="bar"/><text x="1262.0" y="70" class="val">923</text><text x="670" y="112" class="lbl" text-anchor="middle"><tspan class="m">web_events</tspan></text><rect x="94.3" y="94" width="375.7" height="26" rx="5.0" class="bar red"/><text x="82.3" y="112" class="val" text-anchor="end">88 M</text><rect x="870" y="94" width="66.3" height="26" rx="5.0" class="bar red"/><text x="948.3" y="112" class="val">161</text><text x="670" y="154" class="lbl" text-anchor="middle"><tspan class="m">fact_order_lines</tspan></text><rect x="245.6" y="136" width="224.4" height="26" rx="5.0" class="bar"/><text x="233.6" y="154" class="val" text-anchor="end">52 M</text><rect x="870" y="136" width="82.3" height="26" rx="5.0" class="bar"/><text x="964.3" y="154" class="val">200</text><text x="670" y="196" class="lbl" text-anchor="middle"><tspan class="m">dim_customers</tspan></text><rect x="344.4" y="178" width="125.6" height="26" rx="5.0" class="bar"/><text x="332.4" y="196" class="val" text-anchor="end">29 M</text><rect x="870" y="178" width="94.7" height="26" rx="5.0" class="bar"/><text x="976.7" y="196" class="val">230</text><text x="670" y="238" class="lbl" text-anchor="middle"><tspan class="m">orders</tspan></text><rect x="445.7" y="220" width="24.3" height="26" rx="5.0" class="bar"/><text x="433.7" y="238" class="val" text-anchor="end">6 M</text><rect x="870" y="220" width="16.5" height="26" rx="4.1" class="bar"/><text x="898.5" y="238" class="val">40</text><text x="670" y="280" class="lbl" text-anchor="middle"><tspan class="m">rpt_daily_sales_wide</tspan></text><rect x="458.7" y="262" width="11.3" height="26" rx="2.8" class="bar"/><text x="446.7" y="280" class="val" text-anchor="end">3 M</text><rect x="870" y="262" width="3.0" height="26" rx="0.8" class="bar"/><text x="885.0" y="280" class="val">5</text><text x="670" y="322" class="lbl" text-anchor="middle"><tspan class="m">tickets</tspan></text><rect x="460.9" y="304" width="9.1" height="26" rx="2.3" class="bar"/><text x="448.9" y="322" class="val" text-anchor="end">2 M</text><rect x="870" y="304" width="49.4" height="26" rx="5.0" class="bar"/><text x="931.4" y="322" class="val">120</text><text x="670" y="364" class="lbl" text-anchor="middle"><tspan class="m">returns</tspan></text><rect x="462.3" y="346" width="7.7" height="26" rx="1.9" class="bar"/><text x="450.3" y="364" class="val" text-anchor="end">2 M</text><rect x="870" y="346" width="41.2" height="26" rx="5.0" class="bar"/><text x="923.2" y="364" class="val">100</text></svg></div></div>
<div class="s" id="u4"><h3>Rows scanned vs. rows needed</h3><p class="one">2 queries and 1 build need under 3 % of the rows they scan.</p><div class="chart"><table class="t"><thead><tr><th class="">query or build</th><th class="num">rows scanned</th><th class="num">rows needed</th><th class="num">% needed</th><th class="grow"></th></tr></thead><tbody><tr><td class="">sessions of one customer on <span class="id">web_events</span></td><td class="num">1,458,470</td><td class="num">12</td><td class="num">0.00082 %</td><td></td></tr><tr><td class="">by <span class="id">order_month</span> and <span class="id">ship_country</span> on <span class="id">obt_order_lines</span></td><td class="num">529,610</td><td class="num">12,892</td><td class="num">2.4 %</td><td></td></tr><tr><td class="">build of <span class="id">rpt_daily_sales_wide</span></td><td class="num">1,471,575,729</td><td class="num">366,337</td><td class="num">0.025 %</td><td></td></tr></tbody></table></div></div>
</section>
<section class="g" id="tables">
<div class="s" id="t1"><h3>Unused and stale tables</h3><p class="one">11 tables, 1.4 GB, were not read in 2026-08, and 8 of them not in the last 90 days; <span class="id">rpt_daily_sales_wide</span> has had no new rows since <span class="id">2026-07-31</span>.</p><div class="chart"><table class="t"><thead><tr><th class="">table</th><th class="">purpose</th><th class="num">size</th><th class="">last read</th><th class="">action</th><th class="grow"></th></tr></thead><tbody><tr><td class="m">commerce_orders_backup_20260714</td><td class="dim">backup</td><td class="num">410 MB</td><td class="m dim">never</td><td class="w drop">drop</td><td></td></tr><tr><td class="m">rpt_daily_sales_wide</td><td class="dim">stale report</td><td class="num">391 MB</td><td class="m dim">2026-08-31</td><td class="w retire">deprecate</td><td></td></tr><tr><td class="m">obt_order_lines_copy</td><td class="dim">copy</td><td class="num">355 MB</td><td class="m dim">never</td><td class="w drop">drop</td><td></td></tr><tr><td class="m">fact_order_lines_v1</td><td class="dim">old version</td><td class="num">302 MB</td><td class="m dim">2026-06-28</td><td class="w retire">deprecate</td><td></td></tr><tr><td class="m">orders_dedup_test</td><td class="dim">test table</td><td class="num">188 MB</td><td class="m dim">never</td><td class="w drop">drop</td><td></td></tr><tr><td class="m">web_events_sample_10pct</td><td class="dim">sample</td><td class="num">96 MB</td><td class="m dim">2026-06-03</td><td class="w retire">deprecate</td><td></td></tr><tr><td class="m">customers_snapshot_20260601</td><td class="dim">snapshot</td><td class="num">64 MB</td><td class="m dim">never</td><td class="w archive">archive</td><td></td></tr><tr><td class="m">tmp_returns_fix</td><td class="dim">temp table</td><td class="num">21 MB</td><td class="m dim">2026-07-09</td><td class="w retire">deprecate</td><td></td></tr><tr><td class="m">dim_promotions_old</td><td class="dim">old version</td><td class="num">9 MB</td><td class="m dim">never</td><td class="w drop">drop</td><td></td></tr><tr><td class="m">gates_old</td><td class="dim">old version</td><td class="num">2 MB</td><td class="m dim">never</td><td class="w drop">drop</td><td></td></tr><tr><td class="m">dim_products_bak</td><td class="dim">backup</td><td class="num">1 MB</td><td class="m dim">never</td><td class="w drop">drop</td><td></td></tr><tr><td class="m">rpt_weekly_sales_2025</td><td class="dim">archive</td><td class="num">1 MB</td><td class="m dim">2026-01-06</td><td class="w archive">archive</td><td></td></tr></tbody></table></div></div>
<div class="s" id="t2"><h3>Storage by table purpose</h3><p class="one">Copies, samples, test tables and backups take 1.05 GB of 1.84 GB.</p><div class="chart"><svg viewBox="2 2 1340 340" width="100%" role="img"><rect x="2.0" y="2.0" width="462.7" height="340.0" rx="6" class="bar"/><text x="18.0" y="33.0" class="lbl tm">copies, samples and test tables</text><text x="18.0" y="59.0" class="val tm">639 MB</text><rect x="468.7" y="2.0" width="296.2" height="340.0" rx="6" class="bar"/><text x="484.7" y="33.0" class="lbl tm">backups</text><text x="484.7" y="59.0" class="val tm">411 MB</text><rect x="769.0" y="2.0" width="281.6" height="340.0" rx="6" class="bar dim"/><text x="785.0" y="33.0" class="lbl tm">stale report</text><text x="785.0" y="59.0" class="val tm">391 MB</text><rect x="1054.6" y="2.0" width="287.4" height="265.9" rx="6" class="bar dim"/><text x="1070.6" y="33.0" class="lbl tm">old versions</text><text x="1070.6" y="59.0" class="val tm">313 MB</text><rect x="1054.6" y="271.9" width="287.4" height="70.1" rx="6" class="bar dim"/><text x="1070.6" y="302.9" class="lbl tm">snapshots, temp, archives</text><text x="1070.6" y="328.9" class="val tm">86 MB</text></svg></div></div>
<div class="s" id="t3"><h3>Unused columns</h3><p class="one">26 columns in 5 of the 7 gold tables are never queried.</p><div class="chart"><table class="t"><thead><tr><th class="">table</th><th class="num">unused</th><th class="grow">columns</th></tr></thead><tbody><tr><td class="m">dim_products</td><td class="num">6 of 12</td><td class="m dim wrap">family_id, colour, warranty_months, range_position, supplier_id, supplier_name</td></tr><tr><td class="m">fact_order_lines</td><td class="num">6 of 18</td><td class="m dim wrap">line_id, customer_id, acquisition_source, campaign_id, offer_discount_eur, voucher_discount_eur</td></tr><tr><td class="m">obt_order_lines</td><td class="num">7 of 23</td><td class="m dim wrap">line_id, customer_id, home_country, signup_channel, is_business, gross_eur, standard_cost_eur</td></tr><tr><td class="m">metric_trading</td><td class="num">5 of 13</td><td class="m dim wrap">customer_type, discount_eur, registered_customers, average_order_value_eur, weighted_discount</td></tr><tr><td class="m">dim_customers</td><td class="num">2 of 10</td><td class="m dim wrap">signup_source, business_account_id</td></tr></tbody></table></div></div>
</section>
<section class="g" id="deadcode">
<div class="s" id="d1"><h3>Unused functions</h3><p class="one">11 functions with 322 lines have no callers.</p><div class="chart"><table class="t"><thead><tr><th class="">function</th><th class="">file</th><th class="num">lines</th><th class="">last modified</th><th class="grow"></th></tr></thead><tbody><tr><td class="m">export_to_sftp</td><td class="m dim">month_end.py</td><td class="num">52</td><td class="m dim">2026-07-11</td><td></td></tr><tr><td class="m">_render_promotions_page</td><td class="m dim">catalog.py</td><td class="num">46</td><td class="m dim">2026-07-02</td><td></td></tr><tr><td class="m">read_xlsx_legacy</td><td class="m dim">readers.py</td><td class="num">41</td><td class="m dim">2026-07-12</td><td></td></tr><tr><td class="m">parse_manifest_v1</td><td class="m dim">manifest.py</td><td class="num">37</td><td class="m dim">2026-07-02</td><td></td></tr><tr><td class="m">dedupe_by_hash_v1</td><td class="m dim">gates.py</td><td class="num">33</td><td class="m dim">2026-07-09</td><td></td></tr><tr><td class="m">send_slack_alert</td><td class="m dim">notify.py</td><td class="num">28</td><td class="m dim">2026-07-21</td><td></td></tr><tr><td class="m">read_json_answers</td><td class="m dim">readers.py</td><td class="num">24</td><td class="m dim">2026-08-03</td><td></td></tr><tr><td class="m">retry_with_backoff</td><td class="m dim">engine.py</td><td class="num">19</td><td class="m dim">2026-07-18</td><td></td></tr><tr><td class="m">load_web_events_sample</td><td class="m dim">replay.py</td><td class="num">18</td><td class="m dim">2026-06-04</td><td></td></tr><tr><td class="m">normalize_country_old</td><td class="m dim">shared.py</td><td class="num">15</td><td class="m dim">2026-06-27</td><td></td></tr><tr><td class="m">to_euros</td><td class="m dim">money.py</td><td class="num">9</td><td class="m dim">2026-06-30</td><td></td></tr></tbody></table></div></div>
<div class="s" id="d2"><h3>Unused parameters</h3><p class="one">Every call uses the default for these 7 parameters.</p><div class="chart"><table class="t"><thead><tr><th class="">parameter</th><th class="num">call sites</th><th class="">default</th><th class="grow"></th></tr></thead><tbody><tr><td class="m">write_run_record(indent)</td><td class="num">31</td><td class="m dim">2</td><td></td></tr><tr><td class="m">connect(path)</td><td class="num">23</td><td class="m dim">None</td><td></td></tr><tr><td class="m">render_page(theme)</td><td class="num">10</td><td class="m dim">"dark"</td><td></td></tr><tr><td class="m">run_layer(dry_run)</td><td class="num">6</td><td class="m dim">False</td><td></td></tr><tr><td class="m">load_bronze(limit)</td><td class="num">4</td><td class="m dim">None</td><td></td></tr><tr><td class="m">check_rows(strict)</td><td class="num">3</td><td class="m dim">True</td><td></td></tr><tr><td class="m">build_gold(skip_metrics)</td><td class="num">2</td><td class="m dim">False</td><td></td></tr></tbody></table></div></div>
<div class="s" id="d3"><h3>Unused SQL</h3><p class="one">A view, 2 CTEs, a macro and a check file were not used in 2026-08.</p><div class="chart"><table class="t"><thead><tr><th class="">name</th><th class="">type</th><th class="">location</th><th class="">last used</th><th class="grow"></th></tr></thead><tbody><tr><td class="m">v_orders_debug</td><td class="dim">view</td><td class="m dim">gold_marts</td><td class="m dim">2026-07-02</td><td></td></tr><tr><td class="m">returns_by_day</td><td class="dim">CTE</td><td class="m dim">obt_order_lines.sql</td><td class="m dim">never</td><td></td></tr><tr><td class="m">old_prices</td><td class="dim">CTE</td><td class="m dim">dim_products.sql</td><td class="m dim">never</td><td></td></tr><tr><td class="m">pct_of</td><td class="dim">macro</td><td class="m dim">macros.sql</td><td class="m dim">never</td><td></td></tr><tr><td class="m">check_legacy.sql</td><td class="dim">check file</td><td class="m dim">pipeline/checks</td><td class="m dim">never</td><td></td></tr></tbody></table></div></div>
<div class="s" id="d4"><h3>Lines of dead code per file</h3><p class="one"><span class="id">notify.py</span> and <span class="id">money.py</span> contain only dead code.</p><div class="chart"><svg viewBox="0 0 1340 450" width="100%" role="img"><text x="0" y="28" class="lbl"><tspan class="m">readers.py</tspan></text><rect x="272" y="10" width="760.0" height="26" rx="4" class="bar dim"/><rect x="485.1" y="10" width="21.3" height="26" class="bar"/><rect x="698.2" y="10" width="145.6" height="26" class="bar"/><rect x="882.8" y="10" width="85.2" height="26" class="bar"/><text x="1046.0" y="28" class="val">71 of 214</text><text x="0" y="74" class="lbl"><tspan class="m">engine.py</tspan></text><rect x="272" y="56" width="728.0" height="26" rx="4" class="bar dim"/><rect x="563.2" y="56" width="10.7" height="26" class="bar"/><rect x="804.7" y="56" width="67.5" height="26" class="bar"/><text x="1014.0" y="74" class="val">22 of 205</text><text x="0" y="120" class="lbl"><tspan class="m">catalog.py</tspan></text><rect x="272" y="102" width="653.5" height="26" rx="4" class="bar dim"/><rect x="662.7" y="102" width="163.4" height="26" class="bar"/><text x="939.5" y="120" class="val">46 of 184</text><text x="0" y="166" class="lbl"><tspan class="m">manifest.py</tspan></text><rect x="272" y="148" width="561.1" height="26" rx="4" class="bar dim"/><rect x="414.1" y="148" width="131.4" height="26" class="bar"/><rect x="733.7" y="148" width="14.2" height="26" class="bar"/><text x="847.1" y="166" class="val">41 of 158</text><text x="0" y="212" class="lbl"><tspan class="m">shared.py</tspan></text><rect x="272" y="194" width="511.4" height="26" rx="4" class="bar dim"/><rect x="478.0" y="194" width="10.7" height="26" class="bar"/><rect x="627.1" y="194" width="53.3" height="26" class="bar"/><text x="797.4" y="212" class="val">18 of 144</text><text x="0" y="258" class="lbl"><tspan class="m">month_end.py</tspan></text><rect x="272" y="240" width="440.4" height="26" rx="4" class="bar dim"/><rect x="343.0" y="240" width="21.3" height="26" class="bar"/><rect x="506.4" y="240" width="184.7" height="26" class="bar"/><text x="726.4" y="258" class="val">58 of 124</text><text x="0" y="304" class="lbl"><tspan class="m">gates.py</tspan></text><rect x="272" y="286" width="440.4" height="26" rx="4" class="bar dim"/><rect x="378.5" y="286" width="10.7" height="26" class="bar"/><rect x="584.5" y="286" width="117.2" height="26" class="bar"/><text x="726.4" y="304" class="val">36 of 124</text><text x="0" y="350" class="lbl"><tspan class="m">replay.py</tspan></text><rect x="272" y="332" width="344.5" height="26" rx="4" class="bar dim"/><rect x="343.0" y="332" width="7.1" height="26" class="bar"/><rect x="520.6" y="332" width="63.9" height="26" class="bar"/><text x="630.5" y="350" class="val">20 of 97</text><text x="0" y="396" class="lbl"><tspan class="m">notify.py</tspan></text><rect x="272" y="378" width="110.1" height="26" rx="4" class="bar red"/><text x="396.1" y="396" class="val">31 of 31</text><text x="0" y="442" class="lbl"><tspan class="m">money.py</tspan></text><rect x="272" y="424" width="39.1" height="26" rx="4" class="bar red"/><text x="325.1" y="442" class="val">11 of 11</text></svg></div></div>
</section>
<section class="g" id="health">
<div class="s" id="c1"><h3>Duplicate code</h3><p class="one">The same cents-to-euro conversion is repeated 6 times in <span class="id">fact_order_lines.sql</span>.</p><div class="chart"><div class="code"><div class="hd">pipeline/gold/marts/fact_order_lines.sql</div><div class="lines"><div class="ln"><span class="num">37</span><span class="src"> <span class="fn">CAST</span>(lines.gross_cents <span class="kw">AS</span> <span class="kw">DECIMAL</span>(<span class="nu">18</span>,<span class="nu">2</span>)) / <span class="nu">100</span> <span class="kw">AS</span> gross_eur,</span></div><div class="ln"><span class="num">38</span><span class="src"> <span class="fn">CAST</span>(lines.discount_cents <span class="kw">AS</span> <span class="kw">DECIMAL</span>(<span class="nu">18</span>,<span class="nu">2</span>)) / <span class="nu">100</span> <span class="kw">AS</span> discount_eur,</span></div><div class="ln"><span class="num">39</span><span class="src"> <span class="fn">CAST</span>(lines.offer_discount_cents <span class="kw">AS</span> <span class="kw">DECIMAL</span>(<span class="nu">18</span>,<span class="nu">2</span>)) / <span class="nu">100</span> <span class="kw">AS</span> offer_discount_eur,</span></div><div class="ln"><span class="num">40</span><span class="src"> <span class="fn">CAST</span>(lines.voucher_discount_cents <span class="kw">AS</span> <span class="kw">DECIMAL</span>(<span class="nu">18</span>,<span class="nu">2</span>)) / <span class="nu">100</span> <span class="kw">AS</span> voucher_discount_eur,</span></div><div class="ln"><span class="num">41</span><span class="src"> <span class="fn">CAST</span>(lines.net_cents <span class="kw">AS</span> <span class="kw">DECIMAL</span>(<span class="nu">18</span>,<span class="nu">2</span>)) / <span class="nu">100</span> <span class="kw">AS</span> net_eur,</span></div><div class="ln"><span class="num">42</span><span class="src"> <span class="fn">CAST</span>(lines.cost_cents <span class="kw">AS</span> <span class="kw">DECIMAL</span>(<span class="nu">18</span>,<span class="nu">2</span>)) / <span class="nu">100</span> <span class="kw">AS</span> standard_cost_eur</span></div></div></div></div></div>
<div class="s" id="c2"><h3>Outdated documentation</h3><p class="one">2 documents contain 3 outdated statements.</p><div class="chart"><table class="t"><thead><tr><th class="">document</th><th class="">documented</th><th class="">actual</th><th class="grow"></th></tr></thead><tbody><tr><td class="m">core_model.md</td><td class="dim"><span class="id">dim_date</span> covers the order dates</td><td class=""><span class="id">dim_date</span> covers 2017 to 2027</td><td></td></tr><tr><td class="m">core_model.md</td><td class="dim">5 gold tables</td><td class="">7 gold tables</td><td></td></tr><tr><td class="m">stakeholders.md</td><td class="dim">the Monday pack reads <span class="id">obt_order_lines</span></td><td class="">the Monday pack reads 4 tables</td><td></td></tr></tbody></table></div></div>
<div class="s" id="c3"><h3>Longest functions by lines of code</h3><p class="one">3 functions are 150 lines or longer.</p><div class="chart"><svg viewBox="0 0 1340 266" width="100%" role="img"><text x="0" y="28" class="lbl"><tspan class="m">_layers</tspan> in <tspan class="m">architecture.py</tspan></text><rect x="422" y="10" width="758.0" height="26" rx="5.0" class="bar red"/><text x="1194.0" y="28" class="val">179</text><text x="0" y="74" class="lbl"><tspan class="m">check_rows</tspan> in <tspan class="m">generate_checks.py</tspan></text><rect x="422" y="56" width="673.3" height="26" rx="5.0" class="bar red"/><text x="1109.3" y="74" class="val">159</text><text x="0" y="120" class="lbl"><tspan class="m">check_files</tspan> in <tspan class="m">generate_checks.py</tspan></text><rect x="422" y="102" width="635.2" height="26" rx="5.0" class="bar red"/><text x="1071.2" y="120" class="val">150</text><text x="0" y="166" class="lbl"><tspan class="m">build_platform</tspan> in <tspan class="m">tables.py</tspan></text><rect x="422" y="148" width="436.2" height="26" rx="5.0" class="bar"/><text x="872.2" y="166" class="val">103</text><text x="0" y="212" class="lbl"><tspan class="m">_defined_columns</tspan> in <tspan class="m">parse_sql.py</tspan></text><rect x="422" y="194" width="368.4" height="26" rx="5.0" class="bar"/><text x="804.4" y="212" class="val">87</text><text x="0" y="258" class="lbl"><tspan class="m">run_day</tspan> in <tspan class="m">daily.py</tspan></text><rect x="422" y="240" width="288.0" height="26" rx="5.0" class="bar"/><text x="724.0" y="258" class="val">68</text></svg></div></div>
</section>
<section class="g" id="quality">
<div class="s" id="q1"><h3>Data quality checks per layer</h3><p class="one">The gold layer has no checks.</p><div class="chart"><div class="layers"><div class="layer"><div class="nm">landing</div><div class="cnt">4</div></div><svg viewBox="0 0 40 20" class="arr"><path d="M11 10h18M23 4l6 6-6 6" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round"/></svg><div class="layer"><div class="nm">bronze</div><div class="cnt">12</div></div><svg viewBox="0 0 40 20" class="arr"><path d="M11 10h18M23 4l6 6-6 6" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round"/></svg><div class="layer"><div class="nm">silver_clean</div><div class="cnt">8</div></div><svg viewBox="0 0 40 20" class="arr"><path d="M11 10h18M23 4l6 6-6 6" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round"/></svg><div class="layer"><div class="nm">silver_core</div><div class="cnt">5</div></div><svg viewBox="0 0 40 20" class="arr"><path d="M11 10h18M23 4l6 6-6 6" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round"/></svg><div class="layer empty"><div class="nm">gold_marts</div><div class="cnt">0</div></div><svg viewBox="0 0 40 20" class="arr"><path d="M11 10h18M23 4l6 6-6 6" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round"/></svg><div class="layer"><div class="nm">month_end</div><div class="cnt">2</div></div></div></div></div>
<div class="s" id="q2"><h3>Architecture decisions</h3><p class="one">1 decision should be revisited and 1 open question can be closed.</p><div class="chart"><table class="t"><thead><tr><th class="">decision</th><th class="">action</th><th class="grow">reason</th></tr></thead><tbody><tr><td class=""><span class="id">metric_trading</span> as a view</td><td class="w revisit">revisit</td><td class="wrap">a table built in the gold transaction is as fresh as the view</td></tr><tr><td class="">keep <span class="id">web_events</span> at event level</td><td class="w close">close</td><td class="wrap">no 2026-08 query needs event-level rows</td></tr></tbody></table></div></div>
</section>
<section class="g" id="proposals">
<div class="s" id="p1"><h3>14 proposals, 25 to 30 hours</h3><p class="one">No changes were made.</p><div class="chart"><table class="t"><thead><tr><th class=""></th><th class="grow">proposal</th><th class="num">effort</th><th class="">risk</th></tr></thead><tbody><tr><td class="no">1</td><td class="wrap">Add <span class="id">has_rows</span>, <span class="id">unique_key</span> and freshness checks inside the gold transaction<span class=rec>priority</span></td><td class="num">3 h</td><td class="w medium">medium</td></tr><tr><td class="no">2</td><td class="wrap">Move the Monday pack to <span class="id">obt_order_lines</span> and deprecate <span class="id">rpt_daily_sales_wide</span></td><td class="num">3 h</td><td class="w medium">medium</td></tr><tr><td class="no">3</td><td class="wrap">Drop the 6 tables nobody ever read once their owners agree, deprecate 3 and archive 2</td><td class="num">1 h</td><td class="w low">low</td></tr><tr><td class="no">4</td><td class="wrap">Remove 11 unused functions and the files <span class="id">notify.py</span> and <span class="id">money.py</span></td><td class="num">1 h</td><td class="w low">low</td></tr><tr><td class="no">5</td><td class="wrap">Remove the 7 unused parameters</td><td class="num">1 h</td><td class="w low">low</td></tr><tr><td class="no">6</td><td class="wrap">Remove <span class="id">v_orders_debug</span>, <span class="id">pct_of</span>, <span class="id">check_legacy.sql</span> and the 2 unused CTEs</td><td class="num">0.5 h</td><td class="w low">low</td></tr><tr><td class="no">7</td><td class="wrap">Replace the 6 cents-to-euro conversions with a <span class="id">cents_to_eur</span> macro</td><td class="num">1 h</td><td class="w low">low</td></tr><tr><td class="no">8</td><td class="wrap">Materialize <span class="id">metric_trading</span> as a table in the gold transaction</td><td class="num">1 h</td><td class="w medium">medium</td></tr><tr><td class="no">9</td><td class="wrap">Move the queries by <span class="id">order_month</span> and <span class="id">ship_country</span> from <span class="id">obt_order_lines</span> to <span class="id">metric_trading</span></td><td class="num">0.5 h</td><td class="w low">low</td></tr><tr><td class="no">10</td><td class="wrap">Build aggregates of <span class="id">web_events</span>, sorted by <span class="id">customer_id</span></td><td class="num">3 to 4 h</td><td class="w low">low</td></tr><tr><td class="no">11</td><td class="wrap">Build an operations mart for shipments, returns and tickets</td><td class="num">8 to 12 h</td><td class="w medium">medium</td></tr><tr><td class="no">12</td><td class="wrap">Update <span class="id">core_model.md</span> and <span class="id">stakeholders.md</span></td><td class="num">1 h</td><td class="w low">low</td></tr><tr><td class="no">13</td><td class="wrap">Clear <span class="id">data/warehouse/staging</span> after a full replay</td><td class="num">0.5 h</td><td class="w low">low</td></tr><tr><td class="no">14</td><td class="wrap">Restrict the <span class="id">Edit(**)</span> permission to the folders a session edits</td><td class="num">0.5 h</td><td class="w low">low</td></tr></tbody></table></div></div>
</section>
</main>
<script>
(function () {
var links = Array.prototype.slice.call(document.querySelectorAll('nav li a'));
var groups = links.map(function (a) { return document.querySelector(a.getAttribute('href')); });
function paint() {
var y = window.scrollY > 0 ? window.scrollY + window.innerHeight / 2 : 0, on = groups[0];
groups.forEach(function (g) { if (g.offsetTop <= y) on = g; });
links.forEach(function (a) { a.classList.toggle('on', a.getAttribute('href') === '#' + on.id); });
}
window.addEventListener('scroll', paint, { passive: true }); paint();
})();
</script>
</body>
</html>
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| receiving-code-reviewobra/superpowersUse when receiving code review feedback, before implementing suggestions, especially if feedback seems unclear or technically questionable - requires technical rigor and verification, not performative agreement or blind implementation | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| requesting-code-reviewobra/superpowersUse when completing tasks, implementing major features, or before merging to verify work meets requirements | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| using-git-worktreesobra/superpowersUse when starting feature work that needs isolation from current workspace or before executing implementation plans - ensures an isolated workspace exists via native tools or git worktree fallback | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| verification-before-completionobra/superpowersUse when about to claim work is complete, fixed, or passing, before committing or creating PRs - requires running verification commands and confirming output before making any success claims; evidence before assertions always | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |