Skip to content

DataWithBaraa/claude-code-data-engineering-skills / skills/profile

profile

Verified

Use when a new source or new files arrive, to profile them before any data contract or pipeline code is written, the file formats, the schema, the data quality, the bad records, the relationships, the gaps and the personal data.

references/profile.html

View on GitHub
<!DOCTYPE html>
<html lang="en">
<head>
<meta charset="utf-8">
<title>Data profile: purchasing</title>
<style>
@font-face{font-family:'Bricolage Grotesque';font-weight:200 800;font-display:block;src:url('fonts/BricolageGrotesque-700.woff2') format('woff2');}
@font-face{font-family:'JetBrains Mono';font-weight:100 800;font-display:block;src:url('fonts/JetBrainsMono-500.woff2') format('woff2');}
*{margin:0;padding:0;box-sizing:border-box;}
:root{--bg:#0f0a1e;--plate:#1a1230;--ink:#ece7f8;--ink-2:rgba(236,231,248,.72);--line:rgba(236,231,248,.14);--line-2:rgba(236,231,248,.08);
  --purple:#8a63f2;--purple-soft:#c9b8ff;--red:#ff8a73;--orange:#ffa657;--green:#5fe3a1;}
html{background:var(--bg);}
body{font-family:'Bricolage Grotesque',sans-serif;font-weight:400;color:var(--ink);background:var(--bg);font-size:20px;line-height:1.5;-webkit-font-smoothing:antialiased;}
.id,.chip,code,pre,.t td.m,.t td.num{font-family:'JetBrains Mono',monospace;font-variant-ligatures:none;}
.id{font-size:.95em;color:var(--purple-soft);white-space:nowrap;}
.nw{white-space:nowrap;}
.red{color:var(--red);} .orange{color:var(--orange);} .dim{color:var(--ink-2);}
main{max-width:1440px;margin:0 auto;padding:64px 48px 160px;}
p,.one,.lead{text-wrap:pretty;}

/* head */
.path{font-family:'JetBrains Mono',monospace;font-size:20px;color:var(--purple-soft);}
h1{font-size:56px;font-weight:800;letter-spacing:-.02em;line-height:1.05;margin-top:12px;}
.lead{margin-top:16px;font-size:25px;line-height:1.4;}
.kpis{margin-top:40px;display:grid;grid-template-columns:repeat(6,minmax(0,1fr));border-top:1px solid var(--line);border-bottom:1px solid var(--line);}
.kpi{padding:22px 20px 22px 0;}
.kpi + .kpi{border-left:1px solid var(--line);padding-left:22px;}
.kpi .l{font-size:19px;color:var(--ink-2);}
.kpi .v{margin-top:8px;font-size:36px;font-weight:700;line-height:1;letter-spacing:-.01em;}
.kpi .v.red{color:var(--red);}

/* screens: a title, one sentence, one visual */
.s{margin-top:104px;}
.s h2{font-size:32px;font-weight:700;letter-spacing:-.01em;line-height:1.15;text-wrap:balance;}
.s h2 .id{font-size:.9em;font-weight:600;}
.s .one{margin-top:8px;font-size:22px;font-weight:600;line-height:1.45;}
.vis{margin-top:30px;}

/* tables */
table.t{width:100%;border-collapse:collapse;}
.t th{font-size:19px;font-weight:600;color:var(--ink-2);text-align:left;padding:0 32px 12px 0;border-bottom:1px solid var(--line);white-space:nowrap;}
.t th.num{text-align:right;}
.t th.grow{width:100%;}
.t td{padding:12px 32px 12px 0;border-bottom:1px solid var(--line-2);vertical-align:baseline;font-size:20px;line-height:1.4;white-space:nowrap;}
.t td:last-child,.t th:last-child{padding-right:0;}
.t td.m,.t td.num{font-size:19px;}
.t td.num{text-align:right;}
.t td.col{color:var(--ink);font-weight:600;}
.t td.wrap{white-space:normal;line-height:1.45;text-wrap:balance;}
.t td.bar{padding-right:24px;vertical-align:middle;}
.t td.bar svg{display:block;}
.t .b{fill:var(--purple);}
.t.inv td,.t.inv th{padding-right:20px;}
.t.inv td.num,.t.inv th.num{padding-right:28px;}
.t.find td:first-child,.t.find th:first-child{width:44px;padding-right:16px;}
.t.find td.col{white-space:nowrap;}
.t.find td.dim .id{color:var(--purple-soft);}
table.t.cur,table.t.pii,table.t.ph{width:auto;min-width:60%;}
.t.cur th.grow,.t.pii th.grow,.t.ph th.grow{width:auto;}
.t.cur .chip,.t.ph .chip{font-size:21px;padding:3px 12px;}

/* file format */
.fmt .r{display:grid;grid-template-columns:540px 220px minmax(0,1fr);align-items:center;padding:16px 0;border-bottom:1px solid var(--line-2);}
.fmt .r:first-child{border-top:1px solid var(--line);}
.fmt .r:last-child{border-bottom:1px solid var(--line);}
.fmt .raw{display:flex;flex-wrap:wrap;gap:10px;padding-right:24px;}
.chip{display:inline-block;font-size:26px;font-weight:500;line-height:1.2;color:var(--ink);background:#1a1230;border:1px solid var(--line);border-radius:10px;padding:7px 14px;white-space:pre;}
.chip.empty{min-width:48px;border-style:dashed;}
.fmt .nm{font-size:23px;font-weight:700;}
.fmt .ds{font-size:20px;color:var(--ink-2);line-height:1.4;text-wrap:balance;}
.fmt .ds .id{color:var(--purple-soft);}

/* charts */
svg text{font-family:'Bricolage Grotesque',sans-serif;}
svg .lbl{font-size:20px;fill:var(--ink);}
svg .lbl tspan.m{font-family:'JetBrains Mono',monospace;font-size:19px;}
svg .val{font-family:'JetBrains Mono',monospace;font-size:19px;fill:var(--ink);}
svg .bar{fill:var(--purple);}
svg .bar.new{fill:rgba(138,99,242,.3);}
svg .axis{font-size:18px;font-weight:600;fill:var(--ink-2);}
svg .note{font-size:19px;font-weight:600;fill:var(--ink-2);}
svg .note.m{font-family:'JetBrains Mono',monospace;font-weight:500;}
svg .note.red{fill:var(--red);}
svg .base{stroke:var(--line);stroke-width:1.5;}
svg .tick{stroke:rgba(236,231,248,.3);stroke-width:1.5;}
svg .cut{stroke:rgba(236,231,248,.45);stroke-width:1.5;stroke-dasharray:5 6;}
svg .gap{fill:none;stroke:var(--red);stroke-width:2;stroke-dasharray:6 6;}
.months{display:block;width:100%;height:auto;}
.vis svg{display:block;}

/* supplier ids: 3 spellings become 1 */
.ids{display:grid;grid-template-columns:minmax(0,1fr) 160px minmax(0,1fr);align-items:center;}
.ids .col{display:grid;row-gap:14px;}
.ids .card{background:var(--plate);border:1px solid var(--plate-border);border-radius:12px;padding:18px 24px;display:flex;align-items:baseline;justify-content:space-between;}
.ids .card .v{font-family:'JetBrains Mono',monospace;font-size:28px;font-weight:500;white-space:pre;}
.ids .card .v b{color:var(--red);font-weight:500;}
.ids .card .n{font-family:'JetBrains Mono',monospace;font-size:19px;color:var(--ink-2);}
.ids .card.one{border-color:var(--purple);padding:30px 24px;}
.ids .card.one .n{color:var(--ink);}
.ids .arrow{display:flex;justify-content:center;}
.arr{width:120px;height:24px;fill:none;stroke:var(--ink-2);stroke-width:2;stroke-linecap:round;stroke-linejoin:round;}

/* duplicate rows: the same line twice */
.dup{display:grid;grid-template-columns:1fr 1fr;column-gap:32px;}
.dup .card{background:var(--plate);border:1px solid var(--plate-border);border-radius:14px;padding:24px 34px 24px;}
.dup .card .tag{display:block;margin-bottom:12px;font-family:'JetBrains Mono',monospace;font-size:19px;color:var(--purple-soft);}
.dup pre{font-size:21px;line-height:1.6;color:var(--ink-2);white-space:pre-wrap;}
.dup pre b{font-weight:600;color:var(--ink);}
.dup pre b.diff{color:var(--red);}

/* orphans: 2 boxes and a dashed third */
.orph{display:grid;grid-template-columns:1fr 220px 1fr;align-items:center;}
.orph .targets,.orph .links{display:grid;row-gap:20px;}
.orph .links .link{height:66px;justify-content:center;}
.orph .box{border:1px solid var(--plate-border);border-radius:12px;padding:18px 24px;background:var(--plate);display:flex;align-items:baseline;justify-content:space-between;gap:24px;}
.orph .box .nm{font-family:'JetBrains Mono',monospace;font-size:21px;white-space:nowrap;}
.orph .box .n{font-size:36px;font-weight:700;line-height:1;white-space:nowrap;}
.orph .box .n small{font-size:20px;font-weight:600;color:var(--ink-2);margin-left:8px;}
.orph > .box{align-self:stretch;align-items:center;}
.orph .box.miss{border:2px dashed var(--red);background:none;}
.orph .box.miss .n{color:var(--red);font-size:22px;line-height:1.2;}
.orph .link{display:flex;flex-direction:column;align-items:center;gap:6px;font-family:'JetBrains Mono',monospace;font-size:19px;color:var(--ink-2);}
.orph .link.bad{color:var(--red);}
.orph .link.bad .arr{stroke:var(--red);}

/* column strips */
.strips{display:grid;row-gap:12px;}
.strip{display:grid;grid-template-columns:270px minmax(0,1fr) 220px;align-items:center;column-gap:24px;}
.strip .nm{font-size:19px;}
.strip .cells{display:flex;gap:4px;}
.strip .cells i{display:block;width:26px;height:22px;border-radius:3px;background:var(--purple);}
.strip .cells i.dead{background:var(--red);}
.strip .cells i.const{background:var(--orange);}
.strip .cnt{font-family:'JetBrains Mono',monospace;font-size:19px;color:var(--ink-2);text-align:right;}
.strip .cnt b{font-weight:600;}
.strips.drift .strip{grid-template-columns:270px minmax(0,1fr) 186px;}
.strips.drift .cells i.chg{background:none;border:2px solid var(--ink);}
.strips.drift .cnt .id{color:var(--ink);}
.strips.gaps .strip{grid-template-columns:270px 896px minmax(0,1fr);}
.strips.gaps .cells{gap:3px;}
.strips.gaps .cells.off{height:22px;border:1px dashed var(--red);border-radius:3px;}
.strips.gaps .strip.axis .cells i{background:none;height:24px;overflow:visible;font-style:normal;font-family:'JetBrains Mono',monospace;font-size:18px;color:var(--ink-2);white-space:nowrap;}
.strips.gaps .cells i.part{background:var(--orange);}
.strips.gaps .cells i.empty{background:var(--red);}
.strips.gaps .cells i.dim{background:rgba(236,231,248,.16);}
.strips.drift .cnt.red .id{color:var(--red);}

/* the orphan matrix and the length bars */
.t.mx th.c,.t.mx td.c{text-align:center;padding-left:16px;padding-right:16px;}
.t.mx th.c{font-family:'JetBrains Mono',monospace;font-weight:500;color:var(--ink-2);}
.t.mx th.top{font-family:'Bricolage Grotesque',sans-serif;font-weight:600;border-bottom:0;padding-bottom:6px;}
.t.mx td.c{font-family:'JetBrains Mono',monospace;font-size:19px;}
.t.mx th:first-child,.t.mx td:first-child{width:300px;}
svg .rng{stroke:var(--purple);stroke-width:12;stroke-linecap:round;}
svg .rng.red{stroke:var(--red);}
svg .val.red{fill:var(--red);}

/* contract block */
.copy{position:relative;background:var(--plate);border:1px solid var(--plate-border);border-radius:14px;padding:34px 34px 30px;}
.copy button{position:absolute;right:30px;top:33px;cursor:pointer;background:transparent;border:1px solid var(--line);border-radius:8px;padding:5px 12px;font-family:'JetBrains Mono',monospace;font-size:20px;font-weight:600;letter-spacing:.14em;text-transform:uppercase;color:var(--ink-2);}
.copy button:hover{color:var(--ink);border-color:rgba(236,231,248,.4);}
.copy button.done{color:var(--green);border-color:rgba(95,227,161,.5);}
.copy pre{font-size:20px;line-height:1.7;color:var(--ink);white-space:pre-wrap;max-width:1180px;}
.copy pre b{font-weight:600;color:var(--ink-2);}
.copy pre .f{display:block;padding-left:3ch;text-indent:-3ch;text-wrap:pretty;}

/* the ground, from the insight series: a radial purple ground, a faint grid, plates with a purple edge */
:root{--ground:#080513;--plate:linear-gradient(160deg,#1b1436 0%,#110c24 100%);--plate-border:rgba(138,99,242,.28);--red:#ff8a73;}
html{background:var(--ground);}
body{background:var(--ground);}
body{position:relative;min-height:100%;}
body::before{content:'';position:absolute;left:0;right:0;top:0;height:min(1600px,100%);z-index:0;pointer-events:none;
  background:radial-gradient(1500px 900px at 50% 420px,#161033 0%,#0e0a1d 55%,rgba(8,5,19,0) 100%);}
body::after{content:'';position:fixed;inset:0;z-index:0;pointer-events:none;
  background-image:linear-gradient(rgba(173,150,255,.05) 1.2px,transparent 1.2px),linear-gradient(90deg,rgba(173,150,255,.05) 1.2px,transparent 1.2px);
  background-size:46px 46px;}
main,nav{position:relative;z-index:1;}
.chip{background:var(--plate);border-color:var(--plate-border);}
</style>
</head>
<body>
<main>
  <div class="path">data/landing/purchasing/ · 14 files · 41 GB</div>
  <h1>Data profile: purchasing</h1>
  <p class="lead">The extract holds 10 tables from 2 ERP systems. 21 findings go into the contract before anything is loaded.</p>
  <div class="kpis">
    <div class="kpi"><div class="l">tables</div><div class="v">10</div></div>
    <div class="kpi"><div class="l">rows</div><div class="v">87.7 M</div></div>
    <div class="kpi"><div class="l">columns</div><div class="v">205</div></div>
    <div class="kpi"><div class="l">duplicate rows</div><div class="v red">1.4 M</div></div>
    <div class="kpi"><div class="l">findings</div><div class="v red">21</div></div>
    <div class="kpi"><div class="l">files written</div><div class="v">0</div></div>
  </div>

  <section class="s">
    <h2>Tables</h2>
    <p class="one"><span class="id">purchase_order_lines</span> holds 24.8 M of the 87.7 M rows, and <span class="id">purchase_requisitions</span> has no rows after <span class="nw">2025-11-30</span>.</p>
    <div class="vis"><table class="t inv"><tr><th>Table</th><th class="num">Rows</th><th></th><th class="num">Columns</th><th class="grow">Key</th><th class="num">Duplicate rows</th><th class="num">Missing cells</th><th>Last row</th></tr><tr><td class="m col">purchase_orders</td><td class="num">6,142,380</td><td class="bar"><svg viewBox="0 0 100 18" width="100" height="18"><rect class="b" x="0" y="2" width="25" height="14" rx="1"/></svg></td><td class="num dim">21</td><td class="m dim">PO_ID</td><td class="num dim">0</td><td class="num dim">16.4 %</td><td class="m dim">2026-07-31</td></tr><tr><td class="m col">purchase_order_lines</td><td class="num">24,816,952</td><td class="bar"><svg viewBox="0 0 100 18" width="100" height="18"><rect class="b" x="0" y="2" width="100" height="14" rx="1"/></svg></td><td class="num dim">28</td><td class="m dim">PO_ID, LINE_NO</td><td class="num red">1,389,204</td><td class="num dim">13.4 %</td><td class="m dim">2026-07-31</td></tr><tr><td class="m col">goods_receipts</td><td class="num">5,903,117</td><td class="bar"><svg viewBox="0 0 100 18" width="100" height="18"><rect class="b" x="0" y="2" width="24" height="14" rx="1"/></svg></td><td class="num dim">16</td><td class="m dim">GR_ID</td><td class="num dim">0</td><td class="num dim">8.1 %</td><td class="m dim">2026-07-31</td></tr><tr><td class="m col">goods_receipt_lines</td><td class="num">22,311,540</td><td class="bar"><svg viewBox="0 0 100 18" width="100" height="18"><rect class="b" x="0" y="2" width="90" height="14" rx="1"/></svg></td><td class="num dim">19</td><td class="m dim">GR_ID, LINE_NO</td><td class="num dim">0</td><td class="num dim">12.6 %</td><td class="m dim">2026-07-31</td></tr><tr><td class="m col">supplier_invoices</td><td class="num">4,711,862</td><td class="bar"><svg viewBox="0 0 100 18" width="100" height="18"><rect class="b" x="0" y="2" width="19" height="14" rx="1"/></svg></td><td class="num dim">24</td><td class="m dim">INVOICE_ID</td><td class="num dim">0</td><td class="num dim">11.8 %</td><td class="m dim">2026-07-31</td></tr><tr><td class="m col">supplier_invoice_lines</td><td class="num">19,604,338</td><td class="bar"><svg viewBox="0 0 100 18" width="100" height="18"><rect class="b" x="0" y="2" width="79" height="14" rx="1"/></svg></td><td class="num dim">22</td><td class="m dim">INVOICE_ID, LINE_NO</td><td class="num dim">0</td><td class="num dim">11.2 %</td><td class="m dim">2026-07-31</td></tr><tr><td class="m col">suppliers</td><td class="num">48,212</td><td class="bar"><svg viewBox="0 0 100 18" width="100" height="18"><rect class="b" x="0" y="2" width="5" height="14" rx="1"/></svg></td><td class="num dim">31</td><td class="m dim">SUPPLIER_ID</td><td class="num dim">0</td><td class="num dim">26.4 %</td><td class="m dim">2026-07-29</td></tr><tr><td class="m col">supplier_addresses</td><td class="num">71,406</td><td class="bar"><svg viewBox="0 0 100 18" width="100" height="18"><rect class="b" x="0" y="2" width="5" height="14" rx="1"/></svg></td><td class="num dim">18</td><td class="m dim">ADDRESS_ID</td><td class="num dim">0</td><td class="num dim">27.9 %</td><td class="m dim">2026-07-29</td></tr><tr><td class="m col">price_agreements</td><td class="num">912,340</td><td class="bar"><svg viewBox="0 0 100 18" width="100" height="18"><rect class="b" x="0" y="2" width="5" height="14" rx="1"/></svg></td><td class="num dim">14</td><td class="m dim">AGREEMENT_ID, MATERIAL_NO</td><td class="num dim">0</td><td class="num dim">5.5 %</td><td class="m dim">2026-07-31</td></tr><tr><td class="m col">purchase_requisitions</td><td class="num">3,208,015</td><td class="bar"><svg viewBox="0 0 100 18" width="100" height="18"><rect class="b" x="0" y="2" width="13" height="14" rx="1"/></svg></td><td class="num dim">12</td><td class="m dim">REQ_ID</td><td class="num dim">0</td><td class="num dim">1.9 %</td><td class="m red">2025-11-30</td></tr></table></div>
  </section>

  <section class="s">
    <h2>File format</h2>
    <p class="one">The rows come from 2 ERP systems, the old one until the go-live on <span class="nw">2024-03-04</span>, and 2 delimiters, 2 encodings, 3 date formats and 2 decimal separators arrive in 1 source.</p>
    <div class="vis fmt"><div class="r"><div class="raw"><span class="chip">;</span><span class="chip">,</span></div><div class="nm">Delimiter</div><div class="ds">semicolon in the 10 full files, comma in the 4 monthly files of <span class="id">purchase_order_lines</span></div></div><div class="r"><div class="raw"><span class="chip">&quot;</span></div><div class="nm">Quoting</div><div class="ds">double quotes around text; 1,208 rows hold an unescaped quote and cannot be parsed</div></div><div class="r"><div class="raw"><span class="chip">UTF-8</span><span class="chip">Latin-1</span></div><div class="nm">Encoding</div><div class="ds">2 files are Latin-1; read as UTF-8, 11,408 supplier names decode as <span class="id">M�ller GmbH</span></div></div><div class="r"><div class="raw"><span class="chip">17.01.2022</span><span class="chip">2024-03-04</span><span class="chip">45292</span></div><div class="nm">Date</div><div class="ds"><span class="id">dd.MM.yyyy</span> until the ERP go-live on 2024-03-04, <span class="id">yyyy-MM-dd</span> after it, Excel serial numbers from a manual load</div></div><div class="r"><div class="raw"><span class="chip">17.01.2022 16:45:00</span><span class="chip">2024-03-04 02:10:44</span></div><div class="nm">Timestamp</div><div class="ds">no time zone: Europe/Berlin before the <span class="nw">go-live</span>, UTC after it; <span class="nw">97 %</span> of <span class="id">goods_receipts.POSTED_AT</span> values are at 00:00:00</div></div><div class="r"><div class="raw"><span class="chip">1.234,56</span><span class="chip">1234.56</span></div><div class="nm">Decimal separator</div><div class="ds">comma with a thousands separator before the <span class="nw">go-live</span>, dot after it: 61 % and 39 % of the amounts</div></div><div class="r"><div class="raw"><span class="chip">1.234,56-</span></div><div class="nm">Negative amount</div><div class="ds">trailing minus sign in 203,118 rows of <span class="id">supplier_invoice_lines</span>, the old ERP convention</div></div><div class="r"><div class="raw"><span class="chip empty">&nbsp;</span><span class="chip">NULL</span><span class="chip">\N</span><span class="chip">N/A</span><span class="chip">0000-00-00</span></div><div class="nm">Null token</div><div class="ds">5 ways to write a missing value</div></div><div class="r"><div class="raw"><span class="chip">CRLF</span><span class="chip">LF</span></div><div class="nm">Line ending</div><div class="ds">Windows line endings in 9 files, <span class="nw">Unix in 5</span>; 1 file starts with a byte-order mark</div></div></div>
  </section>

  <section class="s">
    <h2>Null tokens</h2>
    <p class="one">Missing values are written 5 ways, and only the empty field is read as null without a token list.</p>
    <div class="vis"><svg viewBox="0 0 1344 244" width="1344" height="244"><text class="lbl" x="0" y="27">empty field</text><rect class="bar" x="230" y="10" width="760.0" height="26" rx="1"/><text class="val" x="1004.0" y="29">198,412,560 cells</text><text class="lbl" x="0" y="77"><tspan class="m">NULL</tspan></text><rect class="bar" x="230" y="60" width="113.4" height="26" rx="1"/><text class="val" x="357.4" y="79">29,604,118 cells</text><text class="lbl" x="0" y="127"><tspan class="m">\N</tspan></text><rect class="bar" x="230" y="110" width="37.6" height="26" rx="1"/><text class="val" x="281.6" y="129">9,811,540 cells</text><text class="lbl" x="0" y="177"><tspan class="m">N/A</tspan></text><rect class="bar" x="230" y="160" width="4.6" height="26" rx="1"/><text class="val" x="248.6" y="179">1,188,206 cells</text><text class="lbl" x="0" y="227"><tspan class="m">0000-00-00</tspan></text><rect class="bar" x="230" y="210" width="4.0" height="26" rx="1"/><text class="val" x="248.0" y="229">588,431 cells</text></svg></div>
  </section>

  <section class="s">
    <h2>Date formats in <span class="id">purchase_orders.ORDER_DATE</span></h2>
    <p class="one">The format switches to <span class="id">yyyy-MM-dd</span> at the ERP go-live on <span class="nw">2024-03-04</span>, and 12,406 rows carry Excel serial numbers.</p>
    <div class="vis"><svg class="months" viewBox="0 0 1344 262" width="1344" height="262"><rect class="bar" x="0.0" y="30.0" width="11" height="190.0"/><line class="tick" x1="0.0" y1="220" x2="0.0" y2="228"/><text class="axis" x="0.0" y="252">2019</text><rect class="bar" x="14.7" y="30.0" width="11" height="190.0"/><rect class="bar" x="29.5" y="30.0" width="11" height="190.0"/><rect class="bar" x="44.2" y="30.0" width="11" height="190.0"/><rect class="bar" x="58.9" y="30.0" width="11" height="190.0"/><rect class="bar" x="73.7" y="30.0" width="11" height="190.0"/><rect class="bar" x="88.4" y="30.0" width="11" height="190.0"/><rect class="bar" x="103.1" y="30.0" width="11" height="190.0"/><rect class="bar" x="117.8" y="30.0" width="11" height="190.0"/><rect class="bar" x="132.6" y="30.0" width="11" height="190.0"/><rect class="bar" x="147.3" y="30.0" width="11" height="190.0"/><rect class="bar" x="162.0" y="30.0" width="11" height="190.0"/><rect class="bar" x="176.8" y="30.0" width="11" height="190.0"/><line class="tick" x1="176.8" y1="220" x2="176.8" y2="228"/><text class="axis" x="176.8" y="252">2020</text><rect class="bar" x="191.5" y="30.0" width="11" height="190.0"/><rect class="bar" x="206.2" y="30.0" width="11" height="190.0"/><rect class="bar" x="221.0" y="30.0" width="11" height="190.0"/><rect class="bar" x="235.7" y="30.0" width="11" height="190.0"/><rect class="bar" x="250.4" y="30.0" width="11" height="190.0"/><rect class="bar" x="265.1" y="30.0" width="11" height="190.0"/><rect class="bar" x="279.9" y="30.0" width="11" height="190.0"/><rect class="bar" x="294.6" y="30.0" width="11" height="190.0"/><rect class="bar" x="309.3" y="30.0" width="11" height="190.0"/><rect class="bar" x="324.1" y="30.0" width="11" height="190.0"/><rect class="bar" x="338.8" y="30.0" width="11" height="190.0"/><rect class="bar" x="353.5" y="30.0" width="11" height="190.0"/><line class="tick" x1="353.5" y1="220" x2="353.5" y2="228"/><text class="axis" x="353.5" y="252">2021</text><rect class="bar" x="368.2" y="30.0" width="11" height="190.0"/><rect class="bar" x="383.0" y="30.0" width="11" height="190.0"/><rect class="bar" x="397.7" y="30.0" width="11" height="190.0"/><rect class="bar" x="412.4" y="30.0" width="11" height="190.0"/><rect class="bar" x="427.2" y="30.0" width="11" height="190.0"/><rect class="bar" x="441.9" y="30.0" width="11" height="190.0"/><rect class="bar" x="456.6" y="30.0" width="11" height="190.0"/><rect class="bar" x="471.4" y="30.0" width="11" height="190.0"/><rect class="bar" x="486.1" y="30.0" width="11" height="190.0"/><rect class="bar" x="500.8" y="30.0" width="11" height="190.0"/><rect class="bar" x="515.6" y="30.0" width="11" height="190.0"/><rect class="bar" x="530.3" y="30.0" width="11" height="190.0"/><line class="tick" x1="530.3" y1="220" x2="530.3" y2="228"/><text class="axis" x="530.3" y="252">2022</text><rect class="bar" x="545.0" y="30.0" width="11" height="190.0"/><rect class="bar" x="559.7" y="30.0" width="11" height="190.0"/><rect class="bar" x="574.5" y="30.0" width="11" height="190.0"/><rect class="bar" x="589.2" y="30.0" width="11" height="190.0"/><rect class="bar" x="603.9" y="30.0" width="11" height="190.0"/><rect class="bar" x="618.7" y="30.0" width="11" height="190.0"/><rect class="bar" x="633.4" y="30.0" width="11" height="190.0"/><rect class="bar" x="648.1" y="30.0" width="11" height="190.0"/><rect class="bar" x="662.9" y="30.0" width="11" height="190.0"/><rect class="bar" x="677.6" y="30.0" width="11" height="190.0"/><rect class="bar" x="692.3" y="30.0" width="11" height="190.0"/><rect class="bar" x="707.0" y="30.0" width="11" height="190.0"/><line class="tick" x1="707.0" y1="220" x2="707.0" y2="228"/><text class="axis" x="707.0" y="252">2023</text><rect class="bar" x="721.8" y="30.0" width="11" height="190.0"/><rect class="bar" x="736.5" y="30.0" width="11" height="190.0"/><rect class="bar" x="751.2" y="30.0" width="11" height="190.0"/><rect class="bar" x="766.0" y="30.0" width="11" height="190.0"/><rect class="bar" x="780.7" y="30.0" width="11" height="190.0"/><rect class="bar" x="795.4" y="30.0" width="11" height="190.0"/><rect class="bar" x="810.1" y="30.0" width="11" height="190.0"/><rect class="bar" x="824.9" y="30.0" width="11" height="190.0"/><rect class="bar" x="839.6" y="30.0" width="11" height="190.0"/><rect class="bar" x="854.3" y="30.0" width="11" height="190.0"/><rect class="bar" x="869.1" y="30.0" width="11" height="190.0"/><rect class="bar" x="883.8" y="30.0" width="11" height="190.0"/><line class="tick" x1="883.8" y1="220" x2="883.8" y2="228"/><text class="axis" x="883.8" y="252">2024</text><rect class="bar" x="898.5" y="30.0" width="11" height="190.0"/><rect class="bar new" x="913.3" y="30.0" width="11" height="190.0"/><rect class="bar new" x="928.0" y="30.0" width="11" height="190.0"/><rect class="bar new" x="942.7" y="30.0" width="11" height="190.0"/><rect class="bar new" x="957.5" y="30.0" width="11" height="190.0"/><rect class="bar new" x="972.2" y="30.0" width="11" height="190.0"/><rect class="bar new" x="986.9" y="30.0" width="11" height="190.0"/><rect class="bar new" x="1001.6" y="30.0" width="11" height="190.0"/><rect class="bar new" x="1016.4" y="30.0" width="11" height="190.0"/><rect class="bar new" x="1031.1" y="30.0" width="11" height="190.0"/><rect class="bar new" x="1045.8" y="30.0" width="11" height="190.0"/><rect class="bar new" x="1060.6" y="30.0" width="11" height="190.0"/><line class="tick" x1="1060.6" y1="220" x2="1060.6" y2="228"/><text class="axis" x="1060.6" y="252">2025</text><rect class="bar new" x="1075.3" y="30.0" width="11" height="190.0"/><rect class="bar new" x="1090.0" y="30.0" width="11" height="190.0"/><rect class="bar new" x="1104.8" y="30.0" width="11" height="190.0"/><rect class="bar new" x="1119.5" y="30.0" width="11" height="190.0"/><rect class="bar new" x="1134.2" y="30.0" width="11" height="190.0"/><rect class="bar new" x="1148.9" y="30.0" width="11" height="190.0"/><rect class="bar new" x="1163.7" y="30.0" width="11" height="190.0"/><rect class="bar new" x="1178.4" y="30.0" width="11" height="190.0"/><rect class="bar new" x="1193.1" y="30.0" width="11" height="190.0"/><rect class="bar new" x="1207.9" y="30.0" width="11" height="190.0"/><rect class="bar new" x="1222.6" y="30.0" width="11" height="190.0"/><rect class="bar new" x="1237.3" y="30.0" width="11" height="190.0"/><line class="tick" x1="1237.3" y1="220" x2="1237.3" y2="228"/><text class="axis" x="1237.3" y="252">2026</text><rect class="bar new" x="1252.0" y="30.0" width="11" height="190.0"/><rect class="bar new" x="1266.8" y="30.0" width="11" height="190.0"/><rect class="bar new" x="1281.5" y="30.0" width="11" height="190.0"/><rect class="bar new" x="1296.2" y="30.0" width="11" height="190.0"/><rect class="bar new" x="1311.0" y="30.0" width="11" height="190.0"/><rect class="bar new" x="1325.7" y="30.0" width="11" height="190.0"/><text class="note m" x="0" y="26">dd.MM.yyyy</text><text class="note m" x="1344" y="26" text-anchor="end">yyyy-MM-dd</text><line class="cut" x1="911.4" y1="16" x2="911.4" y2="220"/><text class="note" x="901.4" y="26" text-anchor="end">go-live 2024-03-04</text><line class="base" x1="0" y1="220" x2="1344" y2="220"/></svg></div>
  </section>

  <section class="s">
    <h2>Supplier IDs</h2>
    <p class="one"><span class="id">suppliers.SUPPLIER_ID</span> is written 3 ways, so 48,212 IDs are 41,870 suppliers.</p>
    <div class="vis ids">
      <div class="col">
        <div class="card"><span class="v"><b>000</b>12345</span><span class="n">29,870 IDs</span></div>
        <div class="card"><span class="v">12345</span><span class="n">14,118 IDs</span></div>
        <div class="card"><span class="v">12345<b>␣␣</b></span><span class="n">4,224 IDs</span></div>
      </div>
      <div class="arrow"><svg class="arr" viewBox="0 0 120 24" aria-hidden="true"><path d="M2 12h112M104 4l10 8-10 8"/></svg></div>
      <div class="col"><div class="card one"><span class="v">00012345</span><span class="n">41,870 suppliers</span></div></div>
    </div>
  </section>

  <section class="s">
    <h2>Duplicate rows</h2>
    <p class="one">1,389,204 purchase order lines (5.6 %) arrive twice, because each monthly file repeats the previous month, and only <span class="id">UPDATED_AT</span> differs.</p>
    <div class="vis dup">
      <div class="card"><span class="tag">purchase_order_lines_2026-06.csv</span>
<pre>po_id          <b>PO0004471820</b>
line_no        <b>30</b>
material_no    KO-21603
quantity       36
net_amount_doc 30522.24
updated_at     <b>2026-06-28 15:00:12</b></pre></div>
      <div class="card"><span class="tag">purchase_order_lines_2026-07.csv</span>
<pre>po_id          <b>PO0004471820</b>
line_no        <b>30</b>
material_no    KO-21603
quantity       36
net_amount_doc 30522.24
updated_at     <b class="diff">2026-07-01 02:10:44</b></pre></div>
    </div>
  </section>

  <section class="s">
    <h2>Schema drift in the monthly files</h2>
    <p class="one">The 4 monthly files of <span class="id">purchase_order_lines</span> have 3 schemas: <span class="id">PLANT</span> is added, <span class="id">NET_AMOUNT</span> becomes <span class="id">NET_AMOUNT_DOC</span> with a <span class="nw">lower-case</span> header, and the last file ends with a trailer row for 694,318 data rows.</p>
    <div class="vis"><div class="strips drift"><div class="strip"><span class="nm id">2026-04</span><span class="cells"><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i></span><span class="cnt">27 columns</span></div><div class="strip"><span class="nm id">2026-05</span><span class="cells"><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="chg"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i></span><span class="cnt">PLANT</span></div><div class="strip"><span class="nm id">2026-06</span><span class="cells"><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="chg"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i></span><span class="cnt"><span class="id">NET_AMOUNT_DOC</span></span></div><div class="strip"><span class="nm id">2026-07</span><span class="cells"><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i></span><span class="cnt red"><span class="id">TOTAL,694320</span></span></div></div></div>
  </section>

  <section class="s">
    <h2>Business days without rows</h2>
    <p class="one">The 3 pairs of transaction tables have 9, 17 and 15 business days without rows in 2026, and the week of <span class="nw">2026-06-15</span> is empty in all 6: the extract job did not run.</p>
    <div class="vis"><div class="strips gaps"><div class="strip axis"><span></span><span class="cells"><i>2026-01</i><i></i><i></i><i></i><i></i><i>2026-02</i><i></i><i></i><i></i><i>2026-03</i><i></i><i></i><i></i><i>2026-04</i><i></i><i></i><i></i><i>2026-05</i><i></i><i></i><i></i><i></i><i>2026-06</i><i></i><i></i><i></i><i>2026-07</i><i></i><i></i><i></i><i></i></span><span></span></div><div class="strip"><span class="nm id">purchase_orders</span><span class="cells"><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="part"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="part"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="empty"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i></span><span class="cnt"><b class="orange">9 days</b></span></div><div class="strip"><span class="nm id">purchase_order_lines</span><span class="cells"><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="part"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="part"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="empty"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i></span><span class="cnt"><b class="orange">9 days</b></span></div><div class="strip"><span class="nm id">goods_receipts</span><span class="cells"><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="empty"></i><i class="empty"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="part"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="empty"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i></span><span class="cnt"><b class="orange">17 days</b></span></div><div class="strip"><span class="nm id">goods_receipt_lines</span><span class="cells"><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="empty"></i><i class="empty"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="part"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="empty"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i></span><span class="cnt"><b class="orange">17 days</b></span></div><div class="strip"><span class="nm id">supplier_invoices</span><span class="cells"><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="part"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="part"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="part"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="part"></i><i class="ok"></i><i class="ok"></i><i class="empty"></i><i class="ok"></i><i class="part"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i></span><span class="cnt"><b class="orange">15 days</b></span></div><div class="strip"><span class="nm id">supplier_invoice_lines</span><span class="cells"><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="part"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="part"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="part"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="part"></i><i class="ok"></i><i class="ok"></i><i class="empty"></i><i class="ok"></i><i class="part"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i></span><span class="cnt"><b class="orange">15 days</b></span></div><div class="strip"><span class="nm id">suppliers</span><span class="cells"><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i></span><span class="cnt"><b class="">master data</b></span></div><div class="strip"><span class="nm id">supplier_addresses</span><span class="cells"><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i></span><span class="cnt"><b class="">master data</b></span></div><div class="strip"><span class="nm id">price_agreements</span><span class="cells"><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i><i class="dim"></i></span><span class="cnt"><b class="">master data</b></span></div><div class="strip"><span class="nm id">purchase_requisitions</span><span class="cells off"></span><span class="cnt"><b class="red">0 rows</b></span></div></div></div>
  </section>

  <section class="s">
    <h2>Deletion indicator</h2>
    <p class="one">Deleted lines stay in the file with <span class="id">DELETION_FLAG</span> <span class="id">L</span>, and 1,942 lines of 2026-06 are missing from the repeat in the 2026-07 file.</p>
    <div class="vis"><svg viewBox="0 0 1344 144" width="1344" height="144"><text class="lbl" x="0" y="27">empty<tspan>, active</tspan></text><rect class="bar" x="230" y="10" width="760.0" height="26" rx="1"/><text class="val" x="1004.0" y="29">24,044,438 rows</text><text class="lbl" x="0" y="77"><tspan class="m">L</tspan><tspan>, deleted</tspan></text><rect class="bar" x="230" y="60" width="23.1" height="26" rx="1"/><text class="val" x="267.1" y="79">731,204 rows</text><text class="lbl" x="0" y="127"><tspan class="m">S</tspan><tspan>, blocked</tspan></text><rect class="bar" x="230" y="110" width="4.0" height="26" rx="1"/><text class="val" x="248.0" y="129">41,310 rows</text></svg></div>
  </section>

  <section class="s">
    <h2>Goods receipt lines without a purchase order</h2>
    <p class="one">468,542 goods receipt lines (2.1 %) reference purchase order lines archived before <span class="nw">2019-01-01</span>, the start of the extract.</p>
    <div class="vis orph">
      <div class="box"><div class="nm">goods_receipt_lines</div><div class="n">22.3 M<small>rows</small></div></div>
      <div class="links"><div class="link"><svg class="arr" viewBox="0 0 120 24" aria-hidden="true"><path d="M2 12h112M104 4l10 8-10 8"/></svg><span>21.8 M rows</span></div><div class="link bad"><svg class="arr" viewBox="0 0 120 24" aria-hidden="true"><path d="M2 12h112M104 4l10 8-10 8"/></svg><span>468,542 rows</span></div></div>
      <div class="targets">
        <div class="box"><div class="nm">purchase_order_lines</div><div class="n">24.8 M<small>rows</small></div></div>
        <div class="box miss"><div class="nm">archived before 2019-01-01</div><div class="n">not in the extract</div></div>
      </div>
    </div>
  </section>

  <section class="s">
    <h2>Orphans per foreign key</h2>
    <p class="one">After the <span class="id">SUPPLIER_ID</span> normalisation, 4 of the 9 foreign keys have orphans, and the largest share is goods receipt lines to purchase order lines at 2.1 %.</p>
    <div class="vis"><table class="t mx"><tr><th></th><th class="c top" colspan="5">Parent table</th></tr><tr><th>Child table</th><th class="c">purchase_orders</th><th class="c">purchase_order_lines</th><th class="c">goods_receipts</th><th class="c">supplier_invoices</th><th class="c">suppliers</th></tr><tr><td class="m col">purchase_orders</td><td class="c"></td><td class="c"></td><td class="c"></td><td class="c"></td><td class="c orange">0.2 %</td></tr><tr><td class="m col">purchase_order_lines</td><td class="c dim">0.0 %</td><td class="c"></td><td class="c"></td><td class="c"></td><td class="c"></td></tr><tr><td class="m col">goods_receipt_lines</td><td class="c"></td><td class="c orange">2.1 %</td><td class="c dim">0.0 %</td><td class="c"></td><td class="c"></td></tr><tr><td class="m col">supplier_invoices</td><td class="c"></td><td class="c"></td><td class="c"></td><td class="c"></td><td class="c dim">0.0 %</td></tr><tr><td class="m col">supplier_invoice_lines</td><td class="c"></td><td class="c orange">0.4 %</td><td class="c"></td><td class="c dim">0.0 %</td><td class="c"></td></tr><tr><td class="m col">supplier_addresses</td><td class="c"></td><td class="c"></td><td class="c"></td><td class="c"></td><td class="c orange">0.9 %</td></tr><tr><td class="m col">price_agreements</td><td class="c"></td><td class="c"></td><td class="c"></td><td class="c"></td><td class="c dim">0.0 %</td></tr></table></div>
  </section>

  <section class="s">
    <h2>Columns without information</h2>
    <p class="one">23 columns are 100 % null and 11 columns are constant, so the 23 null columns are not loaded.</p>
    <div class="vis"><div class="strips"><div class="strip"><span class="nm id">purchase_orders</span><span class="cells"><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="dead"></i><i class="dead"></i><i class="dead"></i><i class="const"></i></span><span class="cnt"><b class="red">3 null</b>, <b class="orange">1 constant</b></span></div><div class="strip"><span class="nm id">purchase_order_lines</span><span class="cells"><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="dead"></i><i class="dead"></i><i class="dead"></i><i class="const"></i><i class="const"></i></span><span class="cnt"><b class="red">3 null</b>, <b class="orange">2 constant</b></span></div><div class="strip"><span class="nm id">goods_receipts</span><span class="cells"><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="dead"></i><i class="const"></i></span><span class="cnt"><b class="red">1 null</b>, <b class="orange">1 constant</b></span></div><div class="strip"><span class="nm id">goods_receipt_lines</span><span class="cells"><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="dead"></i><i class="dead"></i></span><span class="cnt"><b class="red">2 null</b></span></div><div class="strip"><span class="nm id">supplier_invoices</span><span class="cells"><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="dead"></i><i class="dead"></i><i class="const"></i></span><span class="cnt"><b class="red">2 null</b>, <b class="orange">1 constant</b></span></div><div class="strip"><span class="nm id">supplier_invoice_lines</span><span class="cells"><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="dead"></i><i class="const"></i></span><span class="cnt"><b class="red">1 null</b>, <b class="orange">1 constant</b></span></div><div class="strip"><span class="nm id">suppliers</span><span class="cells"><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="dead"></i><i class="dead"></i><i class="dead"></i><i class="dead"></i><i class="dead"></i><i class="dead"></i><i class="dead"></i><i class="const"></i><i class="const"></i><i class="const"></i></span><span class="cnt"><b class="red">7 null</b>, <b class="orange">3 constant</b></span></div><div class="strip"><span class="nm id">supplier_addresses</span><span class="cells"><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="dead"></i><i class="dead"></i><i class="dead"></i><i class="dead"></i><i class="const"></i><i class="const"></i></span><span class="cnt"><b class="red">4 null</b>, <b class="orange">2 constant</b></span></div><div class="strip"><span class="nm id">price_agreements</span><span class="cells"><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i></span><span class="cnt"><b>0</b></span></div><div class="strip"><span class="nm id">purchase_requisitions</span><span class="cells"><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i></span><span class="cnt"><b>0</b></span></div></div></div>
  </section>

  <section class="s">
    <h2>Leading and trailing whitespace</h2>
    <p class="one">19 text columns carry leading or trailing whitespace in 2.4 M cells, among them the 4,224 supplier IDs with trailing spaces.</p>
    <div class="vis"><div class="strips"><div class="strip"><span class="nm id">purchase_orders</span><span class="cells"><i class="ok"></i><i class="const"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="const"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i></span><span class="cnt"><b class="orange">2 columns</b></span></div><div class="strip"><span class="nm id">purchase_order_lines</span><span class="cells"><i class="ok"></i><i class="ok"></i><i class="const"></i><i class="ok"></i><i class="const"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="const"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i></span><span class="cnt"><b class="orange">3 columns</b></span></div><div class="strip"><span class="nm id">goods_receipts</span><span class="cells"><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="const"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i></span><span class="cnt"><b class="orange">1 column</b></span></div><div class="strip"><span class="nm id">goods_receipt_lines</span><span class="cells"><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i></span><span class="cnt"><b>0</b></span></div><div class="strip"><span class="nm id">supplier_invoices</span><span class="cells"><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="const"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="const"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i></span><span class="cnt"><b class="orange">2 columns</b></span></div><div class="strip"><span class="nm id">supplier_invoice_lines</span><span class="cells"><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i></span><span class="cnt"><b>0</b></span></div><div class="strip"><span class="nm id">suppliers</span><span class="cells"><i class="const"></i><i class="const"></i><i class="const"></i><i class="ok"></i><i class="ok"></i><i class="const"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="const"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="const"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i></span><span class="cnt"><b class="orange">6 columns</b></span></div><div class="strip"><span class="nm id">supplier_addresses</span><span class="cells"><i class="ok"></i><i class="const"></i><i class="const"></i><i class="const"></i><i class="ok"></i><i class="ok"></i><i class="const"></i><i class="ok"></i><i class="const"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i></span><span class="cnt"><b class="orange">5 columns</b></span></div><div class="strip"><span class="nm id">price_agreements</span><span class="cells"><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i></span><span class="cnt"><b>0</b></span></div><div class="strip"><span class="nm id">purchase_requisitions</span><span class="cells"><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i><i class="ok"></i></span><span class="cnt"><b>0</b></span></div></div></div>
  </section>

  <section class="s">
    <h2>Column names</h2>
    <p class="one">22 column names need cleaning before they become identifiers.</p>
    <div class="vis"><table class="t names"><tr><th class="">Problem</th><th class="num">Columns</th><th class="grow">Example</th></tr><tr><td class="col">trailing spaces in the header</td><td class="num">18</td><td class="dim"><span class="id">SUPPLIER_NAME</span><b class="red">␣</b></td></tr><tr><td class="col">the same name twice</td><td class="num">2</td><td class="dim"><span class="id">STATUS</span> and <span class="id">status</span> in <span class="id">supplier_invoices</span>, loaded as <span class="id">status</span> and <span class="id">status_2</span></td></tr><tr><td class="col">no name</td><td class="num">1</td><td class="dim">column 23 of suppliers, no header and no values</td></tr><tr><td class="col">a non-ASCII character</td><td class="num">1</td><td class="dim"><span class="id">MENGE_STÜCK</span> in <span class="id">purchase_requisitions</span>, loaded as <span class="id"><span class="id">menge_stueck</span></span></td></tr></table></div>
  </section>

  <section class="s">
    <h2>Text lengths</h2>
    <p class="one">1,106 supplier names are exactly 35 characters, the field length of the old ERP, so they are truncated, and 11,306 IBANs are written with spaces.</p>
    <div class="vis"><svg viewBox="0 0 1344 348" width="1344" height="348"><text class="lbl"><tspan class="m" x="0" y="30">SUPPLIER_NAME</tspan></text><line class="rng red" x1="371.9" y1="23" x2="668.6" y2="23"/><text class="val" x="359.9" y="30" text-anchor="end">2</text><text class="val red" x="680.6" y="30">35</text><text class="lbl"><tspan class="m" x="0" y="80">PO_TEXT</tspan></text><line class="rng" x1="300.0" y1="73" x2="1160.0" y2="73"/><text class="val" x="288.0" y="80" text-anchor="end">1</text><text class="val" x="1172.0" y="80">4,000</text><text class="lbl"><tspan class="m" x="0" y="130">MATERIAL_DESCRIPTION</tspan></text><line class="rng" x1="413.9" y1="123" x2="682.5" y2="123"/><text class="val" x="401.9" y="130" text-anchor="end">3</text><text class="val" x="694.5" y="130">40</text><text class="lbl"><tspan class="m" x="0" y="180">CONTACT_EMAIL</tspan></text><line class="rng" x1="501.8" y1="173" x2="755.7" y2="173"/><text class="val" x="489.8" y="180" text-anchor="end">7</text><text class="val" x="767.7" y="180">81</text><text class="lbl"><tspan class="m" x="0" y="230">IBAN</tspan></text><line class="rng red" x1="620.5" y1="223" x2="641.7" y2="223"/><text class="val" x="608.5" y="230" text-anchor="end">22</text><text class="val red" x="653.7" y="230">27</text><text class="lbl"><tspan class="m" x="0" y="280">SUPPLIER_ID</tspan></text><line class="rng" x1="466.9" y1="273" x2="515.6" y2="273"/><text class="val" x="454.9" y="280" text-anchor="end">5</text><text class="val" x="527.6" y="280">8</text><line class="base" x1="300" y1="306" x2="1160" y2="306"/><line class="tick" x1="300.0" y1="306" x2="300.0" y2="314"/><text class="axis" x="300.0" y="338" text-anchor="middle">1</text><line class="tick" x1="538.8" y1="306" x2="538.8" y2="314"/><text class="axis" x="538.8" y="338" text-anchor="middle">10</text><line class="tick" x1="777.5" y1="306" x2="777.5" y2="314"/><text class="axis" x="777.5" y="338" text-anchor="middle">100</text><line class="tick" x1="1016.3" y1="306" x2="1016.3" y2="314"/><text class="axis" x="1016.3" y="338" text-anchor="middle">1,000</text><text class="axis" x="1184" y="338">characters</text></svg></div>
  </section>

  <section class="s">
    <h2>Currency codes</h2>
    <p class="one"><span class="id">supplier_invoice_lines.CURRENCY</span> has 12 distinct values for 4 currencies, and the euro alone is written 9 ways.</p>
    <div class="vis"><table class="t cur"><tr><th class="">Written as</th><th class="num">Rows</th><th class=""></th><th class="grow">Currency</th></tr><tr><td class="m"><span class="chip">EUR</span></td><td class="num">13,208,330</td><td class="bar"><svg viewBox="0 0 160 18" width="160" height="18"><rect class="b" x="0" y="2" width="160" height="14" rx="1"/></svg></td><td class="dim">euro</td></tr><tr><td class="m"><span class="chip">eur</span></td><td class="num">2,827,334</td><td class="bar"><svg viewBox="0 0 160 18" width="160" height="18"><rect class="b" x="0" y="2" width="34" height="14" rx="1"/></svg></td><td class="dim">euro</td></tr><tr><td class="m"><span class="chip">EURO</span></td><td class="num">1,010,221</td><td class="bar"><svg viewBox="0 0 160 18" width="160" height="18"><rect class="b" x="0" y="2" width="12" height="14" rx="1"/></svg></td><td class="dim">euro</td></tr><tr><td class="m"><span class="chip">€</span></td><td class="num">612,480</td><td class="bar"><svg viewBox="0 0 160 18" width="160" height="18"><rect class="b" x="0" y="2" width="7" height="14" rx="1"/></svg></td><td class="dim">euro</td></tr><tr><td class="m"><span class="chip">Euro</span></td><td class="num">302,116</td><td class="bar"><svg viewBox="0 0 160 18" width="160" height="18"><rect class="b" x="0" y="2" width="5" height="14" rx="1"/></svg></td><td class="dim">euro</td></tr><tr><td class="m"><span class="chip">978</span></td><td class="num">148,902</td><td class="bar"><svg viewBox="0 0 160 18" width="160" height="18"><rect class="b" x="0" y="2" width="5" height="14" rx="1"/></svg></td><td class="dim">euro, the ISO 4217 numeric code</td></tr><tr><td class="m"><span class="chip">EUR </span></td><td class="num">96,441</td><td class="bar"><svg viewBox="0 0 160 18" width="160" height="18"><rect class="b" x="0" y="2" width="5" height="14" rx="1"/></svg></td><td class="dim">euro, with a trailing space</td></tr><tr><td class="m"><span class="chip">E</span></td><td class="num">71,300</td><td class="bar"><svg viewBox="0 0 160 18" width="160" height="18"><rect class="b" x="0" y="2" width="5" height="14" rx="1"/></svg></td><td class="dim">euro</td></tr><tr><td class="m"><span class="chip">Eur</span></td><td class="num">34,544</td><td class="bar"><svg viewBox="0 0 160 18" width="160" height="18"><rect class="b" x="0" y="2" width="5" height="14" rx="1"/></svg></td><td class="dim">euro</td></tr><tr><td class="m"><span class="chip">USD</span></td><td class="num">802,111</td><td class="bar"><svg viewBox="0 0 160 18" width="160" height="18"><rect class="b" x="0" y="2" width="10" height="14" rx="1"/></svg></td><td class="dim">US dollar</td></tr><tr><td class="m"><span class="chip">GBP</span></td><td class="num">388,019</td><td class="bar"><svg viewBox="0 0 160 18" width="160" height="18"><rect class="b" x="0" y="2" width="5" height="14" rx="1"/></svg></td><td class="dim">pound sterling</td></tr><tr><td class="m"><span class="chip">CHF</span></td><td class="num">102,540</td><td class="bar"><svg viewBox="0 0 160 18" width="160" height="18"><rect class="b" x="0" y="2" width="5" height="14" rx="1"/></svg></td><td class="dim">Swiss franc</td></tr></table></div>
  </section>

  <section class="s">
    <h2>Placeholder values</h2>
    <p class="one">5 placeholder values mark missing data, and 184,026 negative quantities in <span class="id">goods_receipt_lines</span> are reversals.</p>
    <div class="vis"><table class="t ph"><tr><th class="">Value</th><th class="">Column</th><th class="num">Rows</th><th class="grow">Meaning</th></tr><tr><td class="m"><span class="chip">9999-12-31</span></td><td class="m dim">purchase_orders.PROMISED_DATE</td><td class="num">612,408</td><td class="dim">no promised date</td></tr><tr><td class="m"><span class="chip">1900-01-01</span></td><td class="m dim">supplier_invoices.INVOICE_DATE</td><td class="num">8,412</td><td class="dim">date missing, defaulted by the ERP</td></tr><tr><td class="m"><span class="chip">0</span></td><td class="m dim">supplier_invoice_lines.NET_AMOUNT</td><td class="num">1,204,377</td><td class="dim">free-of-charge lines and missing amounts, not separable</td></tr><tr><td class="m"><span class="chip">UNKNOWN</span></td><td class="m dim">suppliers.SUPPLIER_NAME</td><td class="num">2,116</td><td class="dim">name missing</td></tr><tr><td class="m"><span class="chip">-1</span></td><td class="m dim">purchase_order_lines.QUANTITY</td><td class="num">91,208</td><td class="dim">quantity missing</td></tr></table></div>
  </section>

  <section class="s">
    <h2>Restricted columns</h2>
    <p class="one">4 columns hold personal or bank data, and the contract marks them before the load.</p>
    <div class="vis"><table class="t pii"><tr><th class="">Column</th><th class="num">Filled rows</th><th class="grow">Data category</th></tr><tr><td class="m col">supplier_addresses.CONTACT_EMAIL</td><td class="num">58,112</td><td class="dim">email address</td></tr><tr><td class="m col">supplier_addresses.CONTACT_PHONE</td><td class="num">61,004</td><td class="dim">phone number</td></tr><tr><td class="m col">suppliers.IBAN</td><td class="num">44,790</td><td class="dim">bank account</td></tr><tr><td class="m col">suppliers.TAX_ID</td><td class="num">47,900</td><td class="dim">tax number</td></tr></table></div>
  </section>

  <section class="s">
    <h2>Purchase requisitions per month</h2>
    <p class="one"><span class="id">purchase_requisitions</span> has no rows after <span class="nw">2025-11-30</span>, the day the source team retired the requisition module.</p>
    <div class="vis"><svg class="months" viewBox="0 0 1344 262" width="1344" height="262"><rect class="bar" x="0.0" y="157.1" width="11" height="62.9"/><line class="tick" x1="0.0" y1="220" x2="0.0" y2="228"/><text class="axis" x="0.0" y="252">2019</text><rect class="bar" x="14.7" y="134.2" width="11" height="85.8"/><rect class="bar" x="29.5" y="98.2" width="11" height="121.8"/><rect class="bar" x="44.2" y="135.1" width="11" height="84.9"/><rect class="bar" x="58.9" y="121.9" width="11" height="98.1"/><rect class="bar" x="73.7" y="125.9" width="11" height="94.1"/><rect class="bar" x="88.4" y="133.8" width="11" height="86.2"/><rect class="bar" x="103.1" y="150.5" width="11" height="69.5"/><rect class="bar" x="117.8" y="114.1" width="11" height="105.9"/><rect class="bar" x="132.6" y="99.8" width="11" height="120.2"/><rect class="bar" x="147.3" y="111.6" width="11" height="108.4"/><rect class="bar" x="162.0" y="157.0" width="11" height="63.0"/><rect class="bar" x="176.8" y="149.9" width="11" height="70.1"/><line class="tick" x1="176.8" y1="220" x2="176.8" y2="228"/><text class="axis" x="176.8" y="252">2020</text><rect class="bar" x="191.5" y="107.6" width="11" height="112.4"/><rect class="bar" x="206.2" y="106.9" width="11" height="113.1"/><rect class="bar" x="221.0" y="123.8" width="11" height="96.2"/><rect class="bar" x="235.7" y="111.3" width="11" height="108.7"/><rect class="bar" x="250.4" y="101.2" width="11" height="118.8"/><rect class="bar" x="265.1" y="111.5" width="11" height="108.5"/><rect class="bar" x="279.9" y="147.3" width="11" height="72.7"/><rect class="bar" x="294.6" y="71.3" width="11" height="148.7"/><rect class="bar" x="309.3" y="104.8" width="11" height="115.2"/><rect class="bar" x="324.1" y="73.9" width="11" height="146.1"/><rect class="bar" x="338.8" y="147.9" width="11" height="72.1"/><rect class="bar" x="353.5" y="150.6" width="11" height="69.4"/><line class="tick" x1="353.5" y1="220" x2="353.5" y2="228"/><text class="axis" x="353.5" y="252">2021</text><rect class="bar" x="368.2" y="121.0" width="11" height="99.0"/><rect class="bar" x="383.0" y="91.3" width="11" height="128.7"/><rect class="bar" x="397.7" y="98.0" width="11" height="122.0"/><rect class="bar" x="412.4" y="117.3" width="11" height="102.7"/><rect class="bar" x="427.2" y="104.0" width="11" height="116.0"/><rect class="bar" x="441.9" y="101.5" width="11" height="118.5"/><rect class="bar" x="456.6" y="142.6" width="11" height="77.4"/><rect class="bar" x="471.4" y="77.3" width="11" height="142.7"/><rect class="bar" x="486.1" y="95.8" width="11" height="124.2"/><rect class="bar" x="500.8" y="95.2" width="11" height="124.8"/><rect class="bar" x="515.6" y="144.6" width="11" height="75.4"/><rect class="bar" x="530.3" y="133.2" width="11" height="86.8"/><line class="tick" x1="530.3" y1="220" x2="530.3" y2="228"/><text class="axis" x="530.3" y="252">2022</text><rect class="bar" x="545.0" y="103.7" width="11" height="116.3"/><rect class="bar" x="559.7" y="82.0" width="11" height="138.0"/><rect class="bar" x="574.5" y="97.2" width="11" height="122.8"/><rect class="bar" x="589.2" y="101.0" width="11" height="119.0"/><rect class="bar" x="603.9" y="105.5" width="11" height="114.5"/><rect class="bar" x="618.7" y="88.0" width="11" height="132.0"/><rect class="bar" x="633.4" y="129.4" width="11" height="90.6"/><rect class="bar" x="648.1" y="80.4" width="11" height="139.6"/><rect class="bar" x="662.9" y="65.7" width="11" height="154.3"/><rect class="bar" x="677.6" y="67.0" width="11" height="153.0"/><rect class="bar" x="692.3" y="123.2" width="11" height="96.8"/><rect class="bar" x="707.0" y="126.2" width="11" height="93.8"/><line class="tick" x1="707.0" y1="220" x2="707.0" y2="228"/><text class="axis" x="707.0" y="252">2023</text><rect class="bar" x="721.8" y="101.0" width="11" height="119.0"/><rect class="bar" x="736.5" y="44.0" width="11" height="176.0"/><rect class="bar" x="751.2" y="105.9" width="11" height="114.1"/><rect class="bar" x="766.0" y="94.5" width="11" height="125.5"/><rect class="bar" x="780.7" y="81.6" width="11" height="138.4"/><rect class="bar" x="795.4" y="102.9" width="11" height="117.1"/><rect class="bar" x="810.1" y="129.0" width="11" height="91.0"/><rect class="bar" x="824.9" y="80.7" width="11" height="139.3"/><rect class="bar" x="839.6" y="51.7" width="11" height="168.3"/><rect class="bar" x="854.3" y="46.5" width="11" height="173.5"/><rect class="bar" x="869.1" y="125.0" width="11" height="95.0"/><rect class="bar" x="883.8" y="116.6" width="11" height="103.4"/><line class="tick" x1="883.8" y1="220" x2="883.8" y2="228"/><text class="axis" x="883.8" y="252">2024</text><rect class="bar" x="898.5" y="92.6" width="11" height="127.4"/><rect class="bar" x="913.3" y="46.3" width="11" height="173.7"/><rect class="bar" x="928.0" y="80.7" width="11" height="139.3"/><rect class="bar" x="942.7" y="80.6" width="11" height="139.4"/><rect class="bar" x="957.5" y="84.7" width="11" height="135.3"/><rect class="bar" x="972.2" y="69.3" width="11" height="150.7"/><rect class="bar" x="986.9" y="111.1" width="11" height="108.9"/><rect class="bar" x="1001.6" y="51.7" width="11" height="168.3"/><rect class="bar" x="1016.4" y="41.9" width="11" height="178.1"/><rect class="bar" x="1031.1" y="69.9" width="11" height="150.1"/><rect class="bar" x="1045.8" y="115.8" width="11" height="104.2"/><rect class="bar" x="1060.6" y="116.8" width="11" height="103.2"/><line class="tick" x1="1060.6" y1="220" x2="1060.6" y2="228"/><text class="axis" x="1060.6" y="252">2025</text><rect class="bar" x="1075.3" y="58.2" width="11" height="161.8"/><rect class="bar" x="1090.0" y="30.0" width="11" height="190.0"/><rect class="bar" x="1104.8" y="85.1" width="11" height="134.9"/><rect class="bar" x="1119.5" y="80.4" width="11" height="139.6"/><rect class="bar" x="1134.2" y="68.3" width="11" height="151.7"/><rect class="bar" x="1148.9" y="94.0" width="11" height="126.0"/><rect class="bar" x="1163.7" y="118.8" width="11" height="101.2"/><rect class="bar" x="1178.4" y="57.6" width="11" height="162.4"/><rect class="bar" x="1193.1" y="59.4" width="11" height="160.6"/><rect class="bar" x="1207.9" y="61.6" width="11" height="158.4"/><line class="tick" x1="1237.3" y1="220" x2="1237.3" y2="228"/><text class="axis" x="1237.3" y="252">2026</text><rect class="gap" x="1220.7" y="30" width="123.3" height="190" rx="4"/><text class="note red m" x="1282.4" y="130" text-anchor="middle">0 rows</text><line class="base" x1="0" y1="220" x2="1344" y2="220"/></svg></div>
  </section>

  <section class="s">
    <h2>Findings</h2>
    <p class="one">21 findings, each with the rows it affects and the decision the contract needs.</p>
    <div class="vis"><table class="t find"><tr><th class=""></th><th class="">Finding</th><th class="num">Affected</th><th class="grow">Contract decision</th></tr><tr><td class="num dim">1</td><td class="col">Missing values are written 5 ways</td><td class="num">239.6 M cells</td><td class="wrap dim">null tokens: <span class="id">NULL</span>, <span class="id">\N</span>, <span class="id">N/A</span>, <span class="id">0000-00-00</span> and the empty field</td></tr><tr><td class="num dim">2</td><td class="col">3 date formats in 1 column</td><td class="num">6.1 M rows</td><td class="wrap dim"><span class="id">dd.MM.yyyy</span> before 2024-03-04, <span class="id">yyyy-MM-dd</span> after; 12,406 Excel serial numbers</td></tr><tr><td class="num dim">3</td><td class="col">Timestamps without a time zone</td><td class="num">87.7 M rows</td><td class="wrap dim">Europe/Berlin before 2024-03-04, UTC after, stored as UTC; <span class="id">goods_receipts.POSTED_AT</span> loaded as DATE</td></tr><tr><td class="num dim">4</td><td class="col"><span class="id">SUPPLIER_ID</span> written 3 ways</td><td class="num">48,212 IDs</td><td class="wrap dim">normalise to 8 digits with leading zeros; 41,870 suppliers</td></tr><tr><td class="num dim">5</td><td class="col">Duplicate rows in <span class="id">purchase_order_lines</span></td><td class="num">1,389,204 rows</td><td class="wrap dim">1 row per <span class="id">PO_ID</span>, <span class="id">LINE_NO</span>, from the latest file; <span class="id">UPDATED_AT</span> is the extract time, not a change date</td></tr><tr><td class="num dim">6</td><td class="col">Schema drift in the monthly files</td><td class="num">4 files</td><td class="wrap dim">columns matched by name, <span class="nw">case-insensitive</span>; the trailer row dropped</td></tr><tr><td class="num dim">7</td><td class="col">Business days without rows</td><td class="num">9, 17 and 15 days</td><td class="wrap dim">a business day with 0 rows fails the load; master data and <span class="id">purchase_requisitions</span> exempt</td></tr><tr><td class="num dim">8</td><td class="col">Deleted and blocked lines stay in the file</td><td class="num">772,514 rows</td><td class="wrap dim"><span class="id">L</span> as <span class="id">is_deleted</span>, <span class="id">S</span> as <span class="id">is_blocked</span>; a line missing from the repeated month is a hard delete, 1,942 in 2026-07</td></tr><tr><td class="num dim">9</td><td class="col">Goods receipt lines without a purchase order</td><td class="num">468,542 rows</td><td class="wrap dim">purchase order lines archived before 2019-01-01; kept with a flag</td></tr><tr><td class="num dim">10</td><td class="col">Orphans in 4 of 9 foreign keys</td><td class="num">0.2 % to 2.1 %</td><td class="wrap dim">every foreign key checked at load; orphans kept with a flag per foreign key</td></tr><tr><td class="num dim">11</td><td class="col">2 files in Latin-1</td><td class="num">11,408 names</td><td class="wrap dim">encoding per file: Latin-1 for <span class="id">suppliers</span> and <span class="id">supplier_addresses</span></td></tr><tr><td class="num dim">12</td><td class="col">Placeholder values</td><td class="num">1.9 M cells</td><td class="wrap dim"><span class="id">9999-12-31</span>, <span class="id">1900-01-01</span>, <span class="id">-1</span> and <span class="id">UNKNOWN</span> read as missing; 0 in <span class="id">NET_AMOUNT</span> kept</td></tr><tr><td class="num dim">13</td><td class="col">The euro written 9 ways</td><td class="num">18.3 M rows</td><td class="wrap dim">a code list for <span class="id">CURRENCY</span>: <span class="id">EUR</span>, <span class="id">USD</span>, <span class="id">GBP</span>, <span class="id">CHF</span></td></tr><tr><td class="num dim">14</td><td class="col">Leading and trailing whitespace</td><td class="num">19 columns</td><td class="wrap dim">every text column trimmed at load</td></tr><tr><td class="num dim">15</td><td class="col">IBAN written with spaces</td><td class="num">11,306 rows</td><td class="wrap dim">spaces inside IBAN removed; a German IBAN has 22 characters</td></tr><tr><td class="num dim">16</td><td class="col">Column names need cleaning</td><td class="num">22 columns</td><td class="wrap dim">trimmed, <span class="nw">lower-cased</span>, <span class="nw">de-duplicated</span> with a suffix, non-ASCII transliterated; the empty unnamed column dropped</td></tr><tr><td class="num dim">17</td><td class="col">Truncated text</td><td class="num">1,106 names</td><td class="wrap dim"><span class="id">SUPPLIER_NAME</span> is <span class="id">CHAR(35)</span> in the old ERP; the name of the 8-digit ID from the new ERP wins, otherwise flagged</td></tr><tr><td class="num dim">18</td><td class="col">Columns without information</td><td class="num">34 of 205</td><td class="wrap dim">drop the 23 null columns, keep the 11 constant columns</td></tr><tr><td class="num dim">19</td><td class="col">Personal and bank data</td><td class="num">4 columns</td><td class="wrap dim">email, phone, IBAN and tax number are restricted</td></tr><tr><td class="num dim">20</td><td class="col"><span class="id">purchase_requisitions</span> ends in 2025-11</td><td class="num">0 rows after 2025-11-30</td><td class="wrap dim">the table is loaded once, never refreshed</td></tr><tr><td class="num dim">21</td><td class="col">Negative amounts with a trailing minus sign</td><td class="num">203,118 rows</td><td class="wrap dim"><span class="id">1.234,56-</span> in the old ERP rows; the sign is read from the end</td></tr></table></div>
  </section>

  <section class="s">
    <h2>Input for the contract and the pipeline</h2>
    <p class="one">The profile wrote no files. The contract and the pipeline start from these 24 facts.</p>
    <div class="vis copy"><pre><span class="f"><b>Delimiter:</b> &quot;;&quot; in the 10 full files, &quot;,&quot; in the 4 monthly files of purchase_order_lines</span><span class="f"><b>Quoting:</b> double quotes; 1,208 rows with an unescaped quote go to quarantine</span><span class="f"><b>Encoding:</b> UTF-8; Latin-1 for suppliers and supplier_addresses</span><span class="f"><b>Null tokens:</b> NULL, \N, N/A, 0000-00-00, empty field</span><span class="f"><b>Date formats:</b> dd.MM.yyyy before 2024-03-04, yyyy-MM-dd after, Excel serial as integer</span><span class="f"><b>Decimal separator:</b> comma with a thousands separator before 2024-03-04, dot after</span><span class="f"><b>Timestamps:</b> Europe/Berlin before 2024-03-04, UTC after; stored as UTC; goods_receipts.POSTED_AT is a date, loaded as DATE</span><span class="f"><b>Negative amounts:</b> a trailing minus sign in the old ERP rows; negative quantities in goods_receipt_lines are reversals</span><span class="f"><b>Primary keys:</b> PO_ID; PO_ID, LINE_NO; GR_ID; GR_ID, LINE_NO; INVOICE_ID; INVOICE_ID, LINE_NO; SUPPLIER_ID; ADDRESS_ID; AGREEMENT_ID, MATERIAL_NO; REQ_ID</span><span class="f"><b>Foreign keys:</b> lines reference their headers; goods_receipt_lines and supplier_invoice_lines reference purchase_order_lines; purchase_orders, supplier_invoices and supplier_addresses reference suppliers; price_agreements reference suppliers; orphans before 2019-01-01 kept</span><span class="f"><b>Orphans:</b> kept with a flag per foreign key; goods_receipt_lines to purchase_order_lines 2.1 %</span><span class="f"><b>Whitespace:</b> every text column trimmed at load; spaces inside IBAN removed</span><span class="f"><b>Column names:</b> trimmed, lower-cased, de-duplicated with a suffix, non-ASCII transliterated; column 23 of suppliers has no name and no values and is dropped</span><span class="f"><b>Text length:</b> SUPPLIER_NAME up to 35 in the old ERP and truncated; PO_TEXT up to 4,000</span><span class="f"><b>SUPPLIER_ID:</b> 8 digits with leading zeros, trimmed</span><span class="f"><b>Duplicate rows:</b> purchase_order_lines: 1 row per PO_ID, LINE_NO, from the latest file; UPDATED_AT is the extract time, not a change date</span><span class="f"><b>Schema drift:</b> columns matched by name, case-insensitive; PLANT optional; NET_AMOUNT_DOC maps to NET_AMOUNT; the TOTAL trailer row is dropped, and trailer minus 2 must equal the data rows</span><span class="f"><b>Completeness:</b> business days are Monday to Friday without German public holidays; a business day with 0 rows in a daily transaction table fails the load; the gaps of 2026 are recorded and accepted; suppliers, supplier_addresses, price_agreements and purchase_requisitions are exempt</span><span class="f"><b>Deleted rows:</b> DELETION_FLAG L as is_deleted, S as is_blocked; a line missing from the repeated month is a hard delete</span><span class="f"><b>Placeholders:</b> 9999-12-31, 1900-01-01, UNKNOWN and -1 read as missing; 0 in NET_AMOUNT kept</span><span class="f"><b>CURRENCY:</b> code list EUR, USD, GBP, CHF; 9 spellings map to EUR</span><span class="f"><b>Columns not loaded:</b> the 23 null columns; the 11 constant columns stay</span><span class="f"><b>Restricted columns:</b> CONTACT_EMAIL, CONTACT_PHONE, IBAN, TAX_ID</span><span class="f"><b>Arrival:</b> 10 full files; purchase_order_lines monthly, each file repeating the previous month; purchase_requisitions loaded once</span></pre></div>
  </section>
</main>
</body>
</html>
writing-skillsobra/superpowersUse when creating new skills, editing existing skills, or verifying skills work before deploymentStars: 319kUpdated Claude CodeCodexVerifiedInstall
xlsxanthropics/skillsUse this skill any time a spreadsheet file is the primary input or output. This means any task where the user wants to: open, read, edit, or fix an existing .xlsx, .xlsm, .xltx, .csv, or .tsv file (e.g., adding columns, computing formulas, formatting, charting, cleaning messy data); create a new spreadsheet from scratch or from other data sources; or convert between tabular file formats. Trigger especially when the user references a spreadsheet file by name or path — even casually (like "the xlsx in my downloads") — and wants something done to it or produced from it. Also trigger for cleaning or restructuring messy tabular data files (malformed rows, misplaced headers, junk data) into proper spreadsheets. The deliverable must be a spreadsheet file. Do NOT trigger when the primary deliverable is a Word document, HTML report, standalone Python script, database pipeline, or Google Sheets API integration, even if tabular data is involved.Stars: 197kUpdated Claude CodeCodexVerifiedInstall
shipping-and-launchaddyosmani/agent-skillsPrepares production launches. Use when preparing to deploy to production, or when asking what needs to be in place before shipping. Use when you need a pre-launch checklist, when setting up monitoring, when planning a staged rollout, or when you need a rollback strategy.Stars: 118kUpdated Claude CodeCodexVerifiedInstall
childhoodthedotmack/claude-memBabysit a shipped release after merge, publication, or deployment. Verify published packages, production behavior, installed plugins, and late CI or user reports until the observation window is clean; use babysit for PR readiness before release.Stars: 118kUpdated Claude CodeCodexVerifiedInstall