Skip to content

getaero-io/gtm-eng-skills / skills/deepline-crm-cleaning

deepline-crm-cleaning

Verified

Use for CRM audits, duplicate detection, missing or stale fields, job changes, domain checks, acquisitions, parent-child relationships, repair plans, prevention, monitoring, and evaluation. Supports HubSpot, Salesforce, Attio, and mapped exports. Start with read-only analysis. Skip outreach writing, CRM interface design, and unrelated analysis.

FileKindSize
SKILL.mdskill md8.5 KB
adapters/attio.mdmarkdown3.3 KB
adapters/hubspot.mdmarkdown3.4 KB
adapters/other.mdmarkdown1.9 KB
adapters/salesforce.mdmarkdown3.7 KB
jobs/audit.mdmarkdown2.8 KB
jobs/dedupe.mdmarkdown4.6 KB
jobs/employment.mdmarkdown1.0 KB
jobs/enrich.mdmarkdown1.5 KB
jobs/evaluate.mdmarkdown1.8 KB
jobs/hierarchy.mdmarkdown1.9 KB
jobs/monitor.mdmarkdown1.1 KB
jobs/prevent.mdmarkdown1.2 KB
jobs/relationships.mdmarkdown1.0 KB
jobs/repair.mdmarkdown1.6 KB
plays/README.mdmarkdown14.5 KB
plays/audit-crm-snapshot.play.tsscript1.7 KB
plays/bun.lockother2.1 KB
plays/classify-company-domains.play.tsscript882 B
plays/collect-domain-evidence.play.tsscript1.8 KB
plays/collect-hubspot-companies.play.tsscript876 B
plays/deepline.jsonconfig27 B
plays/evaluate-crm-cleaning.play.tsscript3.5 KB
plays/package.jsonmanifest408 B
plays/plan-crm-domain-repairs.play.tsscript1.4 KB
plays/resolve-crm-contact-duplicates.play.tsscript1.9 KB
plays/sample-hubspot-crm.play.tsscript2.3 KB
plays/schemas/receipt.schema.jsonconfig13.1 KB
plays/score-crm-company-candidates.play.tsscript2.3 KB
plays/shared/assets/README.mdmarkdown566 B
plays/shared/assets/public-suffix-list.LICENSE.txtmarkdown16.7 KB
plays/shared/assets/public-suffix-list.txtmarkdown311.1 KB
plays/shared/assets/unicode.LICENSE.txtmarkdown1.9 KB
plays/shared/audit.tsscript30.7 KB
plays/shared/collect-domains.tsscript20.3 KB
plays/shared/company-candidates.tsscript16.7 KB
plays/shared/domain-policy.tsscript7.8 KB
plays/shared/domain-repairs.tsscript13.2 KB
plays/shared/domain.tsscript16.7 KB
plays/shared/duplicates.tsscript21.1 KB
plays/shared/evaluate.tsscript40.9 KB
plays/shared/hubspot.tsscript21.7 KB
plays/shared/identity-evaluation.tsscript14.4 KB
plays/shared/io.tsscript1.8 KB
plays/shared/json.tsscript6.8 KB
plays/shared/native.tsscript1004 B
plays/shared/time.tsscript1.9 KB
plays/shared/unicode-casefold.jsonconfig37.1 KB
shared/domain-evidence.mdmarkdown7.1 KB
shared/entity-model.mdmarkdown4.4 KB
shared/evaluation.mdmarkdown4.4 KB
shared/hierarchy-discovery.mdmarkdown4.5 KB
shared/metrics.mdmarkdown8.2 KB
shared/receipts.mdmarkdown5.9 KB
shared/source-connections.mdmarkdown1.5 KB
skill-metadata.jsonconfig851 B

shared/evaluation.md

View on GitHub
# Evaluation

Test decision quality, procedure correctness, and live CRM behavior separately. Finite tests cannot guarantee every future outcome.

## Freeze the test

1. Define the decision, account unit, output contract, and effective date.
2. Freeze public licensed or synthetic inputs with source, rights, dates, limits, and hashes.
3. Obtain independent labels with evidence, reviewer state, unknowns, and valid alternatives.
4. Split whole people, aliases, legal entities, and corporate families before tuning.
5. Keep labels, answer hints, earlier outputs, and research notes outside candidate access.
6. Pin the skill, code, model settings, dependencies, policy, and source versions.
7. Run the actual candidate in a fresh process with permitted tools and inputs only.
8. Retain prompts, file access, tool trace, outputs, failures, duration, and Deepline charges.

Keep representative samples separate from selected challenge cases. Historical merges prove recorded operations, not correct identity. Provider scores and candidate predictions are not independent labels.

Test skill invocation separately from task success. Supplying expected answers to the grader tests only the grader.

## Grade

Use `evaluate-crm-cleaning.play.ts` with the separate input, label, and prediction files. Keep scoring controls outside the candidate run. Validate IDs, versions, types, evidence, and vocabulary before scoring.

Read `summary`, `cases`, and `failures`. Require `passed === true`; completed execution can still contain a failed grade. Missing or invalid predictions remain failures.

With `artifacts_file`, the grader hashes retained bytes. Without it, validation is `receipt_only`. Neither mode independently proves a live CRM change. Keep original byte hashes separate from recalculated `crm-json-js-v1` fingerprints.

| Task                | Required checks                                                                                    |
| ------------------- | -------------------------------------------------------------------------------------------------- |
| Candidate retrieval | Reviewed-candidate precision; recall over all known positives, including omitted pairs             |
| Duplicate decisions | Pair precision and recall; implied group pairs; group contamination; unresolved pairs and records  |
| Hierarchy           | Directed typed-edge precision and recall; effective dates; complete paths; unresolved parent slots |
| Enrichment          | Correct current fields; conflicts; unresolved fields; useful results per charge                    |
| Repair              | Protected values; exact targets and links; required postconditions; retry and uncertain outcomes   |
| Prevention          | Writer coverage; false accepts and blocks; holds; bypasses; concurrent and repeated events         |

Keep abstained positives in recall. Absent evidence is not a negative label. State whether unresolved coverage uses candidates, all pairs, or records.

Report counts with rates. Use null for zero denominators. Related pairs are not independent trials. Separate missing-field groups from richer benchmark records. Keep explicit no-parent states separate from unknown parent slots.

## Test transfer

Vary IDs, names, domains, regions, account units, source systems, field availability, and record order. Check unchanged outcomes under opaque-ID changes and irrelevant records.

Test shared services, shared contact details, conflicting IDs, stale evidence, incomplete graphs, repeated events, and late events. Include completed and failed deals, asset sales, minority interests, franchises, rebrands, and concurrent jobs.

Use counterfactual cases where a changed legal ID or effective date changes the answer. Synthetic cases test rules; they do not estimate real defect rates.

Retain the first failed result. After inspecting held-out results, treat those cases as regression data. Use new independent families for the next held-out claim.

## Test external effects

Apply the safety rule before tests that change records or incur charges. Use approved disposable records for merges, conversions, unique-key races, restrictions, and event replay.

Retain before/after state, provider receipts, result IDs, and exact preservation checks. Offline simulation does not certify live writes.

Set separate release gates for false merges, unsupported ownership, useful recall, and unresolved coverage. Universal abstention must not pass. Report passed, failed, not run, unsupported, and insufficient evidence separately.
rea-analysis-optimizationmorluto/reaOptimize REA providers and shared analysis workflows for agent context, latency, CPU, and memory while preserving correctness and Evidence. Use for analysis bottlenecks and cache or query design; CI/test-suite optimization belongs to rea-ci-tests-audit.Stars: 472kUpdated Claude CodeCodexVerifiedInstall
rea-ci-tests-auditmorluto/reaAudit REA CI and test suites for correctness, fixture drift, false passes, and measured performance; use for suite or workflow investigations and efficiency changes, rather than ordinary feature testing or a single test failure.Stars: 472kUpdated Claude CodeCodexVerifiedInstall
rea-tool-designmorluto/reaAudit, investigate, design, or change REA investigation tools, CLI/MCP contracts, provider capabilities, and Evidence semantics.Stars: 472kUpdated Claude CodeCodexVerifiedInstall
ponytail-auditDietrichGebert/ponytailQuality audit of the whole repo: bugs, security, real load, missing tests, speed, and what to delete. Most important first.Stars: 194kUpdated Claude CodeCodexVerifiedInstall