Skip to content

getaero-io/gtm-eng-skills / engineering/warm-intro-scoring

warm-intro-scoring

Verified

FileKindSize
.gitignoreother121 B
GUIDE.mdmarkdown4.7 KB
LICENSEother1.1 KB
README.mdmarkdown8.0 KB
SKILL.mdskill md327 B
TESTING.mdmarkdown8.9 KB
UPSTREAM.mdmarkdown1.3 KB
assets/company-research.play.tsscript1021 B
assets/customer-db.sqlother2.7 KB
assets/evaluation-example.jsonconfig4.6 KB
assets/example.jsonconfig6.9 KB
assets/portfolio-focus.weights.jsonconfig32 B
assets/review.htmlother7.4 KB
assets/tuning-example.jsonconfig1.2 KB
assets/tuning.htmlother30.1 KB
check_all.pyscript1.4 KB
package-manifest.jsonconfig9.8 KB
plays/README.mdmarkdown18.2 KB
plays/check-report.pyscript1.8 KB
plays/check_all.pyscript1.6 KB
plays/check_parity.pyscript6.0 KB
plays/collect.play.tsscript4.0 KB
plays/collection.tsscript1.9 KB
plays/core.tsscript44.2 KB
plays/evaluation-contract.mdmarkdown3.4 KB
plays/evaluation.tsscript13.8 KB
plays/features.play.tsscript4.7 KB
plays/features.tsscript22.6 KB
plays/generatedtemplate.tsscript38.1 KB
plays/guardrails.tsscript948 B
plays/legacy.tsscript9.7 KB
plays/merge-payloads.pyscript8.6 KB
plays/parity-driver.tsscript995 B
plays/parity-evaluation.pyscript8.5 KB
plays/parity-reports.pyscript2.3 KB
plays/prepare-inputs.pyscript6.5 KB
plays/quality.tsscript3.8 KB
plays/read-sources.play.tsscript3.4 KB
plays/report-cli.tsscript590 B
plays/report.play.tsscript2.9 KB
plays/report.tsscript3.1 KB
plays/reports.tsscript5.7 KB
plays/research.play.tsscript1.6 KB
plays/review-uncertainty.play.tsscript5.5 KB
plays/score.play.tsscript2.3 KB
plays/snapshots.play.tsscript4.2 KB
plays/strict-json.tsscript1.8 KB
plays/sync-template.pyscript849 B
plays/uncertainty.tsscript4.9 KB
plays/validation.play.tsscript3.6 KB
references/adversarial-review.mdmarkdown7.0 KB
references/batch-collection.mdmarkdown5.1 KB
references/company-network.mdmarkdown5.8 KB
references/competitive-review.mdmarkdown8.8 KB
references/evaluation.mdmarkdown8.5 KB
references/evaluator-validation.mdmarkdown3.4 KB
references/evaluator.mdmarkdown7.9 KB
references/external-data.mdmarkdown4.0 KB
references/factor-test-matrix.mdmarkdown4.6 KB
references/factors.mdmarkdown6.1 KB
references/intro-drafts.mdmarkdown1.6 KB
references/pipeline.mdmarkdown7.6 KB
references/readable-output.mdmarkdown5.4 KB
references/research-brief.mdmarkdown2.4 KB
references/sources.mdmarkdown7.5 KB
references/tuning.mdmarkdown14.6 KB
scripts/audit_history.pyscript5.1 KB
scripts/check.pyscript5.1 KB
scripts/compare_versions.pyscript1.9 KB
scripts/evaluate.pyscript22.5 KB
scripts/package-skill.pyscript1.9 KB
scripts/portfolio.pyscript3.7 KB
scripts/quality.pyscript5.3 KB
scripts/recipe-demo.tsscript2.6 KB
scripts/render.pyscript1.6 KB
scripts/score.pyscript9.6 KB
scripts/temporal.pyscript2.2 KB
scripts/test_ask_handoff.pyscript2.1 KB
scripts/test_audit_history.pyscript2.7 KB
scripts/test_handoff_evaluate.pyscript9.1 KB
scripts/test_portfolio.pyscript3.6 KB
scripts/test_quality.pyscript3.1 KB
scripts/test_temporal.pyscript1.3 KB
scripts/test_tuning.pyscript14.1 KB
scripts/test_tuning_browser.cjsscript7.7 KB
scripts/test_version_parity.pyscript1.0 KB
scripts/tuning.pyscript10.9 KB
tests/adversarial.test.tsscript8.2 KB
tests/browser_e2e.cjsscript1.9 KB
tests/cloud_e2e.pyscript6.9 KB
tests/e2e-fixture.jsonconfig3.6 KB
tests/feature_parity.pyscript2.4 KB
tests/features.test.tsscript8.3 KB
tests/test_prepare_inputs.pyscript8.6 KB
tests/uncertainty.test.tsscript2.5 KB
vendor-manifest.jsonconfig748 B

plays/evaluation-contract.md

View on GitHub
# Evaluation and reviewed-evidence contracts

`validation.play.ts` accepts a CSV with `case_id`, `operation`, `payload_json`, and `today`. Optional columns are `expected_json`, `expected_error`, and `max_age_days` (default 180). Supported operations are `evaluate`, `quality`, `legacy`, `temporal`, and `portfolio`.

- `evaluate`: the existing `scripts/evaluate.py` input object. Its `as_of` and each query's `scored_at` are explicit observation cutoffs.
- `quality`: the existing `scripts/quality.py` reviewed-evidence input. `today` is the explicit clock used by the embedded scorer.
- `legacy`: the existing `scripts/score.py` reviewed-evidence input. `today` is the explicit clock. Output preserves the existing model version, fields, path IDs, and review gates.
- `temporal`: `{left, right, as_of}`. Date precision and conservative overlap are preserved.
- `portfolio`: `{graph, company_id}`. `today` is the explicit source-observation cutoff.

The output records each result and a parity status. `pass` requires matching expected output or the requested validation rejection. `not_checked` means no expected output was supplied. A mismatch or missing expected rejection produces `fail`. A runtime `TypeError` or other unexpected exception does not count as a successful expected rejection. Check these statuses after export: a completed Play is not proof of parity.

Numeric comparisons use an absolute tolerance of `1e-12`. The account bootstrap uses CPython's integer-seeded MT19937 and rejection-sampled `randrange`; it does not substitute JavaScript's random generator. No report permits automatic promotion or claims causal uplift.

## Explicit input limits

The JavaScript transport accepts integer seeds from 0 through `2^53−1`. Python accepts seeds through `2^63−1`. Larger seeds fail instead of being rounded. This is a documented input-range difference.

Evaluator timestamps use extended ISO dates and times with seconds and a timezone: `YYYY-MM-DDTHH:MM:SS[.fraction]Z` or a signed `HH:MM` offset. A space separator and decimal comma are accepted. Exact microseconds are retained; further fraction digits are truncated like Python `datetime`. Other valid Python `fromisoformat` spellings, including basic dates and omitted seconds, are not accepted here. Inputs must use the documented format before comparison.

Raw JSON is parsed with duplicate-key and nonfinite-number rejection. An already parsed object cannot retain evidence of duplicate source keys.

## Report rendering

`reports.ts` exposes `renderLegacy(rows, template)` using `assets/review.html` and `renderEvaluation(report)` using the existing evaluator stylesheet and report content. Tests compare the embedded report, visible evaluation tables, warning list, and script escaping. Whitespace and numeric JSON serialization need not be byte-identical to Python HTML.

The old vendor SQL lookup methods and unreviewed contact-search ranking are not part of `scripts/score.py` and are not exposed by this Play.

## Reproduce

```sh
python3 plays/parity-evaluation.py /private/path/validation-cases.csv
python3 plays/parity-reports.py
deepline plays check plays/validation.play.ts
deepline plays run plays/validation.play.ts --input '{"csv":"/private/path/validation-cases.csv"}' --debug
```

The CSV contains fictional fixtures. Export the run and inspect every `result.parity`; keep run receipts outside the repository. Live provider calls and source-truth checks are separate from this deterministic parity test.
slack-gif-creatoranthropics/skillsKnowledge and utilities for creating animated GIFs optimized for Slack. Provides constraints, validation tools, and animation concepts. Use when users request animated GIFs for Slack like "make me a GIF of X doing Y for Slack."Stars: 198kUpdated Claude CodeCodexVerifiedInstall
ponytailDietrichGebert/ponytailLazy senior dev mode for any coding task: the smallest change that fully solves it, and a reply a busy human understands in one read.Stars: 194kUpdated Claude CodeCodexVerifiedInstall
ponytail-debtDietrichGebert/ponytailHarvest every shortcut: comment into one debt ledger, so deferrals get tracked instead of forgotten. One-shot report.Stars: 194kUpdated Claude CodeCodexVerifiedInstall
ponytail-debtDietrichGebert/ponytailList every `shortcut:` comment (and older `ponytail:` ones) as a debt ledger. One-shot report, changes nothing. Use for "ponytail debt", "what did ponytail defer", "list the shortcuts", /ponytail-debt.Stars: 194kUpdated Claude CodeCodexVerifiedInstall