cianfhoghlaim/cianchosaint / .agents/skills/dlt
dlt
Verified| File | Kind | Size |
|---|---|---|
| SKILL.md | skill md | 20.6 KB |
| references/crawl4ai-dlt-summary.md | markdown | 1.8 KB |
| references/dagster-dlt-assets.md | markdown | 3.9 KB |
| references/deploy-gcp-cloud-function-webhook.md | markdown | 2.1 KB |
| references/deploy-gcp-cloud-function.md | markdown | 2.0 KB |
| references/deploy-gcp-cloud-run.md | markdown | 2.4 KB |
| references/deploy-modal.md | markdown | 2.6 KB |
| references/destinations-cognee-memgraph.md | markdown | 3.3 KB |
| references/destinations-graphiti.md | markdown | 3.0 KB |
| references/destinations-lancedb.md | markdown | 3.4 KB |
| references/dlt-baml-orpc-mcp-typesafe-pipeline-analysis.md | markdown | 20.0 KB |
| references/dlt-transformations.md | markdown | 3.3 KB |
| references/dlthub-codebase-analysis.md | markdown | 32.4 KB |
| references/dlthub.md | markdown | 12.5 KB |
| references/openapi-generator.md | markdown | 2.3 KB |
| references/performance-optimisation.md | markdown | 3.3 KB |
| references/sqlmesh-init.md | markdown | 1.7 KB |
| references/type-safe-pipeline.md | markdown | 4.4 KB |
references/openapi-generator.md
View on GitHub# OpenAPI Source Generator (dlt-init-openapi)
`dlt-init-openapi` is a 3rd-party tool that **auto-generates a
verified dlt source from any OpenAPI spec**. It parses the spec,
inspects the example responses, and produces a typed Python module
with one `@dlt.resource` per endpoint.
## Install
```bash
pip install dlt-init-openapi
```
## Usage
```bash
# 1. Download the OpenAPI spec
curl -o spec.json https://api.example.com/openapi.json
# 2. Generate the source
dlt-init-openapi source spec.json --output ./generated_sources/example_api
# 3. Use the generated source
```
The generated module has:
- One `@dlt.source` per tag (e.g. `users`, `orders`, `products`)
- One `@dlt.resource` per endpoint
- Typed `pydantic` models for the response schema
- `incremental` cursor configuration for endpoints that support it
- A `Pipeline` class wired to the dlt destination
```python
# generated_sources/example_api/__init__.py
from .pipeline import example_api_source
source = example_api_source()
load_info = dlt.pipeline(
pipeline_name="example_api",
destination="duckdb",
dataset_name="example",
).run(source)
```
## When to use this
- You're integrating with a **REST API that has an OpenAPI spec**
- The spec is **stable** (the API doesn't change frequently)
- You want a **verified, typed source** without hand-writing the
`@dlt.resource` per endpoint
## When NOT to use this
- The API doesn't have an OpenAPI spec → use `create-rest-api-pipeline`
instead (hand-write the resources)
- The spec is large (> 100 endpoints) → consider scoping to a
subset
- The spec is unstable → you'll regenerate often, hand-writing is
more stable
## Cianfhoghlaim usage
- `dlt/british_isles/ireland/` (NCCA, SEC, DES) — most
Irish sources are hand-written (no OpenAPI spec)
- `dlt/british_isles/northern_ireland/ccea_curriculum.py` —
CCEA pages, hand-written
- `dlt/british_isles/medicine/ie/hse.py` — HSE OpenData
portal (some endpoints have OpenAPI specs; could be migrated to
`dlt-init-openapi` for auto-generation)
## Reference
- The `dlt_OpenAPI_Generator.py` reference (the full generator
workflow) was in `docs/dlt/` (deleted with the
`sync-skills-from-docs` change)
- The `dlt-init-openapi` docs: <https://github.com/dlt-hub/dlt-init-openapi>
- The `create-rest-api-pipeline` sub-skill for the hand-written
approach
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| slack-gif-creatoranthropics/skillsKnowledge and utilities for creating animated GIFs optimized for Slack. Provides constraints, validation tools, and animation concepts. Use when users request animated GIFs for Slack like "make me a GIF of X doing Y for Slack." | Stars: 198k | Updated | Claude CodeCodex | Verified | Install |
| ponytailDietrichGebert/ponytailLazy senior dev mode for any coding task: the smallest change that fully solves it, and a reply a busy human understands in one read. | Stars: 194k | Updated | Claude CodeCodex | Verified | Install |
| ponytail-debtDietrichGebert/ponytailHarvest every shortcut: comment into one debt ledger, so deferrals get tracked instead of forgotten. One-shot report. | Stars: 194k | Updated | Claude CodeCodex | Verified | Install |
| ponytail-debtDietrichGebert/ponytailList every `shortcut:` comment (and older `ponytail:` ones) as a debt ledger. One-shot report, changes nothing. Use for "ponytail debt", "what did ponytail defer", "list the shortcuts", /ponytail-debt. | Stars: 194k | Updated | Claude CodeCodex | Verified | Install |