Skip to content

shepsci/kaggle-skill / skills/kaggle

kaggle

Flagged

Unified Kaggle skill. Use when the user explicitly mentions Kaggle, kaggle.com, a Kaggle URL, Kaggle competitions, Kaggle datasets/models/notebooks, Kaggle forums/discussions/writeups, Kaggle benchmarks, hackathons hosted on Kaggle, Kaggle badges, or Kaggle account setup. Do not use for generic ML, GPU/TPU, notebook, dataset, benchmark, or data-science tasks unless the user clearly ties them to Kaggle.

FileKindSize
SKILL.mdskill md10.3 KB
modules/README.mdmarkdown2.3 KB
modules/badges/README.mdmarkdown1.6 KB
modules/badges/references/badge-catalog.mdmarkdown6.6 KB
modules/badges/scripts/badge_registry.pyscript8.5 KB
modules/badges/scripts/badge_tracker.pyscript4.1 KB
modules/badges/scripts/orchestrator.pyscript5.3 KB
modules/badges/scripts/phase_1_instant_api.pyscript24.0 KB
modules/badges/scripts/phase_2_competition.pyscript13.5 KB
modules/badges/scripts/phase_3_pipeline.pyscript11.7 KB
modules/badges/scripts/phase_4_browser.pyscript2.2 KB
modules/badges/scripts/phase_5_streaks.pyscript5.6 KB
modules/badges/scripts/templates/README_dataset.mdmarkdown573 B
modules/badges/scripts/templates/dataset-metadata.jsonconfig871 B
modules/badges/scripts/templates/kernel-metadata.jsonconfig412 B
modules/badges/scripts/templates/model-instance-metadata.jsonconfig253 B
modules/badges/scripts/templates/model-metadata.jsonconfig355 B
modules/badges/scripts/templates/python_notebook.ipynbother1.3 KB
modules/badges/scripts/templates/r_notebook.ipynbother1.1 KB
modules/badges/scripts/templates/submission_titanic.csvother2.8 KB
modules/badges/scripts/templates/utility_script.pyscript802 B
modules/badges/scripts/utils.pyscript3.9 KB
modules/benchmarks/README.mdmarkdown1.2 KB
modules/benchmarks/references/benchmark-endpoints.mdmarkdown1.6 KB
modules/benchmarks/references/benchmarks-cli.mdmarkdown4.4 KB
modules/competitions/README.mdmarkdown5.8 KB
modules/competitions/hackathons/README.mdmarkdown2.9 KB
modules/competitions/hackathons/references/episode-endpoints.mdmarkdown2.2 KB
modules/competitions/hackathons/references/hackathon-endpoints.mdmarkdown4.6 KB
modules/competitions/hackathons/scripts/fetch_writeup.pyexecutablescript10.5 KB
modules/competitions/hackathons/scripts/hackathon_overview.pyexecutablescript1.5 KB
modules/competitions/hackathons/scripts/list_writeups.pyexecutablescript9.9 KB
modules/competitions/references/competition-categories.mdmarkdown2.1 KB
modules/competitions/references/competition-operations.mdmarkdown5.7 KB
modules/competitions/references/competition-overview.mdmarkdown3.9 KB
modules/competitions/references/competition-research.mdmarkdown3.0 KB
modules/competitions/scripts/competition_brief.pyscript5.4 KB
modules/competitions/scripts/competition_details.pyscript8.2 KB
modules/competitions/scripts/competition_download.pyscript5.1 KB
modules/competitions/scripts/competition_episodes.pyscript9.2 KB
modules/competitions/scripts/competition_leaderboard.pyscript12.3 KB
modules/competitions/scripts/competition_ledger.pyscript3.3 KB
modules/competitions/scripts/competition_pages.pyexecutablescript1.7 KB
modules/competitions/scripts/competition_status.pyscript9.0 KB
modules/competitions/scripts/competition_submit.pyscript8.9 KB
modules/competitions/scripts/competition_validate.pyscript14.2 KB
modules/competitions/scripts/competition_watch.pyscript5.9 KB
modules/competitions/scripts/list_competitions.pyscript13.3 KB
modules/datasets/README.mdmarkdown2.1 KB
modules/datasets/references/kagglehub-datasets.mdmarkdown2.6 KB
modules/datasets/scripts/dataset_download.pyscript4.1 KB
modules/datasets/scripts/dataset_publish.pyscript5.5 KB
modules/discussions/README.mdmarkdown2.1 KB
modules/discussions/references/writeups.mdmarkdown5.8 KB
modules/discussions/scripts/forums.pyscript22.0 KB
modules/discussions/scripts/leaderboard_writeups.pyscript24.8 KB
modules/models/README.mdmarkdown2.6 KB
modules/models/references/kagglehub-models.mdmarkdown1.7 KB
modules/models/scripts/model_download.pyscript4.5 KB
modules/models/scripts/model_publish.pyscript8.7 KB
modules/notebooks/README.mdmarkdown2.6 KB
modules/notebooks/scripts/notebook_push.pyscript5.7 KB
modules/notebooks/scripts/notebook_run.pyscript2.8 KB
modules/notebooks/scripts/notebook_wait.pyscript3.7 KB
modules/references/README.mdmarkdown454 B
modules/references/cli-reference.mdmarkdown13.4 KB
modules/references/kaggle-knowledge.mdmarkdown7.6 KB
modules/references/mcp-reference.mdmarkdown18.9 KB
modules/setup/README.mdmarkdown3.0 KB
modules/setup/references/kaggle-setup.mdmarkdown6.7 KB
modules/setup/scripts/check_all_credentials.pyscript5.7 KB
modules/setup/scripts/doctor.pyscript10.2 KB
modules/setup/scripts/save_credentials.pyscript3.9 KB
scripts/kaggle_skill.pyscript11.5 KB
shared/__init__.pyscript0 B
shared/competition.pyscript20.0 KB
shared/credentials.pyscript9.6 KB
shared/hub.pyscript2.9 KB
shared/kaggle_cli.pyscript20.7 KB
shared/ledger.pyscript3.6 KB
shared/mcp_client.pyscript11.6 KB
shared/net.pyscript6.9 KB
shared/notebook.pyscript4.4 KB
shared/preflight.pyscript5.1 KB
shared/safe_extract.pyscript2.7 KB
shared/script.pyscript11.2 KB
shared/text.pyscript10.5 KB
shared/untrusted.pyscript7.6 KB

modules/datasets/scripts/dataset_publish.py

View on GitHub
#!/usr/bin/env python3
"""Publish a dataset, or a new version of one. A dry run unless --yes is given.

    dataset_publish.py owner/name ./data --notes "what changed"          dry run
    dataset_publish.py owner/name ./data --notes "what changed" --yes    upload
    dataset_publish.py owner/name ./data --via cli --yes                 with the Kaggle CLI

By default kagglehub uploads: it creates the dataset when it does not exist
(private) and adds a version when it does.

--via cli uses the Kaggle CLI and the folder's dataset-metadata.json, which
gives control over the title, the licence and the visibility. Without --notes
it creates the dataset; with --notes it adds a version to an existing one. The
`id` in the metadata must be the dataset you name.

Everything in the folder is uploaded, so the folder is checked for credential
files first (exit status 5). Get the user's go-ahead before --yes.
"""

from __future__ import annotations

import argparse
import json
import sys
from pathlib import Path

SKILL_ROOT = Path(__file__).resolve().parents[3]
sys.path.insert(0, str(SKILL_ROOT))

from shared import credentials, hub, kaggle_cli, preflight, script  # noqa: E402

METADATA_FILE = "dataset-metadata.json"
DEFAULT_NOTES = "Upload via kagglehub"


def publish_with_kagglehub(handle: str, folder: str, notes: str = DEFAULT_NOTES) -> None:
    """Upload ``folder`` as ``handle``. kagglehub returns nothing on success."""
    kagglehub = hub.load()
    kagglehub.dataset_upload(handle=handle, local_dataset_dir=folder, version_notes=notes)


def metadata_id(folder: Path) -> str | None:
    """The ``id`` in the folder's dataset-metadata.json, or None."""
    try:
        data = json.loads((folder / METADATA_FILE).read_text(encoding="utf-8"))
    except (OSError, ValueError):
        return None
    return str(data.get("id") or "") if isinstance(data, dict) else None


def main(argv: list[str] | None = None) -> int:
    parser = argparse.ArgumentParser(
        description="Publish a dataset, or a new version of one. A dry run unless --yes is given.",
        epilog="Uploads everything in the folder. New datasets are private.",
    )
    parser.add_argument("handle", help="The dataset: owner/name")
    parser.add_argument("dir", help="The folder to upload")
    parser.add_argument("notes_pos", nargs="?", help=argparse.SUPPRESS)
    parser.add_argument("--notes", help="Version notes")
    parser.add_argument(
        "--via",
        choices=("kagglehub", "cli"),
        default="kagglehub",
        help="The tool that uploads (default: kagglehub)",
    )
    script.add_yes(parser)
    args = script.parse(parser, argv)
    notes = args.notes or args.notes_pos
    folder = Path(args.dir)

    if not script.is_handle(args.handle, 2):
        parser.error("the dataset is owner/name: letters, digits, '.', '_' and '-'")
    status = preflight.check(folder)
    if status:
        return status

    details = [("dataset", args.handle), ("folder", preflight.describe(folder))]
    if args.via == "cli":
        found = metadata_id(folder)
        if found is None:
            return script.fail(
                f"{folder / METADATA_FILE} is missing or unreadable. Write a template with: "
                f"kaggle datasets init -p {folder}",
                script.EXIT_USAGE,
            )
        if found != args.handle:
            return script.fail(
                f"{METADATA_FILE} names another dataset than the one you gave; fix its id",
                script.EXIT_USAGE,
            )
        action = "add a dataset version" if notes else "create a dataset"
        details.append(("with", f"the Kaggle CLI and {METADATA_FILE}"))
    else:
        action = "create the dataset, or add a version if it exists"
        details.append(("with", "kagglehub"))
    details.append(("notes", notes or ("(none)" if args.via == "cli" else DEFAULT_NOTES)))
    details.append(("visibility", "private when new, unless the metadata says otherwise"))

    gate = script.write_gate(args.yes, action=action, details=details)
    if gate is not None:
        return gate

    credentials.load_configured_env_file()
    if credentials.resolve() is None:
        return script.no_credential("publishing a dataset")
    if args.via == "kagglehub" and not credentials.kagglehub_ready():
        return script.fail(
            "kagglehub does not use an OAuth login. Add --via cli, or create an API "
            'token with "Generate New Token" at https://www.kaggle.com/settings',
            script.EXIT_NO_CREDENTIAL,
        )
    if args.via == "cli":
        if not kaggle_cli.installed():
            return script.missing_package("kaggle", "--via cli")
        # --message=VALUE keeps notes that start with "-" from being read as an option.
        # --dir-mode zip uploads subfolders too; the default skips them.
        if notes:
            cli_args = ["datasets", "version", "-p", str(folder), f"--message={notes}"]
        else:
            cli_args = ["datasets", "create", "-p", str(folder)]
        status = kaggle_cli.run_wrapped(
            [*cli_args, "--dir-mode", "zip"], tool="datasets." + cli_args[1]
        )
        if status != 0:
            return status
    else:
        try:
            publish_with_kagglehub(args.handle, str(folder), notes or DEFAULT_NOTES)
        except Exception as exc:  # noqa: BLE001 - kagglehub raises many types; none should traceback
            return hub.fail("dataset_upload", exc)
    print(f"Dataset uploaded: https://www.kaggle.com/datasets/{args.handle}")
    return script.EXIT_OK


if __name__ == "__main__":
    sys.exit(main())
deprecation-and-migrationaddyosmani/agent-skillsManages deprecation and migration. Use when removing old systems, APIs, or features. Use when migrating users from one implementation to another. Use when migrating a database schema in production, such as renaming or dropping a column without downtime (expand/contract). Use when deciding whether to maintain or sunset existing code.Stars: 119kUpdated Claude CodeCodexVerifiedInstall
performance-optimizationaddyosmani/agent-skillsOptimizes application performance across frontend, backend, queries, and databases. Use when performance requirements exist, when you suspect performance regressions, when Core Web Vitals or load times need improvement, when N+1 query patterns need fixing, or when profiling reveals bottlenecks.Stars: 119kUpdated Claude CodeCodexVerifiedInstall
agent-cost-reportthedotmack/claude-memBelievable agent cost report for any period, default the last 7 full days PT, not counting today. Measured tokens from Claude Code transcripts priced at OpenRouter list prices (ESTIMATED), measured provider spend when a sanctioned source exists, note-taker cost separate, Timing-style HTML/PDF plus report.json, line-items.csv, evidence.json.Stars: 118kUpdated Claude CodeCodexVerifiedInstall
agent-cost-reportthedotmack/claude-memBelievable agent cost report for any period, default the last 7 full days PT, not counting today. Measured tokens from Claude Code transcripts priced at OpenRouter list prices (ESTIMATED), measured provider spend when a sanctioned source exists, note-taker cost separate, Timing-style HTML/PDF plus report.json, line-items.csv, evidence.json.Stars: 118kUpdated Claude CodeCodexVerifiedInstall