Skip to content

shepsci/kaggle-skill / skills/kaggle

kaggle

Flagged

Unified Kaggle skill. Use when the user explicitly mentions Kaggle, kaggle.com, a Kaggle URL, Kaggle competitions, Kaggle datasets/models/notebooks, Kaggle forums/discussions/writeups, Kaggle benchmarks, hackathons hosted on Kaggle, Kaggle badges, or Kaggle account setup. Do not use for generic ML, GPU/TPU, notebook, dataset, benchmark, or data-science tasks unless the user clearly ties them to Kaggle.

FileKindSize
SKILL.mdskill md10.3 KB
modules/README.mdmarkdown2.3 KB
modules/badges/README.mdmarkdown1.6 KB
modules/badges/references/badge-catalog.mdmarkdown6.6 KB
modules/badges/scripts/badge_registry.pyscript8.5 KB
modules/badges/scripts/badge_tracker.pyscript4.1 KB
modules/badges/scripts/orchestrator.pyscript5.3 KB
modules/badges/scripts/phase_1_instant_api.pyscript24.0 KB
modules/badges/scripts/phase_2_competition.pyscript13.5 KB
modules/badges/scripts/phase_3_pipeline.pyscript11.7 KB
modules/badges/scripts/phase_4_browser.pyscript2.2 KB
modules/badges/scripts/phase_5_streaks.pyscript5.6 KB
modules/badges/scripts/templates/README_dataset.mdmarkdown573 B
modules/badges/scripts/templates/dataset-metadata.jsonconfig871 B
modules/badges/scripts/templates/kernel-metadata.jsonconfig412 B
modules/badges/scripts/templates/model-instance-metadata.jsonconfig253 B
modules/badges/scripts/templates/model-metadata.jsonconfig355 B
modules/badges/scripts/templates/python_notebook.ipynbother1.3 KB
modules/badges/scripts/templates/r_notebook.ipynbother1.1 KB
modules/badges/scripts/templates/submission_titanic.csvother2.8 KB
modules/badges/scripts/templates/utility_script.pyscript802 B
modules/badges/scripts/utils.pyscript3.9 KB
modules/benchmarks/README.mdmarkdown1.2 KB
modules/benchmarks/references/benchmark-endpoints.mdmarkdown1.6 KB
modules/benchmarks/references/benchmarks-cli.mdmarkdown4.4 KB
modules/competitions/README.mdmarkdown5.8 KB
modules/competitions/hackathons/README.mdmarkdown2.9 KB
modules/competitions/hackathons/references/episode-endpoints.mdmarkdown2.2 KB
modules/competitions/hackathons/references/hackathon-endpoints.mdmarkdown4.6 KB
modules/competitions/hackathons/scripts/fetch_writeup.pyexecutablescript10.5 KB
modules/competitions/hackathons/scripts/hackathon_overview.pyexecutablescript1.5 KB
modules/competitions/hackathons/scripts/list_writeups.pyexecutablescript9.9 KB
modules/competitions/references/competition-categories.mdmarkdown2.1 KB
modules/competitions/references/competition-operations.mdmarkdown5.7 KB
modules/competitions/references/competition-overview.mdmarkdown3.9 KB
modules/competitions/references/competition-research.mdmarkdown3.0 KB
modules/competitions/scripts/competition_brief.pyscript5.4 KB
modules/competitions/scripts/competition_details.pyscript8.2 KB
modules/competitions/scripts/competition_download.pyscript5.1 KB
modules/competitions/scripts/competition_episodes.pyscript9.2 KB
modules/competitions/scripts/competition_leaderboard.pyscript12.3 KB
modules/competitions/scripts/competition_ledger.pyscript3.3 KB
modules/competitions/scripts/competition_pages.pyexecutablescript1.7 KB
modules/competitions/scripts/competition_status.pyscript9.0 KB
modules/competitions/scripts/competition_submit.pyscript8.9 KB
modules/competitions/scripts/competition_validate.pyscript14.2 KB
modules/competitions/scripts/competition_watch.pyscript5.9 KB
modules/competitions/scripts/list_competitions.pyscript13.3 KB
modules/datasets/README.mdmarkdown2.1 KB
modules/datasets/references/kagglehub-datasets.mdmarkdown2.6 KB
modules/datasets/scripts/dataset_download.pyscript4.1 KB
modules/datasets/scripts/dataset_publish.pyscript5.5 KB
modules/discussions/README.mdmarkdown2.1 KB
modules/discussions/references/writeups.mdmarkdown5.8 KB
modules/discussions/scripts/forums.pyscript22.0 KB
modules/discussions/scripts/leaderboard_writeups.pyscript24.8 KB
modules/models/README.mdmarkdown2.6 KB
modules/models/references/kagglehub-models.mdmarkdown1.7 KB
modules/models/scripts/model_download.pyscript4.5 KB
modules/models/scripts/model_publish.pyscript8.7 KB
modules/notebooks/README.mdmarkdown2.6 KB
modules/notebooks/scripts/notebook_push.pyscript5.7 KB
modules/notebooks/scripts/notebook_run.pyscript2.8 KB
modules/notebooks/scripts/notebook_wait.pyscript3.7 KB
modules/references/README.mdmarkdown454 B
modules/references/cli-reference.mdmarkdown13.4 KB
modules/references/kaggle-knowledge.mdmarkdown7.6 KB
modules/references/mcp-reference.mdmarkdown18.9 KB
modules/setup/README.mdmarkdown3.0 KB
modules/setup/references/kaggle-setup.mdmarkdown6.7 KB
modules/setup/scripts/check_all_credentials.pyscript5.7 KB
modules/setup/scripts/doctor.pyscript10.2 KB
modules/setup/scripts/save_credentials.pyscript3.9 KB
scripts/kaggle_skill.pyscript11.5 KB
shared/__init__.pyscript0 B
shared/competition.pyscript20.0 KB
shared/credentials.pyscript9.6 KB
shared/hub.pyscript2.9 KB
shared/kaggle_cli.pyscript20.7 KB
shared/ledger.pyscript3.6 KB
shared/mcp_client.pyscript11.6 KB
shared/net.pyscript6.9 KB
shared/notebook.pyscript4.4 KB
shared/preflight.pyscript5.1 KB
shared/safe_extract.pyscript2.7 KB
shared/script.pyscript11.2 KB
shared/text.pyscript10.5 KB
shared/untrusted.pyscript7.6 KB

shared/preflight.py

View on GitHub
#!/usr/bin/env python3
"""Refuse to upload a folder that contains credential files.

The Kaggle CLI and kagglehub upload everything in the folder except a short
built-in ignore list (``.git``, ``.cache``, ``.huggingface``). A stray ``.env``
or ``kaggle.json`` would be published with the dataset or model. They follow
links too, so a link to a file or folder outside the upload folder is refused
as well: ``notes.txt`` can point at ``~/.kaggle/kaggle.json``.

    python3 shared/preflight.py ./data

Exit status 0 means nothing suspicious was found. Exit status 5 lists what
was. Set ``KAGGLE_PUBLISH_ALLOW_SECRETS=1`` to upload anyway.
"""

from __future__ import annotations

import fnmatch
import os
import sys
from pathlib import Path

if __package__ in (None, ""):
    sys.path.insert(0, str(Path(__file__).resolve().parent.parent))

from shared import untrusted  # noqa: E402

SECRET_PATTERNS = (
    ".env",
    ".env.*",
    "*.env",
    "kaggle.json",
    "access_token",
    "access_token.txt",
    "credentials.json",
    ".netrc",
    "id_rsa",
    "id_ed25519",
    "*.pem",
    "*.p12",
    "*.pfx",
)
ALLOWED = (".env.example", ".env.sample", ".env.template")
# What the uploaders leave out by themselves (kaggle 2.2.4 and kagglehub 1.0.2):
# `.git` at any depth, `.cache` and `.huggingface` only at the top of the folder.
SKIPPED_ANYWHERE = {".git"}
SKIPPED_AT_TOP = {".cache", ".huggingface"}
OVERRIDE_VAR = "KAGGLE_PUBLISH_ALLOW_SECRETS"
EXIT_REFUSED = 5


def looks_secret(name: str) -> bool:
    """True when a file name looks like a credential file."""
    return name not in ALLOWED and any(fnmatch.fnmatch(name, p) for p in SECRET_PATTERNS)


def links_outside(path: Path, folder: Path) -> bool:
    """True when ``path`` is a link whose target is not inside ``folder``."""
    if not path.is_symlink():
        return False
    try:
        target, base = path.resolve(), folder.resolve()
    except (OSError, RuntimeError):
        return True
    return target != base and base not in target.parents


def find_secret_files(folder: Path) -> list[str]:
    """Relative paths under ``folder`` that look like credential files or link outside it."""
    found: list[str] = []
    for root, dirs, files in os.walk(folder):
        at_top = Path(root) == folder
        dirs[:] = [
            d for d in dirs if d not in SKIPPED_ANYWHERE and not (at_top and d in SKIPPED_AT_TOP)
        ]
        for name in [*dirs, *files]:
            path = Path(root) / name
            relative = str(path.relative_to(folder))
            if links_outside(path, folder):
                found.append(f"{relative} (a link to something outside the folder)")
            elif name in files and looks_secret(name):
                found.append(relative)
    return sorted(found)


def folder_facts(folder: Path) -> tuple[int, int]:
    """How many files an upload of ``folder`` would send, and their total size."""
    count = size = 0
    for root, dirs, files in os.walk(folder):
        at_top = Path(root) == folder
        dirs[:] = [
            d for d in dirs if d not in SKIPPED_ANYWHERE and not (at_top and d in SKIPPED_AT_TOP)
        ]
        for name in files:
            try:
                size += (Path(root) / name).stat().st_size
            except OSError:
                continue
            count += 1
    return count, size


def _amount(size: float) -> str:
    for unit in ("B", "KB", "MB", "GB"):
        if size < 1000 or unit == "GB":
            return f"{size:.0f} {unit}" if unit == "B" else f"{size:.1f} {unit}"
        size /= 1000
    return ""


def size_text(path: Path) -> str:
    """``3.4 MB``: the size of one file."""
    try:
        return _amount(path.stat().st_size)
    except OSError:
        return "size unknown"


def describe(folder: Path) -> str:
    """``./data (12 files, 3.4 MB)`` for a dry run."""
    count, size = folder_facts(folder)
    return f"{folder} ({count} files, {_amount(size)})"


def check(folder: Path) -> int:
    if not folder.is_dir():
        print("error: the upload folder is not a directory", file=sys.stderr)
        return 2
    found = find_secret_files(folder)
    if not found:
        return 0
    allowed = os.environ.get(OVERRIDE_VAR) == "1"
    if allowed:
        print("warning: uploading despite credential-like files or links:", file=sys.stderr)
    else:
        print(
            "error: refusing to upload; these look like credential files or link outside "
            "the folder:",
            file=sys.stderr,
        )
    # File names can come from a Kaggle download that is being republished.
    untrusted.emit_text("\n".join(found), source="local", tool="preflight", file=sys.stderr)
    if allowed:
        return 0
    print(
        f"Remove them, or set {OVERRIDE_VAR}=1 if they are meant to be published.",
        file=sys.stderr,
    )
    return EXIT_REFUSED


def main(argv: list[str] | None = None) -> int:
    args = sys.argv[1:] if argv is None else argv
    if len(args) != 1 or args[0] in ("-h", "--help"):
        print("Usage: preflight.py <folder>")
        return 0 if args and args[0] in ("-h", "--help") else 2
    return check(Path(args[0]))


if __name__ == "__main__":
    sys.exit(main())
deprecation-and-migrationaddyosmani/agent-skillsManages deprecation and migration. Use when removing old systems, APIs, or features. Use when migrating users from one implementation to another. Use when migrating a database schema in production, such as renaming or dropping a column without downtime (expand/contract). Use when deciding whether to maintain or sunset existing code.Stars: 119kUpdated Claude CodeCodexVerifiedInstall
performance-optimizationaddyosmani/agent-skillsOptimizes application performance across frontend, backend, queries, and databases. Use when performance requirements exist, when you suspect performance regressions, when Core Web Vitals or load times need improvement, when N+1 query patterns need fixing, or when profiling reveals bottlenecks.Stars: 119kUpdated Claude CodeCodexVerifiedInstall
agent-cost-reportthedotmack/claude-memBelievable agent cost report for any period, default the last 7 full days PT, not counting today. Measured tokens from Claude Code transcripts priced at OpenRouter list prices (ESTIMATED), measured provider spend when a sanctioned source exists, note-taker cost separate, Timing-style HTML/PDF plus report.json, line-items.csv, evidence.json.Stars: 118kUpdated Claude CodeCodexVerifiedInstall
agent-cost-reportthedotmack/claude-memBelievable agent cost report for any period, default the last 7 full days PT, not counting today. Measured tokens from Claude Code transcripts priced at OpenRouter list prices (ESTIMATED), measured provider spend when a sanctioned source exists, note-taker cost separate, Timing-style HTML/PDF plus report.json, line-items.csv, evidence.json.Stars: 118kUpdated Claude CodeCodexVerifiedInstall