Skip to content

shepsci/kaggle-skill / skills/kaggle

kaggle

Flagged

Unified Kaggle skill. Use when the user explicitly mentions Kaggle, kaggle.com, a Kaggle URL, Kaggle competitions, Kaggle datasets/models/notebooks, Kaggle forums/discussions/writeups, Kaggle benchmarks, hackathons hosted on Kaggle, Kaggle badges, or Kaggle account setup. Do not use for generic ML, GPU/TPU, notebook, dataset, benchmark, or data-science tasks unless the user clearly ties them to Kaggle.

FileKindSize
SKILL.mdskill md10.3 KB
modules/README.mdmarkdown2.3 KB
modules/badges/README.mdmarkdown1.6 KB
modules/badges/references/badge-catalog.mdmarkdown6.6 KB
modules/badges/scripts/badge_registry.pyscript8.5 KB
modules/badges/scripts/badge_tracker.pyscript4.1 KB
modules/badges/scripts/orchestrator.pyscript5.3 KB
modules/badges/scripts/phase_1_instant_api.pyscript24.0 KB
modules/badges/scripts/phase_2_competition.pyscript13.5 KB
modules/badges/scripts/phase_3_pipeline.pyscript11.7 KB
modules/badges/scripts/phase_4_browser.pyscript2.2 KB
modules/badges/scripts/phase_5_streaks.pyscript5.6 KB
modules/badges/scripts/templates/README_dataset.mdmarkdown573 B
modules/badges/scripts/templates/dataset-metadata.jsonconfig871 B
modules/badges/scripts/templates/kernel-metadata.jsonconfig412 B
modules/badges/scripts/templates/model-instance-metadata.jsonconfig253 B
modules/badges/scripts/templates/model-metadata.jsonconfig355 B
modules/badges/scripts/templates/python_notebook.ipynbother1.3 KB
modules/badges/scripts/templates/r_notebook.ipynbother1.1 KB
modules/badges/scripts/templates/submission_titanic.csvother2.8 KB
modules/badges/scripts/templates/utility_script.pyscript802 B
modules/badges/scripts/utils.pyscript3.9 KB
modules/benchmarks/README.mdmarkdown1.2 KB
modules/benchmarks/references/benchmark-endpoints.mdmarkdown1.6 KB
modules/benchmarks/references/benchmarks-cli.mdmarkdown4.4 KB
modules/competitions/README.mdmarkdown5.8 KB
modules/competitions/hackathons/README.mdmarkdown2.9 KB
modules/competitions/hackathons/references/episode-endpoints.mdmarkdown2.2 KB
modules/competitions/hackathons/references/hackathon-endpoints.mdmarkdown4.6 KB
modules/competitions/hackathons/scripts/fetch_writeup.pyexecutablescript10.5 KB
modules/competitions/hackathons/scripts/hackathon_overview.pyexecutablescript1.5 KB
modules/competitions/hackathons/scripts/list_writeups.pyexecutablescript9.9 KB
modules/competitions/references/competition-categories.mdmarkdown2.1 KB
modules/competitions/references/competition-operations.mdmarkdown5.7 KB
modules/competitions/references/competition-overview.mdmarkdown3.9 KB
modules/competitions/references/competition-research.mdmarkdown3.0 KB
modules/competitions/scripts/competition_brief.pyscript5.4 KB
modules/competitions/scripts/competition_details.pyscript8.2 KB
modules/competitions/scripts/competition_download.pyscript5.1 KB
modules/competitions/scripts/competition_episodes.pyscript9.2 KB
modules/competitions/scripts/competition_leaderboard.pyscript12.3 KB
modules/competitions/scripts/competition_ledger.pyscript3.3 KB
modules/competitions/scripts/competition_pages.pyexecutablescript1.7 KB
modules/competitions/scripts/competition_status.pyscript9.0 KB
modules/competitions/scripts/competition_submit.pyscript8.9 KB
modules/competitions/scripts/competition_validate.pyscript14.2 KB
modules/competitions/scripts/competition_watch.pyscript5.9 KB
modules/competitions/scripts/list_competitions.pyscript13.3 KB
modules/datasets/README.mdmarkdown2.1 KB
modules/datasets/references/kagglehub-datasets.mdmarkdown2.6 KB
modules/datasets/scripts/dataset_download.pyscript4.1 KB
modules/datasets/scripts/dataset_publish.pyscript5.5 KB
modules/discussions/README.mdmarkdown2.1 KB
modules/discussions/references/writeups.mdmarkdown5.8 KB
modules/discussions/scripts/forums.pyscript22.0 KB
modules/discussions/scripts/leaderboard_writeups.pyscript24.8 KB
modules/models/README.mdmarkdown2.6 KB
modules/models/references/kagglehub-models.mdmarkdown1.7 KB
modules/models/scripts/model_download.pyscript4.5 KB
modules/models/scripts/model_publish.pyscript8.7 KB
modules/notebooks/README.mdmarkdown2.6 KB
modules/notebooks/scripts/notebook_push.pyscript5.7 KB
modules/notebooks/scripts/notebook_run.pyscript2.8 KB
modules/notebooks/scripts/notebook_wait.pyscript3.7 KB
modules/references/README.mdmarkdown454 B
modules/references/cli-reference.mdmarkdown13.4 KB
modules/references/kaggle-knowledge.mdmarkdown7.6 KB
modules/references/mcp-reference.mdmarkdown18.9 KB
modules/setup/README.mdmarkdown3.0 KB
modules/setup/references/kaggle-setup.mdmarkdown6.7 KB
modules/setup/scripts/check_all_credentials.pyscript5.7 KB
modules/setup/scripts/doctor.pyscript10.2 KB
modules/setup/scripts/save_credentials.pyscript3.9 KB
scripts/kaggle_skill.pyscript11.5 KB
shared/__init__.pyscript0 B
shared/competition.pyscript20.0 KB
shared/credentials.pyscript9.6 KB
shared/hub.pyscript2.9 KB
shared/kaggle_cli.pyscript20.7 KB
shared/ledger.pyscript3.6 KB
shared/mcp_client.pyscript11.6 KB
shared/net.pyscript6.9 KB
shared/notebook.pyscript4.4 KB
shared/preflight.pyscript5.1 KB
shared/safe_extract.pyscript2.7 KB
shared/script.pyscript11.2 KB
shared/text.pyscript10.5 KB
shared/untrusted.pyscript7.6 KB

shared/notebook.py

View on GitHub
"""Kaggle notebook runs: the status, the wait, the output and the log.

Everything goes through ``shared/kaggle_cli.py``, so the environment is
cleaned and Kaggle's text is printed as untrusted content.
"""

from __future__ import annotations

import json
import re
import sys
import time
from pathlib import Path
from typing import Callable

from shared import kaggle_cli, script, untrusted

METADATA_FILE = "kernel-metadata.json"
_STATUS_RE = re.compile(r'has status "([A-Za-z_.]*)"')
FAILED_STATES = frozenset({"ERROR", "CANCEL_REQUESTED", "CANCEL_ACKNOWLEDGED"})
MAX_FAILED_CHECKS = 5


def read_metadata(folder: Path) -> dict | None:
    """The folder's ``kernel-metadata.json``, or None when it is missing or unreadable."""
    try:
        data = json.loads((folder / METADATA_FILE).read_text(encoding="utf-8"))
    except (OSError, ValueError):
        return None
    return data if isinstance(data, dict) else None


def status(slug: str) -> str | None:
    """The run's state as one upper-case word, ``""`` when the CLI's answer has
    none, or None when the status call failed."""
    result = kaggle_cli.run(["kernels", "status", slug], timeout=120)
    if result.returncode != 0:
        return None
    found = _STATUS_RE.findall(result.stdout)
    # The CLI prints `KernelWorkerStatus.COMPLETE` in some versions.
    return found[-1].rsplit(".", 1)[-1].upper() if found else ""


def wait(
    slug: str,
    interval: int = 30,
    max_wait: int = 3600,
    *,
    sleep: Callable[[float], None] | None = None,
) -> int:
    """Wait for a run to finish.

    Returns 0 complete, 1 failed or cancelled, 124 still running after
    ``max_wait`` seconds, 4 the status could not be read five times in a row.
    """
    elapsed = 0
    failures = 0
    while True:
        state = status(slug)
        stamp = time.strftime("%H:%M:%S")
        if state is None:
            failures += 1
            print(f"[{stamp}] status check failed ({failures} in a row)", file=sys.stderr)
            if failures >= MAX_FAILED_CHECKS:
                return script.EXIT_UNAVAILABLE
        else:
            failures = 0
            print(f"[{stamp}] status: {state or 'UNKNOWN'}")
            if state == "COMPLETE":
                return script.EXIT_OK
            if state in FAILED_STATES:
                return script.EXIT_FAILED
        if elapsed >= max_wait:
            return script.EXIT_TIMEOUT
        (sleep or time.sleep)(interval)
        elapsed += interval


def download_output(slug: str, folder: Path) -> int:
    """Download a run's output after checking its file names.

    Returns 5 when a name would escape ``folder`` and 4 when the names cannot
    be listed. Nothing is downloaded in either case.
    """
    bad = kaggle_cli.unsafe_kernel_output_names(slug)
    if bad is None:
        return script.fail(
            "could not list the notebook's output files to check their names; "
            "nothing was downloaded",
            script.EXIT_UNAVAILABLE,
        )
    if bad:
        print(
            "error: refusing to download; output file names escape the target folder:",
            file=sys.stderr,
        )
        untrusted.emit_text(
            "\n".join(bad),
            source="kaggle-cli",
            tool="kernels.files",
            stream="stderr",
            file=sys.stderr,
        )
        return script.EXIT_REFUSED
    folder.mkdir(parents=True, exist_ok=True)
    return kaggle_cli.run_wrapped(
        ["kernels", "output", slug, "--path", str(folder), "--quiet"], tool="kernels.output"
    )


def print_log_tail(slug: str, lines: int = 40, max_chars: int = 4000) -> None:
    """Print the end of a run's log on standard error. A notebook log can be very long.

    The tail is cut to ``max_chars`` too: one progress-bar line can be megabytes.
    """
    result = kaggle_cli.run(["kernels", "logs", slug], timeout=300)
    log = (result.stdout or result.stderr).strip()
    if not log:
        print("The log is empty or could not be read.", file=sys.stderr)
        return
    rows = log.splitlines()
    shown = rows[-lines:]
    tail = "\n".join(shown)
    if len(tail) > max_chars:
        tail = tail[-max_chars:]
        print(f"The last {max_chars:,} characters of the log:", file=sys.stderr)
    else:
        print(f"The last {len(shown)} of {len(rows)} log lines:", file=sys.stderr)
    untrusted.emit_text(tail, source="kaggle-cli", tool="kernels.logs", file=sys.stderr)
deprecation-and-migrationaddyosmani/agent-skillsManages deprecation and migration. Use when removing old systems, APIs, or features. Use when migrating users from one implementation to another. Use when migrating a database schema in production, such as renaming or dropping a column without downtime (expand/contract). Use when deciding whether to maintain or sunset existing code.Stars: 119kUpdated Claude CodeCodexVerifiedInstall
performance-optimizationaddyosmani/agent-skillsOptimizes application performance across frontend, backend, queries, and databases. Use when performance requirements exist, when you suspect performance regressions, when Core Web Vitals or load times need improvement, when N+1 query patterns need fixing, or when profiling reveals bottlenecks.Stars: 119kUpdated Claude CodeCodexVerifiedInstall
agent-cost-reportthedotmack/claude-memBelievable agent cost report for any period, default the last 7 full days PT, not counting today. Measured tokens from Claude Code transcripts priced at OpenRouter list prices (ESTIMATED), measured provider spend when a sanctioned source exists, note-taker cost separate, Timing-style HTML/PDF plus report.json, line-items.csv, evidence.json.Stars: 118kUpdated Claude CodeCodexVerifiedInstall
agent-cost-reportthedotmack/claude-memBelievable agent cost report for any period, default the last 7 full days PT, not counting today. Measured tokens from Claude Code transcripts priced at OpenRouter list prices (ESTIMATED), measured provider spend when a sanctioned source exists, note-taker cost separate, Timing-style HTML/PDF plus report.json, line-items.csv, evidence.json.Stars: 118kUpdated Claude CodeCodexVerifiedInstall