Skip to content

xiaoqianran/kaggle-demo / docs/skills/hackathon-judging

hackathon-judging

Verified

Steers Kaggle Hackathon hosts toward defensible LLM-assisted grading workflows collecting writeups and artifacts via the Kaggle MCP server, auditing with hamelsmu/evals-skills, and ranking submissions via pairwise comparisons / ELO with bell-curve adjustments. Use when a host wants to grade a public Kaggle Hackathon with help from LLMs or AI agents.

FileKindSize
README.mdmarkdown1.0 KB
SKILL.mdskill md9.6 KB
# Hackathon Judging Skill

This skill steers Kaggle Hackathon hosts toward defensible LLM-assisted grading. It documents the Kaggle MCP endpoints for retrieving hackathon writeups and attached artifacts, the prerequisites for setting up the MCP client, a 12-step grading workflow (collection → auditing → pairwise scoring → final ranking), and the anti-patterns to avoid.

## Structure

```
hackathon-judging/
├── SKILL.md    # Complete skill file — MCP endpoints, prereqs, workflow, anti-patterns
└── README.md   # This file
```

## Installation

Point your AI coding agent to read `SKILL.md`.

**Gemini CLI** — Copy to the auto-discovery location:
```bash
cp -r hackathon-judging ~/.gemini/skills/hackathon-judging
```

**Other tools** — Ask your agent to read `hackathon-judging/SKILL.md`.

## Related resources

- [hamelsmu/evals-skills](https://github.com/hamelsmu/evals-skills/tree/main) — the auditing toolkit referenced in Step 10.
- [Kaggle MCP server](https://www.kaggle.com/mcp) — endpoint for hackathon writeup retrieval.
rea-analysis-optimizationmorluto/reaOptimize REA providers and shared analysis workflows for agent context, latency, CPU, and memory while preserving correctness and Evidence. Use for analysis bottlenecks and cache or query design; CI/test-suite optimization belongs to rea-ci-tests-audit.Stars: 472kUpdated Claude CodeCodexVerifiedInstall
rea-ci-tests-auditmorluto/reaAudit REA CI and test suites for correctness, fixture drift, false passes, and measured performance; use for suite or workflow investigations and efficiency changes, rather than ordinary feature testing or a single test failure.Stars: 472kUpdated Claude CodeCodexVerifiedInstall
rea-tool-designmorluto/reaAudit, investigate, design, or change REA investigation tools, CLI/MCP contracts, provider capabilities, and Evidence semantics.Stars: 472kUpdated Claude CodeCodexVerifiedInstall
ponytail-auditDietrichGebert/ponytailQuality audit of the whole repo: bugs, security, real load, missing tests, speed, and what to delete. Most important first.Stars: 194kUpdated Claude CodeCodexVerifiedInstall