Skip to content

sybil-solutions/inference-optimisation-skill / skills/inference-optimisation

inference-optimisation

Unverified

Hill-climb the serving speed of a local LLM on any hardware (NVIDIA, AMD, Intel, Apple, unified-memory laptops, multi-GPU) and any quantization (GGUF, EXL2/EXL3, AWQ/GPTQ, FP8, MLX, BF16): single-user and concurrent decode tok/s, speculative decoding, prefill tok/s, KV cache size, startup time and TTFT, under a memory cap and with full-context stability. Computes the theoretical ceiling first, runs noise-controlled A/B experiments, keeps a ledger, and qualifies the winner before publishing it. Use when asked to optimise, tune, speed up, benchmark or hill-climb a model server (vLLM, SGLang, llama.cpp, ExLlama/TabbyAPI, MLX, TensorRT-LLM...), to find the maximum possible tok/s on a machine, or to publish a tuned recipe. Triggers: hill climb, tok/s, decode speed, prefill speed, MTP, EAGLE, draft model, speculative decoding, KV cache, TTFT, startup time, theoretical maximum.

Security report

Unverified

Static analysis of one exact version. It reduces risk and shows evidence; it does not certify that a skill is safe.

Commit
fda968e7fc1996aa23c67139c755fe541c9d4be0
Content hash
01663538a4e58ec3455b0c8e793b096363d2e748d071f4a2b8203f22dad79d5e
Scanned
2026-11-17
Scanner version
skillxone-scan-1.0.0
Policy version
0.1-draft
Decision
1 open medium finding to review.
Verification expires
Not applicable

Findings (1 medium, 5 info)

  • mediumNET-UPLOAD-LOCAL-DATAexamples/config-sglang-docker.json:15

    A local file is sent to a remote host.

    "stop": ["bash", "-c", "curl -s -X POST localhost:8000/abort_request -d '{\"abort_all\":true}' -H 'Content-Type: application/json'; sleep 5; docker stop -t 60 llm; docker rm -f llm"],

    Suggested fix: Make uploads explicit to the user, name the destination, and never send files the task does not need.

    Report as false positive

  • infoINT-EXECUTABLE-SCRIPTscripts/bench.py:1

    The skill ships an executable script. Review it before allowing an agent to run it.

    #!/usr/bin/env python3

    Suggested fix: None required. Informational.

    Report as false positive

  • infoINT-EXECUTABLE-SCRIPTscripts/ceiling.py:1

    The skill ships an executable script. Review it before allowing an agent to run it.

    #!/usr/bin/env python3

    Suggested fix: None required. Informational.

    Report as false positive

  • infoINT-EXECUTABLE-SCRIPTscripts/mem.sh:1

    The skill ships an executable script. Review it before allowing an agent to run it.

    #!/usr/bin/env bash

    Suggested fix: None required. Informational.

    Report as false positive

  • infoCMD-SUDOscripts/mem.sh:7

    A command runs with administrator privileges. Severity lowered from low because the surrounding text warns against it.

    # with passwordless sudo for this script, or as root. Never embed a password here.

    Suggested fix: Avoid sudo where possible. If it is required, explain why so the user can decide.

    Report as false positive

  • infoINT-EXECUTABLE-SCRIPTscripts/queue.sh:1

    The skill ships an executable script. Review it before allowing an agent to run it.

    #!/usr/bin/env bash

    Suggested fix: None required. Informational.

    Report as false positive

Checks run

  • prompt-injection
  • dangerous-commands
  • credentials
  • network
  • file-access
  • integrity

Checks skipped

  • dependencies: No dependency manifest in the skill directory.
  • gitleaks: gitleaks is not installed on this host.
slack-gif-creatoranthropics/skillsKnowledge and utilities for creating animated GIFs optimized for Slack. Provides constraints, validation tools, and animation concepts. Use when users request animated GIFs for Slack like "make me a GIF of X doing Y for Slack."Stars: 196kUpdated Claude CodeCodexVerifiedInstall
ponytailDietrichGebert/ponytailLazy senior dev mode for any coding task: the smallest change that fully solves it, and a reply a busy human understands in one read.Stars: 192kUpdated Claude CodeCodexVerifiedInstall
ponytail-debtDietrichGebert/ponytailHarvest every shortcut: comment into one debt ledger, so deferrals get tracked instead of forgotten. One-shot report.Stars: 192kUpdated Claude CodeCodexVerifiedInstall
ponytail-debtDietrichGebert/ponytailList every `shortcut:` comment (and older `ponytail:` ones) as a debt ledger. One-shot report, changes nothing. Use for "ponytail debt", "what did ponytail defer", "list the shortcuts", /ponytail-debt.Stars: 192kUpdated Claude CodeCodexVerifiedInstall