Skip to content

hashgraph-online/awesome-codex-plugins / plugins/beastlabai/multi-llm-plugin/skills/multi-llm

multi-llm

Flagged

Orchestrate plan reviews, task generation, implementation and code reviews across several LLM CLIs in parallel, or ask every model one free-text question about a plan. Use when the user says: review my plan, multi-llm, run a code review, generate tasks from a plan, implement this plan, ask the models about my plan.

FileKindSize
SKILL.mdskill md4.0 KB
apply_code_fixes_orchestrator.pyscript56.6 KB
apply_commit_fixes_orchestrator.pyscript2.3 KB
apply_suggestions_orchestrator.pyscript4.5 KB
apply_task_suggestions_orchestrator.pyscript19.1 KB
ask_orchestrator.pyscript162.5 KB
assets/icons/Anthropic.svgother584 B
assets/icons/Codex.svgother1.3 KB
assets/icons/Copilot.svgother1.5 KB
assets/icons/Cursor.svgother793 B
assets/icons/GoogleGemini.svgother623 B
assets/icons/Goose.svgother3.2 KB
assets/icons/Kilocode.svgother531 B
assets/icons/MiniMax.pngbinary1.5 KB
assets/icons/Mistral.svgother717 B
assets/icons/MoonshotAI.svgother957 B
assets/icons/Nvidia.svgother2.4 KB
assets/icons/OhMyPi.svgother434 B
assets/icons/OpenAI.svgother1.7 KB
assets/icons/Opencode.svgother325 B
assets/icons/Pi.svgother440 B
assets/icons/Qwen.svgother1.7 KB
assets/icons/Zhipu.pngbinary442 B
assets/icons/xAI.svgother343 B
assets/omp/overlay.ymlconfig2.4 KB
check_workflow_prerequisites.pyscript74.5 KB
code_review_orchestrator.pyscript324.0 KB
display_decisions.pyscript9.8 KB
finalize_tracking.pyscript1.3 KB
full_workflow_orchestrator.pyscript58.8 KB
generate_tasks_orchestrator.pyscript44.2 KB
hosts/capabilities.yamlconfig49.9 KB
hosts/codex/plugin-skill.md.tmplother2.8 KB
hosts/codex/shim.md.tmplother7.3 KB
hosts/opencode/plugin-command.md.tmplother2.2 KB
hosts/opencode/shim.md.tmplother6.8 KB
hosts/render_capabilities.pyscript48.4 KB
hosts/snippets/poll-loop.mdmarkdown4.4 KB
hosts/snippets/uv-preflight.mdmarkdown2.2 KB
hosts/uv-missing.txtmarkdown1.5 KB
implement_orchestrator.pyscript156.0 KB
improve_code_orchestrator.pyscript1.6 KB
improve_commits_orchestrator.pyscript2.5 KB
improve_plan_orchestrator.pyscript1.6 KB
init_config.pyscript57.6 KB
instructions/apply-code-fixes.mdmarkdown52.0 KB
instructions/apply-commit-fixes.mdmarkdown10.3 KB
instructions/apply-suggestions.mdmarkdown48.2 KB
instructions/apply-task-suggestions.mdmarkdown53.9 KB
instructions/ask.mdmarkdown27.6 KB
instructions/full-workflow.mdmarkdown24.6 KB
instructions/generate-tasks.mdmarkdown18.1 KB
instructions/implement.mdmarkdown54.0 KB
instructions/improve-code.mdmarkdown25.0 KB
instructions/improve-commits.mdmarkdown24.8 KB
instructions/improve-plan.mdmarkdown26.2 KB
instructions/init-config.mdmarkdown6.6 KB
instructions/review-code.mdmarkdown43.5 KB
instructions/review-commits.mdmarkdown11.4 KB
instructions/review-plan.mdmarkdown38.4 KB
instructions/review-tasks.mdmarkdown37.8 KB
modes.pyscript58.8 KB
multi_llm.pyscript101.1 KB
prompts/ask.txtmarkdown948 B
prompts/code_review.txtmarkdown4.5 KB
prompts/commit_review.txtmarkdown6.2 KB
prompts/consolidate_suggestions.txtmarkdown3.1 KB
prompts/implementation_task.txtmarkdown1.4 KB
prompts/plan_review.txtmarkdown8.0 KB
prompts/task_review.txtmarkdown8.3 KB
providers.yamlconfig19.6 KB
pyproject.tomlmanifest6.8 KB
references/apply-write-executor.mdmarkdown3.0 KB
references/consolidation.mdmarkdown5.6 KB
references/host-capabilities.mdmarkdown13.5 KB
references/human-decision-batch.mdmarkdown17.2 KB
references/implement-prerequisites.mdmarkdown6.0 KB
references/implement-write-executor.mdmarkdown4.9 KB
references/interrupted-run-recovery.mdmarkdown3.1 KB
references/own-check.mdmarkdown4.3 KB
references/resume-detection.mdmarkdown8.5 KB
references/revalidation.mdmarkdown6.9 KB
references/review-code-apply-fixes.mdmarkdown4.3 KB
references/salvage-handling.mdmarkdown12.5 KB
references/summary-format.mdmarkdown10.0 KB
references/uv-check.mdmarkdown5.7 KB
references/wave-batching.mdmarkdown5.2 KB
review_commits_orchestrator.pyscript2.3 KB
review_plan_orchestrator.pyexecutablescript22.3 KB
review_tasks_orchestrator.pyscript10.7 KB
schemas/cascade_record.schema.jsonconfig6.6 KB
schemas/code_review_issues.schema.jsonconfig2.0 KB
schemas/consolidated.schema.jsonconfig6.8 KB
schemas/consolidation_batch.schema.jsonconfig3.7 KB
schemas/generated_tasks.schema.jsonconfig3.1 KB
schemas/host_capabilities.schema.jsonconfig38.3 KB
schemas/human_decision_verdicts.schema.jsonconfig2.6 KB
schemas/result_line.schema.jsonconfig10.1 KB
schemas/review_suggestions.schema.jsonconfig2.4 KB
schemas/state_file.schema.jsonconfig21.5 KB
schemas/status_file.schema.jsonconfig24.9 KB
schemas/status_json.schema.jsonconfig10.8 KB
schemas/subagent_tasks.schema.jsonconfig20.5 KB
schemas/task_decomposition.schema.jsonconfig1.2 KB
schemas/write_batch_result.schema.jsonconfig8.8 KB
templates/config/providers.override.yamlconfig17.2 KB
templates/consolidated_report_template.htmlother44.1 KB
templates/pr_report_template.htmlother181.2 KB
templates/report_template.htmlother67.5 KB
templates/shared/report_core.cssother4.1 KB
templates/shared/report_core.jsscript25.5 KB
update_plan_tasks.pyscript20.9 KB
utils/__init__.pyscript284 B
utils/advisory.pyscript4.8 KB
utils/apply_orchestrator_base.pyscript220.6 KB
utils/apply_output_helpers.pyscript10.9 KB
utils/apply_path_helpers.pyscript683 B
utils/apply_report.pyscript51.2 KB
utils/apply_selection_helpers.pyscript6.8 KB
utils/apply_suggestion_phase.pyscript11.7 KB
utils/atomic_io.pyscript12.9 KB
utils/attempt_classifier.pyscript31.4 KB
utils/backup.pyscript2.0 KB
utils/batch_done.pyscript79.2 KB
utils/batch_ledger.pyscript27.4 KB
utils/batch_prompt.pyscript29.3 KB
utils/batch_prompt_builder.pyscript12.2 KB
utils/batch_reply.pyscript32.9 KB
utils/cascade_archive.pyscript50.6 KB
utils/cascade_ledger.pyscript39.3 KB
utils/cascade_provenance.pyscript22.0 KB
utils/check_records.pyscript59.3 KB
utils/check_reply.pyscript9.5 KB
utils/check_tree.pyscript1.2 KB
utils/cli_common.pyscript91.2 KB
utils/cli_version_cache.pyscript14.0 KB
utils/clock.pyscript3.5 KB
utils/code_fix_batcher.pyscript30.6 KB
utils/codex_trust.pyscript12.9 KB
utils/commit_apply.pyscript73.3 KB
utils/commit_attribution.pyscript21.2 KB
utils/commit_brief.pyscript32.2 KB
utils/commit_front_door.pyscript81.6 KB
utils/commit_paths.pyscript18.0 KB
utils/commit_range.pyscript61.2 KB
utils/commit_report.pyscript19.9 KB
utils/commit_review.pyscript413 B
utils/commit_spelling.pyscript7.9 KB
utils/commit_write_guard.pyscript9.9 KB
utils/concurrency.pyscript11.6 KB
utils/consolidation.pyscript87.3 KB
utils/detach.pyscript186.8 KB
utils/dispatch_spawn.pyscript56.3 KB
utils/doctor.pyscript76.7 KB
utils/env_vars.pyscript20.5 KB
utils/failure_capture.pyscript10.1 KB
utils/file_discovery.pyscript11.0 KB
utils/filtering.pyscript19.9 KB
utils/git_diff.pyscript23.6 KB
utils/git_utils.pyscript86.6 KB
utils/held_folder.pyscript21.3 KB
utils/host_capabilities.pyscript48.0 KB
utils/host_install.pyscript77.6 KB
utils/host_paths.pyscript12.0 KB
utils/host_routes/__init__.pyscript5.7 KB
utils/host_routes/codex.pyscript18.3 KB
utils/host_routes/npm.pyscript12.2 KB
utils/host_shim.pyscript14.7 KB
utils/html_report_generator.pyscript118.9 KB
utils/human_decisions.pyscript38.3 KB
utils/human_task_plan.pyscript30.2 KB
utils/importance.pyscript6.2 KB
utils/improve_cascade.pyscript63.7 KB
utils/improve_cascade_next.pyscript22.2 KB
utils/improve_steps.pyscript32.4 KB
utils/improve_workflow.pyscript114.4 KB
utils/interactive.pyscript31.6 KB
utils/json_extractor.pyscript61.5 KB
utils/judge_vocab.pyscript5.3 KB
utils/known_checks.pyscript37.5 KB
utils/landlock_dispatch.pyscript103.8 KB
utils/landlock_exec.pyscript21.4 KB
utils/launch_limiter.pyscript13.5 KB
utils/llm_client.pyscript126.9 KB
utils/manual_tasks.pyscript14.9 KB
utils/metrics.pyscript68.1 KB
utils/next_phase.pyscript96.1 KB
utils/next_phase_words.pyscript6.4 KB
utils/output_handler.pyscript23.2 KB
utils/phase_walk.pyscript6.4 KB
utils/plan_updater.pyscript17.9 KB
utils/positionals.pyscript5.8 KB
utils/prior_changes.pyscript28.7 KB
utils/probe_state.pyscript17.9 KB
utils/process_capture.pyscript37.6 KB
utils/process_control.pyscript228.7 KB
utils/process_state.pyscript6.6 KB
utils/progress_tracker.pyscript92.2 KB
utils/prompt_channels.pyscript34.1 KB
utils/prompt_files.pyscript24.5 KB

utils/apply_selection_helpers.py

View on GitHub
"""Selection helper utilities for apply orchestrators.

Provides shared functions for checking user-skipped items, merging
validation with groups, resolving priority arguments, and merging
user-edited descriptions. Extracted from the three apply orchestrators.
"""

import copy
import sys
from typing import Any, Dict, List, Set, Tuple

from .scope_policy import attach_verdict
from .state_manager import group_join_ids, records_by_unique_id


def _is_user_skipped(group: Dict[str, Any], skipped_ids: Set[str]) -> bool:
    """Check if a group corresponds to a user-skipped suggestion ID."""
    # Check suggestions within the group for matching IDs
    for s in group.get("suggestions", []):
        if s.get("id") in skipped_ids:
            return True
    # Also check group-level id if present
    if group.get("id") in skipped_ids:
        return True
    return False


def merge_validation_with_groups(
    groups: List[Dict[str, Any]],
    validation: List[Dict[str, Any]]
) -> List[Dict[str, Any]]:
    """Merge validation results into grouped suggestions.

    Joins by stable content hash (validation ``group_id`` == group
    ``group_hash``) when available, falling back to positional
    ``group_index`` for legacy data that predates group_id.

    Hash-based matching is required because validation results are not
    guaranteed to be in the same order as the groups array — reaggregation
    and priority sorting can reorder one but not the other. A pure
    positional join silently attaches each validation status/reason to the
    wrong group, dropping genuinely-valid fixes into needs-human and
    force-routing needs-human items into to-apply. Mirrors the logic in
    ``validation.apply_validation_to_groups`` used by the review path.

    Scope authority (plans/scope-policy-and-report-tags.md §3) transfers only
    through the stable-hash join: the matched record's host-stamped verdict
    becomes the group's ``scope_verdict`` (``scope_policy.attach_verdict``).
    The positional fallback keeps its validity behaviour but never carries
    scope authority, and any verdict the group arrived with is dropped, so
    the group reads ``unclear``. Validity fields are unaffected either way.
    """
    # Primary lookup: stamped group id -> validation record (an id two
    # records carry is left out: it cannot say which group each judged)
    validation_by_id = records_by_unique_id(validation, "group_id")
    # Fallback lookup: positional index -> validation record (legacy data)
    validation_by_index = {
        v.get("group_index", i): v for i, v in enumerate(validation)
    }

    merged = []
    join_ids = group_join_ids(groups)
    for i, group in enumerate(groups):
        group_copy = dict(group)
        group_copy["group_index"] = i  # Track original index
        # The stamped group_hash, or the plain content hash for a group never
        # stamped, each only where it names this one group (same-content
        # groups share the plain hash).
        hashed = next(
            (validation_by_id[key] for key in join_ids[i] if key in validation_by_id),
            None,
        )
        val = (
            hashed
            or validation_by_index.get(i)
            or {}
        )
        group_copy["validation_status"] = val.get("status", "needs-human-decision")
        group_copy["validation_reason"] = val.get("reason", "No validation result")
        group_copy["validation_confidence"] = val.get("confidence", 0.0)
        # Copy error_type and recoverable fields
        if "error_type" in val:
            group_copy["validation_error_type"] = val.get("error_type")
        if "recoverable" in val:
            group_copy["validation_recoverable"] = val.get("recoverable")
        attach_verdict(group_copy, hashed, hash_matched=hashed is not None)
        merged.append(group_copy)

    return merged


def resolve_priority_args(args) -> str:
    """Resolve --include-low and --min-priority to a single min_priority value.

    Handles both the legacy --include-low flag (deprecated) and the
    current --min-priority argument. If the args namespace does not
    have an ``include_low`` attribute (e.g. apply_task_suggestions),
    only --min-priority is checked.
    """
    include_low = getattr(args, 'include_low', False)
    min_priority = getattr(args, 'min_priority', None)

    if include_low and min_priority:
        print("WARNING: --include-low and --min-priority both set; using --min-priority=%s (--include-low ignored)" % min_priority, file=sys.stderr)
        return min_priority
    if include_low:
        print("WARNING: --include-low is deprecated (low is now default). Use --min-priority to filter.", file=sys.stderr)
        return "low"
    return min_priority or "low"


def merge_edited_descriptions(
    groups: List[Dict[str, Any]],
    edited_descriptions: Dict[str, Tuple[str, str]],
) -> Tuple[List[Dict[str, Any]], List[Dict[str, Any]]]:
    """Replace desc fields with user edits, return updated groups and edit log.

    Shared implementation used by all three apply orchestrators.

    Args:
        groups: List of group dicts with 'suggestions' arrays.
        edited_descriptions: Dict mapping ID (G1S1 or suggestion_hash) to
            (original, edited) tuple.

    Returns:
        Tuple of (updated_groups, edit_log).
        edit_log is list of dicts with {id, title, original_len, edited_len}.
    """
    updated_groups = copy.deepcopy(groups)
    edit_log: List[Dict[str, Any]] = []

    # Build hash->location lookup for hash-based matching
    hash_lookup: Dict[str, Tuple[int, int]] = {}
    for group_idx, group in enumerate(updated_groups):
        for sugg_idx, suggestion in enumerate(group.get("suggestions", [])):
            shash = suggestion.get("suggestion_hash")
            if shash:
                hash_lookup[shash] = (group_idx, sugg_idx)

    for group_idx, group in enumerate(updated_groups, start=1):
        for sugg_idx, suggestion in enumerate(group.get("suggestions", []), start=1):
            shash = suggestion.get("suggestion_hash", "")
            positional_id = f"G{group_idx}S{sugg_idx}"

            matched_key = None
            if shash and shash in edited_descriptions:
                matched_key = shash
            elif positional_id in edited_descriptions:
                matched_key = positional_id

            if matched_key is not None:
                original_desc, edited_desc = edited_descriptions[matched_key]
                suggestion["_original_desc"] = suggestion.get("desc", "")
                suggestion["desc"] = edited_desc
                suggestion["_description_edited"] = True
                edit_log.append({
                    "id": shash or positional_id,
                    "title": suggestion.get("title", "Unknown"),
                    "original_len": len(original_desc),
                    "edited_len": len(edited_desc),
                })

    return updated_groups, edit_log
receiving-code-reviewobra/superpowersUse when receiving code review feedback, before implementing suggestions, especially if feedback seems unclear or technically questionable - requires technical rigor and verification, not performative agreement or blind implementationStars: 321kUpdated Claude CodeCodexVerifiedInstall
requesting-code-reviewobra/superpowersUse when completing tasks, implementing major features, or before merging to verify work meets requirementsStars: 321kUpdated Claude CodeCodexVerifiedInstall
using-git-worktreesobra/superpowersUse when starting feature work that needs isolation from current workspace or before executing implementation plans - ensures an isolated workspace exists via native tools or git worktree fallbackStars: 321kUpdated Claude CodeCodexVerifiedInstall
verification-before-completionobra/superpowersUse when about to claim work is complete, fixed, or passing, before committing or creating PRs - requires running verification commands and confirming output before making any success claims; evidence before assertions alwaysStars: 321kUpdated Claude CodeCodexVerifiedInstall