davila7/claude-code-templates / cli-tool/components/skills/ai-research/fine-tuning-llama-factory
fine-tuning-llama-factory
VerifiedExpert guidance for fine-tuning LLMs with LLaMA-Factory - WebUI no-code, 100+ models, 2/3/4/5/6/8-bit QLoRA, multimodal support
| File | Kind | Size |
|---|---|---|
| SKILL.md | skill md | 2.4 KB |
| references/_images.md | markdown | 307 B |
| references/advanced.md | markdown | 46.7 KB |
| references/getting_started.md | markdown | 15.8 KB |
| references/index.md | markdown | 262 B |
| references/other.md | markdown | 1.1 KB |
references/other.md
View on GitHub# Llama-Factory - Other
**Pages:** 1
---
## Welcome to LLaMA Factory!¶
**URL:** https://llamafactory.readthedocs.io/en/latest/
**Contents:**
- Welcome to LLaMA Factory!¶
- Documentation¶
LLaMA Factory is an easy-to-use and efficient platform for training and fine-tuning large language models. With LLaMA Factory, you can fine-tune hundreds of pre-trained models locally without writing any code. Framework features include:
Models: LLaMA, LLaVA, Mistral, Mixtral-MoE, Qwen, Yi, Gemma, Baichuan, ChatGLM, Phi, etc.
Trainers: (incremental) pre-training, (multimodal) instruction supervision fine-tuning, reward model training, PPO training, DPO training, KTO training, ORPO training, etc.
Computation Precision: 16-bit full-parameter fine-tuning, frozen fine-tuning, LoRA fine-tuning, and 2/3/4/5/6/8-bit QLoRA fine-tuning based on AQLM/AWQ/GPTQ/LLM.int8/HQQ/EETQ.
Optimization Algorithms: GaLore, BAdam, DoRA, LongLoRA, LLaMA Pro, Mixture-of-Depths, LoRA+, LoftQ, and PiSSA.
Acceleration Operators: FlashAttention-2 and Unsloth.
Inference Engines: Transformers and vLLM.
Experiment Monitors: LlamaBoard, TensorBoard, Wandb, MLflow, SwanLab etc.
---
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| receiving-code-reviewobra/superpowersUse when receiving code review feedback, before implementing suggestions, especially if feedback seems unclear or technically questionable - requires technical rigor and verification, not performative agreement or blind implementation | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| requesting-code-reviewobra/superpowersUse when completing tasks, implementing major features, or before merging to verify work meets requirements | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| using-git-worktreesobra/superpowersUse when starting feature work that needs isolation from current workspace or before executing implementation plans - ensures an isolated workspace exists via native tools or git worktree fallback | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| verification-before-completionobra/superpowersUse when about to claim work is complete, fixed, or passing, before committing or creating PRs - requires running verification commands and confirming output before making any success claims; evidence before assertions always | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |