Orchestra-Research/AI-Research-SKILLs / 18-multimodal/openpi
fine-tuning-serving-openpi
VerifiedFine-tune and serve Physical Intelligence OpenPI models (pi0, pi0-fast, pi0.5) using JAX or PyTorch backends for robot policy inference across ALOHA, DROID, and LIBERO environments. Use when adapting pi0 models to custom datasets, converting JAX checkpoints to PyTorch, running policy inference servers, or debugging norm stats and GPU memory issues.
| File | Kind | Size |
|---|---|---|
| SKILL.md | skill md | 13.9 KB |
| references/checkpoints-and-env-map.md | markdown | 2.5 KB |
| references/config-recipes.md | markdown | 1.7 KB |
| references/pytorch-gotchas.md | markdown | 1.4 KB |
| references/remote-client-pattern.md | markdown | 1.2 KB |
| references/training-debugging.md | markdown | 1.2 KB |
references/checkpoints-and-env-map.md
View on GitHub# Checkpoints and Environment Map
Use default environment mode for first runs, then switch to explicit checkpoint mode when needed.
## Default mapping from scripts/serve_policy.py
| Environment | Config | Checkpoint directory |
|-------------|--------|---------------------|
| `ALOHA` | `pi05_aloha` | `gs://openpi-assets/checkpoints/pi05_base` |
| `ALOHA_SIM` | `pi0_aloha_sim` | `gs://openpi-assets/checkpoints/pi0_aloha_sim` |
| `DROID` | `pi05_droid` | `gs://openpi-assets/checkpoints/pi05_droid` |
| `LIBERO` | `pi05_libero` | `gs://openpi-assets/checkpoints/pi05_libero` |
## Common explicit checkpoint commands
```bash
# PI 0.5 DROID
uv run scripts/serve_policy.py policy:checkpoint \
--policy.config=pi05_droid \
--policy.dir=gs://openpi-assets/checkpoints/pi05_droid
# PI 0 FAST DROID
uv run scripts/serve_policy.py policy:checkpoint \
--policy.config=pi0_fast_droid \
--policy.dir=gs://openpi-assets/checkpoints/pi0_fast_droid
# PI 0.5 LIBERO
uv run scripts/serve_policy.py policy:checkpoint \
--policy.config=pi05_libero \
--policy.dir=gs://openpi-assets/checkpoints/pi05_libero
```
## Local checkpoint command template
```bash
uv run scripts/serve_policy.py policy:checkpoint \
--policy.config=<config_name> \
--policy.dir=checkpoints/<config_name>/<exp_name>/<step>
```
## Data home and caching
- OpenPI downloads and caches assets under `~/.cache/openpi` by default.
- Set `OPENPI_DATA_HOME` to move download/cache location.
## LIBERO checkpoint prefetch on clusters
If policy server startup times out while logs show checkpoint downloading:
```bash
# 1) Ensure gsutil exists
pip install gsutil
# 2) Clear stale lock from previous interrupted download
rm -f <OPENPI_DATA_HOME>/openpi-assets/checkpoints/pi05_libero.lock
# 3) Prefetch checkpoint manually
cd <OPENPI_DATA_HOME>/openpi-assets/checkpoints
gsutil -m cp -r gs://openpi-assets/checkpoints/pi05_libero .
```
## Cluster compatibility notes (uv + Slurm)
If `uv sync` fails with `rerun-sdk` wheel/platform mismatch:
```bash
# 1) Skip dev groups
uv sync --no-dev
# 2) Force skip incompatible package
uv sync --no-dev --no-install-package rerun-sdk
```
For shared clusters with small `/home`, point cache roots to scratch:
- `HF_HOME`, `XDG_CACHE_HOME`, `PIP_CACHE_DIR`, `UV_CACHE_DIR`, `TMPDIR`
## Runtime hotfix dependencies for OpenPI + LIBERO
If server startup fails with `ModuleNotFoundError`:
```bash
uv pip install pytest robosuite==1.4.0 gym bddl easydict matplotlib
```
Install into both the OpenPI server environment and the LIBERO client environment.
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| receiving-code-reviewobra/superpowersUse when receiving code review feedback, before implementing suggestions, especially if feedback seems unclear or technically questionable - requires technical rigor and verification, not performative agreement or blind implementation | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| requesting-code-reviewobra/superpowersUse when completing tasks, implementing major features, or before merging to verify work meets requirements | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| using-git-worktreesobra/superpowersUse when starting feature work that needs isolation from current workspace or before executing implementation plans - ensures an isolated workspace exists via native tools or git worktree fallback | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| verification-before-completionobra/superpowersUse when about to claim work is complete, fixed, or passing, before committing or creating PRs - requires running verification commands and confirming output before making any success claims; evidence before assertions always | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |