Hello-QM/catgo-LRG / .claude/skills/dpdata
dpdata
VerifiedConvert between computational chemistry data formats using dpdata. Handles VASP, QE, CP2K, Gaussian, LAMMPS, and DeePMD formats. Essential for preparing ML potential training data.
| File | Kind | Size |
|---|---|---|
| SKILL.md | skill md | 4.2 KB |
SKILL.md
View on GitHub---
name: dpdata
description: >
Convert between computational chemistry data formats using dpdata. Handles
VASP, QE, CP2K, Gaussian, LAMMPS, and DeePMD formats. Essential for preparing
ML potential training data.
compatibility: >
Requires dpdata Python package (pip install dpdata). Works on any platform.
catalog-hidden: true
---
# dpdata — Format Conversion
## When to Use
- User needs to convert DFT calculation outputs to DeePMD training format
- User wants to convert between VASP, QE, CP2K, Gaussian, LAMMPS formats
- User needs to merge, filter, or split trajectory data
- User is preparing training data for machine learning potentials
## Prerequisites
1. dpdata installed (`pip install dpdata`, or `python -c "import dpdata"`)
## Supported Formats
| Format | Read | Write | Key |
|---|---|---|---|
| VASP OUTCAR | Yes | - | `vasp/outcar` |
| VASP POSCAR/CONTCAR | Yes | Yes | `vasp/poscar` |
| VASP XML | Yes | - | `vasp/xml` |
| QE pw.x output | Yes | - | `qe/pw/scf` |
| CP2K output | Yes | - | `cp2k/output` |
| Gaussian log | Yes | - | `gaussian/log` |
| LAMMPS dump | Yes | Yes | `lammps/dump` |
| LAMMPS data | Yes | Yes | `lammps/lmp` |
| DeePMD raw | Yes | Yes | `deepmd/raw` |
| DeePMD npy | Yes | Yes | `deepmd/npy` |
| ExtXYZ | Yes | Yes | `extxyz` |
## Workflow Steps
### 1. Convert VASP OUTCAR to DeePMD
```
catgo_workflow_engine(action="add_task", params={
"workflow_id": "wf_xxx",
"task_type": "shell",
"name": "convert_data",
"command": "python convert.py",
"input_files": {
"convert.py": "import dpdata\nd = dpdata.LabeledSystem('OUTCAR', fmt='vasp/outcar')\nd.to('deepmd/npy', 'training_data')"
},
"system_name": "data_prep"
})
```
## Common Conversion Scripts
### VASP to DeePMD (with train/valid split)
```python
import dpdata
import numpy as np
# Load all frames from OUTCAR
d = dpdata.LabeledSystem("OUTCAR", fmt="vasp/outcar")
print(f"Loaded {len(d)} frames")
# Random split: 90% train, 10% valid
indices = np.random.permutation(len(d))
n_train = int(0.9 * len(d))
d_train = d.sub_system(indices[:n_train])
d_valid = d.sub_system(indices[n_train:])
d_train.to("deepmd/npy", "data/train")
d_valid.to("deepmd/npy", "data/valid")
print(f"Train: {len(d_train)}, Valid: {len(d_valid)}")
```
### Multiple OUTCARs to single dataset
```python
import dpdata
from pathlib import Path
d = None
for outcar in Path(".").rglob("OUTCAR"):
sys = dpdata.LabeledSystem(str(outcar), fmt="vasp/outcar")
d = sys if d is None else d + sys
print(f"Total frames: {len(d)}")
d.to("deepmd/npy", "merged_data")
```
### QE to DeePMD
```python
import dpdata
d = dpdata.LabeledSystem("relax.out", fmt="qe/pw/scf")
d.to("deepmd/npy", "training_data")
```
### LAMMPS dump to ExtXYZ
```python
import dpdata
d = dpdata.System("dump.lammpstrj", fmt="lammps/dump",
type_map=["Ti", "O"])
d.to("extxyz", "trajectory.xyz")
```
### Filter by energy/force
```python
import dpdata
import numpy as np
d = dpdata.LabeledSystem("OUTCAR", fmt="vasp/outcar")
# Remove frames with max force > 10 eV/Ang (likely unconverged)
mask = []
for i in range(len(d)):
max_f = np.max(np.abs(d["forces"][i]))
mask.append(max_f < 10.0)
d_clean = d.sub_system(np.where(mask)[0])
print(f"Kept {len(d_clean)}/{len(d)} frames")
```
## CLI Usage
```bash
# Quick convert
dpdata convert OUTCAR vasp/outcar deepmd/npy training_data
# System info
dpdata info OUTCAR vasp/outcar
```
## Parameter Guidance
| Parameter | Notes |
|---|---|
| `fmt` | Format string — must match exactly (case-sensitive) |
| `type_map` | Required for LAMMPS formats — maps type indices to element symbols |
| `begin` / `end` / `step` | Frame selection for large trajectories |
## Common Pitfalls
1. **Missing type_map for LAMMPS** — LAMMPS dump files have numeric types, not element names. Always provide `type_map`.
2. **Unconverged frames** — VASP OUTCARs may contain unconverged ionic steps. Filter by force magnitude before training.
3. **Mixed element order** — when merging data from different calculations, ensure consistent element ordering.
4. **Large memory for big trajectories** — dpdata loads all frames into memory. For >10K frames, process in chunks.
5. **Units** — dpdata converts to eV/Angstrom internally. LAMMPS `real` units are auto-converted.
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| slack-gif-creatoranthropics/skillsKnowledge and utilities for creating animated GIFs optimized for Slack. Provides constraints, validation tools, and animation concepts. Use when users request animated GIFs for Slack like "make me a GIF of X doing Y for Slack." | Stars: 198k | Updated | Claude CodeCodex | Verified | Install |
| ponytailDietrichGebert/ponytailLazy senior dev mode for any coding task: the smallest change that fully solves it, and a reply a busy human understands in one read. | Stars: 194k | Updated | Claude CodeCodex | Verified | Install |
| ponytail-debtDietrichGebert/ponytailHarvest every shortcut: comment into one debt ledger, so deferrals get tracked instead of forgotten. One-shot report. | Stars: 194k | Updated | Claude CodeCodex | Verified | Install |
| ponytail-debtDietrichGebert/ponytailList every `shortcut:` comment (and older `ponytail:` ones) as a debt ledger. One-shot report, changes nothing. Use for "ponytail debt", "what did ponytail defer", "list the shortcuts", /ponytail-debt. | Stars: 194k | Updated | Claude CodeCodex | Verified | Install |