Skip to content

Hello-QM/catgo-LRG / .claude/skills/dpdata

dpdata

Verified

Convert between computational chemistry data formats using dpdata. Handles VASP, QE, CP2K, Gaussian, LAMMPS, and DeePMD formats. Essential for preparing ML potential training data.

dpdata — Format Conversion

When to Use

  • User needs to convert DFT calculation outputs to DeePMD training format
  • User wants to convert between VASP, QE, CP2K, Gaussian, LAMMPS formats
  • User needs to merge, filter, or split trajectory data
  • User is preparing training data for machine learning potentials

Prerequisites

  1. dpdata installed (pip install dpdata, or python -c "import dpdata")

Supported Formats

FormatReadWriteKey
VASP OUTCARYes-vasp/outcar
VASP POSCAR/CONTCARYesYesvasp/poscar
VASP XMLYes-vasp/xml
QE pw.x outputYes-qe/pw/scf
CP2K outputYes-cp2k/output
Gaussian logYes-gaussian/log
LAMMPS dumpYesYeslammps/dump
LAMMPS dataYesYeslammps/lmp
DeePMD rawYesYesdeepmd/raw
DeePMD npyYesYesdeepmd/npy
ExtXYZYesYesextxyz

Workflow Steps

1. Convert VASP OUTCAR to DeePMD

catgo_workflow_engine(action="add_task", params={
  "workflow_id": "wf_xxx",
  "task_type": "shell",
  "name": "convert_data",
  "command": "python convert.py",
  "input_files": {
    "convert.py": "import dpdata\nd = dpdata.LabeledSystem('OUTCAR', fmt='vasp/outcar')\nd.to('deepmd/npy', 'training_data')"
  },
  "system_name": "data_prep"
})

Common Conversion Scripts

VASP to DeePMD (with train/valid split)

import dpdata
import numpy as np

# Load all frames from OUTCAR
d = dpdata.LabeledSystem("OUTCAR", fmt="vasp/outcar")
print(f"Loaded {len(d)} frames")

# Random split: 90% train, 10% valid
indices = np.random.permutation(len(d))
n_train = int(0.9 * len(d))

d_train = d.sub_system(indices[:n_train])
d_valid = d.sub_system(indices[n_train:])

d_train.to("deepmd/npy", "data/train")
d_valid.to("deepmd/npy", "data/valid")
print(f"Train: {len(d_train)}, Valid: {len(d_valid)}")

Multiple OUTCARs to single dataset

import dpdata
from pathlib import Path

d = None
for outcar in Path(".").rglob("OUTCAR"):
    sys = dpdata.LabeledSystem(str(outcar), fmt="vasp/outcar")
    d = sys if d is None else d + sys

print(f"Total frames: {len(d)}")
d.to("deepmd/npy", "merged_data")

QE to DeePMD

import dpdata
d = dpdata.LabeledSystem("relax.out", fmt="qe/pw/scf")
d.to("deepmd/npy", "training_data")

LAMMPS dump to ExtXYZ

import dpdata
d = dpdata.System("dump.lammpstrj", fmt="lammps/dump",
                  type_map=["Ti", "O"])
d.to("extxyz", "trajectory.xyz")

Filter by energy/force

import dpdata
import numpy as np

d = dpdata.LabeledSystem("OUTCAR", fmt="vasp/outcar")

# Remove frames with max force > 10 eV/Ang (likely unconverged)
mask = []
for i in range(len(d)):
    max_f = np.max(np.abs(d["forces"][i]))
    mask.append(max_f < 10.0)

d_clean = d.sub_system(np.where(mask)[0])
print(f"Kept {len(d_clean)}/{len(d)} frames")

CLI Usage

# Quick convert
dpdata convert OUTCAR vasp/outcar deepmd/npy training_data

# System info
dpdata info OUTCAR vasp/outcar

Parameter Guidance

ParameterNotes
fmtFormat string — must match exactly (case-sensitive)
type_mapRequired for LAMMPS formats — maps type indices to element symbols
begin / end / stepFrame selection for large trajectories

Common Pitfalls

  1. Missing type_map for LAMMPS — LAMMPS dump files have numeric types, not element names. Always provide type_map.
  2. Unconverged frames — VASP OUTCARs may contain unconverged ionic steps. Filter by force magnitude before training.
  3. Mixed element order — when merging data from different calculations, ensure consistent element ordering.
  4. Large memory for big trajectories — dpdata loads all frames into memory. For >10K frames, process in chunks.
  5. Units — dpdata converts to eV/Angstrom internally. LAMMPS real units are auto-converted.
slack-gif-creatoranthropics/skillsKnowledge and utilities for creating animated GIFs optimized for Slack. Provides constraints, validation tools, and animation concepts. Use when users request animated GIFs for Slack like "make me a GIF of X doing Y for Slack."Stars: 196kUpdated Claude CodeCodexVerifiedInstall
ponytailDietrichGebert/ponytailLazy senior dev mode for any coding task: the smallest change that fully solves it, and a reply a busy human understands in one read.Stars: 193kUpdated Claude CodeCodexVerifiedInstall
ponytail-debtDietrichGebert/ponytailHarvest every shortcut: comment into one debt ledger, so deferrals get tracked instead of forgotten. One-shot report.Stars: 193kUpdated Claude CodeCodexVerifiedInstall
ponytail-debtDietrichGebert/ponytailList every `shortcut:` comment (and older `ponytail:` ones) as a debt ledger. One-shot report, changes nothing. Use for "ponytail debt", "what did ponytail defer", "list the shortcuts", /ponytail-debt.Stars: 193kUpdated Claude CodeCodexVerifiedInstall