K-Dense-AI/scientific-agent-skills / skills/scanpy
scanpy
VerifiedPerforms Scanpy single-cell RNA-seq QC, normalization, HVG selection, PCA/UMAP/t-SNE, clustering, exploratory marker ranking, pseudobulk preparation, visualization, and Seurat or SingleCellExperiment RDS conversion to h5ad. Applies to established exploratory scRNA-seq workflows with explicit count and expression provenance; complementary skills cover scvi-tools models and AnnData format details.
| File | Kind | Size |
|---|---|---|
| SKILL.md | skill md | 19.8 KB |
| assets/analysis_template.py | script | 10.0 KB |
| assets/celltype_mapping.json | config | 184 B |
| assets/gene_signatures.json | config | 355 B |
| assets/pipeline_config.json | config | 380 B |
| references/analysis_workflow.md | markdown | 7.6 KB |
| references/api_reference.md | markdown | 9.1 KB |
| references/plotting_guide.md | markdown | 10.5 KB |
| references/r_interop.md | markdown | 11.8 KB |
| references/standard_workflow.md | markdown | 7.0 KB |
| references/upstream-review.md | markdown | 8.3 KB |
| scripts/_common.py | script | 10.0 KB |
| scripts/annotate.py | script | 3.7 KB |
| scripts/batch_correct.py | script | 3.1 KB |
| scripts/cluster.py | script | 2.5 KB |
| scripts/convert.py | script | 1.5 KB |
| scripts/find_markers.py | script | 4.3 KB |
| scripts/inspect_data.py | script | 3.1 KB |
| scripts/plot.py | script | 3.6 KB |
| scripts/preprocess.py | script | 3.5 KB |
| scripts/pseudobulk.py | script | 4.6 KB |
| scripts/qc_analysis.pyexecutable | script | 5.1 KB |
| scripts/reduce_dimensions.py | script | 2.8 KB |
| scripts/run_pipeline.py | script | 9.4 KB |
| scripts/score_genes.py | script | 3.9 KB |
| scripts/subset.py | script | 2.6 KB |
scripts/run_pipeline.py
View on GitHub#!/usr/bin/env python3
"""
End-to-end standard scRNA-seq pipeline in one command.
Runs the full exploratory workflow on raw counts:
load -> QC + filter -> (optional doublets) -> normalize + log1p -> HVG
-> (optional scale/regress) -> PCA -> (optional batch correction)
-> neighbors -> UMAP -> Leiden -> marker genes -> save.
Produces a processed .h5ad, marker CSVs, and figures. Tune the common knobs via
flags, or pass a JSON config with ``--config`` (keys mirror the flag names with
underscores). This is the fastest path from counts to a clustered, annotated-
ready object; use the individual step scripts when you need to iterate on one stage.
Examples:
python run_pipeline.py raw.h5ad -o processed.h5ad
python run_pipeline.py raw.h5ad -o processed.h5ad --resolution 0.8 --n-top-genes 3000
python run_pipeline.py raw.h5ad -o processed.h5ad --batch-key sample --batch-method harmony
python run_pipeline.py raw.h5ad -o processed.h5ad --config params.json
"""
import argparse
import json
import os
from _common import configure_scanpy, info, load_anndata, save_anndata, prepare_counts, normalize_hvg, compute_pca, build_neighbors, die, ensure_categories, integrate_harmony
def build_parser():
p = argparse.ArgumentParser(description=__doc__,
formatter_class=argparse.RawDescriptionHelpFormatter)
p.add_argument("input", help="Input raw-counts file (.h5ad, .h5, .csv, 10x dir, ...)")
p.add_argument("-o", "--output", default="processed.h5ad", help="Output .h5ad")
p.add_argument("--figdir", default="figures", help="Figure directory")
p.add_argument("--marker-dir", default="results/markers", help="Marker CSV directory")
p.add_argument("--config", default=None, help="JSON file overriding any of the options below")
# QC
p.add_argument("--min-genes", type=int, default=200)
p.add_argument("--max-genes", type=int, default=None)
p.add_argument("--min-cells", type=int, default=3)
p.add_argument("--mt-threshold", type=float, default=5)
p.add_argument("--scrublet", action="store_true")
# normalization / HVG
p.add_argument("--counts-layer", default=None, help="Explicit raw-count layer instead of X")
p.add_argument("--target-sum", type=float, default=1e4)
p.add_argument("--n-top-genes", type=int, default=2000)
p.add_argument("--hvg-flavor", default="seurat", choices=["seurat", "cell_ranger", "seurat_v3", "seurat_v3_paper"])
p.add_argument("--scale", action="store_true")
p.add_argument("--regress-out", nargs="+", default=None)
# dim reduction / clustering
p.add_argument("--n-pcs", type=int, default=40)
p.add_argument("--n-neighbors", type=int, default=15)
p.add_argument("--resolution", type=float, default=0.5)
# batch correction
p.add_argument("--batch-key", default=None)
p.add_argument("--batch-method", default="harmony", choices=["harmony", "combat"])
# markers
p.add_argument("--marker-method", default="wilcoxon", choices=["wilcoxon", "t-test", "t-test_overestim_var"])
p.add_argument("--skip-markers", action="store_true")
return p
def apply_config(args):
if args.config:
with open(args.config) as fh:
cfg = json.load(fh)
if not isinstance(cfg, dict):
die("config must be a JSON object")
for k, v in cfg.items():
key = k.replace("-", "_")
if key not in vars(args) or key in {"input", "output", "config"}:
die(f"unknown or unsupported config option: {k}")
action = next(a for a in build_parser()._actions if a.dest == key)
if action.choices and v not in action.choices:
die(f"invalid config choice for {k}: {v}")
old = getattr(args, key)
if old is not None and not isinstance(v, type(old)):
if not (type(old) is float and type(v) is int):
die(f"invalid config value type for {k}")
setattr(args, key, v)
return args
def main():
args = apply_config(build_parser().parse_args())
sc = configure_scanpy(figdir=args.figdir)
info("[1/8] Loading data")
adata = load_anndata(args.input)
prepare_counts(adata, args.counts_layer)
if args.batch_key:
ensure_categories(adata, args.batch_key)
adata.var_names_make_unique()
info(f" {adata.n_obs} cells x {adata.n_vars} genes")
info("[2/8] QC + filtering")
adata.var["mt"] = adata.var_names.str.startswith(("MT-", "mt-", "Mt-"))
qc_vars = ["mt"] if adata.var["mt"].any() else []
sc.pp.calculate_qc_metrics(adata, qc_vars=qc_vars, percent_top=None, log1p=False, inplace=True)
sc.pl.violin(adata, [k for k in ["n_genes_by_counts", "total_counts", "pct_counts_mt"]
if k in adata.obs.columns],
jitter=0.4, multi_panel=True, show=False, save="_qc.png")
n0 = adata.n_obs
sc.pp.filter_cells(adata, min_genes=args.min_genes)
sc.pp.filter_genes(adata, min_cells=args.min_cells)
if args.max_genes:
adata = adata[adata.obs["n_genes_by_counts"] < args.max_genes, :].copy()
if qc_vars and "pct_counts_mt" in adata.obs.columns:
adata = adata[adata.obs["pct_counts_mt"] < args.mt_threshold, :].copy()
if min(adata.shape) == 0:
die("QC removed all cells or genes; inspect thresholds")
if args.scrublet:
try:
sc.pp.scrublet(adata, batch_key=args.batch_key, random_state=0)
adata = adata[~adata.obs["predicted_doublet"], :].copy()
except (ImportError, ValueError) as e:
die(f"Requested Scrublet failed: {e}; check counts, capture/library groups and scikit-image")
info(f" {n0} -> {adata.n_obs} cells, {adata.n_vars} genes")
info("[3/8] Normalize + log1p + HVG")
normalize_hvg(sc, adata, target_sum=args.target_sum, n_top_genes=args.n_top_genes,
flavor=args.hvg_flavor, batch_key=args.batch_key)
info(f" {int(adata.var['highly_variable'].sum())} HVGs")
info("[4/8] Scale / regress (optional)")
work = adata[:, adata.var["highly_variable"]].copy()
if args.regress_out:
sc.pp.regress_out(work, args.regress_out)
if args.scale:
sc.pp.scale(work, max_value=10)
info("[5/8] PCA" + (f" + {args.batch_method} batch correction" if args.batch_key else ""))
compute_pca(sc, work, args.n_pcs)
sc.pl.pca_variance_ratio(work, n_pcs=work.obsm["X_pca"].shape[1], log=True, show=False, save="_variance.png")
use_rep = "X_pca"
if args.batch_key:
if args.batch_method == "harmony":
try:
integrate_harmony(work, args.batch_key)
use_rep = "X_pca_harmony"
except ImportError:
die("Requested Harmony requires harmonypy; install it before running integration")
else:
sc.pp.combat(work, key=args.batch_key)
compute_pca(sc, work, args.n_pcs)
info("[6/8] Neighbors + UMAP")
build_neighbors(sc, work, n_neighbors=args.n_neighbors, n_pcs=args.n_pcs, use_rep=use_rep)
sc.tl.umap(work)
info("[7/8] Leiden clustering")
sc.tl.leiden(work, resolution=args.resolution, flavor="igraph",
n_iterations=2, directed=False)
n_clusters = work.obs["leiden"].nunique()
color = ["leiden"] + ([args.batch_key] if args.batch_key else [])
sc.pl.umap(work, color=color, legend_loc="on data", show=False, save="_leiden.png")
info(f" {n_clusters} clusters at resolution {args.resolution}")
# Carry embeddings/clusters back onto the full-gene object so markers use all genes.
adata.obs["leiden"] = work.obs["leiden"].copy()
adata.obsm["X_pca"] = work.obsm["X_pca"]
adata.obsm["X_umap"] = work.obsm["X_umap"]
if use_rep in work.obsm:
adata.obsm[use_rep] = work.obsm[use_rep]
import numpy as np
adata.uns["pca"] = work.uns["pca"].copy()
adata.uns["pca"]["params"]["mask_var"] = "highly_variable"
loadings = np.zeros((adata.n_vars, work.obsm["X_pca"].shape[1]), dtype=work.varm["PCs"].dtype)
loadings[adata.var["highly_variable"].to_numpy()] = work.varm["PCs"]
adata.varm["PCs"] = loadings
adata.uns["umap"] = work.uns["umap"].copy()
adata.uns["leiden"] = work.uns["leiden"].copy()
adata.uns["neighbors"] = work.uns["neighbors"]
adata.obsp = work.obsp
if not args.skip_markers and (n_clusters < 2 or work.obs["leiden"].value_counts().min() < 2):
die("marker ranking requires at least two groups with at least two cells each; tune clustering or use --skip-markers")
if not args.skip_markers:
info("[8/8] Marker genes")
sc.tl.rank_genes_groups(adata, "leiden", method=args.marker_method, use_raw=True,
reference="rest", corr_method="benjamini-hochberg", tie_correct=True)
sc.pl.rank_genes_groups_dotplot(adata, n_genes=5, show=False, save="_markers_dotplot.png")
os.makedirs(args.marker_dir, exist_ok=True)
import pandas as pd
frames = []
for g in adata.obs["leiden"].cat.categories:
df = sc.get.rank_genes_groups_df(adata, group=g).head(25)
df.insert(0, "cluster", g)
frames.append(df)
pd.concat(frames, ignore_index=True).to_csv(
os.path.join(args.marker_dir, "markers_all.csv"), index=False)
info(f" marker tables in {args.marker_dir}/")
else:
info("[8/8] Skipping markers")
save_anndata(adata, args.output)
info("Pipeline complete. Next: inspect markers, then annotate.py with a cluster->cell_type mapping.")
if __name__ == "__main__":
main()
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| reverse-engineer-anythingmorluto/reaReverse engineer native, managed, Electron/JavaScript, packaged, firmware, and browser targets with REA, and build agent environments (AgentEnv bundles) of web applications from a live instance or a capture, and of Linux desktop apps with a task from a request. Use shipped-artifact or requested runtime evidence to explain features, compare versions, decompile code, or guide a reconstruction. Skip REA for ordinary source-repository architecture analysis. | Stars: 472k | Updated | Claude CodeCodex | Verified | Install |
| diagnosing-superpowersobra/superpowersUse when a superpowers session went wrong and your human partner wants to know why — repeated work, ignored plans, stumbles, poor results, a skill that didn't fire, "it took too long", "why is it so expensive", "what is it doing" — or wants to build a bug report for the superpowers maintainers, for the current session or a past one identified by id or path, on any harness. | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| dispatching-parallel-agentsobra/superpowersUse when facing 2+ independent tasks that can be worked on without shared state or sequential dependencies | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| executing-plansobra/superpowersUse when executing an implementation plan in the current session as the implementer yourself — your human partner chose inline execution, or no subagent tool is available | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |