K-Dense-AI/scientific-agent-skills / skills/pathway-enrichment
pathway-enrichment
VerifiedPerforms pathway and gene-set enrichment analysis on gene lists or ranked gene data and interprets the results. Used when the user has a set of genes (differentially expressed genes from PyDESeq2/Scanpy, CRISPR-screen hits, cluster marker genes, proteomics hits) and wants to know which biological pathways, GO terms, or gene sets are over-represented or enriched. Covers over-representation analysis (ORA / Enrichr / Fisher / hypergeometric), ranked Gene Set Enrichment Analysis (GSEA / preranked), single-sample scoring (ssGSEA/GSVA), and functional profiling via gseapy, g:Profiler, Enrichr libraries, MSigDB, GO, KEGG, Reactome, and WikiPathways — plus gene-ID mapping, choosing the right background universe, multiple-testing correction, redundancy reduction, dotplots/enrichment maps, and publication-ready tables. Use this for "pathway analysis", "enrichment analysis", "GO enrichment", "KEGG/Reactome pathways", "GSEA", "over-representation", "functional annotation", or "what pathways are my genes in".
| File | Kind | Size |
|---|---|---|
| SKILL.md | skill md | 16.3 KB |
| references/databases-and-gene-sets.md | markdown | 8.8 KB |
| references/gseapy.md | markdown | 9.6 KB |
| references/interpretation.md | markdown | 7.3 KB |
| references/verified-api.md | markdown | 8.1 KB |
| scripts/run_enrichment.py | script | 13.3 KB |
references/databases-and-gene-sets.md
View on GitHub# Databases, Gene Sets, and Gene-ID Mapping
## Contents
- [Picking libraries by question](#picking-libraries-by-question)
- [The main gene-set databases](#the-main-gene-set-databases)
- [MSigDB collections](#msigdb-collections)
- [g:Profiler (alternative ORA, custom background, many organisms)](#gprofiler)
- [Gene-ID types and conversion](#gene-id-types-and-conversion)
- [Organism handling](#organism-handling)
- [Pathway/interaction APIs (Reactome, KEGG, STRING)](#pathwayinteraction-apis)
- [Activity inference (decoupler: PROGENy, DoRothEA/CollecTRI)](#activity-inference)
## Picking libraries by question
Match the database to the biological question instead of running everything:
| Question | Best gene sets |
|----------|----------------|
| "What are the broad themes?" | MSigDB **Hallmark** (50 curated, low redundancy) |
| "What mechanism/process?" | **GO Biological Process** |
| "Which curated pathways?" | **Reactome**, **KEGG**, **WikiPathways** |
| "Molecular function / localization?" | GO MF / GO CC |
| "Immune signatures?" | MSigDB **C7** (ImmuneSigDB) |
| "Oncogenic / perturbation?" | MSigDB **C6** (oncogenic), **C2:CGP** |
| "TF targets / regulons?" | MSigDB **C3**, ChEA, or decoupler (below) |
| "Disease/phenotype association?" | g:Profiler HP, DisGeNET, GWAS Catalog |
Start narrow (Hallmark + one of GO:BP / Reactome). Add libraries only if the
question needs them — each extra library multiplies the testing burden.
## The main gene-set databases
- **GO (Gene Ontology)** — three namespaces: Biological Process (BP), Molecular
Function (MF), Cellular Component (CC). Hierarchical → highly redundant; collapse
terms after testing (see `interpretation.md`).
- **KEGG** — manually curated metabolic & signaling pathways. Compact, well known.
- **Reactome** — large, expert-curated, hierarchical human pathway set; good
granularity. APIs in `database-lookup`.
- **WikiPathways** — community-curated pathways; complements KEGG/Reactome.
- **MSigDB** — collections of collections (Hallmark, curated, GO, immune, etc.);
the standard source of GMT files for GSEA.
## MSigDB collections
| Collection | Contents |
|-----------|----------|
| **H** (`h.all`) | Hallmark — 50 refined, non-redundant signatures (best default for GSEA) |
| **C2:CP** | Canonical Pathways: `c2.cp.kegg_medicus`, `c2.cp.reactome`, `c2.cp.wikipathways`, `c2.cp.biocarta` |
| **C2:CGP** | Chemical & genetic perturbations |
| **C3** | Regulatory targets (TFT, miRNA) |
| **C5** | Ontology: `c5.go.bp`, `c5.go.mf`, `c5.go.cc`, `c5.hpo` |
| **C6** | Oncogenic signatures |
| **C7** | ImmuneSigDB |
| **C8** | Cell-type signatures |
| **C9** | Computational perturbation signatures from DepMap CRISPR/CCLE analyses |
Current release (reviewed 2026-10-01): **2026.1.Hs / 2026.1.Mm**. Fetch human
Hallmark with `gp.Msigdb.get_gmt(category="h.all", dbver="2026.1.Hs")`.
Mouse uses its own category codes (Hallmark `mh.all`, `m2`, `m5`, etc.); changing
only Hs to Mm is insufficient. List categories for the exact release. Symbols and
Entrez GMTs are available; save the file/hash and comply with MSigDB license terms.
See [gseapy.md](gseapy.md) and the [official collections](https://www.gsea-msigdb.org/gsea/msigdb).
## g:Profiler
The official client (`gprofiler-official`) is the best path when you need a
**custom background**, **many organisms** (discover supported organism codes), or g:Profiler's `g:SCS`
multiple-testing correction. It performs ORA over GO, KEGG, Reactome,
WikiPathways, miRTarBase, CORUM, HP, and more in one call.
```python
from gprofiler import GProfiler
gp = GProfiler(return_dataframe=True)
res = gp.profile(
organism="hsapiens", # mmusculus, dmelanogaster, ...
query=gene_list, # symbols, Ensembl, Entrez — auto-detected
sources=["GO:BP", "KEGG", "REAC", "WP"], # restrict sources
user_threshold=0.05,
significance_threshold_method="g_SCS", # default; or "fdr" / "bonferroni"
domain_scope="custom", # use a custom statistical background
background=expressed_genes, # the tested/expressed universe
all_results=True, # retain nonsignificant returned terms
no_evidences=False, # required for intersections/evidences
ordered=False, # ranked-prefix ORA is not GSEA
no_iea=False, # True = drop electronic GO annotations
)
# columns: source, native, name, p_value, term_size, query_size,
# intersection_size, effective_domain_size, intersections
```
`gp.convert(organism="hsapiens", query=ids, target_namespace="ENTREZGENE_ACC")` maps
numeric Entrez IDs. In the live service, target `ENTREZGENE` returned a symbol
(`TP53`), whereas `ENTREZGENE_ACC` returned `7157`; validate the output namespace.
`gp.orth(query=["Trp53"], organism="mmusculus", target="hsapiens")` returns
source `converted`, target `ortholog_ensg`, and target `name`; do not confuse them.
`p_value` is **already adjusted** with the requested method. Do not BH-adjust it
a second time or relabel g:SCS as FDR. `all_results=True` retains nonsignificant
returned terms; it does not promise all database terms including zero overlap.
Save `gp.meta` immediately with results (subsequent calls overwrite it), including
version, effective domains, mapping failures/ambiguities and correction settings.
Client 1.0.0 forces `domain_scope="custom"` whenever background is supplied; it
cannot preserve `custom_annotated` via that method. Use the documented raw API
only if that alternative domain is actually required, and verify echoed metadata.
## Gene-ID types and conversion
Choose one declared namespace and species. Many Enrichr libraries use symbols;
MSigDB also offers numeric Entrez GMTs. Map only when needed and retain the
source-to-target table, failed IDs and ambiguous mappings. No casing operation
constitutes identifier mapping; `capitalize()` can corrupt identifiers.
| You have | Convert with |
|----------|--------------|
| Ensembl gene IDs (`ENSG…`) | `gp.Biomart`, g:Profiler `g:Convert`, or `mygene` |
| Entrez IDs | `mygene`, g:Profiler |
| Mouse symbols → human | g:Profiler `g:Orth` or another explicit orthology resource; querying MyGene with `species="human"` is not orthology conversion |
`mygene` example:
```python
import mygene
mg = mygene.MyGeneInfo()
mapping = mg.querymany(ensembl_ids, scopes="ensembl.gene",
fields="symbol", species="human", returnall=True)
# mapping["out"] contains query-aligned hits (or notfound); inspect dup/missing.
# Resolve one-to-many cases before extracting symbols; never silently keep first.
```
For versioned Ensembl IDs only, record and strip the numeric version suffix first (`ENSG00000141510.16` → `ENSG00000141510`).
The `gget` skill (`gget info`) is another quick ID-mapping path.
## Organism handling
- Human symbols are often uppercase (`TP53`), and mouse symbols often start
with a capital (`Trp53`); these conventions are not a conversion rule.
- Set `organism=` for `gp.enrichr` (Enrichr) and use the matching MSigDB `dbver`
(`…Hs` vs `…Mm`) or g:Profiler `organism=` code.
- Human and mouse both route to the main Enrichr instance; `organism="mouse"`
does not make every selected library mouse-specific. Prefer native mouse GMTs,
or map explicit orthologs and disclose one-to-many/lost genes. Apply the same
mapping to the assay universe, and resolve ranking collisions before GSEA.
## Pathway/interaction APIs
For raw pathway content or network context (not enrichment statistics), use the
`database-lookup` skill, which wraps:
- **Reactome** content + Analysis Service (submit a gene list, get pathway
over-representation).
- **KEGG** pathways/compounds.
- **STRING** — protein–protein interactions plus its own functional-enrichment
endpoint for a submitted gene set; pairs well with `networkx` for network views.
- **Gene Ontology / QuickGO** term metadata.
## Activity inference
When the goal is **pathway or TF activity** (a continuous score per sample/cell)
rather than over-representation of a list, use `decoupler`. It runs multiple
enrichment/activity methods (ORA, GSEA, univariate linear models, etc.) against
curated priors:
- **PROGENy** — 14 signaling pathway responsive signatures.
- **DoRothEA / CollecTRI** — TF→target regulons for TF-activity inference.
- **Hallmark** and other priors via its OmniPath integration (check resource
availability and license). Current decoupler uses `dc.op.progeny`,
`dc.op.collectri`, `dc.op.hallmark` and `dc.mt.*` method namespaces; these are
documentation pointers here, not runtime-tested decoupler workflows.
decoupler integrates natively with AnnData/Scanpy (per-cell activities) and with
per-sample pseudobulk matrices. APIs evolve between major versions — check the
current decoupler docs (https://decoupler.scverse.org/) for exact function
names before writing code.
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| finishing-a-development-branchobra/superpowersUse when implementation is complete, all tests pass, and you need to decide how to integrate the work | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| systematic-debuggingobra/superpowersUse when encountering any bug, test failure, or unexpected behavior, before proposing fixes | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| test-driven-developmentobra/superpowersUse when implementing any feature or bugfix, before writing implementation code | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| skill-creatoranthropics/skillsCreate new skills, modify and improve existing skills, and measure skill performance. Use when users want to create a skill from scratch, edit, or optimize an existing skill, run evals to test a skill, benchmark skill performance with variance analysis, or optimize a skill's description for better triggering accuracy. | Stars: 198k | Updated | Claude CodeCodex | Verified | Install |