bioepic-data/ecosim-agent / .agents/skills/ecosim-evaluation-output-check
ecosim-evaluation-output-check
VerifiedVerify EcoSIM evaluation-output coverage with an isolated one-year run. Use before model-data comparison or a full site run when observations need matching history variables, units, temporal/depth support and plant pools; also diagnose missing evaluation outputs. This checks output readiness, not model skill or a replacement for the two-year plant-trait smoke test.
| File | Kind | Size |
|---|---|---|
| SKILL.md | skill md | 9.3 KB |
| agents/openai.yaml | config | 292 B |
| references/manifest.md | markdown | 3.5 KB |
| references/target_mapping.md | markdown | 4.2 KB |
| scripts/check_outputs.py | script | 21.3 KB |
| tests/test_output_check.py | script | 13.3 KB |
references/target_mapping.md
View on GitHub# Candidate history mappings
These are candidate standalone EcoSIM names, not guaranteed fields for every
executable or proof of observational equivalence. Inspect the current
`f90src/IOutils/HistData/HistRegister*.F90` and `HistUpdate*.F90`, then put actual
names, units, dimensions and semantics into the manifest.
| Observation target | Candidate fields | Required interpretation/support |
|---|---|---|
| NEE | `ECO_NEE_CO2_col` | Verify sign, units, mean interval and observation QC. |
| GPP | `ECO_GPP_col` | Cumulative counter; annual end value or reset-aware increments. NT/DT tower products are partition-derived. |
| Ecosystem respiration | `ECO_RA_col`, `ECO_RH_col` | Verify signs and cumulative counters before summation. |
| ET from LE | `ECO_ET_col` | Cumulative water depth; integrate LE with explicit latent-heat convention. |
| Sensible heat | `ECO_HeatS_col` | Confirm sign and time averaging against H. |
| Radiation | `ECO_RADSW_col`, `SOL_RADN_col`, `RADN_col` | Absorbed/incoming/net and shortwave/all-wave are different quantities. Missing outgoing components must be flagged. |
| LAI | `ECO_LAI_col` | Leaf area versus leaf+stalk area; active PFT aggregation. |
| Canopy height | `CAN_HT_pft`, `Stalk_HT_pft` | Match height statistic and plant organs. |
| Leaf N | `LEAF_N_pft`, `LeafN_pft`, `LeafProteinN_pft`, actual PFT leaf area | Separate N stock per ground area, N per leaf area and protein N; verify structural/storage definitions and averaging. |
| Phenological development | `Growth_Stage_pft` and applicable phenology/node/leaf fields | Verify codes, branch aggregation and sampling before assigning emergence, flowering, filling or senescence dates. |
| Shoot-to-root ratio | `SHOOT_C_pft`, `Root_C_pft` | Carbon stock ratio with matching PFT/area/time support. Record storage/reproductive/nodule inclusion, mask invalid or near-zero root denominators, and show component stocks. Do not substitute a structural or root-density field. |
| Foliage/aboveground C | `LEAF_C_pft`, `PetolSheth_C_pft`, `STALK_C_pft`, `RESERVE_C_pft`, `HUSK_C_pft`, `GRAIN_C_pft`, `SHOOT_C_pft`, `SHOOT_NONSTC_pft` | Trace pool overlap and storage before choosing/summing. Request leaf/sheath for foliage and all relevant aboveground pools for total biomass; do not double-count aggregate SHOOT_C. |
| Crop production | Organ/pool/harvest fields established from code | Standing biomass is not cumulative harvested/exported production; Total/Foliage BIF is not automatically grain yield. |
| LMA/SLA | `SLA_pft` and matching leaf C/dry-mass basis | Verify observed units and carbon fraction; leaf and shoot pools differ. |
| Plant C/N | Matching organ C and N fields | Confirm concentration/stock and structural/storage basis. Block ambiguous records. |
| Soil temperature | `TEMP_vr`, `BOTDEPZ_vr` | Actual sensor depths, selected layers and depth interpolation. |
| Soil volumetric water | Direct volumetric-water output if available; `rWatFLP_vr`, `VSPore_vr` as diagnostic support | Relative saturation is not volumetric water. Trace micro/macro/rock basis and time averaging. Daily products cannot generally reconstruct a mean of a product. |
| SOC and soil N | `tSOC_vr`, `tSOCL_vr`, `tSON_vr`, `BOTDEPZ_vr` | Verify geometric/matrix volume, layer thickness and laboratory pool definition; tSOC includes organic pools excluded by some soil sampling protocols. |
| Bulk density/pH | Actual registry fields if available | Initialization-only values, water/salt pH, sampling depth and runtime changes require explicit mapping; mark missing outputs blocked. |
A one-year output check includes support for **all relevant observations** and
the five required plant diagnostics: height, GPP, leaf N, phenological
development and shoot-to-root ratio. These diagnostics remain required without
field observations; report that limitation separately. Other fields are
selected for the requested analysis and available observations, rather than
because an extractor happens to support them. Follow the parent skill's
companion coverage-table guidance for diagnostics without observations.
If useful observations exist in other years, request their fields as well and
record that this year validates output coverage rather than a same-year score.
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| finishing-a-development-branchobra/superpowersUse when implementation is complete, all tests pass, and you need to decide how to integrate the work | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| systematic-debuggingobra/superpowersUse when encountering any bug, test failure, or unexpected behavior, before proposing fixes | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| test-driven-developmentobra/superpowersUse when implementing any feature or bugfix, before writing implementation code | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| skill-creatoranthropics/skillsCreate new skills, modify and improve existing skills, and measure skill performance. Use when users want to create a skill from scratch, edit, or optimize an existing skill, run evals to test a skill, benchmark skill performance with variance analysis, or optimize a skill's description for better triggering accuracy. | Stars: 198k | Updated | Claude CodeCodex | Verified | Install |