Skip to content

GeoGeekLab/nature-reviewer-skills / nature-engineering-reviewer-skill

nature-engineering-reviewer

Verified

Nature-style engineering manuscript reviewer skill for testing devices, robots, platforms, systems, algorithms embodied in physical systems and engineering methods against requirements, validation, benchmarking, uncertainty, robustness and failure modes.

reviewer_db/patterns.jsonl

View on GitHub
{"concern": "A reader cannot tell which claims are directly demonstrated and which are extrapolated beyond the test matrix.", "domain": "nature-engineering", "evidence_risk": "The manuscript demonstrates a prototype or limited operating regime but phrases the result as broadly general.", "gate": "claim_evidence_calibration", "pattern_id": "ENG-PAT-0001", "revision_direction": "Calibrate the abstract, title and discussion to the validated envelope; state unresolved scaling and deployment constraints.", "severity": "major", "source_fields": {"claim_type": "General engineering performance or platform claim", "corpus_support_unit_count": "12", "evidence_risk": "The manuscript demonstrates a prototype or limited operating regime but phrases the result as broadly general.", "gate": "claim_evidence_calibration", "gate_title": "Claim-evidence calibration", "pattern_id": "ENG-PAT-0001", "pattern_name": "Demonstration-to-general-claim gap", "reviewer_concern": "A reader cannot tell which claims are directly demonstrated and which are extrapolated beyond the test matrix.", "revision_direction": "Calibrate the abstract, title and discussion to the validated envelope; state unresolved scaling and deployment constraints.", "severity_default": "major", "support_unit_hashes": "3fe0a0e14954;c4801c4eb8ea;d840634cbdbb;cb6e4b594475;bad6ee266b2b", "verbatim_source_text_included": "false"}, "title": "Demonstration-to-general-claim gap", "triggers": []}
{"concern": "The claimed advance may disappear under a complete multi-objective comparison.", "domain": "nature-engineering", "evidence_risk": "Only favourable metrics are highlighted while trade-offs such as power, yield, lifetime, complexity or safety are underweighted.", "gate": "claim_evidence_calibration", "pattern_id": "ENG-PAT-0002", "revision_direction": "Report a balanced metric table and explicitly discuss performance trade-offs against closest alternatives.", "severity": "major", "source_fields": {"claim_type": "Best-in-class or superior-performance claim", "corpus_support_unit_count": "12", "evidence_risk": "Only favourable metrics are highlighted while trade-offs such as power, yield, lifetime, complexity or safety are underweighted.", "gate": "claim_evidence_calibration", "gate_title": "Claim-evidence calibration", "pattern_id": "ENG-PAT-0002", "pattern_name": "Metric-selected narrative", "reviewer_concern": "The claimed advance may disappear under a complete multi-objective comparison.", "revision_direction": "Report a balanced metric table and explicitly discuss performance trade-offs against closest alternatives.", "severity_default": "major", "support_unit_hashes": "3fe0a0e14954;c4801c4eb8ea;d840634cbdbb;cb6e4b594475;bad6ee266b2b", "verbatim_source_text_included": "false"}, "title": "Metric-selected narrative", "triggers": []}
{"concern": "The claimed conceptual advance may be an incremental combination or implementation detail.", "domain": "nature-engineering", "evidence_risk": "The closest previous systems are not compared under equivalent definitions or conditions.", "gate": "novelty_and_positioning", "pattern_id": "ENG-PAT-0003", "revision_direction": "Add a focused comparison with the nearest prior art and specify what is new in principle, capability or scale.", "severity": "major", "source_fields": {"claim_type": "Novel device, platform, method or architecture", "corpus_support_unit_count": "4", "evidence_risk": "The closest previous systems are not compared under equivalent definitions or conditions.", "gate": "novelty_and_positioning", "gate_title": "Novelty and related-work positioning", "pattern_id": "ENG-PAT-0003", "pattern_name": "Insufficient separation from closest prior art", "reviewer_concern": "The claimed conceptual advance may be an incremental combination or implementation detail.", "revision_direction": "Add a focused comparison with the nearest prior art and specify what is new in principle, capability or scale.", "severity_default": "major", "support_unit_hashes": "752b31224c13;afeba8eb54d9;b80184da6030;1765c186d5f4", "verbatim_source_text_included": "false"}, "title": "Insufficient separation from closest prior art", "triggers": []}
{"concern": "The manuscript may overclaim originality because it samples only a narrow citation field.", "domain": "nature-engineering", "evidence_risk": "The work is novel to one community but routine in another domain whose literature is not represented.", "gate": "novelty_and_positioning", "pattern_id": "ENG-PAT-0004", "revision_direction": "Map the contribution against the relevant materials, controls, robotics, bioengineering or computation literature as appropriate.", "severity": "major", "source_fields": {"claim_type": "Interdisciplinary engineering contribution", "corpus_support_unit_count": "4", "evidence_risk": "The work is novel to one community but routine in another domain whose literature is not represented.", "gate": "novelty_and_positioning", "gate_title": "Novelty and related-work positioning", "pattern_id": "ENG-PAT-0004", "pattern_name": "Cross-field novelty mismatch", "reviewer_concern": "The manuscript may overclaim originality because it samples only a narrow citation field.", "revision_direction": "Map the contribution against the relevant materials, controls, robotics, bioengineering or computation literature as appropriate.", "severity_default": "major", "support_unit_hashes": "752b31224c13;afeba8eb54d9;b80184da6030;1765c186d5f4", "verbatim_source_text_included": "false"}, "title": "Cross-field novelty mismatch", "triggers": []}
{"concern": "It is unclear whether the proposed design is optimized for the claimed use case or merely works in a permissive setting.", "domain": "nature-engineering", "evidence_risk": "Functional requirements, constraints and acceptance criteria are implicit rather than quantitatively defined.", "gate": "design_specification_and_requirements", "pattern_id": "ENG-PAT-0005", "revision_direction": "Define requirements before presenting results, including target operating range, tolerances, safety constraints and success thresholds.", "severity": "major", "source_fields": {"claim_type": "System design solves a practical engineering problem", "corpus_support_unit_count": "8", "evidence_risk": "Functional requirements, constraints and acceptance criteria are implicit rather than quantitatively defined.", "gate": "design_specification_and_requirements", "gate_title": "Design specification and requirement fit", "pattern_id": "ENG-PAT-0005", "pattern_name": "Unstated design requirements", "reviewer_concern": "It is unclear whether the proposed design is optimized for the claimed use case or merely works in a permissive setting.", "revision_direction": "Define requirements before presenting results, including target operating range, tolerances, safety constraints and success thresholds.", "severity_default": "major", "support_unit_hashes": "c0f11779695a;0e7ef6623086;3c350e5c5828;43303484e268;05820f8c4502", "verbatim_source_text_included": "false"}, "title": "Unstated design requirements", "triggers": []}
{"concern": "Component performance may not transfer to the assembled device or workflow.", "domain": "nature-engineering", "evidence_risk": "Individual modules are characterized, but integration losses and system interactions are not tested.", "gate": "design_specification_and_requirements", "pattern_id": "ENG-PAT-0006", "revision_direction": "Add end-to-end system tests and account for losses, delays, coupling effects and failure propagation.", "severity": "major", "source_fields": {"claim_type": "Integrated engineering system claim", "corpus_support_unit_count": "8", "evidence_risk": "Individual modules are characterized, but integration losses and system interactions are not tested.", "gate": "design_specification_and_requirements", "gate_title": "Design specification and requirement fit", "pattern_id": "ENG-PAT-0006", "pattern_name": "Component-level success treated as system-level validation", "reviewer_concern": "Component performance may not transfer to the assembled device or workflow.", "revision_direction": "Add end-to-end system tests and account for losses, delays, coupling effects and failure propagation.", "severity_default": "major", "support_unit_hashes": "c0f11779695a;0e7ef6623086;3c350e5c5828;43303484e268;05820f8c4502", "verbatim_source_text_included": "false"}, "title": "Component-level success treated as system-level validation", "triggers": []}
{"concern": "Observed improvements may be caused by fabrication history, geometry, training protocol or environmental conditions rather than the proposed mechanism.", "domain": "nature-engineering", "evidence_risk": "The experiment lacks controls that isolate the active design element from confounders.", "gate": "experimental_validation_and_controls", "pattern_id": "ENG-PAT-0007", "revision_direction": "Add matched controls and ablations that remove or perturb the claimed causal design feature.", "severity": "major", "source_fields": {"claim_type": "Mechanism, material, device or bioengineering effect", "corpus_support_unit_count": "9", "evidence_risk": "The experiment lacks controls that isolate the active design element from confounders.", "gate": "experimental_validation_and_controls", "gate_title": "Experimental validation and controls", "pattern_id": "ENG-PAT-0007", "pattern_name": "Missing negative or process controls", "reviewer_concern": "Observed improvements may be caused by fabrication history, geometry, training protocol or environmental conditions rather than the proposed mechanism.", "revision_direction": "Add matched controls and ablations that remove or perturb the claimed causal design feature.", "severity_default": "major", "support_unit_hashes": "96881511a8f2;4825317231ba;f457724ad51b;8b3494f2bc04;883aadd91d79", "verbatim_source_text_included": "false"}, "title": "Missing negative or process controls", "triggers": []}
{"concern": "The magnitude and repeatability of the effect are not distinguishable from run-to-run variability.", "domain": "nature-engineering", "evidence_risk": "Key results rely on few devices, cells, robots, samples or experimental runs.", "gate": "experimental_validation_and_controls", "pattern_id": "ENG-PAT-0008", "revision_direction": "Report biological or technical replicates, failure counts, variance and confidence intervals for principal claims.", "severity": "major", "source_fields": {"claim_type": "Reliable performance or robustness claim", "corpus_support_unit_count": "9", "evidence_risk": "Key results rely on few devices, cells, robots, samples or experimental runs.", "gate": "experimental_validation_and_controls", "gate_title": "Experimental validation and controls", "pattern_id": "ENG-PAT-0008", "pattern_name": "Single-run or low-replicate validation", "reviewer_concern": "The magnitude and repeatability of the effect are not distinguishable from run-to-run variability.", "revision_direction": "Report biological or technical replicates, failure counts, variance and confidence intervals for principal claims.", "severity_default": "major", "support_unit_hashes": "96881511a8f2;4825317231ba;f457724ad51b;8b3494f2bc04;883aadd91d79", "verbatim_source_text_included": "false"}, "title": "Single-run or low-replicate validation", "triggers": []}
{"concern": "The use-case claim is stronger than the environmental realism of the tests.", "domain": "nature-engineering", "evidence_risk": "Validation is performed under simplified laboratory conditions that omit load, contamination, heterogeneity, motion, ageing or deployment stress.", "gate": "experimental_validation_and_controls", "pattern_id": "ENG-PAT-0009", "revision_direction": "Add tests under representative operating conditions or narrow the deployment claim accordingly.", "severity": "major", "source_fields": {"claim_type": "Real-world engineering applicability", "corpus_support_unit_count": "9", "evidence_risk": "Validation is performed under simplified laboratory conditions that omit load, contamination, heterogeneity, motion, ageing or deployment stress.", "gate": "experimental_validation_and_controls", "gate_title": "Experimental validation and controls", "pattern_id": "ENG-PAT-0009", "pattern_name": "Test condition mismatch", "reviewer_concern": "The use-case claim is stronger than the environmental realism of the tests.", "revision_direction": "Add tests under representative operating conditions or narrow the deployment claim accordingly.", "severity_default": "major", "support_unit_hashes": "96881511a8f2;4825317231ba;f457724ad51b;8b3494f2bc04;883aadd91d79", "verbatim_source_text_included": "false"}, "title": "Test condition mismatch", "triggers": []}
{"concern": "Performance superiority may be an artefact of comparison design.", "domain": "nature-engineering", "evidence_risk": "Baselines are not tuned, not current, or evaluated under different data, hardware or operating conditions.", "gate": "benchmark_and_comparability", "pattern_id": "ENG-PAT-0010", "revision_direction": "Use current baselines, matched constraints and transparent evaluation protocols; report where each method is advantaged or disadvantaged.", "severity": "major", "source_fields": {"claim_type": "Outperforms existing methods or devices", "corpus_support_unit_count": "5", "evidence_risk": "Baselines are not tuned, not current, or evaluated under different data, hardware or operating conditions.", "gate": "benchmark_and_comparability", "gate_title": "Benchmarking and comparability", "pattern_id": "ENG-PAT-0010", "pattern_name": "Unfair baseline comparison", "reviewer_concern": "Performance superiority may be an artefact of comparison design.", "revision_direction": "Use current baselines, matched constraints and transparent evaluation protocols; report where each method is advantaged or disadvantaged.", "severity_default": "major", "support_unit_hashes": "5666214eaea3;7e8f33885f6b;c66b97c471f1;5c584b4031fd;e33907d44a5e", "verbatim_source_text_included": "false"}, "title": "Unfair baseline comparison", "triggers": []}
{"concern": "Readers cannot reproduce or compare the reported performance.", "domain": "nature-engineering", "evidence_risk": "Latency, efficiency, sensitivity, accuracy, stability, throughput or yield are not defined consistently.", "gate": "benchmark_and_comparability", "pattern_id": "ENG-PAT-0011", "revision_direction": "Define every metric, denominator, time window and normalization; align tables and figures with those definitions.", "severity": "major", "source_fields": {"claim_type": "Quantitative performance claim", "corpus_support_unit_count": "5", "evidence_risk": "Latency, efficiency, sensitivity, accuracy, stability, throughput or yield are not defined consistently.", "gate": "benchmark_and_comparability", "gate_title": "Benchmarking and comparability", "pattern_id": "ENG-PAT-0011", "pattern_name": "Metric definition ambiguity", "reviewer_concern": "Readers cannot reproduce or compare the reported performance.", "revision_direction": "Define every metric, denominator, time window and normalization; align tables and figures with those definitions.", "severity_default": "major", "support_unit_hashes": "5666214eaea3;7e8f33885f6b;c66b97c471f1;5c584b4031fd;e33907d44a5e", "verbatim_source_text_included": "false"}, "title": "Metric definition ambiguity", "triggers": []}
{"concern": "Scaling may introduce new dominant limitations not present in the proof-of-concept.", "domain": "nature-engineering", "evidence_risk": "The work extrapolates from small devices or short demonstrations without considering yield, cost, parallelization, heat, mass transport or control complexity.", "gate": "scaling_boundary_and_operating_envelope", "pattern_id": "ENG-PAT-0012", "revision_direction": "Provide a scale-up analysis or explicitly restrict the claim to the demonstrated size and throughput.", "severity": "major", "source_fields": {"claim_type": "Scalable manufacturing, deployment or throughput claim", "corpus_support_unit_count": "1", "evidence_risk": "The work extrapolates from small devices or short demonstrations without considering yield, cost, parallelization, heat, mass transport or control complexity.", "gate": "scaling_boundary_and_operating_envelope", "gate_title": "Scaling, boundary and operating envelope", "pattern_id": "ENG-PAT-0012", "pattern_name": "Scale-up assumption without bottleneck analysis", "reviewer_concern": "Scaling may introduce new dominant limitations not present in the proof-of-concept.", "revision_direction": "Provide a scale-up analysis or explicitly restrict the claim to the demonstrated size and throughput.", "severity_default": "major", "support_unit_hashes": "dbd01ba439e6", "verbatim_source_text_included": "false"}, "title": "Scale-up assumption without bottleneck analysis", "triggers": []}
{"concern": "The reported result may be a narrow optimum rather than a robust capability.", "domain": "nature-engineering", "evidence_risk": "Performance is reported at one or a few operating points rather than across the relevant envelope.", "gate": "scaling_boundary_and_operating_envelope", "pattern_id": "ENG-PAT-0013", "revision_direction": "Map performance over load, speed, temperature, humidity, concentration, duration, geometry or dataset shift as appropriate.", "severity": "major", "source_fields": {"claim_type": "Robust or practical device/system claim", "corpus_support_unit_count": "1", "evidence_risk": "Performance is reported at one or a few operating points rather than across the relevant envelope.", "gate": "scaling_boundary_and_operating_envelope", "gate_title": "Scaling, boundary and operating envelope", "pattern_id": "ENG-PAT-0013", "pattern_name": "Operating envelope underreported", "reviewer_concern": "The reported result may be a narrow optimum rather than a robust capability.", "revision_direction": "Map performance over load, speed, temperature, humidity, concentration, duration, geometry or dataset shift as appropriate.", "severity_default": "major", "support_unit_hashes": "dbd01ba439e6", "verbatim_source_text_included": "false"}, "title": "Operating envelope underreported", "triggers": []}
{"concern": "The model may encode assumptions that determine the conclusion.", "domain": "nature-engineering", "evidence_risk": "A simulation or optimization result is used as if it independently validates the physical system.", "gate": "model_assumptions_and_sensitivity", "pattern_id": "ENG-PAT-0014", "revision_direction": "Separate model prediction from experimental validation; test sensitivity to assumptions and parameters.", "severity": "major", "source_fields": {"claim_type": "Model-guided engineering claim", "corpus_support_unit_count": "2", "evidence_risk": "A simulation or optimization result is used as if it independently validates the physical system.", "gate": "model_assumptions_and_sensitivity", "gate_title": "Model assumptions and sensitivity", "pattern_id": "ENG-PAT-0014", "pattern_name": "Simulation-as-validation substitution", "reviewer_concern": "The model may encode assumptions that determine the conclusion.", "revision_direction": "Separate model prediction from experimental validation; test sensitivity to assumptions and parameters.", "severity_default": "major", "support_unit_hashes": "1cecd5f9727a;559694a59626", "verbatim_source_text_included": "false"}, "title": "Simulation-as-validation substitution", "triggers": []}
{"concern": "The model may not be predictive outside the calibration set.", "domain": "nature-engineering", "evidence_risk": "Important parameters are fitted, selected or fixed without uncertainty propagation.", "gate": "model_assumptions_and_sensitivity", "pattern_id": "ENG-PAT-0015", "revision_direction": "Disclose parameter sources, fitting strategy and sensitivity; test on independent data or unseen conditions.", "severity": "major", "source_fields": {"claim_type": "Mechanistic or predictive engineering model", "corpus_support_unit_count": "2", "evidence_risk": "Important parameters are fitted, selected or fixed without uncertainty propagation.", "gate": "model_assumptions_and_sensitivity", "gate_title": "Model assumptions and sensitivity", "pattern_id": "ENG-PAT-0015", "pattern_name": "Hidden parameter dependence", "reviewer_concern": "The model may not be predictive outside the calibration set.", "revision_direction": "Disclose parameter sources, fitting strategy and sensitivity; test on independent data or unseen conditions.", "severity_default": "major", "support_unit_hashes": "1cecd5f9727a;559694a59626", "verbatim_source_text_included": "false"}, "title": "Hidden parameter dependence", "triggers": []}
{"concern": "It is impossible to judge whether differences are meaningful and reproducible.", "domain": "nature-engineering", "evidence_risk": "Key metrics are plotted without error bars, sample sizes, confidence intervals or failure rates.", "gate": "uncertainty_statistics_and_failure_modes", "pattern_id": "ENG-PAT-0016", "revision_direction": "Report n, variance, error model and failure statistics for each major metric.", "severity": "major", "source_fields": {"claim_type": "Performance improvement or reliability claim", "corpus_support_unit_count": "4", "evidence_risk": "Key metrics are plotted without error bars, sample sizes, confidence intervals or failure rates.", "gate": "uncertainty_statistics_and_failure_modes", "gate_title": "Uncertainty, statistics and failure modes", "pattern_id": "ENG-PAT-0016", "pattern_name": "Uncertainty absent from engineering metrics", "reviewer_concern": "It is impossible to judge whether differences are meaningful and reproducible.", "revision_direction": "Report n, variance, error model and failure statistics for each major metric.", "severity_default": "major", "support_unit_hashes": "11bf86bdf430;62b9c217c690;b7785a59cfdc;bf258e8fda79", "verbatim_source_text_included": "false"}, "title": "Uncertainty absent from engineering metrics", "triggers": []}
{"concern": "The manuscript does not show when the design fails or how failure affects the claimed application.", "domain": "nature-engineering", "evidence_risk": "Aggregate performance masks catastrophic, rare or condition-specific failures.", "gate": "uncertainty_statistics_and_failure_modes", "pattern_id": "ENG-PAT-0017", "revision_direction": "Include failure taxonomy, worst-case cases, survival/lifetime tests or stress tests matched to the intended use.", "severity": "major", "source_fields": {"claim_type": "Robustness, reliability or safety claim", "corpus_support_unit_count": "4", "evidence_risk": "Aggregate performance masks catastrophic, rare or condition-specific failures.", "gate": "uncertainty_statistics_and_failure_modes", "gate_title": "Uncertainty, statistics and failure modes", "pattern_id": "ENG-PAT-0017", "pattern_name": "Failure modes hidden behind averages", "reviewer_concern": "The manuscript does not show when the design fails or how failure affects the claimed application.", "revision_direction": "Include failure taxonomy, worst-case cases, survival/lifetime tests or stress tests matched to the intended use.", "severity_default": "major", "support_unit_hashes": "11bf86bdf430;62b9c217c690;b7785a59cfdc;bf258e8fda79", "verbatim_source_text_included": "false"}, "title": "Failure modes hidden behind averages", "triggers": []}
{"concern": "The proposed mechanism may be plausible but not demonstrated.", "domain": "nature-engineering", "evidence_risk": "The manuscript shows a correlation between design parameters and output but does not perturb the causal pathway.", "gate": "mechanism_and_causality", "pattern_id": "ENG-PAT-0018", "revision_direction": "Add targeted perturbations, ablations, intermediate measurements or competing-mechanism tests.", "severity": "major", "source_fields": {"claim_type": "Mechanistic explanation of an engineering effect", "corpus_support_unit_count": "3", "evidence_risk": "The manuscript shows a correlation between design parameters and output but does not perturb the causal pathway.", "gate": "mechanism_and_causality", "gate_title": "Mechanism and causality", "pattern_id": "ENG-PAT-0018", "pattern_name": "Correlation presented as mechanism", "reviewer_concern": "The proposed mechanism may be plausible but not demonstrated.", "revision_direction": "Add targeted perturbations, ablations, intermediate measurements or competing-mechanism tests.", "severity_default": "major", "support_unit_hashes": "61a4da3fca96;cdab66bfc68a;95c204bb9935", "verbatim_source_text_included": "false"}, "title": "Correlation presented as mechanism", "triggers": []}
{"concern": "The central explanatory claim is underdetermined by the evidence.", "domain": "nature-engineering", "evidence_risk": "Alternative mechanisms could explain the same performance trend.", "gate": "mechanism_and_causality", "pattern_id": "ENG-PAT-0019", "revision_direction": "State alternative explanations and add discriminating experiments or narrow the claim to phenomenology.", "severity": "major", "source_fields": {"claim_type": "Physical, chemical or biological mechanism claim", "corpus_support_unit_count": "3", "evidence_risk": "Alternative mechanisms could explain the same performance trend.", "gate": "mechanism_and_causality", "gate_title": "Mechanism and causality", "pattern_id": "ENG-PAT-0019", "pattern_name": "Multiple plausible mechanisms unresolved", "reviewer_concern": "The central explanatory claim is underdetermined by the evidence.", "revision_direction": "State alternative explanations and add discriminating experiments or narrow the claim to phenomenology.", "severity_default": "major", "support_unit_hashes": "61a4da3fca96;cdab66bfc68a;95c204bb9935", "verbatim_source_text_included": "false"}, "title": "Multiple plausible mechanisms unresolved", "triggers": []}
{"concern": "The device performance may depend on unreported fabrication variability.", "domain": "nature-engineering", "evidence_risk": "Only selected devices or batches are reported; yield and batch-to-batch variation are absent.", "gate": "materials_devices_and_fabrication", "pattern_id": "ENG-PAT-0020", "revision_direction": "Report process window, yield, rejected devices, batch statistics and critical fabrication tolerances.", "severity": "major", "source_fields": {"claim_type": "Manufacturable device or material platform", "corpus_support_unit_count": "5", "evidence_risk": "Only selected devices or batches are reported; yield and batch-to-batch variation are absent.", "gate": "materials_devices_and_fabrication", "gate_title": "Materials, devices and fabrication", "pattern_id": "ENG-PAT-0020", "pattern_name": "Fabrication reproducibility not demonstrated", "reviewer_concern": "The device performance may depend on unreported fabrication variability.", "revision_direction": "Report process window, yield, rejected devices, batch statistics and critical fabrication tolerances.", "severity_default": "major", "support_unit_hashes": "54deb57f1cc8;eee234b67660;8f3858bc9fd0;adedf659b5ee;87a3d4f078f7", "verbatim_source_text_included": "false"}, "title": "Fabrication reproducibility not demonstrated", "triggers": []}
{"concern": "Short-term performance may not support lifetime or deployment claims.", "domain": "nature-engineering", "evidence_risk": "Tests do not capture interface degradation, fouling, fatigue, hysteresis, drift or environmental ageing.", "gate": "materials_devices_and_fabrication", "pattern_id": "ENG-PAT-0021", "revision_direction": "Add accelerated ageing, cyclic tests, post-test characterization or restrict lifetime claims.", "severity": "major", "source_fields": {"claim_type": "Long-lived material, device or implant performance", "corpus_support_unit_count": "5", "evidence_risk": "Tests do not capture interface degradation, fouling, fatigue, hysteresis, drift or environmental ageing.", "gate": "materials_devices_and_fabrication", "gate_title": "Materials, devices and fabrication", "pattern_id": "ENG-PAT-0021", "pattern_name": "Interface and ageing effects omitted", "reviewer_concern": "Short-term performance may not support lifetime or deployment claims.", "revision_direction": "Add accelerated ageing, cyclic tests, post-test characterization or restrict lifetime claims.", "severity_default": "major", "support_unit_hashes": "54deb57f1cc8;eee234b67660;8f3858bc9fd0;adedf659b5ee;87a3d4f078f7", "verbatim_source_text_included": "false"}, "title": "Interface and ageing effects omitted", "triggers": []}
{"concern": "The controller may not be robust to perturbations, terrain, contact dynamics or distribution shift.", "domain": "nature-engineering", "evidence_risk": "Robots are evaluated in simple arenas, limited tasks or hand-curated scenarios.", "gate": "robotics_control_and_embodiment", "pattern_id": "ENG-PAT-0022", "revision_direction": "Add perturbation tests, task diversity, held-out environments and comparisons to simpler control policies.", "severity": "major", "source_fields": {"claim_type": "Robotic autonomy or control claim", "corpus_support_unit_count": "3", "evidence_risk": "Robots are evaluated in simple arenas, limited tasks or hand-curated scenarios.", "gate": "robotics_control_and_embodiment", "gate_title": "Robotics, control and embodiment", "pattern_id": "ENG-PAT-0022", "pattern_name": "Controller tested only in permissive environments", "reviewer_concern": "The controller may not be robust to perturbations, terrain, contact dynamics or distribution shift.", "revision_direction": "Add perturbation tests, task diversity, held-out environments and comparisons to simpler control policies.", "severity_default": "major", "support_unit_hashes": "3b15aefa8e6f;e85f14651970;b5fdd879ab8c", "verbatim_source_text_included": "false"}, "title": "Controller tested only in permissive environments", "triggers": []}
{"concern": "The claimed design principle may be attributable to one subsystem or to tuning rather than embodiment.", "domain": "nature-engineering", "evidence_risk": "The study does not separate hardware morphology, sensing, actuation and control algorithm contributions.", "gate": "robotics_control_and_embodiment", "pattern_id": "ENG-PAT-0023", "revision_direction": "Use ablations and matched controllers/morphologies to isolate the contribution of each subsystem.", "severity": "major", "source_fields": {"claim_type": "Robot morphology or embodied intelligence claim", "corpus_support_unit_count": "3", "evidence_risk": "The study does not separate hardware morphology, sensing, actuation and control algorithm contributions.", "gate": "robotics_control_and_embodiment", "gate_title": "Robotics, control and embodiment", "pattern_id": "ENG-PAT-0023", "pattern_name": "Embodiment contribution unclear", "reviewer_concern": "The claimed design principle may be attributable to one subsystem or to tuning rather than embodiment.", "revision_direction": "Use ablations and matched controllers/morphologies to isolate the contribution of each subsystem.", "severity_default": "major", "support_unit_hashes": "3b15aefa8e6f;e85f14651970;b5fdd879ab8c", "verbatim_source_text_included": "false"}, "title": "Embodiment contribution unclear", "triggers": []}
{"concern": "Safety, immune response, off-target effects, biodistribution, durability or manufacturing controls remain unresolved.", "domain": "nature-engineering", "evidence_risk": "The evidence is limited to in vitro or short animal studies but the claims imply clinical or translational readiness.", "gate": "biomedical_and_bioengineering_translation", "pattern_id": "ENG-PAT-0024", "revision_direction": "Use cautious translational language and add relevant safety, dose-response, durability or in vivo controls.", "severity": "major", "source_fields": {"claim_type": "Biomedical device, implant, therapeutic or diagnostic claim", "corpus_support_unit_count": "6", "evidence_risk": "The evidence is limited to in vitro or short animal studies but the claims imply clinical or translational readiness.", "gate": "biomedical_and_bioengineering_translation", "gate_title": "Biomedical and bioengineering translation", "pattern_id": "ENG-PAT-0024", "pattern_name": "Translation claim beyond biological validation", "reviewer_concern": "Safety, immune response, off-target effects, biodistribution, durability or manufacturing controls remain unresolved.", "revision_direction": "Use cautious translational language and add relevant safety, dose-response, durability or in vivo controls.", "severity_default": "major", "support_unit_hashes": "c7d19aac0ac3;88a1331623bd;934adad17866;fab50d1723af;6e25b47e5841", "verbatim_source_text_included": "false"}, "title": "Translation claim beyond biological validation", "triggers": []}
{"concern": "The engineering effect may not generalize across biological contexts.", "domain": "nature-engineering", "evidence_risk": "Cell line, animal model, patient-like heterogeneity or biological confounders are not sufficiently specified.", "gate": "biomedical_and_bioengineering_translation", "pattern_id": "ENG-PAT-0025", "revision_direction": "Clarify biological model choice and test representative heterogeneity where it is central to the claim.", "severity": "major", "source_fields": {"claim_type": "Bioengineering performance in cells, tissues or organisms", "corpus_support_unit_count": "6", "evidence_risk": "Cell line, animal model, patient-like heterogeneity or biological confounders are not sufficiently specified.", "gate": "biomedical_and_bioengineering_translation", "gate_title": "Biomedical and bioengineering translation", "pattern_id": "ENG-PAT-0025", "pattern_name": "Biological context under-specified", "reviewer_concern": "The engineering effect may not generalize across biological contexts.", "revision_direction": "Clarify biological model choice and test representative heterogeneity where it is central to the claim.", "severity_default": "major", "support_unit_hashes": "c7d19aac0ac3;88a1331623bd;934adad17866;fab50d1723af;6e25b47e5841", "verbatim_source_text_included": "false"}, "title": "Biological context under-specified", "triggers": []}
{"concern": "The system may be automated execution rather than autonomous discovery or reasoning.", "domain": "nature-engineering", "evidence_risk": "Human intervention, curated search space or hard-coded constraints are not separated from autonomous decision-making.", "gate": "automation_ai_and_closed_loop_systems", "pattern_id": "ENG-PAT-0026", "revision_direction": "Disclose human inputs, constraints, stopping rules and decision logic; compare against manual or non-adaptive baselines.", "severity": "major", "source_fields": {"claim_type": "Autonomous laboratory, AI scientist or self-driving system claim", "corpus_support_unit_count": "4", "evidence_risk": "Human intervention, curated search space or hard-coded constraints are not separated from autonomous decision-making.", "gate": "automation_ai_and_closed_loop_systems", "gate_title": "Automation, AI and closed-loop systems", "pattern_id": "ENG-PAT-0026", "pattern_name": "Closed-loop autonomy overstated", "reviewer_concern": "The system may be automated execution rather than autonomous discovery or reasoning.", "revision_direction": "Disclose human inputs, constraints, stopping rules and decision logic; compare against manual or non-adaptive baselines.", "severity_default": "major", "support_unit_hashes": "93b4a5578c26;e059dbac0026;20d077dd8196;628c2ac451d0", "verbatim_source_text_included": "false"}, "title": "Closed-loop autonomy overstated", "triggers": []}
{"concern": "The reported gain may not transfer to unseen designs, tasks or laboratories.", "domain": "nature-engineering", "evidence_risk": "Training, tuning, benchmark selection or prompt engineering may contaminate evaluation.", "gate": "automation_ai_and_closed_loop_systems", "pattern_id": "ENG-PAT-0027", "revision_direction": "Use held-out tasks, disclose tuning protocol, separate development and evaluation sets, and include strong non-AI baselines.", "severity": "major", "source_fields": {"claim_type": "AI-assisted engineering performance claim", "corpus_support_unit_count": "4", "evidence_risk": "Training, tuning, benchmark selection or prompt engineering may contaminate evaluation.", "gate": "automation_ai_and_closed_loop_systems", "gate_title": "Automation, AI and closed-loop systems", "pattern_id": "ENG-PAT-0027", "pattern_name": "Training-test leakage or narrow benchmark", "reviewer_concern": "The reported gain may not transfer to unseen designs, tasks or laboratories.", "revision_direction": "Use held-out tasks, disclose tuning protocol, separate development and evaluation sets, and include strong non-AI baselines.", "severity_default": "major", "support_unit_hashes": "93b4a5578c26;e059dbac0026;20d077dd8196;628c2ac451d0", "verbatim_source_text_included": "false"}, "title": "Training-test leakage or narrow benchmark", "triggers": []}
{"concern": "A competent reader could not reproduce the core result.", "domain": "nature-engineering", "evidence_risk": "Critical materials, process parameters, calibration steps, code or data are unavailable or under-specified.", "gate": "reproducibility_data_and_code", "pattern_id": "ENG-PAT-0028", "revision_direction": "Provide executable code, raw/processed data, full protocols, calibration details and versioned dependencies where possible.", "severity": "major", "source_fields": {"claim_type": "Reproducible engineering method or device", "corpus_support_unit_count": "1", "evidence_risk": "Critical materials, process parameters, calibration steps, code or data are unavailable or under-specified.", "gate": "reproducibility_data_and_code", "gate_title": "Reproducibility, data and code", "pattern_id": "ENG-PAT-0028", "pattern_name": "Insufficient protocol for reproduction", "reviewer_concern": "A competent reader could not reproduce the core result.", "revision_direction": "Provide executable code, raw/processed data, full protocols, calibration details and versioned dependencies where possible.", "severity_default": "major", "support_unit_hashes": "1079572da957", "verbatim_source_text_included": "false"}, "title": "Insufficient protocol for reproduction", "triggers": []}
{"concern": "The apparent efficiency or reliability may be biased by selective reporting.", "domain": "nature-engineering", "evidence_risk": "The manuscript reports successful designs but not failed trials, exclusion criteria or selection filters.", "gate": "reproducibility_data_and_code", "pattern_id": "ENG-PAT-0029", "revision_direction": "Report screening funnel, failed variants, exclusion criteria and all material/device/sample counts.", "severity": "major", "source_fields": {"claim_type": "Robust design or discovery workflow", "corpus_support_unit_count": "1", "evidence_risk": "The manuscript reports successful designs but not failed trials, exclusion criteria or selection filters.", "gate": "reproducibility_data_and_code", "gate_title": "Reproducibility, data and code", "pattern_id": "ENG-PAT-0029", "pattern_name": "Unavailable negative results or selection criteria", "reviewer_concern": "The apparent efficiency or reliability may be biased by selective reporting.", "revision_direction": "Report screening funnel, failed variants, exclusion criteria and all material/device/sample counts.", "severity_default": "major", "support_unit_hashes": "1079572da957", "verbatim_source_text_included": "false"}, "title": "Unavailable negative results or selection criteria", "triggers": []}
{"concern": "The evidence anchor for major claims is unclear or insufficiently quantified.", "domain": "nature-engineering", "evidence_risk": "Figures show qualitative examples while text uses them to make quantitative or general claims.", "gate": "detail_audit_and_presentation", "pattern_id": "ENG-PAT-0030", "revision_direction": "Add quantitative summaries, sample sizes, units, axis definitions and source-data links for claim-bearing figures.", "severity": "major", "source_fields": {"claim_type": "Quantitative interpretation based on visual evidence", "corpus_support_unit_count": "5", "evidence_risk": "Figures show qualitative examples while text uses them to make quantitative or general claims.", "gate": "detail_audit_and_presentation", "gate_title": "Detail audit and presentation", "pattern_id": "ENG-PAT-0030", "pattern_name": "Figure-to-claim mismatch", "reviewer_concern": "The evidence anchor for major claims is unclear or insufficiently quantified.", "revision_direction": "Add quantitative summaries, sample sizes, units, axis definitions and source-data links for claim-bearing figures.", "severity_default": "minor_to_major", "support_unit_hashes": "4abdd2670604;4a4874be4b8f;e7f0d1482d32;d90b481f00b3;92ce58c2082c", "verbatim_source_text_included": "false"}, "title": "Figure-to-claim mismatch", "triggers": []}
{"concern": "Ambiguity prevents evaluation of methods and comparison with prior work.", "domain": "nature-engineering", "evidence_risk": "Definitions, symbols, units or abbreviations vary across the manuscript, figures and supplement.", "gate": "detail_audit_and_presentation", "pattern_id": "ENG-PAT-0031", "revision_direction": "Standardize definitions, add notation tables and ensure captions carry all units and measurement conditions.", "severity": "major", "source_fields": {"claim_type": "Technical communication and comparability", "corpus_support_unit_count": "5", "evidence_risk": "Definitions, symbols, units or abbreviations vary across the manuscript, figures and supplement.", "gate": "detail_audit_and_presentation", "gate_title": "Detail audit and presentation", "pattern_id": "ENG-PAT-0031", "pattern_name": "Terminology and unit ambiguity", "reviewer_concern": "Ambiguity prevents evaluation of methods and comparison with prior work.", "revision_direction": "Standardize definitions, add notation tables and ensure captions carry all units and measurement conditions.", "severity_default": "minor_to_major", "support_unit_hashes": "4abdd2670604;4a4874be4b8f;e7f0d1482d32;d90b481f00b3;92ce58c2082c", "verbatim_source_text_included": "false"}, "title": "Terminology and unit ambiguity", "triggers": []}
{"concern": "The conclusion may be stronger than the demonstrated engineering evidence.", "domain": "nature-engineering", "evidence_risk": "A device paper reports an impressive exemplar but not yield across fabricated units.", "gate": "materials_devices_and_fabrication", "pattern_id": "ENG-PAT-0032", "revision_direction": "Report unit counts, process yield, failed devices and batch-level variability.", "severity": "major", "source_fields": {"claim_type": "Materials, devices and fabrication", "corpus_support_unit_count": "5", "evidence_risk": "A device paper reports an impressive exemplar but not yield across fabricated units.", "gate": "materials_devices_and_fabrication", "gate_title": "Materials, devices and fabrication", "pattern_id": "ENG-PAT-0032", "pattern_name": "Device yield vs selected exemplar", "reviewer_concern": "The conclusion may be stronger than the demonstrated engineering evidence.", "revision_direction": "Report unit counts, process yield, failed devices and batch-level variability.", "severity_default": "major", "support_unit_hashes": "54deb57f1cc8;eee234b67660;8f3858bc9fd0;adedf659b5ee;87a3d4f078f7", "verbatim_source_text_included": "false"}, "title": "Device yield vs selected exemplar", "triggers": []}
{"concern": "The conclusion may be stronger than the demonstrated engineering evidence.", "domain": "nature-engineering", "evidence_risk": "Durability tests are shorter or milder than the claimed deployment regime.", "gate": "materials_devices_and_fabrication", "pattern_id": "ENG-PAT-0033", "revision_direction": "Extend cycling, stress or storage tests and state practical lifetime limits.", "severity": "major", "source_fields": {"claim_type": "Materials, devices and fabrication", "corpus_support_unit_count": "5", "evidence_risk": "Durability tests are shorter or milder than the claimed deployment regime.", "gate": "materials_devices_and_fabrication", "gate_title": "Materials, devices and fabrication", "pattern_id": "ENG-PAT-0033", "pattern_name": "Stability tested below use intensity", "reviewer_concern": "The conclusion may be stronger than the demonstrated engineering evidence.", "revision_direction": "Extend cycling, stress or storage tests and state practical lifetime limits.", "severity_default": "major", "support_unit_hashes": "54deb57f1cc8;eee234b67660;8f3858bc9fd0;adedf659b5ee;87a3d4f078f7", "verbatim_source_text_included": "false"}, "title": "Stability tested below use intensity", "triggers": []}
{"concern": "The conclusion may be stronger than the demonstrated engineering evidence.", "domain": "nature-engineering", "evidence_risk": "The robot succeeds in one task class but the title implies general manipulation, locomotion or autonomy.", "gate": "robotics_control_and_embodiment", "pattern_id": "ENG-PAT-0034", "revision_direction": "Add task diversity and failure analysis or narrow the robot capability claim.", "severity": "major", "source_fields": {"claim_type": "Robotics, control and embodiment", "corpus_support_unit_count": "3", "evidence_risk": "The robot succeeds in one task class but the title implies general manipulation, locomotion or autonomy.", "gate": "robotics_control_and_embodiment", "gate_title": "Robotics, control and embodiment", "pattern_id": "ENG-PAT-0034", "pattern_name": "Task diversity gap", "reviewer_concern": "The conclusion may be stronger than the demonstrated engineering evidence.", "revision_direction": "Add task diversity and failure analysis or narrow the robot capability claim.", "severity_default": "major", "support_unit_hashes": "3b15aefa8e6f;e85f14651970;b5fdd879ab8c", "verbatim_source_text_included": "false"}, "title": "Task diversity gap", "triggers": []}
{"concern": "The conclusion may be stronger than the demonstrated engineering evidence.", "domain": "nature-engineering", "evidence_risk": "Simulation performance is emphasized without enough real-world transfer evidence.", "gate": "robotics_control_and_embodiment", "pattern_id": "ENG-PAT-0035", "revision_direction": "Report sim-to-real assumptions, real-world trials and domain randomization or adaptation details.", "severity": "major", "source_fields": {"claim_type": "Robotics, control and embodiment", "corpus_support_unit_count": "3", "evidence_risk": "Simulation performance is emphasized without enough real-world transfer evidence.", "gate": "robotics_control_and_embodiment", "gate_title": "Robotics, control and embodiment", "pattern_id": "ENG-PAT-0035", "pattern_name": "Simulation-real transfer gap", "reviewer_concern": "The conclusion may be stronger than the demonstrated engineering evidence.", "revision_direction": "Report sim-to-real assumptions, real-world trials and domain randomization or adaptation details.", "severity_default": "major", "support_unit_hashes": "3b15aefa8e6f;e85f14651970;b5fdd879ab8c", "verbatim_source_text_included": "false"}, "title": "Simulation-real transfer gap", "triggers": []}
{"concern": "The conclusion may be stronger than the demonstrated engineering evidence.", "domain": "nature-engineering", "evidence_risk": "Efficacy endpoints are stronger than toxicity, immune, off-target or durability endpoints.", "gate": "biomedical_and_bioengineering_translation", "pattern_id": "ENG-PAT-0036", "revision_direction": "Add safety endpoints matched to the proposed biomedical application.", "severity": "major", "source_fields": {"claim_type": "Biomedical and bioengineering translation", "corpus_support_unit_count": "6", "evidence_risk": "Efficacy endpoints are stronger than toxicity, immune, off-target or durability endpoints.", "gate": "biomedical_and_bioengineering_translation", "gate_title": "Biomedical and bioengineering translation", "pattern_id": "ENG-PAT-0036", "pattern_name": "Safety endpoint incompleteness", "reviewer_concern": "The conclusion may be stronger than the demonstrated engineering evidence.", "revision_direction": "Add safety endpoints matched to the proposed biomedical application.", "severity_default": "major", "support_unit_hashes": "c7d19aac0ac3;88a1331623bd;934adad17866;fab50d1723af;6e25b47e5841", "verbatim_source_text_included": "false"}, "title": "Safety endpoint incompleteness", "triggers": []}
{"concern": "The conclusion may be stronger than the demonstrated engineering evidence.", "domain": "nature-engineering", "evidence_risk": "Autonomous discovery claims depend on a manually restricted search space.", "gate": "automation_ai_and_closed_loop_systems", "pattern_id": "ENG-PAT-0037", "revision_direction": "Make the search-space design explicit and compare adaptive against non-adaptive search.", "severity": "major", "source_fields": {"claim_type": "Automation, AI and closed-loop systems", "corpus_support_unit_count": "4", "evidence_risk": "Autonomous discovery claims depend on a manually restricted search space.", "gate": "automation_ai_and_closed_loop_systems", "gate_title": "Automation, AI and closed-loop systems", "pattern_id": "ENG-PAT-0037", "pattern_name": "Search-space dependence", "reviewer_concern": "The conclusion may be stronger than the demonstrated engineering evidence.", "revision_direction": "Make the search-space design explicit and compare adaptive against non-adaptive search.", "severity_default": "major", "support_unit_hashes": "93b4a5578c26;e059dbac0026;20d077dd8196;628c2ac451d0", "verbatim_source_text_included": "false"}, "title": "Search-space dependence", "triggers": []}
finishing-a-development-branchobra/superpowersUse when implementation is complete, all tests pass, and you need to decide how to integrate the workStars: 323kUpdated Claude CodeCodexVerifiedInstall
systematic-debuggingobra/superpowersUse when encountering any bug, test failure, or unexpected behavior, before proposing fixesStars: 323kUpdated Claude CodeCodexVerifiedInstall
test-driven-developmentobra/superpowersUse when implementing any feature or bugfix, before writing implementation codeStars: 323kUpdated Claude CodeCodexVerifiedInstall
skill-creatoranthropics/skillsCreate new skills, modify and improve existing skills, and measure skill performance. Use when users want to create a skill from scratch, edit, or optimize an existing skill, run evals to test a skill, benchmark skill performance with variance analysis, or optimize a skill's description for better triggering accuracy.Stars: 198kUpdated Claude CodeCodexVerifiedInstall