OpenRaiser/NanoResearch / skills/vendor-ai-research/ml-paper-writing
ml-paper-writing
VerifiedWrite publication-ready ML/AI/Systems papers for NeurIPS, ICML, ICLR, ACL, AAAI, COLM, OSDI, NSDI, ASPLOS, SOSP. Use when drafting papers from research repos, structuring arguments, verifying citations, or preparing camera-ready submissions. Includes LaTeX templates, reviewer guidelines, and citation verification workflows.
references/checklists.md
View on GitHub# Conference Paper Checklists
This reference documents the mandatory checklist requirements for major ML/AI and Systems conferences. All major venues now require paper checklists—missing them results in desk rejection.
ML/AI
## Contents
- [NeurIPS Paper Checklist](#neurips-paper-checklist)
- [ICML Paper Checklist](#icml-paper-checklist)
- [ICLR Requirements](#iclr-requirements)
- [ACL Requirements](#acl-requirements)
- [OSDI 2026 Requirements](#osdi-2026-requirements)
- [NSDI 2027 Requirements](#nsdi-2027-requirements)
- [ASPLOS 2027 Requirements](#asplos-2027-requirements)
- [SOSP 2026 Requirements](#sosp-2026-requirements)
- [Universal Pre-Submission Checklist](#universal-pre-submission-checklist)
## NeurIPS Paper Checklist
### Mandatory Components
All NeurIPS submissions must include a completed paper checklist. Papers lacking this element face **automatic desk rejection**. The checklist appears after references and supplemental material, outside the page limit.
### 16 Required Checklist Items
#### 1. Claims Alignment
Authors must verify that abstract and introduction claims match theoretical and experimental results, with clearly stated contributions, assumptions, and limitations.
**What to check:**
- [ ] Abstract claims match actual results
- [ ] Introduction doesn't overclaim
- [ ] Contributions are specific and falsifiable
#### 2. Limitations Discussion
Papers should include a dedicated "Limitations" section addressing strong assumptions, robustness to violations, scope constraints, and performance-influencing factors.
**What to include:**
- [ ] Dedicated Limitations section
- [ ] Honest assessment of scope
- [ ] Conditions where method may fail
#### 3. Theory & Proofs
Theoretical contributions require full assumption statements and complete proofs (main paper or appendix with proof sketches for intuition).
**What to check:**
- [ ] All assumptions stated formally
- [ ] Complete proofs provided (main text or appendix)
- [ ] Proof sketches for intuition in main text
#### 4. Reproducibility
Authors must describe steps ensuring results verification through code release, detailed instructions, model access, or checkpoints appropriate to their contribution type.
**What to provide:**
- [ ] Clear reproducibility statement
- [ ] Code availability information
- [ ] Model checkpoints if applicable
#### 5. Data & Code Access
Instructions for reproducing main experimental results should be provided (supplemental material or URLs), including exact commands and environment specifications.
**What to include:**
- [ ] Exact commands to run experiments
- [ ] Environment specifications (requirements.txt, conda env)
- [ ] Data access instructions
#### 6. Experimental Details
Papers must specify training details: data splits, hyperparameters, and selection methods in the main paper or supplementary materials.
**What to document:**
- [ ] Train/val/test split details
- [ ] All hyperparameters used
- [ ] Hyperparameter selection method
#### 7. Statistical Significance
Results require error bars, confidence intervals, or statistical tests with clearly stated calculation methods and underlying assumptions.
**What to include:**
- [ ] Error bars or confidence intervals
- [ ] Number of runs/seeds
- [ ] Calculation method (std dev vs std error)
#### 8. Compute Resources
Specifications needed: compute worker types (CPU/GPU), memory, storage, execution time per run, and total project compute requirements.
**What to document:**
- [ ] GPU type and count
- [ ] Training time per run
- [ ] Total compute used
#### 9. Ethics Code Compliance
Authors confirm adherence to the NeurIPS Code of Ethics, noting any necessary deviations.
**What to verify:**
- [ ] Read NeurIPS Code of Ethics
- [ ] Confirm compliance
- [ ] Note any deviations with justification
#### 10. Broader Impacts
Discussion of potential negative societal applications, fairness concerns, privacy risks, and possible mitigation strategies when applicable.
**What to address:**
- [ ] Potential negative applications
- [ ] Fairness considerations
- [ ] Privacy implications
- [ ] Mitigation strategies
#### 11. Safeguards
High-risk models (language models, internet-scraped datasets) require controlled release mechanisms and usage guidelines.
**What to consider:**
- [ ] Release strategy for sensitive models
- [ ] Usage guidelines if needed
- [ ] Access controls if appropriate
#### 12. License Respect
All existing assets require creator citations, license names, URLs, version numbers, and terms-of-service acknowledgment.
**What to document:**
- [ ] Dataset licenses cited
- [ ] Code licenses respected
- [ ] Version numbers included
#### 13. Asset Documentation
New releases need structured templates documenting training details, limitations, consent procedures, and licensing information.
**For new datasets/models:**
- [ ] Datasheet or model card
- [ ] Training data documentation
- [ ] Known limitations
#### 14. Human Subjects
Crowdsourcing studies must include participant instructions, screenshots, compensation details, and comply with minimum wage requirements.
**What to include:**
- [ ] Task instructions
- [ ] Compensation details
- [ ] Time estimates
#### 15. IRB Approvals
Human subjects research requires documented institutional review board approval or equivalent, with risk descriptions disclosed (maintaining anonymity at submission).
**What to verify:**
- [ ] IRB approval obtained
- [ ] Risk assessment completed
- [ ] Anonymized at submission
#### 16. LLM Declaration
Usage of large language models as core methodology components requires disclosure; writing/editing use doesn't require declaration.
**What to disclose:**
- [ ] LLM used as core methodology component
- [ ] How LLM was used
- [ ] (Writing assistance doesn't require disclosure)
### Response Format
Authors select "yes," "no," or "N/A" per question, with optional 1-2 sentence justifications.
**Important:** Reviewers are explicitly instructed not to penalize honest limitation acknowledgment.
## ICML Paper Checklist
### Broader Impact Statement
ICML requires a Broader Impact Statement at the end of the paper, before references. This does NOT count toward the page limit.
**Required elements:**
- Potential positive impacts
- Potential negative impacts
- Mitigation strategies
- Who may be affected
### ICML Specific Requirements
#### Reproducibility Checklist
- [ ] Data splits clearly specified
- [ ] Hyperparameters listed
- [ ] Search ranges documented
- [ ] Selection method explained
- [ ] Compute resources specified
- [ ] Code availability stated
#### Statistical Reporting
- [ ] Error bars on all figures
- [ ] Standard deviation vs standard error specified
- [ ] Number of runs stated
- [ ] Significance tests if comparing methods
#### Anonymization
- [ ] No author names in paper
- [ ] No acknowledgments
- [ ] No grant numbers
- [ ] Prior work cited in third person
- [ ] No identifiable repository URLs
## ICLR Requirements
### LLM Disclosure Policy (New for 2026)
ICLR has a specific LLM disclosure requirement:
> "If LLMs played a significant role in research ideation and/or writing to the extent that they could be regarded as a contributor, authors must describe their precise role in a separate appendix section."
**When disclosure is required:**
- LLM used for significant research ideation
- LLM used for substantial writing
- LLM could be considered a contributor
**When disclosure is NOT required:**
- Grammar checking
- Minor editing assistance
- Code completion tools
**Consequences of non-disclosure:**
- Desk rejection
- Potential post-publication issues
### ICLR Specific Requirements
#### Reproducibility Statement (Optional but Recommended)
Add a statement referencing:
- Supporting materials
- Code availability
- Data availability
- Model checkpoints
#### Ethics Statement (Optional)
Address potential concerns in ≤1 page. Does not count toward page limit.
#### Reciprocal Reviewing
- Authors on 3+ papers must serve as reviewers for ≥6 papers
- Each submission needs ≥1 author registered to review ≥3 papers
## ACL Requirements
### Limitations Section (Mandatory)
ACL specifically requires a Limitations section:
**What to include:**
- Strong assumptions made
- Scope limitations
- When method may fail
- Generalization concerns
**Important:** The Limitations section does NOT count toward the page limit.
### ACL Specific Checklist
#### Responsible NLP
- [ ] Bias considerations addressed
- [ ] Fairness evaluated if applicable
- [ ] Dual-use concerns discussed
#### Multilingual Considerations
If applicable:
- [ ] Language diversity addressed
- [ ] Non-English languages included
- [ ] Translation quality verified
#### Human Evaluation
If applicable:
- [ ] Annotator details provided
- [ ] Agreement metrics reported
- [ ] Compensation documented
## OSDI 2026 Requirements / OSDI 2026
OSDI focuses on innovative research and quantified/insightful experiences in systems design and implementation.
OSDI
### Submission Tracks
- **Research Track**: Comparable to previous OSDIs, for novel systems research
- **Operational Systems Track** (New in 2026): For design, implementation, analysis, and experience of operational systems
### OSDI Pre-Submission Checklist / OSDI
#### Formatting
- [ ] ≤12 pages (excluding references)
- [ ] 8.5" x 11" pages, 10pt on 12pt leading, two-column, Times Roman
- [ ] 7" wide x 9" deep text block
- [ ] Pages are numbered
- [ ] Figures and tables legible in black and white
- [ ] Paper is the right length (not padded; <6pp unlikely to receive full consideration)
#### Content
- [ ] Motivates a significant problem
- [ ] Proposes interesting and compelling solution
- [ ] Demonstrates practicality and benefits
- [ ] Draws appropriate conclusions
- [ ] Clearly describes contributions
- [ ] Clearly articulates advances beyond previous work
#### Anonymization
- [ ] Double-blind: no author names, affiliations
- [ ] Anonymized project/system name (different from arXiv/talks)
- [ ] No NDA forms attached
- [ ] **Operational Systems track exception**: May use real company/system names for context
#### Track-Specific
- [ ] Track indicated on title page and submission form
- [ ] Operational Systems papers: title ends with "(Operational Systems)"
- [ ] Max 8 submissions per author
#### AI Policy / AI
- [ ] Work NOT wholly or largely generated by AI (AI editing tools are acceptable)
## NSDI 2027 Requirements / NSDI 2027
NSDI focuses on design principles, implementation, and practical evaluation of networked and distributed systems.
NSDI
### Submission Tracks
- **Traditional Research Track**: Novel ideas with thorough evaluations
- **Frontiers Track** (New): Bold ideas without necessarily complete evaluation
- **Operational Systems Track**: Deployed systems with lessons learned
### Prescreening Phase
Reviewers read only the Introduction to check:
Introduction
- [ ] Subject falls within NSDI scope
- [ ] Exposition understandable by NSDI PC member / NSDI PC
- [ ] Track-specific criteria articulated in Introduction / Introduction
- Research: novel idea + evaluation evidence
- Frontiers: novel non-incremental idea
- Operational: deployment setting, scale, lessons learned
### NSDI Pre-Submission Checklist / NSDI
#### Formatting
- [ ] ≤12 pages (excluding references), USENIX format
- [ ] Two-column, 10pt, Times Roman
- [ ] Double-blind anonymized
#### Content Scope
- [ ] Contributions to networked systems design
- [ ] NOT out-of-scope topics (hardware architecture, physical layer, sensing, UI)
- [ ] Track indicated on title page and submission form
#### Resubmission Rules
- [ ] Not rejected from previous NSDI deadline without one-shot revision option
- [ ] One-shot revision includes: highlighted changes + explanation of major changes
## ASPLOS 2027 Requirements / ASPLOS 2027
ASPLOS focuses on the intersection of computer architecture, programming languages, and operating systems.
ASPLOS
### Rapid Review Round
**This is unique to ASPLOS and critically important. ASPLOS **
- Reviewers only read the **first 2 pages**
- Evaluates how work advances Architecture/PL/OS research
- Majority of submissions may not advance past this stage
- Papers lacking suitable reviewers returned early
### ASPLOS Pre-Submission Checklist / ASPLOS
#### First 2 Pages (CRITICAL for Rapid Review)
- [ ] Self-contained: clearly states problem, approach, and contribution
- [ ] Advances Architecture, PL, and/or OS research
- [ ] Not just advances in another domain using arch/PL/OS
#### Formatting
- [ ] ACM SIGPLAN format (`\documentclass[sigplan,10pt]{acmart}`)
- [ ] ≤12 pages (excluding references)
- [ ] Double-blind anonymized
- [ ] No identifying info in submitted documents
#### Submission Rules
- [ ] Max 4 submissions per author per cycle
- [ ] Resubmission note describing changes (if applicable)
- [ ] Not resubmitted from immediate previous ASPLOS cycle
- [ ] Accurate topic selection for reviewer assignment
## SOSP 2026 Requirements / SOSP 2026
SOSP seeks innovative research related to design, implementation, analysis, evaluation, and deployment of computer systems software.
SOSP
### SOSP Pre-Submission Checklist / SOSP
#### Formatting
- [ ] ACM SIGPLAN format (`\documentclass[sigplan,10pt]{acmart}`)
- [ ] ≤12 pages technical content (excluding references)
- [ ] A4 or US letter, 178×229mm (7×9") text block
- [ ] Two-column, 8mm separation, 10pt on 12pt leading
- [ ] Pages numbered, references hyperlinked
- [ ] Figures/tables readable without magnification, encouraged in color but grayscale-readable
#### Content
- [ ] Motivates a significant problem
- [ ] Proposes and implements compelling solution
- [ ] Demonstrates practicality and benefits
- [ ] Clearly describes contributions and advances
#### Anonymization
- [ ] Double-blind: paper ID instead of author names
- [ ] Anonymized system/project name
- [ ] Own work cited in third person
- [ ] No acknowledgments or grant numbers
#### Artifact Evaluation (Optional) / Artifact
- [ ] Plan for artifact submission after acceptance
- [ ] Reproducibility materials prepared
#### Author Response
- [ ] Response limited to: correcting factual errors + addressing reviewer questions
- [ ] No new experiments or additional work in response
- [ ] Recommended: keep under 500 words
## Systems Conferences Common Requirements
### What All Systems Venues Look For
- [ ] **System design and implementation** - not just algorithms
- [ ] **Real workloads and evaluation** - microbenchmarks are insufficient
- [ ] **Practical benefits demonstrated** - latency, throughput, cost, energy
- [ ] **Comparison with state-of-the-art systems**
- [ ] **No simultaneous submission to other venues**
- [ ] **Prior arXiv/tech reports permitted**
### Before Every Submission
#### Paper Content
- [ ] Abstract ≤ word limit (usually 250-300 words)
- [ ] Main content within page limit
- [ ] References complete and verified
- [ ] Limitations section included
- [ ] All figures/tables have captions
- [ ] Captions are self-contained
#### Formatting
- [ ] Correct template used (venue + year specific)
- [ ] Margins not modified
- [ ] Font sizes not modified
- [ ] Double-blind requirements met
- [ ] Page numbers (for review) or none (camera-ready)
#### Technical
- [ ] All claims supported by evidence
- [ ] Error bars included
- [ ] Baselines appropriate
- [ ] Hyperparameters documented
- [ ] Compute resources stated
#### Reproducibility
- [ ] Code will be available (or justification)
- [ ] Data will be available (or justification)
- [ ] Environment documented
- [ ] Commands to reproduce provided
#### Ethics
- [ ] Broader impacts considered
- [ ] Limitations honestly stated
- [ ] Licenses respected
- [ ] IRB obtained if needed
#### Final Checks
- [ ] PDF compiles without errors
- [ ] All figures render correctly
- [ ] All citations resolve
- [ ] Supplementary material organized
- [ ] Conference checklist completed
## Quick Reference: Page Limits
### ML/AI Conferences / ML/AI
| Conference | Main Content | References | Appendix |
|------------|-------------|------------|----------|
| NeurIPS 2025 | 9 pages | Unlimited | Unlimited (checklist separate) |
| ICML 2026 | 8 pages (+1 camera) | Unlimited | Unlimited |
| ICLR 2026 | 9 pages (+1 camera) | Unlimited | Unlimited |
| ACL 2025 | 8 pages (long) | Unlimited | Unlimited |
| AAAI 2026 | 7 pages (+1 camera) | Unlimited | Unlimited |
| COLM 2025 | 9 pages (+1 camera) | Unlimited | Unlimited |
### Systems Conferences
| Conference | Main Content | Camera-Ready | References | Format |
|------------|-------------|--------------|------------|--------|
| OSDI 2026 | 12 pages | 14 pages | Unlimited | USENIX |
| NSDI 2027 | 12 pages | varies | Unlimited | USENIX |
| ASPLOS 2027 | 12 pages | varies | Unlimited | ACM SIGPLAN |
| SOSP 2026 | 12 pages | varies | Unlimited | ACM SIGPLAN |
## Template Locations
All conference templates are in the `templates/` directory:
```
templates/
├── icml2026/ # ICML 2026 official
├── iclr2026/ # ICLR 2026 official
├── neurips2025/ # NeurIPS 2025
├── acl/ # ACL style files
├── aaai2026/ # AAAI 2026
├── colm2025/ # COLM 2025
├── osdi2026/ # OSDI 2026 (USENIX)
├── nsdi2027/ # NSDI 2027 (USENIX)
├── asplos2027/ # ASPLOS 2027 (ACM SIGPLAN)
└── sosp2026/ # SOSP 2026 (ACM SIGPLAN)
```
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| add-product-e2e-evalpaperclipai/paperclipAdd or extend a Paperclip full-stack runner E2E workflow, fixture, matcher, or report evidence path for local or Daytona execution. | Stars: 115k | Updated | Claude CodeCodex | Verified | Install |
| add-runner-evalpaperclipai/paperclipAdd or extend a Paperclip Runner protocol evaluation definition, roster, assertion, or report fixture with provenance and narrow validation. | Stars: 115k | Updated | Claude CodeCodex | Verified | Install |
| diagnose-why-work-stoppedpaperclipai/paperclipCompatibility entry point for failed, stalled, looping, or over-recovered Paperclip work. Use fix-failed-paperclip-run for the full diagnosis, regression, repair, real verification, and green-PR workflow; honor an explicitly requested diagnosis-only scope. | Stars: 115k | Updated | Claude CodeCodex | Verified | Install |
| fix-failed-paperclip-runpaperclipai/paperclipDiagnose and fix failed, stuck, slow, or incorrectly blocked Paperclip tasks and runs. Use with a task/run URL or failure report to trace the root cause, prove a regression red then green, check second-order effects, verify the real workflow, and deliver a PR with passing checks. | Stars: 115k | Updated | Claude CodeCodex | Verified | Install |