Skip to content

HezaoHezao/poirot / poirot/backend/agents/skill/builtin_skills/research/arxiv

arxiv

Flagged

Search arXiv papers by keyword, author, category, or ID.

arXiv Research

Search and retrieve academic papers from arXiv via their free REST API. No API key, no dependencies — just bash with curl.

Quick Reference

ActionCommand
Search papersbash("curl -s 'https://export.arxiv.org/api/query?search_query=all:QUERY&max_results=5'")
Get specific paperbash("curl -s 'https://export.arxiv.org/api/query?id_list=2402.03300'")
Read abstractbrowse_page(url="https://arxiv.org/abs/2402.03300")
Read full paper (PDF)browse_page(url="https://arxiv.org/pdf/2402.03300")

Searching Papers

The API returns Atom XML. Parse with python3 for clean output.

Basic search

curl -s "https://export.arxiv.org/api/query?search_query=all:GRPO+reinforcement+learning&max_results=5"

Clean output (parse XML to readable format)

curl -s "https://export.arxiv.org/api/query?search_query=all:GRPO+reinforcement+learning&max_results=5&sortBy=submittedDate&sortOrder=descending" | python3 -c "
import sys, xml.etree.ElementTree as ET
ns = {'a': 'http://www.w3.org/2005/Atom'}
root = ET.fromstring(sys.stdin.read())
for entry in root.findall('a:entry', ns):
    title = entry.find('a:title', ns).text.strip().replace('\n', ' ')
    published = entry.find('a:published', ns).text[:10]
    summary = entry.find('a:summary', ns).text.strip()[:200]
    link = entry.find('a:id', ns).text
    print(f'{published} | {title}')
    print(f'  {link}')
    print(f'  {summary}...')
    print()
"

Search Query Syntax

FieldExample
All fieldsall:transformer
Titleti:attention
Authorau:vaswani
Abstractabs:reinforcement
Categorycat:cs.CL
Combine (AND)all:transformer+AND+ti:attention
Combine (OR)all:LLM+OR+all:large+language+model

Common Categories

  • cs.CL — Computation and Language (NLP)
  • cs.CV — Computer Vision
  • cs.LG — Machine Learning
  • cs.AI — Artificial Intelligence
  • stat.ML — Machine Learning (Stats)
  • physics — Physics

Workflow

  1. Search by keyword/author/category to find relevant papers
  2. Read abstracts from search results
  3. Fetch full abstract page with browse_page for promising papers
  4. Read PDF with browse_page for full content (if needed)

Pitfalls

  • Rate limiting: arXiv API asks for 3-second间隔 between requests. Don't hammer it.
  • Query too specific: "diffusion models in computer vision for medical imaging" returns 0 results. Use 2-3 core keywords + category filter.
  • sortBy=relevance is usually better than submittedDate for topical searches; use submittedDate only when user wants chronological order.
  • PDF parsing: browse_page on PDF URLs may return raw text or fail on some papers. Prefer abstract pages for reliable content.
add-product-e2e-evalpaperclipai/paperclipAdd or extend a Paperclip full-stack runner E2E workflow, fixture, matcher, or report evidence path for local or Daytona execution.Stars: 115kUpdated Claude CodeCodexVerifiedInstall
add-runner-evalpaperclipai/paperclipAdd or extend a Paperclip Runner protocol evaluation definition, roster, assertion, or report fixture with provenance and narrow validation.Stars: 115kUpdated Claude CodeCodexVerifiedInstall
diagnose-why-work-stoppedpaperclipai/paperclipCompatibility entry point for failed, stalled, looping, or over-recovered Paperclip work. Use fix-failed-paperclip-run for the full diagnosis, regression, repair, real verification, and green-PR workflow; honor an explicitly requested diagnosis-only scope.Stars: 115kUpdated Claude CodeCodexVerifiedInstall
fix-failed-paperclip-runpaperclipai/paperclipDiagnose and fix failed, stuck, slow, or incorrectly blocked Paperclip tasks and runs. Use with a task/run URL or failure report to trace the root cause, prove a regression red then green, check second-order effects, verify the real workflow, and deliver a PR with passing checks.Stars: 115kUpdated Claude CodeCodexVerifiedInstall