Skip to content

a5c-ai/babysitter / library/specializations/ai-agents-conversational/skills/haystack-pipeline

haystack-pipeline

Verified

Haystack NLP pipeline configuration for document processing and QA

Haystack Pipeline Skill

Capabilities

  • Configure Haystack pipeline components
  • Set up document stores and retrievers
  • Implement reader/generator models
  • Design custom pipeline graphs
  • Configure preprocessing pipelines
  • Implement evaluation pipelines

Target Processes

  • rag-pipeline-implementation
  • intent-classification-system

Implementation Details

Core Components

  1. DocumentStores: Elasticsearch, Weaviate, FAISS, etc.
  2. Retrievers: BM25, Dense, Hybrid
  3. Readers/Generators: Extractive and generative QA
  4. Preprocessors: Document cleaning and splitting

Pipeline Types

  • Retrieval pipelines
  • RAG pipelines
  • Evaluation pipelines
  • Indexing pipelines

Configuration Options

  • Component selection
  • Pipeline graph design
  • Document store backend
  • Model selection
  • Preprocessing settings

Best Practices

  • Modular pipeline design
  • Proper preprocessing
  • Evaluation integration
  • Component versioning

Dependencies

  • haystack-ai
  • farm-haystack (legacy)
finishing-a-development-branchobra/superpowersUse when implementation is complete, all tests pass, and you need to decide how to integrate the workStars: 319kUpdated Claude CodeCodexVerifiedInstall
systematic-debuggingobra/superpowersUse when encountering any bug, test failure, or unexpected behavior, before proposing fixesStars: 319kUpdated Claude CodeCodexVerifiedInstall
test-driven-developmentobra/superpowersUse when implementing any feature or bugfix, before writing implementation codeStars: 319kUpdated Claude CodeCodexVerifiedInstall
skill-creatoranthropics/skillsCreate new skills, modify and improve existing skills, and measure skill performance. Use when users want to create a skill from scratch, edit, or optimize an existing skill, run evals to test a skill, benchmark skill performance with variance analysis, or optimize a skill's description for better triggering accuracy.Stars: 196kUpdated Claude CodeCodexVerifiedInstall