a5c-ai/babysitter / library/specializations/ai-agents-conversational/skills/rag-embedding-generation
rag-embedding-generation
VerifiedBatch embedding generation with caching, rate limiting, and multiple provider support
SKILL.md
View on GitHub---
name: rag-embedding-generation
description: Batch embedding generation with caching, rate limiting, and multiple provider support
allowed-tools:
- Read
- Write
- Edit
- Bash
- Glob
- Grep
graph:
domains: [domain:software-engineering]
specializations: [specialization:ai-agents-conversational]
skillAreas: [skill-area:retrieval-augmented-generation, skill-area:feature-engineering]
roles: [role:ml-engineer, role:backend-engineer]
workflows: [workflow:ml-model-lifecycle, workflow:feature-development]
---
# RAG Embedding Generation Skill
## Capabilities
- Generate embeddings with multiple providers
- Implement batch processing for large datasets
- Configure caching for embedding reuse
- Handle rate limiting and retries
- Support various embedding models
- Implement embedding quality validation
## Target Processes
- rag-pipeline-implementation
- vector-database-setup
## Implementation Details
### Embedding Providers
1. **OpenAI Embeddings**: text-embedding-ada-002, text-embedding-3-*
2. **HuggingFace**: sentence-transformers models
3. **Cohere**: embed-v3 models
4. **Voyage AI**: voyage-2 models
5. **Local Models**: GGUF/ONNX embedding models
### Configuration Options
- Model selection and parameters
- Batch size optimization
- Cache backend configuration
- Rate limit settings
- Retry policies
- Dimensionality settings
### Best Practices
- Use appropriate model for domain
- Implement caching for cost reduction
- Monitor embedding quality
- Handle API errors gracefully
### Dependencies
- langchain-openai / langchain-huggingface
- numpy
- Caching backend (Redis, SQLite)
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| slack-gif-creatoranthropics/skillsKnowledge and utilities for creating animated GIFs optimized for Slack. Provides constraints, validation tools, and animation concepts. Use when users request animated GIFs for Slack like "make me a GIF of X doing Y for Slack." | Stars: 198k | Updated | Claude CodeCodex | Verified | Install |
| ponytailDietrichGebert/ponytailLazy senior dev mode for any coding task: the smallest change that fully solves it, and a reply a busy human understands in one read. | Stars: 194k | Updated | Claude CodeCodex | Verified | Install |
| ponytail-debtDietrichGebert/ponytailHarvest every shortcut: comment into one debt ledger, so deferrals get tracked instead of forgotten. One-shot report. | Stars: 194k | Updated | Claude CodeCodex | Verified | Install |
| ponytail-debtDietrichGebert/ponytailList every `shortcut:` comment (and older `ponytail:` ones) as a debt ledger. One-shot report, changes nothing. Use for "ponytail debt", "what did ponytail defer", "list the shortcuts", /ponytail-debt. | Stars: 194k | Updated | Claude CodeCodex | Verified | Install |