Skip to content

SSZcreate/Pentab_server / .agents/skills/cybersecurity/skills/implementing-log-forwarding-with-fluentd

implementing-log-forwarding-with-fluentd

Verified

Configures Fluent Bit as an endpoint log forwarder and Fluentd as the central aggregator for centralized log collection, routing, filtering, and enrichment, covering input plugins for syslog/file-tailing/application logs and output routing to Elasticsearch, S3, and Splunk. Use when setting up centralized log aggregation across distributed infrastructure or generating Fluent Bit/Fluentd configuration files for a new log pipeline.

Implementing Log Forwarding with Fluentd

Overview

This skill covers configuring Fluentd and Fluent Bit for centralized log collection, routing, and enrichment. Fluent Bit acts as a lightweight log forwarder on endpoints, while Fluentd serves as the central aggregator and processor. The configuration covers input plugins for syslog, file tailing, and application logs, with output routing to Elasticsearch, S3, and Splunk.

When to Use

  • When deploying or configuring implementing log forwarding with fluentd capabilities in your environment
  • When establishing security controls aligned to compliance requirements
  • When building or improving security architecture for this domain
  • When conducting security assessments that require this implementation

Prerequisites

  • Fluentd (td-agent) v1.16+ or Fluent Bit v3.0+
  • Python 3.8+ with fluent-logger library
  • Elasticsearch or Splunk for log destination
  • Network access on port 24224 (Fluentd forward protocol)
  • Ruby 2.7+ (for Fluentd plugin development)

Steps

  1. Generate Fluent Bit Configuration — Create input, filter, and output configuration for endpoint log collection
  2. Generate Fluentd Aggregator Configuration — Configure the central Fluentd instance with forward input, parsing, and multi-output routing
  3. Configure Log Filtering and Enrichment — Add record_transformer and grep filters for log enrichment and noise reduction
  4. Validate Configuration Syntax — Parse and validate Fluentd/Fluent Bit configuration files for syntax errors
  5. Test Log Forwarding — Send test events via fluent-logger Python library and verify delivery
  6. Generate Deployment Report — Produce configuration summary with routing topology and health metrics

Expected Output

  • Fluent Bit and Fluentd configuration files (INI/YAML format)
  • Configuration validation report
  • Log routing topology diagram (text-based)
  • Test event delivery confirmation
writing-skillsobra/superpowersUse when creating new skills, editing existing skills, or verifying skills work before deploymentStars: 318kUpdated Claude CodeCodexVerifiedInstall
xlsxanthropics/skillsUse this skill any time a spreadsheet file is the primary input or output. This means any task where the user wants to: open, read, edit, or fix an existing .xlsx, .xlsm, .xltx, .csv, or .tsv file (e.g., adding columns, computing formulas, formatting, charting, cleaning messy data); create a new spreadsheet from scratch or from other data sources; or convert between tabular file formats. Trigger especially when the user references a spreadsheet file by name or path — even casually (like "the xlsx in my downloads") — and wants something done to it or produced from it. Also trigger for cleaning or restructuring messy tabular data files (malformed rows, misplaced headers, junk data) into proper spreadsheets. The deliverable must be a spreadsheet file. Do NOT trigger when the primary deliverable is a Word document, HTML report, standalone Python script, database pipeline, or Google Sheets API integration, even if tabular data is involved.Stars: 196kUpdated Claude CodeCodexVerifiedInstall
shipping-and-launchaddyosmani/agent-skillsPrepares production launches. Use when preparing to deploy to production, or when asking what needs to be in place before shipping. Use when you need a pre-launch checklist, when setting up monitoring, when planning a staged rollout, or when you need a rollback strategy.Stars: 118kUpdated Claude CodeCodexVerifiedInstall
childhoodthedotmack/claude-memBabysit a shipped release after merge, publication, or deployment. Verify published packages, production behavior, installed plugins, and late CI or user reports until the observation window is clean; use babysit for PR readiness before release.Stars: 117kUpdated Claude CodeCodexVerifiedInstall