Skip to content

LeoYeAI/agent-master-skills / skills/agent-comm-hub

agent-comm-hub

Flagged

多智能体协同通信基础设施——基于 MCP+SSE 的实时消息、任务调度、记忆共享与进化引擎。支持 WorkBuddy、Hermes、QClaw 及任意 MCP 兼容 Agent 接入。53 个 MCP 工具、4 级权限、零外部依赖 Python SDK。触发词:agent通信、智能体通信、hub通信、多智能体、跨agent通信、任务调度、assign_task、send_message、hermes通信、workbuddy通信、agent hub、通信hub、mcp通信、记忆共享、进化引擎、策略共享、经验分享、共享记忆,共同进化

FileKindSize
.clawhub/origin.jsonconfig146 B
API_REFERENCE.mdmarkdown18.4 KB
HERMES-SETUP.mdmarkdown5.5 KB
README.mdmarkdown8.8 KB
SKILL.mdskill md16.4 KB
_meta.jsonconfig133 B
client-sdk/agent-client.d.tsscript11.6 KB
client-sdk/agent-client.jsscript28.6 KB
client-sdk/agent-client.tsscript29.8 KB
client-sdk/hermes-integration.d.tsscript785 B
client-sdk/hermes-integration.jsscript6.3 KB
client-sdk/hermes-integration.tsscript6.1 KB
client-sdk/hub_client.pyscript50.8 KB
client-sdk/workbuddy-integration.d.tsscript11 B
client-sdk/workbuddy-integration.jsscript4.3 KB
client-sdk/workbuddy-integration.tsscript4.2 KB
deploy/docker-compose.ymlconfig2.0 KB
deploy/grafana/dashboard.jsonconfig16.4 KB
deploy/grafana/provisioning/dashboards/dashboards.ymlconfig258 B
deploy/grafana/provisioning/datasources/prometheus.ymlconfig186 B
deploy/prometheus.ymlconfig408 B
docs/advanced-orchestration-guide.mdmarkdown11.8 KB
docs/evolution-engine-guide.mdmarkdown16.6 KB
docs/hermes-integration-guide.mdmarkdown22.3 KB
package-lock.jsonmanifest139.0 KB
package.jsonmanifest861 B
scripts/hub_task_runner.pyscript6.0 KB
scripts/hub_watcher.pyscript13.9 KB
scripts/install.shscript549 B
scripts/migrate_evolution_db.pyscript6.5 KB
scripts/migrate_from_agent.jsscript2.5 KB
scripts/wb_task_trigger.pyscript2.2 KB
src/db.d.tsscript3.7 KB
src/db.jsscript34.0 KB
src/db.tsscript37.4 KB
src/dedup.d.tsscript2.4 KB
src/dedup.jsscript8.5 KB
src/dedup.tsscript8.7 KB
src/errors.tsscript3.4 KB
src/evolution.d.tsscript6.6 KB
src/evolution.jsscript26.4 KB
src/evolution.tsscript31.0 KB
src/identity.d.tsscript3.4 KB
src/identity.jsscript15.9 KB
src/identity.tsscript17.1 KB
src/logger.d.tsscript1.1 KB
src/logger.jsscript2.8 KB
src/logger.tsscript3.5 KB
src/memory.d.tsscript2.1 KB
src/memory.jsscript13.0 KB
src/memory.tsscript14.3 KB
src/metrics.d.tsscript1.8 KB
src/metrics.jsscript8.4 KB
src/metrics.tsscript9.1 KB
src/orchestrator.d.tsscript6.1 KB
src/orchestrator.jsscript30.4 KB
src/orchestrator.tsscript33.4 KB
src/repo/interfaces.d.tsscript3.6 KB
src/repo/interfaces.jsscript49 B
src/repo/interfaces.tsscript4.2 KB
src/repo/sqlite-impl.d.tsscript225 B
src/repo/sqlite-impl.jsscript7.7 KB
src/repo/sqlite-impl.tsscript8.8 KB
src/repo/types.d.tsscript1021 B
src/repo/types.jsscript116 B
src/repo/types.tsscript1.6 KB
src/security.d.tsscript3.7 KB
src/security.jsscript15.0 KB
src/security.tsscript16.4 KB
src/server.d.tsscript11 B
src/server.jsscript24.7 KB
src/server.tsscript24.7 KB
src/sse.d.tsscript1.6 KB
src/sse.jsscript3.3 KB
src/sse.tsscript3.6 KB
src/stdio.d.tsscript11 B
src/stdio.jsscript1.7 KB
src/stdio.tsscript1.6 KB
src/tokenizer.d.tsscript1.3 KB
src/tokenizer.jsscript3.4 KB
src/tokenizer.tsscript3.2 KB
src/tools.d.tsscript474 B
src/tools.jsscript1.1 KB
src/tools.tsscript1.3 KB
src/tools/consumed.d.tsscript361 B
src/tools/consumed.jsscript5.5 KB
src/tools/consumed.tsscript5.3 KB
src/tools/evolution.d.tsscript660 B
src/tools/evolution.jsscript19.3 KB
src/tools/evolution.tsscript17.6 KB
src/tools/file.d.tsscript348 B
src/tools/file.jsscript7.1 KB
src/tools/file.tsscript6.5 KB
src/tools/identity.d.tsscript438 B
src/tools/identity.jsscript9.8 KB
src/tools/identity.tsscript9.3 KB
src/tools/memory.d.tsscript410 B
src/tools/memory.jsscript11.9 KB
src/tools/memory.tsscript10.8 KB
src/tools/message.d.tsscript467 B
src/tools/message.jsscript17.2 KB
src/tools/message.tsscript15.8 KB
src/tools/orchestrator.d.tsscript746 B
src/tools/orchestrator.jsscript27.8 KB
src/tools/orchestrator.tsscript24.3 KB
src/tools/security.d.tsscript386 B
src/tools/security.jsscript9.0 KB
src/tools/security.tsscript7.8 KB
src/types.tsscript5.9 KB
src/utils.d.tsscript421 B
src/utils.jsscript1.3 KB
src/utils.tsscript3.0 KB
tsconfig.jsonconfig337 B
vitest.config.tsscript1.2 KB

src/memory.ts

View on GitHub
/**
 * memory.ts — Memory Service (Phase 1 Week 2)
 *
 * 功能:
 *   - storeMemory: 存储记忆(private/group/collective 三种 scope)
 *   - recallMemory: 通过 FTS5 全文搜索召回记忆
 *   - listMemories: 列出 Agent 的记忆(支持 scope 筛选)
 *   - deleteMemory: 删除记忆
 *   - getMemoryStats: 获取记忆统计
 *
 * 设计要点:
 *   - FTS5 全文索引自动同步(通过 triggers)
 *   - scope 控制:private 仅本人可见,group 组内可见,collective 全局可见
 *   - 内容长度限制 10KB
 *   - 标签支持:JSON array 字符串存储
 */
import { randomUUID } from "crypto";
import { db } from "./db.js";
import { buildFtsTokens, buildSearchQuery } from "./tokenizer.js";
import { auditLog } from "./security.js";
import type { MemoryRow } from "./types.js";
import { getErrorMessage } from "./types.js";
import { logError, logger } from "./logger.js";

// ─── 常量 ────────────────────────────────────────────────
const MAX_CONTENT_LENGTH = 10000;
const MAX_TITLE_LENGTH = 500;
const MAX_RECALL_RESULTS = 20;
const MAX_LIST_RESULTS = 50;

// ─── 类型定义 ────────────────────────────────────────────
export interface MemoryEntry {
  id: string;
  agent_id: string;
  title: string | null;
  content: string;
  scope: "private" | "group" | "collective";
  tags: string | null;  // JSON array
  source_agent_id: string | null;  // Phase 2 Day 4: 溯源
  source_task_id: string | null;   // Phase 2 Day 4: 溯源
  created_at: number;
  updated_at: number | null;
}

export interface MemoryStats {
  total: number;
  by_agent: Record<string, number>;
  by_scope: Record<string, number>;
  fts_entries: number;
}

// ─── 存储记忆 ────────────────────────────────────────────

/**
 * 存储新记忆
 *
 * @returns
 *   - { ok: true, memory } — 成功
 *   - { ok: false, error } — 失败
 */
export function storeMemory(
  agentId: string,
  content: string,
  options?: {
    title?: string;
    scope?: "private" | "group" | "collective";
    tags?: string[];
    source_agent_id?: string;   // Phase 2 Day 4: 溯源(collective 写入时自动设置)
    source_task_id?: string;    // Phase 2 Day 4: 溯源(关联任务)
  }
): { ok: true; memory: MemoryEntry } | { ok: false; error: string } {
  // 参数校验
  if (!content || content.trim().length === 0) {
    return { ok: false, error: "Memory content cannot be empty" };
  }

  if (content.length > MAX_CONTENT_LENGTH) {
    return {
      ok: false,
      error: `Memory content too long (${content.length} > ${MAX_CONTENT_LENGTH} chars)`,
    };
  }

  const title = options?.title?.trim() ?? null;
  if (title && title.length > MAX_TITLE_LENGTH) {
    return {
      ok: false,
      error: `Memory title too long (${title.length} > ${MAX_TITLE_LENGTH} chars)`,
    };
  }

  const scope = options?.scope ?? "private";
  if (!["private", "group", "collective"].includes(scope)) {
    return { ok: false, error: `Invalid scope: ${scope}` };
  }

  const tags = options?.tags ?? null;
  const tagsJson = tags ? JSON.stringify(tags) : null;
  const sourceAgentId = options?.source_agent_id ?? null;
  const sourceTaskId = options?.source_task_id ?? null;

  const now = Date.now();
  const id = randomUUID();

  try {
    const ftsTokens = buildFtsTokens(title, content);

    db.prepare(
      `INSERT INTO memories (id, agent_id, title, content, fts_tokens, scope, tags, source_agent_id, source_task_id, created_at, updated_at)
       VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)`
    ).run(id, agentId, title, content, ftsTokens, scope, tagsJson, sourceAgentId, sourceTaskId, now, now);

    // 同步写入 FTS5 索引
    db.prepare(
      `INSERT INTO memories_fts (title, content, tags, fts_tokens) VALUES (?, ?, ?, ?)`
    ).run(title, content, tagsJson, ftsTokens);

    const memory: MemoryEntry = {
      id,
      agent_id: agentId,
      title,
      content,
      scope,
      tags: tagsJson,
      source_agent_id: sourceAgentId,
      source_task_id: sourceTaskId,
      created_at: now,
      updated_at: now,
    };

    return { ok: true, memory };
  } catch (err: unknown) {
    return { ok: false, error: `Failed to store memory: ${getErrorMessage(err)}` };
  }
}

// ─── 召回记忆(FTS5 全文搜索) ──────────────────────────

/**
 * 通过全文搜索召回记忆
 *
 * 搜索范围:
 *   - private: 仅本人的记忆
 *   - group: scope=group 或 scope=collective 的记忆
 *   - collective: scope=collective 的记忆
 *
 * @param query 搜索关键词(FTS5 query syntax)
 * @param agentId 查询者 ID(用于 scope 过滤)
 * @param options 可选参数
 * @returns 匹配的记忆列表
 */
export function recallMemory(
  query: string,
  agentId: string,
  options?: {
    limit?: number;
    scope?: "private" | "group" | "collective" | "all";
  }
): MemoryEntry[] {
  if (!query || query.trim().length === 0) {
    return [];
  }

  const limit = Math.min(options?.limit ?? MAX_RECALL_RESULTS, MAX_RECALL_RESULTS);
  const scope = options?.scope ?? "all";

  // 构建 FTS5 查询(N-gram 中文分词)
  const safeQuery = buildSearchQuery(query);

  if (!safeQuery) {
    return [];
  }

  try {
    let sql: string;
    let params: (string | number)[];

    if (scope === "all") {
      // 搜索所有可见的记忆(private 仅限本人 + group + collective)
      // Phase 2 Day 4: 按 agent trust_score 加权排序(高信任排名靠前)
      sql = `
        SELECT m.*, COALESCE(a.trust_score, 50) AS source_trust_score
        FROM memories m
        JOIN memories_fts fts ON m.title = fts.title AND m.content = fts.content
        LEFT JOIN agents a ON m.agent_id = a.agent_id
        WHERE memories_fts MATCH ?
        AND (m.agent_id = ? OR m.scope IN ('group', 'collective'))
        ORDER BY source_trust_score DESC, rank
        LIMIT ?
      `;
      params = [safeQuery, agentId, limit];
    } else if (scope === "private") {
      sql = `
        SELECT m.*, COALESCE(a.trust_score, 50) AS source_trust_score
        FROM memories m
        JOIN memories_fts fts ON m.title = fts.title AND m.content = fts.content
        LEFT JOIN agents a ON m.agent_id = a.agent_id
        WHERE memories_fts MATCH ?
        AND m.agent_id = ? AND m.scope = 'private'
        ORDER BY source_trust_score DESC, rank
        LIMIT ?
      `;
      params = [safeQuery, agentId, limit];
    } else if (scope === "group") {
      sql = `
        SELECT m.*, COALESCE(a.trust_score, 50) AS source_trust_score
        FROM memories m
        JOIN memories_fts fts ON m.title = fts.title AND m.content = fts.content
        LEFT JOIN agents a ON m.agent_id = a.agent_id
        WHERE memories_fts MATCH ?
        AND (m.agent_id = ? OR m.scope IN ('group', 'collective'))
        AND m.scope != 'private'
        ORDER BY source_trust_score DESC, rank
        LIMIT ?
      `;
      params = [safeQuery, agentId, limit];
    } else {
      // collective
      sql = `
        SELECT m.*, COALESCE(a.trust_score, 50) AS source_trust_score
        FROM memories m
        JOIN memories_fts fts ON m.title = fts.title AND m.content = fts.content
        LEFT JOIN agents a ON m.agent_id = a.agent_id
        WHERE memories_fts MATCH ?
        AND m.scope = 'collective'
        ORDER BY source_trust_score DESC, rank
        LIMIT ?
      `;
      params = [safeQuery, limit];
    }

    return db.prepare(sql).all(...params) as MemoryEntry[];
  } catch (err: unknown) {
    logError("memory_recallMemory_error", err);
    return [];
  }
}

// ─── 列出记忆 ────────────────────────────────────────────

/**
 * 列出 Agent 的记忆
 */
export function listMemories(
  agentId: string,
  options?: {
    scope?: "private" | "group" | "collective" | "all";
    limit?: number;
    offset?: number;
  }
): MemoryEntry[] {
  const limit = Math.min(options?.limit ?? MAX_LIST_RESULTS, MAX_LIST_RESULTS);
  const offset = options?.offset ?? 0;
  const scope = options?.scope ?? "all";

  try {
    let sql: string;
    let params: (string | number)[];

    if (scope === "all") {
      sql = `
        SELECT m.*, COALESCE(a.trust_score, 50) AS source_trust_score
        FROM memories m
        LEFT JOIN agents a ON m.agent_id = a.agent_id
        WHERE m.agent_id = ? OR m.scope IN ('group', 'collective')
        ORDER BY source_trust_score DESC, m.created_at DESC
        LIMIT ? OFFSET ?
      `;
      params = [agentId, limit, offset];
    } else if (scope === "private") {
      sql = `
        SELECT m.*, COALESCE(a.trust_score, 50) AS source_trust_score
        FROM memories m
        LEFT JOIN agents a ON m.agent_id = a.agent_id
        WHERE m.agent_id = ? AND m.scope = 'private'
        ORDER BY m.created_at DESC
        LIMIT ? OFFSET ?
      `;
      params = [agentId, limit, offset];
    } else {
      sql = `
        SELECT m.*, COALESCE(a.trust_score, 50) AS source_trust_score
        FROM memories m
        LEFT JOIN agents a ON m.agent_id = a.agent_id
        WHERE (m.agent_id = ? OR m.scope IN ('group', 'collective'))
        AND m.scope = ?
        ORDER BY source_trust_score DESC, m.created_at DESC
        LIMIT ? OFFSET ?
      `;
      params = [agentId, scope, limit, offset];
    }

    return db.prepare(sql).all(...params) as MemoryEntry[];
  } catch (err: unknown) {
    logError("memory_listMemories_error", err);
    return [];
  }
}

// ─── 删除记忆 ────────────────────────────────────────────

/**
 * 删除记忆
 * 仅允许删除自己的记忆,或 admin 删除任何记忆
 */
export function deleteMemory(
  memoryId: string,
  agentId: string,
  role: string
): { ok: true; deleted: boolean } | { ok: false; error: string } {
  try {
    // 查找记忆
    const memory = db.prepare(`SELECT * FROM memories WHERE id = ?`).get(memoryId) as MemoryEntry | undefined;
    if (!memory) {
      return { ok: false, error: `Memory ${memoryId} not found` };
    }

    // 权限检查:只能删除自己的记忆(admin 可以删除任何)
    if (memory.agent_id !== agentId && role !== "admin") {
      return { ok: false, error: "Permission denied: can only delete own memories" };
    }

    // 删除 FTS 索引(通过 title + content 匹配)
    try {
      db.prepare(
        `DELETE FROM memories_fts WHERE title = ? AND content = ?`
      ).run(memory.title, memory.content);

      // Phase 5a Day 2: 审计 FTS 索引删除
      auditLog("delete_memory_fts", agentId, memoryId, `title=${memory.title?.slice(0, 50) ?? "null"}`);
    } catch {
      // FTS 删除失败不影响主表删除
    }

    db.prepare(`DELETE FROM memories WHERE id = ?`).run(memoryId);

    // Phase 5a Day 2: 审计记忆主表删除
    auditLog("delete_memory_db", agentId, memoryId, `scope=${memory.scope}, agent=${memory.agent_id}`);

    return { ok: true, deleted: true };
  } catch (err: unknown) {
    return { ok: false, error: `Failed to delete memory: ${getErrorMessage(err)}` };
  }
}

// ─── 记忆统计 ────────────────────────────────────────────

/**
 * 获取记忆统计信息
 */
export function getMemoryStats(): MemoryStats {
  try {
    const totalRow = db.prepare(`SELECT COUNT(*) as cnt FROM memories`).get() as any;
    let ftsEntries = 0;
    try {
      const ftsRow = db.prepare(`SELECT COUNT(*) as cnt FROM memories_fts`).get() as any;
      ftsEntries = ftsRow?.cnt ?? 0;
    } catch {
      // FTS 表可能不存在
    }

    const byAgentRows = db.prepare(
      `SELECT agent_id, COUNT(*) as cnt FROM memories GROUP BY agent_id`
    ).all() as { agent_id: string; cnt: number }[];

    const byScopeRows = db.prepare(
      `SELECT scope, COUNT(*) as cnt FROM memories GROUP BY scope`
    ).all() as { scope: string; cnt: number }[];

    const byAgent: Record<string, number> = {};
    for (const row of byAgentRows) {
      byAgent[row.agent_id] = row.cnt;
    }

    const byScope: Record<string, number> = {};
    for (const row of byScopeRows) {
      byScope[row.scope] = row.cnt;
    }

    return {
      total: totalRow?.cnt ?? 0,
      by_agent: byAgent,
      by_scope: byScope,
      fts_entries: ftsEntries,
    };
  } catch (err: unknown) {
    logError("memory_getMemoryStats_error", err);
    return { total: 0, by_agent: {}, by_scope: {}, fts_entries: 0 };
  }
}

// ─── FTS 索引重建 ────────────────────────────────────────

/**
 * 为所有已有 memories 重建 FTS 索引(Phase 2 Migration)
 * 在 server.ts 启动时调用一次
 */
export function rebuildFtsIndex(): void {
  try {
    const memCount = (db.prepare(`SELECT COUNT(*) as cnt FROM memories`).get() as any)?.cnt ?? 0;
    let ftsCount = 0;
    try {
      ftsCount = (db.prepare(`SELECT COUNT(*) as cnt FROM memories_fts`).get() as any)?.cnt ?? 0;
    } catch {
      // FTS 表不存在,跳过
      return;
    }

    if (memCount === 0 || ftsCount >= memCount) {
      return; // 不需要重建
    }

    logger.info("memory_fts_rebuild_start", { module: "memory", mem_count: memCount, fts_count: ftsCount });

    const memories = db.prepare(
      `SELECT id, title, content, tags, source_agent_id, source_task_id FROM memories`
    ).all() as Pick<MemoryRow, "id" | "title" | "content" | "tags" | "source_agent_id" | "source_task_id">[];

    const insertFts = db.prepare(
      `INSERT INTO memories_fts (title, content, tags, fts_tokens) VALUES (?, ?, ?, ?)`
    );

    const rebuildBatch = db.transaction((mems: Pick<MemoryRow, "id" | "title" | "content" | "tags" | "source_agent_id" | "source_task_id">[]) => {
      for (const m of mems) {
        const tokens = buildFtsTokens(m.title ?? null, m.content);
        insertFts.run(m.title, m.content, m.tags ?? null, tokens);
      }
    });

    rebuildBatch(memories);
    logger.info("memory_fts_rebuild_done", { module: "memory", entries: memories.length });
  } catch (err: unknown) {
    logError("memory_rebuildFtsIndex_error", err);
  }
}
reverse-engineer-anythingmorluto/reaReverse engineer native, managed, Electron/JavaScript, packaged, firmware, and browser targets with REA, and build agent environments (AgentEnv bundles) of web applications from a live instance or a capture, and of Linux desktop apps with a task from a request. Use shipped-artifact or requested runtime evidence to explain features, compare versions, decompile code, or guide a reconstruction. Skip REA for ordinary source-repository architecture analysis.Stars: 472kUpdated Claude CodeCodexVerifiedInstall
diagnosing-superpowersobra/superpowersUse when a superpowers session went wrong and your human partner wants to know why — repeated work, ignored plans, stumbles, poor results, a skill that didn't fire, "it took too long", "why is it so expensive", "what is it doing" — or wants to build a bug report for the superpowers maintainers, for the current session or a past one identified by id or path, on any harness.Stars: 322kUpdated Claude CodeCodexVerifiedInstall
dispatching-parallel-agentsobra/superpowersUse when facing 2+ independent tasks that can be worked on without shared state or sequential dependenciesStars: 322kUpdated Claude CodeCodexVerifiedInstall
executing-plansobra/superpowersUse when executing an implementation plan in the current session as the implementer yourself — your human partner chose inline execution, or no subagent tool is availableStars: 322kUpdated Claude CodeCodexVerifiedInstall