Skip to content

JimLiu/baoyu-skills / skills/baoyu-url-to-markdown

baoyu-url-to-markdown

Verified

Fetch any URL and convert to markdown using baoyu-fetch CLI (Chrome CDP with site-specific adapters). Built-in adapters for X/Twitter, YouTube transcripts, Hacker News threads, and generic pages via Defuddle. Handles login/CAPTCHA via interaction wait modes. Use when user wants to save a webpage as markdown.

FileKindSize
SKILL.mdskill md6.1 KB
references/adapters.mdmarkdown2.5 KB
references/config/first-time-setup.mdmarkdown1.9 KB
references/quality-gate.mdmarkdown2.1 KB
scripts/baoyu-fetchexecutablescript122 B
scripts/bun.lockother34.6 KB
scripts/lib/adapters/generic/index.tsscript2.4 KB
scripts/lib/adapters/hn/index.tsscript10.2 KB
scripts/lib/adapters/index.tsscript834 B
scripts/lib/adapters/types.tsscript2.1 KB
scripts/lib/adapters/x/article.tsscript12.4 KB
scripts/lib/adapters/x/index.tsscript4.0 KB
scripts/lib/adapters/x/login.tsscript2.2 KB
scripts/lib/adapters/x/match.tsscript297 B
scripts/lib/adapters/x/payloads.tsscript1.6 KB
scripts/lib/adapters/x/session.tsscript1.4 KB
scripts/lib/adapters/x/shared.tsscript12.7 KB
scripts/lib/adapters/x/single.tsscript2.5 KB
scripts/lib/adapters/x/thread-loader.tsscript8.9 KB
scripts/lib/adapters/x/thread.tsscript9.0 KB
scripts/lib/adapters/x/types.tsscript600 B
scripts/lib/adapters/youtube/index.tsscript898 B
scripts/lib/adapters/youtube/transcript.tsscript13.0 KB
scripts/lib/adapters/youtube/utils.tsscript6.5 KB
scripts/lib/browser/cdp-client.tsscript6.7 KB
scripts/lib/browser/chrome-launcher.tsscript5.7 KB
scripts/lib/browser/cookie-sidecar.tsscript2.9 KB
scripts/lib/browser/interaction-gates.tsscript4.6 KB
scripts/lib/browser/network-journal.tsscript7.0 KB
scripts/lib/browser/page-snapshot.tsscript3.3 KB
scripts/lib/browser/profile.tsscript5.5 KB
scripts/lib/browser/session.tsscript4.5 KB
scripts/lib/cli.tsexecutablescript6.9 KB
scripts/lib/commands/convert.tsscript17.0 KB
scripts/lib/extract/document.tsscript846 B
scripts/lib/extract/html-cleaner.tsscript10.8 KB
scripts/lib/extract/html-extractor.tsscript2.2 KB
scripts/lib/extract/html-to-markdown.tsscript20.8 KB
scripts/lib/extract/markdown-renderer.tsscript4.6 KB
scripts/lib/media/default-downloader.tsscript5.1 KB
scripts/lib/media/markdown-media.tsscript13.3 KB
scripts/lib/media/media-utils.tsscript6.1 KB
scripts/lib/media/types.tsscript710 B
scripts/lib/types/defuddle-node.d.tsscript605 B
scripts/lib/types/shims.d.tsscript422 B
scripts/lib/utils/logger.tsscript645 B
scripts/lib/utils/url.tsscript300 B
scripts/package.jsonmanifest557 B

scripts/lib/adapters/x/single.ts

View on GitHub
import type { ExtractedDocument, ContentBlock } from "../../extract/document";
import { findTweetNode, formatMediaList, formatTweetAuthor, getTweetAuthorMetadata, normalizeTitle, toXTweet } from "./shared";

export function extractSingleTweetDocumentFromPayload(
  payload: unknown,
  statusId: string,
  pageUrl: string,
): ExtractedDocument | null {
  const tweet = findTweetNode(payload, statusId);
  if (!tweet) {
    return null;
  }

  const xTweet = toXTweet(tweet, pageUrl);
  const content: ContentBlock[] = [];

  if (xTweet.text) {
    content.push({ type: "paragraph", text: xTweet.text });
  }

  for (const mediaLine of formatMediaList(xTweet.media)) {
    if (mediaLine.startsWith("photo: ")) {
      content.push({
        type: "image",
        url: mediaLine.slice("photo: ".length),
      });
    } else {
      content.push({
        type: "list",
        ordered: false,
        items: [mediaLine],
      });
    }
  }

  if (xTweet.quotedTweet) {
    const quotedLines: string[] = [];
    const quotedAuthor =
      xTweet.quotedTweet.author && xTweet.quotedTweet.authorName
        ? `${xTweet.quotedTweet.authorName} (@${xTweet.quotedTweet.author})`
        : xTweet.quotedTweet.author
          ? `@${xTweet.quotedTweet.author}`
          : xTweet.quotedTweet.authorName;

    if (quotedAuthor) {
      quotedLines.push(quotedAuthor);
    }
    if (xTweet.quotedTweet.text) {
      quotedLines.push(xTweet.quotedTweet.text);
    }
    quotedLines.push(...formatMediaList(xTweet.quotedTweet.media));

    if (quotedLines.length > 0) {
      content.push({ type: "heading", depth: 2, text: "Quoted Tweet" });
      content.push({ type: "quote", text: quotedLines.join("\n\n") });
    }
  }

  return {
    url: pageUrl,
    canonicalUrl: xTweet.url,
    title: normalizeTitle(
      xTweet.author ? `@${xTweet.author}: ${xTweet.text}` : xTweet.text,
      "Tweet",
    ),
    author: formatTweetAuthor(xTweet),
    siteName: "X",
    publishedAt: xTweet.createdAt,
    summary: xTweet.text.slice(0, 200) || undefined,
    adapter: "x",
    metadata: {
      kind: "x/post",
      tweetId: xTweet.id,
      ...getTweetAuthorMetadata(xTweet),
      conversationId:
        typeof tweet.legacy === "object" &&
        tweet.legacy !== null &&
        typeof (tweet.legacy as Record<string, unknown>).conversation_id_str === "string"
          ? (tweet.legacy as Record<string, unknown>).conversation_id_str
          : undefined,
      favoriteCount: xTweet.likes,
      replyCount: xTweet.replies,
      retweetCount: xTweet.retweets,
    },
    content,
  };
}
slack-gif-creatoranthropics/skillsKnowledge and utilities for creating animated GIFs optimized for Slack. Provides constraints, validation tools, and animation concepts. Use when users request animated GIFs for Slack like "make me a GIF of X doing Y for Slack."Stars: 198kUpdated Claude CodeCodexVerifiedInstall
ponytailDietrichGebert/ponytailLazy senior dev mode for any coding task: the smallest change that fully solves it, and a reply a busy human understands in one read.Stars: 194kUpdated Claude CodeCodexVerifiedInstall
ponytail-debtDietrichGebert/ponytailHarvest every shortcut: comment into one debt ledger, so deferrals get tracked instead of forgotten. One-shot report.Stars: 194kUpdated Claude CodeCodexVerifiedInstall
ponytail-debtDietrichGebert/ponytailList every `shortcut:` comment (and older `ponytail:` ones) as a debt ledger. One-shot report, changes nothing. Use for "ponytail debt", "what did ponytail defer", "list the shortcuts", /ponytail-debt.Stars: 194kUpdated Claude CodeCodexVerifiedInstall