mxyhi/ok-skills / deep-research
deep-research
UnverifiedProfessional deep research report generation — multi-agent collaboration with parallel chapter writing, automatic latest-data targeting, multilingual output, and built-in quality checks.
| File | Kind | Size |
|---|---|---|
| LICENSE | other | 1.0 KB |
| RULES.md | markdown | 6.9 KB |
| SKILL.md | skill md | 34.7 KB |
| TYPES.md | markdown | 4.9 KB |
| VERSION | other | 6 B |
| command/research.md | markdown | 751 B |
| command/update.md | markdown | 1.4 KB |
| profiles.json | config | 344 B |
| prompts/task1_outline.md | markdown | 8.8 KB |
| prompts/task2_data_collection.md | markdown | 28.9 KB |
| prompts/task3_chapter_agent.md | markdown | 3.8 KB |
| prompts/task4_assembly.md | markdown | 6.2 KB |
| reports-browser/favicon.svg | other | 241 B |
| reports-browser/html-docx.min.js | script | 406.3 KB |
| reports-browser/html2pdf.bundle.min.js | script | 884.7 KB |
| reports-browser/index.html | other | 19.1 KB |
| reports-browser/marked.min.js | script | 51.6 KB |
| reports-browser/reports.json | config | 2 B |
| scrapling-mcp-server.py | script | 6.6 KB |
| sources.json | config | 7.5 KB |
| tools/dr_check.py | script | 21.2 KB |
| tools/dr_gen.py | script | 36.8 KB |
| tools/dr_tools.py | script | 17.2 KB |
| tools/generate_pages.py | script | 28.4 KB |
| tools/lang_config.py | script | 24.1 KB |
scrapling-mcp-server.py
View on GitHub"""
Scrapling MCP Server (all-platform)
Exposes: scrapling_bulk_get, scrapling_bulk_stealthy_fetch, scrapling_bulk_fetch
此脚本是一个标准 MCP Server 实现,供 AI 在安装 Scrapling 时参考。
AI 可以原样使用此脚本,或根据系统环境自行修改后注册到当前工具的 MCP 配置。
不包含任何硬编码路径,完全由 AI 在注册时动态配置。
"""
import asyncio
import json
import sys
import traceback
from typing import Any
import scrapling
from mcp.server import Server
from mcp.types import Tool, TextContent
server = Server("scrapling-mcp")
@server.list_tools()
async def list_tools() -> list[Tool]:
return [
Tool(
name="scrapling_bulk_get",
description="批量抓取网页全文(标准模式,适合大多数网站)",
inputSchema={
"type": "object",
"properties": {
"urls": {
"type": "array",
"items": {"type": "string"},
"description": "要抓取的 URL 列表",
},
"timeout": {
"type": "number",
"description": "超时秒数,默认 12",
"default": 12,
},
"extraction_type": {
"type": "string",
"description": "提取方式:markdown / html / text,默认 markdown",
"default": "markdown",
},
},
"required": ["urls"],
},
),
Tool(
name="scrapling_bulk_stealthy_fetch",
description="批量抓取网页全文(反检测模式,适合有 Cloudflare/WAF 防护的网站)",
inputSchema={
"type": "object",
"properties": {
"urls": {
"type": "array",
"items": {"type": "string"},
"description": "要抓取的 URL 列表",
},
"timeout": {
"type": "number",
"description": "超时秒数,默认 15",
"default": 15,
},
},
"required": ["urls"],
},
),
Tool(
name="scrapling_bulk_fetch",
description="批量抓取网页全文(JS 渲染模式,适合需要 JavaScript 执行才能显示内容的页面)",
inputSchema={
"type": "object",
"properties": {
"urls": {
"type": "array",
"items": {"type": "string"},
"description": "要抓取的 URL 列表",
},
"timeout": {
"type": "number",
"description": "超时秒数,默认 15",
"default": 15,
},
},
"required": ["urls"],
},
),
]
def _fetch_single(url: str, timeout: int, method: str) -> dict:
"""Fetch a single URL and return result dict."""
result = {"url": url, "success": False, "content": "", "error": ""}
try:
if method == "get":
fetcher = scrapling.Fetcher()
response = fetcher.get(url)
result["content"] = response.html_content
result["success"] = True
elif method == "stealthy":
try:
resp = scrapling.StealthyFetcher.fetch(url, headless=True, timeout=timeout * 1000)
result["content"] = resp.html_content
result["success"] = True
except Exception as e:
result["error"] = f"{type(e).__name__}: {e}"
elif method == "dynamic":
try:
resp = scrapling.DynamicFetcher.fetch(url, headless=True, timeout=timeout * 1000)
result["content"] = resp.html_content
result["success"] = True
except Exception as e:
result["error"] = f"{type(e).__name__}: {e}"
except Exception as e:
result["error"] = f"{type(e).__name__}: {e}"
return result
def _bulk_fetch(urls: list[str], timeout: int, method: str) -> list[dict]:
results = []
for url in urls:
r = _fetch_single(url, timeout, method)
results.append(r)
return results
@server.call_tool()
async def call_tool(name: str, arguments: dict[str, Any]) -> list[TextContent]:
urls = arguments.get("urls", [])
timeout = arguments.get("timeout", 12)
extraction_type = arguments.get("extraction_type", "markdown")
if not urls:
return [TextContent(type="text", text=json.dumps({"error": "urls is required"}))]
try:
if name == "scrapling_bulk_get":
raw_results = _bulk_fetch(urls, timeout, "get")
elif name == "scrapling_bulk_stealthy_fetch":
raw_results = _bulk_fetch(urls, timeout, "stealthy")
elif name == "scrapling_bulk_fetch":
raw_results = _bulk_fetch(urls, timeout, "dynamic")
else:
return [TextContent(type="text", text=json.dumps({"error": f"unknown tool: {name}"}))]
output = []
for r in raw_results:
entry = {
"url": r["url"],
"success": r["success"],
}
if r["success"]:
entry["content_length"] = len(r["content"])
entry["content_preview"] = r["content"][:500]
entry["content"] = r["content"]
else:
entry["error"] = r["error"]
output.append(entry)
return [TextContent(
type="text",
text=json.dumps({
"tool": name,
"total_urls": len(urls),
"success_count": sum(1 for r in raw_results if r["success"]),
"fail_count": sum(1 for r in raw_results if not r["success"]),
"results": output,
}, ensure_ascii=False, indent=2)
)]
except Exception as e:
tb = traceback.format_exc()
return [TextContent(type="text", text=json.dumps({
"error": str(e),
"traceback": tb,
}))]
async def main():
from mcp.server.stdio import stdio_server
async with stdio_server() as (read_stream, write_stream):
await server.run(
read_stream,
write_stream,
server.create_initialization_options(),
)
if __name__ == "__main__":
asyncio.run(main())
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| reverse-engineer-anythingmorluto/reaReverse engineer native, managed, Electron/JavaScript, packaged, firmware, and browser targets with REA, and build agent environments (AgentEnv bundles) of web applications from a live instance or a capture, and of Linux desktop apps with a task from a request. Use shipped-artifact or requested runtime evidence to explain features, compare versions, decompile code, or guide a reconstruction. Skip REA for ordinary source-repository architecture analysis. | Stars: 472k | Updated | Claude CodeCodex | Unverified | Install |
| diagnosing-superpowersobra/superpowersUse when a superpowers session went wrong and your human partner wants to know why — repeated work, ignored plans, stumbles, poor results, a skill that didn't fire, "it took too long", "why is it so expensive", "what is it doing" — or wants to build a bug report for the superpowers maintainers, for the current session or a past one identified by id or path, on any harness. | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| dispatching-parallel-agentsobra/superpowersUse when facing 2+ independent tasks that can be worked on without shared state or sequential dependencies | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| executing-plansobra/superpowersUse when executing an implementation plan in the current session as the implementer yourself — your human partner chose inline execution, or no subagent tool is available | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |