TheCrawler
latest · 0.5.8Universal web scraper with LLM-ready markdown, RAG chunking, PDF/DOCX support.
- GitHub
- manchittlab/TheCrawler
- MCP registry
- io.github.manchittlab/thecrawler
Install
claude mcp add io-github-manchittlab-thecrawler -- npx thecrawler/mcp confirms it's connected.
Or add it manually in ~/.cursor/mcp.json:
{
"mcpServers": {
"io-github-manchittlab-thecrawler": {
"command": "npx",
"args": [
"thecrawler"
]
}
}
}In claude_desktop_config.json (Settings → Developer → Edit Config), then restart:
{
"mcpServers": {
"io-github-manchittlab-thecrawler": {
"command": "npx",
"args": [
"thecrawler"
]
}
}
}Config entry, any MCP client:
{
"command": "npx",
"args": [
"thecrawler"
]
}Community score
Community27/ 100
from web signals · no reviews yet (community v3)
- Web signals (ecosystem baseline)27/100 · 100% of the weight
Used it? Rate v0.5.8
No reviews yet — be the first.
What the web says
Ecosystem baseline27/ 100
Objective public usage & activity (formula v3) — the community score's web-signals input, and its own sort.
GitHubsource ↗
- GitHub stars · 12 days ago
- ★ 2
- Last commit · 12 days ago
- 94 days ago
- Issue close rate · 12 days ago
- 0%
- License · 12 days ago
- AGPL-3.0
Packages
No package-registry data collected yet.
Listed on
- Glama · 6 days ago
- Listed ↗
Mentions
No public discussion scraped yet.
Docs & liveness
No liveness or verification signals yet.
Version history1
- 0.5.8release date unknown
Details
- Transport
- stdio
- Status
- listed
- Source
- Imported from the MCP registry
- Repository
- source ↗