61e52403a3
Some checks failed
CI/CD / typecheck (pull_request) Successful in 1m17s
CI/CD / test (pull_request) Successful in 1m24s
CI/CD / lint (pull_request) Successful in 2m56s
CI/CD / smoke (pull_request) Failing after 1m54s
CI/CD / build (pull_request) Successful in 4m19s
CI/CD / publish (pull_request) Has been skipped
Readiness probes ran real searches every interval: searxng's searxng_web_search probe fanned a query out to every engine 1,440 times a day, billing API-key engines (braveapi, kagi), and duckduckgo's `search` probe scraped DuckDuckGo from the same IP agents search from. - searxng: probe searxng_instance_info, which reads /config only - duckduckgo: probe fetch_content on example.com every 300s - firecrawl (new): firecrawl-mcp against a self-hosted or cloud Firecrawl, for reading pages as main-content markdown; probe firecrawl_scrape on example.com every 300s Every probe still names a readiness tool, as templates.test.ts requires; each was run against the real package before being written down. docs/web-search.md now pairs searxng (search) with firecrawl (reading) and says why duckduckgo does not hold up under agent traffic. Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01JPjtnE6Gd343oRNtMU9Bcd
29 lines
1.1 KiB
YAML
29 lines
1.1 KiB
YAML
name: firecrawl
|
|
version: "1.0.0"
|
|
description: Firecrawl MCP server for reading web pages as main-content markdown, JS-rendered pages included
|
|
packageName: "firecrawl-mcp"
|
|
runtime: node
|
|
transport: STDIO
|
|
repositoryUrl: https://github.com/firecrawl/firecrawl-mcp-server
|
|
# Readiness scrapes a tiny static page: a pass proves the Firecrawl API answers
|
|
# and can fetch the web, without a search. Firecrawl's own search needs a
|
|
# SearXNG endpoint on self-hosted instances; use the searxng template for
|
|
# search. 300s because each probe is a real outbound fetch.
|
|
healthCheck:
|
|
tool: firecrawl_scrape
|
|
arguments:
|
|
url: "https://example.com"
|
|
formats: ["markdown"]
|
|
onlyMainContent: true
|
|
intervalSeconds: 300
|
|
timeoutSeconds: 60
|
|
env:
|
|
- name: FIRECRAWL_API_URL
|
|
description: >-
|
|
Self-hosted Firecrawl API base URL (e.g. http://firecrawl-api:3002). Leave
|
|
unset only when using Firecrawl's cloud with FIRECRAWL_API_KEY.
|
|
required: false
|
|
- name: FIRECRAWL_API_KEY
|
|
description: API key — required for Firecrawl's cloud, optional for a self-hosted instance
|
|
required: false
|