scrape2llm

API Reference

Base URL: https://api.scrape2llm.com

Authentication

Job endpoints use X-API-Key header with a key from your dashboard. Account endpoints (/me, /me/keys) use a Bearer JWT from Kinde — these are intended for the dashboard, not for API clients.

POST /jobs

Submit a URL for scraping. Returns a job ID immediately.

Body

  • url (string, required) — URL to scrape.
  • parse (bool, default false) — return ParsedDocument with raw HTML + link graph.
  • selector (string, optional) — CSS selector to pinpoint content.
  • callback_url (string, optional) — webhook target for async delivery.

Response (202)

{"job_id":"abc-123","status":"queued","url":"...","parse":false,"selector":null,"callback_url":null}

GET /jobs/{id}

Status of a job. The result is not returned here — fetch it from GET /jobs/{id}/result once the job is fetched. The response also carries the job fields (job_id, url, parse, tier, error_message, timestamps).

# queued / fetching
{"status":"queued"}
{"status":"fetching"}

# fetched
{"status":"fetched"}

# failed
{"status":"failed","error_message":"..."}

GET /jobs/{id}/result

Result payload of a job, returned as-is (no status wrapper). Returns 404 while the job has no result yet (queued, fetching or failed).

Flat (no parse)

{"url":"...","title":"...","content":"# ...","tier":"httpx"}

parse=true — Markdown, metadata and article images, plus raw_html_file_id for the raw HTML (see GET /jobs/{id}/html).

{
"url": "https://example.com/articles/sample",
"title": "Sample article",
"content_md": "# Sample article",
"tier": "httpx",
"selector": null,
"raw_html_file_id": "abc-123-html",
"raw_html_size_bytes": 48213,
"links": [
{"url": "https://example.com/related", "text": "Related post", "kind": "internal", "rel": []}
],
"metadata": {
"title": "Sample article",
"author": "Jane Doe",
"description": "A short sample description.",
"date": "2026-10-01",
"sitename": "Example",
"language": "en",
"categories": ["news"],
"tags": ["sample"],
"image": "https://cdn.example.com/images/main.jpg"
},
"images": {
"main": "https://cdn.example.com/images/main.jpg",
"body": ["https://cdn.example.com/images/body-1.jpg"]
},
"published_at": "2026-10-01",
"content_source": "page",
"response_headers": {"tdm-reservation": "1"},
"meta_robots": [],
"signal_coverage": "full"
}

GET /jobs/{id}/html

For parse=true jobs only. Streams the raw HTML from R2. Returns 404 for non-parse jobs or jobs without stored HTML.

GET /me

(Bearer JWT) Current user + list of active (non-revoked) API keys.

POST /me/keys

(Bearer JWT) Create a new API key.

# Request
{"label":"Production"}

# Response (201) — raw key shown ONCE
{"id":"...","label":"Production","key_prefix":"s2l_a1b2c3d4","key":"s2l_a1b2c3d4...","created_at":"..."}

DELETE /me/keys/{id}

(Bearer JWT) Soft-delete a key. Subsequent requests with that key return 401.

Errors

  • 401 — missing/invalid/revoked key, or bad JWT.
  • 404 — unknown job ID, or HTML requested for a non-parse job.
  • 422 — malformed request body.
  • 5xx — upstream failure. Job will be marked failed with an error message.