Asynchronous scraping

Asynchronous scraping returns a job ID immediately and sends the result to a webhook. Use it for batches or background work.

Submit a job

curl --request POST \
  --url https://api.pagepith.com/v1/api/scrape/async \
  --header "Authorization: Bearer $PAGEPITH_API_KEY" \
  --header "Content-Type: application/json" \
  --data '{
    "url": "https://example.com/reports/quarterly",
    "callbackUrl": "https://app.example.com/webhooks/pagepith"
  }'

A successful submission returns 202 Accepted.

{
  "jobId": "12843",
  "status": "queued"
}

Handle the callback

Your callback endpoint must accept an HTTP POST. PagePith sends the completed scrape result or an error after processing. Return a 2xx response after you persist the payload.

PagePith retries failed jobs with exponential backoff. A successful scrape consumes one credit when the worker completes it.

Use the asynchronous scrape reference for the complete request schema and response definitions.

⌘I

Getting started

Guides

API reference

Asynchronous scraping

Submit a job

Handle the callback

​Submit a job

​Handle the callback

Submit a job

Handle the callback