Scrape web pages - PagePith

Use the synchronous scrape endpoint when your caller can wait for the result. PagePith tries the least expensive extraction method first and escalates when a page requires JavaScript rendering or additional handling.

Request options

Field	Default	Use it when
`url`	Required	You have a complete public `http` or `https` URL.
`timeoutMs`	`45000`	You need a request budget from 1,000 to 120,000 milliseconds.
`waitForSelector`	None	Dynamic content is ready only after a CSS selector appears.
`extraWaitMs`	`0`	A rendered page needs up to 10,000 milliseconds to settle.

curl --request POST \
  --url https://api.pagepith.com/v1/api/scrape \
  --header "Authorization: Bearer $PAGEPITH_API_KEY" \
  --header "Content-Type: application/json" \
  --data '{
    "url": "https://example.com/pricing",
    "waitForSelector": "main",
    "extraWaitMs": 1000
  }'

Choose synchronous or asynchronous scraping

Use synchronous scraping for interactive requests and single URLs.
Use asynchronous scraping for batch ingestion or work that should not hold an HTTP connection open.