Skip to main content
POST
/
api
/
v1
/
scrape
/
batch
Batch Scrape
curl --request POST \
  --url https://api.promptguard.dev/api/v1/scrape/batch \
  --header 'Authorization: Bearer <token>' \
  --header 'Content-Type: application/json' \
  --data '
{
  "urls": [
    "<string>"
  ],
  "formats": [
    "markdown"
  ],
  "only_main_content": true,
  "scan_for_injection": true,
  "block_on_threat": true,
  "webhook_url": "<string>"
}
'
{
  "job_id": "<string>",
  "total_urls": 123,
  "estimated_time_seconds": 123,
  "status": "queued"
}

Authorizations

Authorization
string
header
required

API Key authentication for developer endpoints (/api/v1/*). Use format: 'Bearer pg_api_your_key_here'

Body

application/json

Request to scrape multiple URLs

urls
string<uri>[]
required
Maximum array length: 100
Required string length: 1 - 2083
formats
string[]
only_main_content
boolean
default:true
scan_for_injection
boolean
default:true
block_on_threat
boolean
default:true
webhook_url
string<uri> | null
Required string length: 1 - 2083

Response

Successful Response

Response for batch scrape initiation

job_id
string
required
total_urls
integer
required
estimated_time_seconds
integer
required
status
string
default:queued