cURL
API Reference
Crawl
Crawl a site starting from one or more seed URLs, following links up to a configurable depth.
POST
cURL
Authorizations
Bearer authentication header of the form Bearer <token>, where <token> is your auth token.
Body
application/json
Minimum array length:
1Required range:
x <= 50Required range:
0 <= x <= 5Minimum array length:
1Available options:
html, markdown, json - Option 1
- Option 2
- Option 3
- Option 4
Required range:
x <= 300000Response
Crawl completed; per-page results and a summary are returned.