AuraCrawlDocs
Preview. Endpoints and response shapes may change before general availability. Keys are issued manually today — there is no self-serve dashboard or sandbox yet. Request access.

Reference

Delivery & webhooks

Small jobs return inline; large ones run in the background and reach you however you choose.

delivery.typeBehaviour
syncBlock briefly and return records inline — jobs up to 1,000 records only; larger jobs must use webhook, store, or a destination.
webhookWe POST the result to your URL, signed with Aura-Signature and retried with backoff.
storeFetch later: GET /v1/extractions/{id}/records?cursor=….
destinationPush to S3, GCS, a warehouse table, or a queue.

Result records always page by cursor, never offset — stable even as a feed changes underneath you. Webhook payloads are signed with a dedicated signing secret (not your API key), so you can verify authenticity before trusting them.