Get Crawl Status
Get the current status of a website crawl operation
Retrieves the current status and details of a specific crawl operation. This endpoint allows you to monitor the progress of an ongoing crawl or check the results of a completed crawl.
When the crawl is completed, the discovered URLs are not indexed immediately. You need to manually add the discovered URLs as a data source by passing them to Create Data Source endpoint.
Path Parameters
The slug of the Guru type associated with the crawl
The unique identifier of the crawl operation to check
Response
Unique identifier for the crawl operation
The root URL that was crawled
Current status of the crawl operation
The Guru type that the crawl was initiated for
List of URLs discovered during crawling
Timestamp when crawl started (ISO 8601 format)
Timestamp when crawl ended (ISO 8601 format)
Error message if the crawl failed (only present if there was an error)