Manually trigger an extra crawl / re-indexing of your website

Crawling your website is an important step in ensuring that Rek.ai has the most up-to-date information about your content. This is especially useful when you have made significant changes to your website or added new content. Normally Rek.ai will automatically crawl your website every 2-12 hours. However, you can manually trigger a crawl whenever you need to.

In the Rek.ai dashboard

• Go to the "Settings" tab of your project
• Click on the "Re-index site" button

In the Rek.ai API

You can programmatically trigger a crawl of your website using the Rek.ai API.

Endpoint

POST http://admin.rek.ai/crawl/{projectId}

Replace {projectId} with your actual project ID.

Required Headers

Example Request

POST http://admin.rek.ai/crawl/YOUR_PROJECT_ID
rek-secret: YOUR_PROJECT_SECRET

Example Response

{
    "message": "Site queued for crawl",
    "data": {
        "site": "nameofthesite"
    },
    "status": 200
}