Build a watchlist of pages

Follow a publication’s research section or a company’s product catalogue over time.

SQL

SELECT DISTINCT url
FROM pages
WHERE startsWith(url, 'https://example.com/research/')
ORDER BY url;

Open in SQL workspaceLoads without running

What you get

Known page URLs under one path. Use this SQL to create a schedule that captures these pages at an interval. Running it first shows the pages it would select today.

Adapt it

Replace the URL prefix. Review the matches for navigation pages and other URLs you do not want to track.

Notes

The schedule locks in the matching URLs when you create it; it does not add future matches. Scheduled pages need not already be in the corpus, so you can also enter URLs directly. Crawl a section first when you need to find its pages.

Create a schedule