Go back

How to: Extract URLs from sitemap.xml

Description:

Make sure that start URL and sitemap.xml URLs are the same domain, even the www part.

Sitemap:

{"_id":"webscraper-sitemap-xml","startUrl":["https://webscraper.io/"],"selectors":[{"id":"xml","parentSelectors":["_root"],"sitemapXmlMinimumPriority":0.1,"sitemapXmlUrlRegex":"","sitemapXmlUrls":["https://webscraper.io/sitemap.xml"],"type":"SelectorSitemapXmlLink"}]}

Was this page helpful?