Actor picture

Sitemap To Request Queue

pocesar/sitemap-to-request-queue

Download sitemap XMLs and put them in a RequestQueue

Author's avatarPaulo Cesar
  • Modified
  • Users5
  • Runs60
Actor picture

Sitemap To Request Queue

Sitemap URLs

startUrls

Required

array

sitemap.xml urls, needs to be a proper sitemap

Target RequestQueue

targetRQ

Optional

string

Provide the target ID for the RequestQueue

Proxy

proxyConfig

Required

object

Proxy configuration

Transform request function

transform

Optional

string

If you need to provide any user data depending on the url. If you return null from this function, the url won't be added to the RequestQueue