Dodle Spider
Pricing
Pay per usage
Crawl a website for SEO issues and image links, then find related Wikipedia trends.
Website pages to crawl for SEO data, image links, and topics related to Wikipedia trends.
Maximum pages to crawl starting from each start URL.
Maximum country rank to check for related topics. Worldwide mode checks the top five separately for each of seven selected language editions.
Number of complete UTC days to check for related topics. One additional earlier day is fetched as a comparison baseline.
Choose top-five rankings separately for seven selected language editions, or rankings for one selected reader country. Only articles matching crawled page topics are included.
Choose a country by name. Its ISO 3166-1 alpha-2 code is sent to Wikimedia. Used only when Wikipedia trend region is Specific country.
Optional Python regular expressions for discovered URLs. When provided, a URL must match at least one pattern to be crawled.
[]Optional Python regular expressions; matching discovered URLs are skipped.
[]Maximum pages fetched simultaneously; lower values are gentler on websites.
Rate limit for page requests during the crawl.