GPT Scraper avatar
GPT Scraper

Pricing

$9.00 / 1,000 pages

Go to Store
GPT Scraper

GPT Scraper

Developed by

Jakub Drobník

Jakub Drobník

Maintained by Apify

Extract data from any website and feed it into GPT via the OpenAI API. Use ChatGPT to proofread content, analyze sentiment, summarize reviews, extract contact details, and much more.

4.4 (7)

Pricing

$9.00 / 1,000 pages

107

Total users

6K

Monthly users

108

Runs succeeded

99%

Issues response

10 hours

Last modified

6 months ago

IM

just can't get it work. Too slow, too many errors. Could be data in iframe.

Open

imkundeng opened this issue
2 days ago

2025-07-23T18:31:00.568Z ACTOR: Pulling Docker image of build DultqBbOXMMEYnkJc from registry. 2025-07-23T18:31:00.570Z ACTOR: Creating Docker container. 2025-07-23T18:31:00.681Z ACTOR: Starting Docker container. 2025-07-23T18:31:00.877Z Starting X virtual framebuffer using: Xvfb :99 -ac -screen 0 1920x1080x24+32 -nolisten tcp 2025-07-23T18:31:00.880Z Executing main command 2025-07-23T18:31:02.251Z INFO System info {"apifyVersion":"3.1.16","apifyClientVersion":"2.9.3","crawleeVersion":"3.8.1","osType":"Linux","nodeVersion":"v18.20.5"} 2025-07-23T18:31:02.569Z INFO Max pages per crawl: 10 2025-07-23T18:31:03.438Z INFO Configuration completed. Starting the crawl. 2025-07-23T18:31:03.596Z INFO PlaywrightCrawler: Starting the crawler. 2025-07-23T18:32:03.263Z INFO Statistics: PlaywrightCrawler request statistics: {"requestAvgFailedDurationMillis":null,"requestAvgFinishedDurationMillis":null,"requestsFinishedPerMinute":0,"requestsFailedPerMinute":0,"requestTotalDurationMillis":0,"requestsTotal":0,"crawlerRuntimeMillis":60148,"retryHistogram":[]} 2025-07-23T18:32:03.296Z INFO PlaywrightCrawler:AutoscaledPool: state {"currentConcurrency":1,"desiredConcurrency":3,"systemStatus":{"isSystemIdle":true,"memInfo":{"isOverloaded":false,"limitRatio":0.2,"actualRatio":0},"eventLoopInfo":{"isOverloaded":false,"limitRatio":0.6,"actualRatio":0},"cpuInfo":{"isOverloaded":false,"limitRatio":0.4,"actualRatio":0},"clientInfo":{"isOverloaded":false,"limitRatio":0.3,"actualRatio":0}}} 2025-07-23T18:32:03.885Z WARN PlaywrightCrawler: Reclaiming failed request back to the list or queue. Navigation timed out after 60 seconds. {"id":"uYO7E5RoTrk73HC","url":"https://help.splunk.com/en/splunk-cloud-platform/search/spl2-search-reference","retryCount":1} 2025-07-23T18:32:13.605Z INFO Opening https://help.splunk.com/en/splunk-cloud-platform/search/spl2-search-reference... 2025-07-23T18:32:14.385Z INFO Page https://help.splunk.com/en/splunk-cloud-platform/search/spl2-search-reference enqueued 38 new URLs. {"foundLinksCount":38,"enqueuedLinksCount":38,"alreadyPresentLinksCount":0} 2025-07-23T18:32:14.390Z ERROR Cannot find targetSelector [role="article"] on https://help.splunk.com/en/splunk-cloud-platform/search/spl2-search-reference, skipping this page. {"err":{"name":"Error","message":"page.$eval: Failed to find element matching selector " [role="article"]"","stack":"page.$eval: Failed to find element matching selector " [role="article"]"\n at crawlRoute (/home/myuser/dist/routes/crawl-route.js:76:44)\n at async wrap (/home/myuser/node_modules/@apify/timeout/cjs/index.cjs:54:21)"}} 2025-07-23T18:32:35.082Z INFO Opening https://help.splunk.com/en/splunk-cloud-platform/search/spl2-search-reference/rex-command... 2025-07-23T18:32:39.780Z INFO Page https://help.splunk.com/en/splunk-cloud-platform/search/spl2-search-reference/rex-command enqueued 38 new URLs. {"foundLinksCount":38,"enqueuedLinksCount":38,"alreadyPresentLinksCount":3} 2025-07-23T18:32:39.879Z ERROR Cannot find targetSelector [role="article"] on https://help.splunk.com/en/splunk-cloud-platform/search/spl2-search-reference/rex-command, skipping this page. {"err":{"name":"Error","message":"page.$eval: Failed to find element matching selector " [role="article"]"","stack":"page.$eval: Failed to find element matching selector " [role="article"]"\n at crawlRoute (/home/myuser/dist/routes/crawl-route.js:76:44)\n at async wrap (/home/myuser/node_modules/@apify/timeout/cjs/index.cjs:54:21)"}} 2025-07-23T18:33:03.279Z INFO Statistics: PlaywrightCrawler request statistics: {"requestAvgFailedDurationMillis":null,"requestAvgFinishedDurationMillis":16397,"requestsFinishedPerMinute":1,"requestsFailedPerMinute":0,"requestTotalDurationMillis":32794,"requestsTotal":2,"crawlerRuntimeMillis":120164,"retryHistogram":[1,1]} 2025-07-23T18:33:03.382Z INFO PlaywrightCrawler:AutoscaledPool: state {"currentConcurrency":3,"desiredConcurrency":1,"systemStatus":{"isSystemIdle":false,"memInfo":{"isOverloaded":false,"limitRatio":0.2,"actualRatio":0},"eventLoopInfo":{"isOverloaded":false,"limitRatio":0.6,"actualRatio":0.06},"cpuInfo":{"isOverloaded":true,"limitRatio":0.4,"actualRatio":0.755},"clientInfo":{"isOverloaded":false,"limitRatio":0.3,"actualRatio":0}}} 2025-07-23T18:33:04.881Z INFO Opening https://help.splunk.com/en/splunk-cloud-platform/search/spl2-search-reference/route-command... 2025-07-23T18:33:04.898Z INFO Opening https://help.splunk.com/en/splunk-cloud-platform/search/spl2-search-reference/sort-command... 2025-07-23T18:33:04.900Z INFO Opening https://help.splunk.com/en/splunk-cloud-platform/search/spl2-search-reference/search-command... 2025-07-23T18:33:06.009Z INFO Page https://help.splunk.com/en/splunk-cloud-platform/search/spl2-search-reference/route-command enqueued 0 new URLs. {"foundLinksCount":0,"enqueuedLinksCount":0,"alreadyPresentLinksCount":69} 2025-07-23T18:33:06.084Z ERROR Cannot find targetSelector [role="article"] on https://help.splunk.com/en/splunk-cloud-platform/search/spl2-search-reference/route-command, skipping this page. {"err":{"name":"Error","message":"page.$eval: Failed to find element matching selector " [role="article"]"","stack":"page.$eval: Failed to find element matching selector " [role="article"]"\n at crawlRoute (/home/myuser/dist/routes/crawl-route.js:76:44)\n at async wrap (/home/myuser/node_modules/@apify/timeout/cjs/index.cjs:54:21)"}} 2025-07-23T18:33:06.481Z INFO Page https://help.splunk.com/en/splunk-cloud-platform/search/spl2-search-reference/sort-command enqueued 2 new URLs. {"foundLinksCount":2,"enqueuedLinksCount":2,"alreadyPresentLinksCount":67} 2025-07-23T18:33:06.487Z INFO Page https://help.splunk.com/en/splunk-cloud-platform/search/spl2-search-reference/search-command enqueued 1 new URLs. {"foundLinksCount":1,"enqueuedLinksCount":1,"alreadyPresentLinksCount":70} 2025-07-23T18:33:06.584Z ERROR Cannot find targetSelector [role="article"] on https://help.splunk.com/en/splunk-cloud-platform/search/spl2-search-reference/sort-command, skipping this page. {"err":{"name":"Error","message":"page.$eval: Failed to find element matching selector " [role="article"]"","stack":"page.$eval: Failed to find element matching selector " [role="article"]"\n at crawlRoute (/home/myuser/dist/routes/crawl-route.js:76:44)\n at async wrap (/home/myuser/node_modules/@apify/timeout/cjs/index.cjs:54:21)"}} 2025-07-23T18:33:06.600Z ERROR Cannot find targetSelector [role="article"] on https://help.splunk.com/en/splunk-cloud-platform/search/spl2-search-reference/search-command, skipping this page. {"err":{"name":"Error","message":"page.$eval: Failed to find element matching selector " [role="article"]"","stack":"page.$eval: Failed to find element matching selector " [role="article"]"\n at crawlRoute (/home/myuser/dist/routes/crawl-route.js:76:44)\n at async wrap (/home/myuser/node_modules/@apify/timeout/cjs/index.cjs:54:21)"}} 2025-07-23T18:33:23.480Z INFO Opening https://help.splunk.com/en/splunk-cloud-platform/search/spl2-search-reference/spl1-command... 2025-07-23T18:33:25.167Z INFO Page