Forever21 Scraper avatar
Forever21 Scraper
Try for free

3 days trial then $30.00/month - No credit card required now

View all Actors
Forever21 Scraper

Forever21 Scraper

epctex/forever21-scraper
Try for free

3 days trial then $30.00/month - No credit card required now

Extract any product data from Forever21 easily! Images, sizes, SKUs, quantities, colors, and many more values are ready for you. Search for any keyword, filter by your needs, or get category pages! Export your data by XML, JSON, CSV, Excel or HTML.

User avatar

Fails at running. Returns the following error when running for the example url(https://www.forever21.com/us/shop/catalog/category/f21/women-main) in the documentation: 2021-11-10T17:47:37.572Z INFO: Processing: "https://www.forever21.com/us/shop/catalog/category/f21/activewear" 2021-11-10T17:47:37.573Z ERROR: BasicCrawler: handleRequestFunction failed, reclaiming failed request back to the list or queue {"url":"https://www.forever21.com/us/shop/catalog/category/f21/activewear","retryCount":1,"id":"cpSm5YI4HuElv7r"} 2021-11-10T17:47:37.574Z TypeError: Cannot read property 'indexOf' of null 2021-11-10T17:47:37.575Z at extractSubcatPage (/usr/src/app/src/extractors.js:50:33) 2021-11-10T17:47:37.575Z at CheerioCrawler.handlePageFunction (/usr/src/app/src/main.js:85:52) 2021-11-10T17:47:37.576Z at CheerioCrawler._handleRequestFunction (/usr/src/app/node_modules/apify/build/crawlers/cheerio_crawler.js:434:50) 2021-11-10T17:47:37.576Z at processTicksAndRejections (internal/process/task_queues.js:97:5) 2021-11-10T17:47:37.577Z at async /usr/src/app/node_modules/apify/build/utils.js:411:20 2021-11-10T17:47:38.126Z INFO: Processing: "https://www.forever21.com/us/shop/catalog/category/f21/lingerie" 2021-11-10T17:47:38.132Z ERROR: BasicCrawler: handleRequestFunction failed, reclaiming failed request back to the list or queue {"url":"https://www.forever21.com/us/shop/catalog/category/f21/lingerie","retryCount":2,"id":"XPB20HPiuBbxkWV"} 2021-11-10T17:47:38.136Z TypeError: Cannot read property 'indexOf' of null 2021-11-10T17:47:38.137Z at extractSubcatPage (/usr/src/app/src/extractors.js:50:33) 2021-11-10T17:47:38.137Z at CheerioCrawler.handlePageFunction (/usr/src/app/src/main.js:85:52) 2021-11-10T17:47:38.138Z at CheerioCrawler._handleRequestFunction (/usr/src/app/node_modules/apify/build/crawlers/cheerio_crawler.js:434:50) 2021-11-10T17:47:38.138Z at processTicksAndRejections (internal/process/task_queues.js:97:5) 2021-11-10T17:47:38.139Z at async /usr/src/app/node_modules/apify/build/utils.js:411:20 2021-11-10T17:47:38.155Z INFO: Processing: "https://www.forever21.com/us/shop/catalog/category/plus/plus_size-tops" 2021-11-10T17:47:38.156Z ERROR: BasicCrawler: handleRequestFunction failed, reclaiming failed request back to the list or queue {"url":"https://www.forever21.com/us/shop/catalog/category/plus/plus_size-tops","retryCount":1,"id":"z6a1JfnDv8EKyfZ"} 2021-11-10T17:47:38.157Z TypeError: Cannot read property 'indexOf' of null 2021-11-10T17:47:38.157Z at extractSubcatPage (/usr/src/app/src/extractors.js:50:33) 2021-11-10T17:47:38.158Z at CheerioCrawler.handlePageFunction (/usr/src/app/src/main.js:85:52) 2021-11-10T17:47:38.159Z at CheerioCrawler._handleRequestFunction (/usr/src/app/node_modules/apify/build/crawlers/cheerio_crawler.js:434:50) 2021-11-10T17:47:38.159Z at processTicksAndRejections (internal/process/task_queues.js:97:5) 2021-11-10T17:47:38.160Z at async /usr/src/app/node_modules/apify/build/utils.js:411:20 2021-11-10T17:47:38.419Z INFO: Processing: "https://www.forever21.com/us/shop/catalog/category/f21/top_blouses" 2021-11-10T17:47:38.420Z ERROR: BasicCrawler: handleRequestFunction failed, reclaiming failed request back to the list or queue {"url":"https://www.forever21.com/us/shop/catalog/category/f21/top_blouses","retryCount":2,"id":"6ezVIYHB2z3p60Q"}

Closed

Ralph Blanes (daddyofdarkness) opened this issue
2 years ago

Full log:

2021-11-10T17:47:37.427Z at CheerioCrawler.handlePageFunction (/usr/src/app/src/main.js:85:52) 2021-11-10T17:47:37.427Z at CheerioCrawler._handleRequestFunction (/usr/src/app/node_modules/apify/build/crawlers/cheerio_crawler.js:434:50) 2021-11-10T17:47:37.428Z at processTicksAndRejections (internal/process/task_queues.js:97:5) 2021-11-10T17:47:37.428Z at async /usr/src/app/node_modules/apify/build/utils.js:411:20 2021-11-10T17:47:37.572Z INFO: Processing: "https://www.forever21.com/us/shop/catalog/category/f21/activewear" 2021-11-10T17:47:37.573Z ERROR: BasicCrawler: handleRequestFunction failed, reclaiming failed request back to the list or queue {"url":"https://www.forever21.com/us/shop/catalog/category/f21/activewear","retryCount":1,"id":"cpSm5YI4HuElv7r"} 2021-11-10T17:47:37.574Z TypeError: Cannot read property 'indexOf' of null 2021-11-10T17:47:37.575Z at extractSubcatPage (/usr/src/app/src/extractors.js:50:33) 2021-11-10T17:47:37.575Z at CheerioCrawler.handlePageFunction (/usr/src/app/src/main.js:85:52) 2021-11-10T17:47:37.576Z at CheerioCrawler._handleRequestFunction (/usr/src/app/node_modules/apify/build/crawlers/cheerio_crawler.js:434:50) 2021-11-10T17:47:37.576Z at processTicksAndRejections (internal/process/task_queues.js:97:5) 2021-11-10T17:47:37.577Z at async /usr/src/app/node_modules/apify/build/utils.js:411:20 2021-11-10T17:47:38.126Z INFO: Processing: "https://www.forever21.com/us/shop/catalog/category/f21/lingerie" 2021-11-10T17:47:38.132Z ERROR: BasicCrawler: handleRequestFunction failed, reclaiming failed request back to the list or queue {"url":"https://www.forever21.com/us/shop/catalog/category/f21/lingerie","retryCount":2,"id":"XPB20HPiuBbxkWV"} 2021-11-10T17:47:38.136Z TypeError: Cannot read property 'indexOf' of null 2021-11-10T17:47:38.137Z at extractSubcatPage (/usr/src/app/src/extractors.js:50:33) 2021-11-10T17:47:38.137Z at CheerioCrawler.handlePageFunction (/usr/src/app/src/main.js:85:52) 2021-11-10T17:47:38.138Z at CheerioCrawler._handleRequestFunction (/usr/src/app/node_modules/apify/build/crawlers/cheerio_crawler.js:434:50) 2021-11-10T17:47:38.138Z at processTicksAndRejections (internal/process/task_queues.js:97:5) 2021-11-10T17:47:38.139Z at async /usr/src/app/node_modules/apify/build/utils.js:411:20 2021-11-10T17:47:38.155Z INFO: Processing: "https://www.forever21.com/us/shop/catalog/category/plus/plus_size-tops" 2021-11-10T17:47:38.156Z ERROR: BasicCrawler: handleRequestFunction failed, reclaiming failed request back to the list or queue {"url":"https://www.forever21.com/us/shop/catalog/category/plus/plus_size-tops","retryCount":1,"id":"z6a1JfnDv8EKyfZ"} 2021-11-10T17:47:38.157Z TypeError: Cannot read property 'indexOf' of null 2021-11-10T17:47:38.157Z at extractSubcatPage (/usr/src/app/src/extractors.js:50:33) 2021-11-10T17:47:38.158Z at CheerioCrawler.handlePageFunction (/usr/src/app/src/main.js:85:52) 2021-11-10T17:47:38.159Z at CheerioCrawler._handleRequestFunction (/usr/src/app/node_modules/apify/build/crawlers/cheerio_crawler.js:434:50) 2021-11-10T17:47:38.159Z at processTicksAndRejections (internal/process/task_queues.js:97:5) 2021-11-10T17:47:38.160Z at async /usr/src/app/node_modules/apify/build/utils.js:411:20 2021-11-10T17:47:38.419Z INFO: Processing: "https://www.forever21.com/us/shop/catalog/category/f21/top_blouses" 2021-11-10T17:47:38.420Z ERROR: BasicCrawler: handleRequestFunction failed, reclaiming failed request back to the list or queue {"url":"https://www.forever21.com/us/shop/catalog/category/f21/top_blouses","retryCount":2,"id":"6ezVIYHB2z3p60Q"} 2021-11-10T17:47:38.421Z TypeError: Cannot read property 'indexOf' of null 2021-11-10T17:47:38.421Z at extractSubcatPage (/usr/src/app/src/extractors.js:50:33) 2021-11-10T17:47:38.422Z at CheerioCrawler.handlePageFunction (/usr/src/app/src/main.js:85:52) 2021-11-10T17:47:38.422Z at CheerioCrawler._handleRequestFunction (/usr/src/app/node_modules/apify/build/crawlers/cheerio_crawler.js:434:50) 2021-11-10T17:47:38.423Z at processTicksAndRejections (internal/process/task_queues.js:97:5) 2021-11-10T17:47:38.423Z at async /usr/src/app/node_modules/apify/build/utils.js:411:20 2021-11-10T17:47:38.739Z INFO: Processing: "https://www.forever21.com/us/shop/catalog/category/f21/sweater" 2021-11-10T17:47:38.740Z ERROR: BasicCrawler: handleRequestFunction failed, reclaiming failed request back to the list or queue {"url":"https://www.forever21.com/us/shop/catalog/category/f21/sweater","retryCount":2,"id":"DqNs4qcLsiZLXWf"} 2021-11-10T17:47:38.741Z TypeError: Cannot read property 'indexOf' of null 2021-11-10T17:47:38.741Z at extractSubcatPage (/usr/src/app/src/extractors.js:50:33) 2021-11-10T17:47:38.742Z at CheerioCrawler.handlePageFunction (/usr/src/app/src/main.js:85:52) 2021-11-10T17:47:38.743Z at CheerioCrawler._handleRequestFunction (/usr/src/app/node_modules/apify/build/crawlers/cheerio_crawler.js:434:50) 2021-11-10T17:47:38.744Z at processTicksAndRejections (internal/process/task_queues.js:97:5) 2021-11-10T17:47:38.744Z at async /usr/src/app/node_modules/apify/build/utils.js:411:20 2021-11-10T17:47:39.078Z INFO: Processing: "https://www.forever21.com/us/shop/catalog/category/plus/plus-size-new-arrivals" 2021-11-10T17:47:39.079Z ERROR: BasicCrawler: handleRequestFunction failed, reclaiming failed request back to the list or queue {"url":"https://www.forever21.com/us/shop/catalog/category/plus/plus-size-new-arrivals","retryCount":2,"id":"nIzZcqXT7uXvWjk"} 2021-11-10T17:47:39.080Z TypeError: Cannot read property 'indexOf' of null 2021-11-10T17:47:39.081Z at extractSubcatPage (/usr/src/app/src/extractors.js:50:33) 2021-11-10T17:47:39.082Z at CheerioCrawler.handlePageFunction (/usr/src/app/src/main.js:85:52) 2021-11-10T17:47:39.082Z at CheerioCrawler._handleRequestFunction (/usr/src/app/node_modules/apify/build/crawlers/cheerio_crawler.js:434:50) 2021-11-10T17:47:39.083Z at processTicksAndRejections (internal/process/task_queues.js:97:5) 2021-11-10T17:47:39.084Z at async /usr/src/app/node_modules/apify/build/utils.js:411:20 2021-11-10T17:47:39.272Z INFO: Processing: "https://www.forever21.com/us/shop/catalog/category/f21/outerwear_coats-and-jackets" 2021-11-10T17:47:39.273Z ERROR: BasicCrawler: handleRequestFunction failed, reclaiming failed request back to the list or queue {"url":"https://www.forever21.com/us/shop/catalog/category/f21/outerwear_coats-and-jackets","retryCount":2,"id":"LBOKhmNU204fmPB"} 2021-11-10T17:47:39.273Z TypeError: Cannot read property 'indexOf' of null 2021-11-10T17:47:39.274Z at extractSubcatPage (/usr/src/app/src/extractors.js:50:33) 2021-11-10T17:47:39.274Z at CheerioCrawler.handlePageFunction (/usr/src/app/src/main.js:85:52) 2021-11-10T17:47:39.275Z at CheerioCrawler._handleRequestFunction (/usr/src/app/node_modules/apify/build/crawlers/cheerio_crawler.js:434:50) 2021-11-10T17:47:39.275Z at processTicksAndRejections (internal/process/task_queues.js:97:5) 2021-11-10T17:47:39.276Z at async /usr/src/app/node_modules/apify/build/utils.js:411:20 2021-11-10T17:47:39.762Z INFO: Processing: "https://www.forever21.com/us/shop/catalog/category/f21/sets" 2021-11-10T17:47:39.764Z ERROR: BasicCrawler: handleRequestFunction failed, reclaiming failed request back to the list or queue {"url":"https://www.forever21.com/us/shop/catalog/category/f21/sets","retryCount":2,"id":"oqvTgOTkv9RbTSw"} 2021-11-10T17:47:39.764Z TypeError: Cannot read property 'indexOf' of null 2021-11-10T17:47:39.765Z at extractSubcatPage (/usr/src/app/src/extractors.js:50:33) 2021-11-10T17:47:39.767Z at CheerioCrawler.handlePageFunction (/usr/src/app/src/main.js:85:52) 2021-11-10T17:47:39.767Z at CheerioCrawler._handleRequestFunction (/usr/src/app/node_modules/apify/build/crawlers/cheerio_crawler.js:434:50) 2021-11-10T17:47:39.768Z at runMicrotasks (

User avatar

Hey, I have just checked, it really does seem broken, I will have a look if we can fix it soon.

Developer
Maintained by Community
Actor metrics
  • 1 monthly users
  • 100.0% runs succeeded
  • 0.0 days response time
  • Created in Dec 2019
  • Modified about 13 hours ago