Reddit Scraper avatar
Reddit Scraper
Try for free

1 day trial then $45.00/month - No credit card required now

View all Actors
Reddit Scraper

Reddit Scraper

trudax/reddit-scraper
Try for free

1 day trial then $45.00/month - No credit card required now

Unlimited Reddit web scraper to crawl posts, comments, communities, and users without login. Limit web scraping by number of posts or items and extract all data in a dataset in multiple formats.

Changelog

All notable changes to this project will be documented in this file. See standard-version for commit guidelines.

4.9.8 (2024-06-05)

4.9.7 (2024-05-28)

Bug Fixes

  • 馃悰 error parsing community search url (91e46d9)

4.9.6 (2024-05-20)

4.9.5 (2024-05-20)

Bug Fixes

  • 馃悰 search community by category does not return results (853d7ea)

4.9.4 (2024-05-19)

Bug Fixes

  • 馃悰 not scrapping subreddit (e5cae45)

4.9.3 (2024-05-07)

4.9.2 (2024-05-07)

4.9.1 (2024-05-07)

Bug Fixes

  • 馃悰 search inside subreddit return outside results (6b883a8)

4.9.0 (2024-04-05)

Features

  • 馃幐 save comment postId for tracking nested comments origin (e7b9fcb)

4.8.1 (2024-04-04)

4.8.0 (2024-03-27)

Features

  • 馃幐 add videoURL to post (0dd7d5b)

4.7.0 (2024-02-21)

Features

  • 馃幐 get user id for post and comments (bf3d62f)

4.6.18 (2024-02-21)

4.6.17 (2024-02-21)

4.6.16 (2024-02-21)

4.6.15 (2024-02-21)

4.6.14 (2024-02-21)

4.6.13 (2024-02-21)

4.6.12 (2024-02-18)

4.6.11 (2024-02-18)

4.6.10 (2024-02-18)

Bug Fixes

  • 馃悰 not handling post url query parameters correctly (61dced2)

4.6.9 (2024-02-17)

4.6.8 (2024-02-17)

4.6.7 (2024-02-17)

Bug Fixes

  • 馃悰 error while trying to get comment replies (9cfc513)

4.6.6 (2024-02-17)

4.6.5 (2024-02-17)

4.6.4 (2024-02-17)

4.6.3 (2024-02-17)

4.6.2 (2024-02-17)

4.6.1 (2024-02-11)

4.6.0 (2024-02-11)

Features

  • 馃幐 improve blocked session handling (a75b5ad)

4.5.12 (2024-02-10)

Bug Fixes

  • 馃悰 not getting all comments (6fd69ed)

4.5.11 (2024-02-10)

4.5.10 (2024-02-10)

4.5.9 (2024-02-08)

4.5.8 (2024-02-08)

4.5.7 (2024-02-08)

4.5.6 (2024-01-04)

4.5.5 (2024-01-04)

4.5.4 (2024-01-04)

Bug Fixes

  • missing documentation about lite version (6bc904d)

4.5.3 (2023-12-23)

4.5.2 (2023-12-14)

4.5.1 (2023-12-14)

4.5.0 (2023-12-14)

4.4.0 (2023-12-14)

4.3.1 (2023-12-13)

4.3.0 (2023-12-12)

4.3.0-beta.1 (2023-12-12)

4.3.0-beta.0 (2023-12-12)

Features

  • 馃幐 include NSFW filter to any url (0a72764)

4.2.1 (2023-12-11)

4.2.0 (2023-11-12)

4.1.0 (2023-11-10)

4.0.9 (2023-10-09)

4.0.8 (2023-10-07)

4.0.7 (2023-08-01)

4.0.6 (2023-07-28)

4.0.5 (2023-07-17)

4.0.4 (2023-07-17)

4.0.3 (2023-07-14)

4.0.1 (2023-07-14)

4.0.1 (2023-07-14)

Bug Fixes

  • 馃悰 search for comments not working (#100) (4280aea)

4.0.1 (2023-07-13)

4.0.0 (2023-06-26)

3.5.1 (2023-06-19)

3.5.0 (2023-06-02)

3.4.13 (2023-05-29)

3.4.12 (2023-05-26)

Bug Fixes

  • 馃悰 error scrapping community (813f992)

3.4.11 (2023-05-25)

3.4.10 (2023-05-18)

3.4.9 (2023-05-18)

3.4.8 (2023-05-18)

3.4.7 (2023-05-18)

3.4.6 (2023-05-18)

3.4.5 (2023-05-18)

3.4.4 (2023-05-18)

3.4.3 (2023-05-09)

3.4.2 (2023-05-09)

3.4.1 (2023-04-21)

3.4.0 (2023-04-13)

3.3.0 (2023-04-10)

3.2.0 (2023-01-27)

Features

  • 馃幐 enable r/popular parsing (c2128fc)

3.1.2 (2022-10-19)

Bug Fixes

  • 馃悰 scrapping less then the maxItems limit (1cc7125)

3.1.1 (2022-10-19)

3.1.0 (2022-10-19)

3.0.9 (2022-10-17)

Bug Fixes

  • 馃悰 treat scrollTimeout value bigget than 32 bit number (0e50923)

3.0.8 (2022-10-13)

3.0.7 (2022-08-24)

Bug Fixes

  • 馃悰 Docker image error (3b60421)

3.0.6 (2022-08-24)

Bug Fixes

  • 馃悰 search is not returning posts (07c3379)

3.0.5 (2022-08-21)

3.0.4 (2022-08-18)

Bug Fixes

  • 馃悰 error while scraping comments (8910242)

3.0.3 (2022-08-18)

3.0.2 (2022-08-18)

3.0.1 (2022-08-18)

3.0.0 (2022-08-18)

Bug Fixes

Features

2.2.3 (2022-07-05)

Bug Fixes

  • 馃悰 broken css selectors for url (fe18b95)

  • cannot scrape comments (5f03e7e)

  • community members count throws error (d784733)

  • community posts are not being scraped (5cc553c)

  • getUrlType no working for POST and COMMENT (95d339d)

  • 馃 disable routes that are not working (c06000d)

2.2.2 (2022-06-09)

2.2.1 (2022-05-16)

2.2.0 (2022-04-11)

Features

  • 馃幐 notify when page requests login (b1a49bd)

2.1.3 (2022-03-15)

2.1.2 (2022-03-15)

2.1.1 (2022-03-08)

2.1.0 (2022-02-23)

Features

  • 馃幐 add support for content gate on communities (f761cc0)

2.0.4 (2022-02-22)

Bug Fixes

  • 馃悰 remove maximum parameter from INPUT_SCHEMA (4bc789b)

2.0.3 (2022-02-22)

Bug Fixes

  • 馃悰 scrapping posts in a search returned an error (bf83b9c)

2.0.2 (2022-02-17)

2.0.1 (2022-02-17)

2.0.0 (2022-02-17)

鈿 BREAKING CHANGES

  • All post and comments are saved as a separated JSON file instead of be inside the community or post they are from.

Bug Fixes

1.2.3 (2022-01-27)

Features

  • 馃幐 get community category when scraping category topic (#48) (bba616b)
  • 馃幐 scrape user and communities trophies (#62) (fbbca1b)
  • 馃幐 use crawler.autoscalePool.abort() (91289ed)

Bug Fixes

  • 馃悰 different types of url inputs (#45) (f93f954)
  • 馃悰 empty comments (#44) (895b33b)
  • 馃悰 humanized date convertion (#52) (68e8da3)
  • 馃悰 parse comment votes (#53) (da0de4c)
  • 馃悰 proxy validation (#50) (386a884)
  • 馃悰 relative date convertion (#49) (7fdef07)
  • 馃悰 remove unused field from communityParser (96de7f7)
  • 馃悰 return total members count (#43) (00a7d7e)
  • 馃悰 save username as user (1223d4a)
  • 馃悰 toogle search if no startUrls are provided (#36) (90b4c83)
  • 馃悰 update comment description selector (b52baf5)

1.2.2 (2021-03-02)

Bug Fixes

  • 馃悰 toogle search if no startUrls are provided (#36) (90b4c83)

1.2.1 (2021-02-26)

鈿 BREAKING CHANGES

  • 馃Ж Change the startUrl input format

Features

Bug Fixes

  • 馃悰 missing INPUT_SCHEMA fields (7fbfcbe)

  • 馃 use requestList editor on input schema (#28) (955641d)

Changelog

All notable changes to this project will be documented in this file. See standard-version for commit guidelines.

Developer
Maintained by Community
Actor metrics
  • 302 monthly users
  • 4 stars
  • 100.0% runs succeeded
  • 12 hours response time
  • Created in Feb 2022
  • Modified 11 days ago
Categories