BBB Data Crawler
- epctex/bbb-scraper
- Modified
- Users 169
- Runs 2.2k
- Created by
epctex
Scrape data from the Better Business Bureau as known as BBB. Crawl and extract company information, insights, financial projections, social links, accreditations and much more. Scrape the huge BBB Cloud, retrieve charities and businesses in the United States, Canada, and Mexico by their categories.
To run the code examples, you need to have an Apify account. Replace <YOUR_API_TOKEN> in the code with your API token. For a more detailed explanation, please read about running Actors via the API in Apify Docs.
# Set API token
API_TOKEN=<YOUR_API_TOKEN>
# Prepare Actor input
cat > input.json <<'EOF'
{
"startUrls": [
"https://www.bbb.org/us/ny/new-york/category/home-improvement",
"https://www.bbb.org/us/ny/new-york/categories",
"https://www.bbb.org/us/ny/new-york/profile/home-builders/jf-hughes-builders-inc-0121-87134180",
"https://www.bbb.org/search?find_country=USA&find_entity=66005-000&find_id=1099_2800-400-1100&find_latlng=40.762801%2C-73.977818&find_loc=New%20York%2C%20NY&find_text=Clean%20Up%20Services&find_type=Category&page=1&sort=Relevance"
],
"maxItems": 50,
"endPage": 1,
"extendOutputFunction": "($) => { return {} }",
"proxy": {
"useApifyProxy": true
}
}
EOF
# Run the Actor
curl "https://api.apify.com/v2/acts/epctex~bbb-scraper/runs?token=$API_TOKEN" \
-X POST \
-d @input.json \
-H 'Content-Type: application/json'
