Actor picture

Dun & Bradstreet Scraper

epctex/dnb-scraper

Scrape data from the Dun & Bradstreet commercial database. Crawl and extract company information, insights, financial projections, industry snapshots, and much more. Scrape the huge D&B Data Cloud, Business Directory, articles, companies, and industries by search term.

Free trial for 3 days

Then $25/month

No credit card required now

Author's avatarepctex
  • Modified
  • Users1,167
  • Runs26,580
Actor picture
Dun & Bradstreet Scraper

Free trial for 3 days

Then $25/month

Features

The official Dun and Bradstreet API enables you to get data, but it also enforces quotas and rate limiting. If you need to do more, this unofficial Dun and Bradstreet API will enable you to:

  • Scrape companies: extract data on companies listed in the DnB Business Directory by search term
  • Scrape articles: extract article content on the DnB website by search term
  • Scrape industries: extract industry insights by search term
  • Scrape URLs: scrape data from one or more specific URLs

Why scrape Dun & Bradstreet?

Dun & Bradstreet has been helping its clients and partners grow through the smart use of data and analytics for over 200 years. The company offers a wealth of valuable data and insights.

The Dun & Bradstreet website has a great section of use cases to explain the benefits of using DnB data, covering areas such as:

  • Business due diligence
  • Buyer activity notifications
  • Buyer and influencer mapping
  • Portfolio monitoring
  • Segmentation and prospect identification

Tutorial

The developer of DnB Scraper has created a detailed step-by-step guide to help you scrape Dun & Bradstreet.

If you're new to the world of web scraping, you should check out our Beginner's Guide to Web Scraping.

To learn more about using Apify, read our quick start guide to using any Apify actor.

Tip

DnB has a geo-location based protection system. That's why you should always use US based proxies.

Setup & Usage

You can see how this actor works in this video:

Start URLs

Watch how to set up Start URLs for Dun & Bradstreet Scraper here.

Apify - DnB Scraper - Start URLs

You can check the output of this video here.

Watch how to set up Search for Dun & Bradstreet Scraper here.

Apify - DnB Scraper - Search

You can check the output of this video here.

Cost of usage

The DnB Scraper actor is optimized to run very quickly and scrape items efficiently. Depending on various factors, it should scrape 100 companies in 2 minutes and use approximately 0.07-0.1 compute units, at a cost of about $0.02.

Input parameters

The input for the scraper should be in JSON. The required fields are:

Field Type Description
mode String Mode for the actor. Can be either COMPANIES, ARTICLES or INDUSTRIES. Will work in combination with search parameter.
search String The keyword that you want to search on Dun & Bradstreet with the selected mode.
proxy Object Proxy configuration.
startUrls Array (optional) List of DnB URLs. You should provide only company, article, or industry detail URLs.
maxItems Integer (optional) Maximum number of items that output will contain. Default is Infinite.
extendOutputFunction string (optional) Function that takes a JQuery handle ($) as argument and returns data that will be merged with the default output. More information in Extend output function.

This scraper requires the use of proxy servers, either your own proxy servers or Apify Proxy.

DnB Scraper input example

{
    "mode": "COMPANIES",
    "search": "apple",
    "maxItems": 5
}

During the run

During the run, the actor will output messages letting you know what's going on and which page it's currently scraping.

When items are loaded from the page, you should see a message about this event with a loaded item count.

If you provide incorrect input to the actor, it will immediately stop with a failure state and output an explanation of what went wrong.

DnB Scraper export

During the run, the actor stores results into an Apify dataset. Each item is a separate item in the dataset.

You can manage the results in any language (Python, PHP, Node.js/NPM). See the FAQ or our API reference to learn more about getting results from this Dun & Bradstreet actor.

Output examples

Scraped company result

The structure of each company scraped from DnB looks like this:

{
    "Company Name": "NEXT BYTE PTY LTD",
    "Company Summary": "NEXT BYTE PTY LTD is located in Albion, QUEENSLAND, Australia and is part of the Retail Sector Industry. NEXT BYTE PTY LTD has 1,440 total employees across all of its locations and generates $505.96 million in sales (USD). There are 54 companies in the NEXT BYTE PTY LTD corporate family.\n\nD&B Hoovers provides sales leads and sales intelligence data on over 120 million companies like NEXT BYTE PTY LTD around the world, including contacts, financials, and competitor information. To witness the full depth and breadth of our data and for industry leading sales intelligence tools, take D&B Hoovers for a test drive. Try D&B Hoovers FreeNEXT BYTE PTY LTD is located in Albion, QUEENSLAND, Australia and is part of the Retail Sector Industry. NEXT BYTE PTY LTD has 1,440 total employees across all of its locations and generates $505.96 million in sales (USD). There are 54 companies in the NEXT BYTE PTY LTD corporate family.",
    "Company Type": "Proprietorship",
    "Company Role": "Subsidiary",
    "Website": "http://www.vitagroup.com.au",
    "Location": {
        "Street Address": "Vita Place 77 Hudson Rd",
        "City": "Albion",
        "Region": "QUEENSLAND",
        "Postal Code": "4010",
        "Country": "Australia"
    },
    "Phone": "+61-736246666\n                        \n                                        Call Us\n                                            \n                                            (866) 258-3217",
    "Description": "NEXT BYTE PTY LTD is located in Albion, QUEENSLAND, Australia and is part of the Retail Sector Industry. NEXT BYTE PTY LTD has 1,440 total employees across all of its locations and generates $505.96 million in sales (USD). There are 54 companies in the NEXT BYTE PTY LTD corporate family.",
    "Key Principal": "MAXINE JOAN HORNE",
    "Industry": [
        "Retail Sector",
        "Miscellaneous retail stores, nec",
        "Computer and software stores",
        "Computer related services, nec",
        "Services, nec"
    ],
    "Company Snapshot": {
        "Employees (This Site)": "",
        "Employees (All Sites)": "1,440",
        "Revenue": "505.96",
        "Year Started": "1997",
        "Incorporated": "1997",
        "Fiscal Year End": "JUN",
        "Assets": "",
        "Ticker Symbol": "",
        "Net Income Growth": "",
        "Sales Growth": ""
    },
    "Financial Statements": {
        "Cost Of Revenue": "",
        "Gross Profit": "",
        "Operating Income": "",
        "Income Before Tax": "",
        "Net income": "",
        "Diluted EPS": ""
    },
    "Competitors": [],
    "Principals": [
        {
            "Name": "MAXINE JOAN HORNE",
            "Position": "Director"
        },
        {
            "Name": "GEORGE EDWARD JAMES SOUTHGATE",
            "Position": "Director"
        }
    ],
    "Breadcrumbs": [
        "HOME",
        "BUSINESS DIRECTORY",
        "RETAIL",
        "AUSTRALIA",
        "QUEENSLAND",
        "ALBION"
    ]
}

Scraped DnB article

The structure of each article scraped from DnB looks like this:

{
    "Url": "https://www.dnb.com/perspectives/corporate-compliance/achieve-greater-fatca-and-crs-compliance.html",
    "Title": "Achieve Greater FATCA and CRS Compliance More Efficiently",
    "Breadcrumbs": ["Home", "Perspectives", "Corporate Compliance"],
    "Author": "David Bolner",
    "Date": "May 30, 2017",
    "Related Articles": [
        {
            "Name": "Six Degrees of Separation: Why You Need to Be Smarter with Data",
            "Link": "/perspectives/corporate-compliance/data-connectivity-relationships.html"
        },
        {
            "Name": "A Record Year for FCPA Fines",
            "Link": "/perspectives/corporate-compliance/2020-record-year-fcpa-settlement-amounts.html"
        },
        {
            "Name": "Beneficial Ownership",
            "Link": "/products/corporate-compliance/beneficial-ownership.html"
        },
        {
            "Name": "Direct for Compliance",
            "Link": "/products/corporate-compliance/direct-for-compliance.html"
        },
        {
            "Name": "D&B Compass",
            "Link": "/products/corporate-compliance/dnb-compass.html"
        },
        {
            "Name": "D&B Onboard",
            "Link": "/products/corporate-compliance/dnb-onboard.html"
        },
        {
            "Name": "",
            "Link": "/products.html"
        }
    ],
    "Cover Image": "https://www.dnb.com/content/dam/english/image-library/Modernization/workspaces/FACTA-and-crs-compliance.jpg",
    "Body": "\n\n                            <p>Foreign Account Tax Compliance Act (FATCA) 2016 deadlines may have passed, but financial institutions (FIs) can achieve Common Reporting Standards (CRS) and FATCA compliance more easily in 2017 using data and technology, as well as lessons learned from 2016.<b></b></p>\n<h2>Pre-existing Account Review Process Is People-Intensive</h2>\n<p>FIs were expected to review their pre-existing accounts (a financial account opened prior to July 1, 2014) to document their account holders' FATCA status during 2016. Once the accounts' FATCA statuses are established, FIs would monitor the accounts for any change in circumstances. Many organizations went to great expense and effort to meet this goal with varying results.&nbsp;</p>\n<p></p>"
}

Scraped DnB industry result

The structure of each industry scraped from DnB looks like this:

{
    "SIC Codes": "7359",
    "NAICS Codes": "532420",
    "Related Industries": [
        "Computer Networking Equipment Manufacturing",
        "Commercial & Industrial Equipment Rental & Leasing",
        "Computer & Office Equipment Wholesalers",
        "Computer Manufacturing",
        "Rental & Leasing"
    ],
    "Description": "Companies in this industry lease technology and office equipment for use in business operations. Major companies include CSI Leasing, Electro Rent, Marlin Business Services, and SmartSource Rentals (all based in the US), along with Fuyo General Lease (Japan) and Syscap (the UK). Major manufacturers such as Hewlett Packard, Canon, and Xerox also offer technology leasing services.",
    "Competitive Landscape": "Demand is driven by business activity, especially in industries that rely heavily on technology. The profitability of individual companies depends on the merchandising mix and the cost of financing rental inventory. Large companies have economies of scale in buying equipment and having multiple outlets to lease the equipment. Smaller companies can compete by providing specialty products for local markets and superior customer service. The US industry is concentrated: the top 50 companies account for about 85% of revenue.",
    "Products, Operations & Technology": "Leasing of computers and peripheral equipment accounts for about 50% of industry revenue; leasing of office machinery, furniture, and fixtures accounts for about 30%."
}

Bugs, fixes, updates, and changelog

This scraper is under active development. If you have any feature requests you can create an issue from here.

Industries

See how Dun & Bradstreet Scraper is used in industries around the world