Actor picture

Dun & Bradstreet Scraper

tugkan/dnb-scraper

Scrape data from the Dun & Bradstreet commercial database. Crawl and extract company information, insights, financial projections, industry snapshots, and much more. Scrape the huge D&B Data Cloud, Business Directory, articles, companies, and industries by search term.

Free trial for 7 days

Then $10/month

No credit card required now

Author's avatarTuğkan Cengiz
  • Modified
  • Users73
  • Runs7,281
Actor picture

Dun & Bradstreet Scraper

Free trial for 7 days

Then $10/month

Dun & Bradstreet scraper

Since DnB doesn't provide a good API, this actor should help you to retrieve data from it.

The DnB data scraper supports the following features:

  • Scrape companies - You can scrape the companies from website with a search term.
  • Scrape articles - You can scrape all the articles via providing a search term.
  • Scrape industries - Retrieve the industry insights by search term
  • Scrape individual URLs - You can scrape any of the individual URLs that you'd like to get.

Bugs, fixes, updates and changelog

This scraper is under active development. If you have any feature requests you can create an issue from here.

Input Parameters

The input of this scraper should be JSON containing. Required fields are:

Field Type Description
mode String Mode for the actor. It can be either COMPANIES, ARTICLES or INDUSTRIES. It will work with the combination of search parameter.
search String The keyword that you want to search on Dun & Bradstreet with the given mode.
proxy Object Proxy configuration
startUrls Array (optional) List of DnB URLs. You should provide only company, article or industry detail URLs
maxItems Integer (optional) Maximum number of items that output will contain. Default is Infinite
extendOutputFunction string (optional) Function that takes a JQuery handle ($) as argument and returns data that will be merged with the default output. More information in Extend output function

This solution requires the use of Proxy servers, either your own proxy servers or you can use Apify Proxy.

Compute Unit Consumption

The actor optimized to run in a very fast manner and scrape the items in the most performant way. Therefore, it forefronts all object result requests. If actor doesn't block very often it'll scrape 100 companies in 2 minutes with ~0.07-0.1 compute units.

DnB Scraper Input example

{
  "mode": "COMPANIES",
  "search": "apple",
  "maxItems": 5
}

During the Run

During the run, the actor will output messages letting you know what is going on and which page it is scraping at that moment. When items are loaded from the page, you should see a message about this event with a loaded item count.

If you provide incorrect input to the actor, it will immediately stop with failure state and output an explanation of what is wrong.

DnB Export

During the run, the actor stores results into a dataset. Each item is a separate item in the dataset.

You can manage the results in any languague (Python, PHP, Node JS/NPM). See the FAQ or our API reference to learn more about getting results from this Dun & Bradstreet actor.

Scraped DnB Company

The structure of each companies in DnB looks like this:

{
  "Company Name": "NEXT BYTE PTY LTD",
  "Company Summary": "NEXT BYTE PTY LTD is located in Albion, QUEENSLAND, Australia and is part of the Retail Sector Industry. NEXT BYTE PTY LTD has 1,440 total employees across all of its locations and generates $505.96 million in sales (USD). There are 54 companies in the NEXT BYTE PTY LTD corporate family.\n\nD&B Hoovers provides sales leads and sales intelligence data on over 120 million companies like NEXT BYTE PTY LTD around the world, including contacts, financials, and competitor information. To witness the full depth and breadth of our data and for industry leading sales intelligence tools, take D&B Hoovers for a test drive. Try D&B Hoovers FreeNEXT BYTE PTY LTD is located in Albion, QUEENSLAND, Australia and is part of the Retail Sector Industry. NEXT BYTE PTY LTD has 1,440 total employees across all of its locations and generates $505.96 million in sales (USD). There are 54 companies in the NEXT BYTE PTY LTD corporate family.",
  "Company Type": "Proprietorship",
  "Company Role": "Subsidiary",
  "Website": "http://www.vitagroup.com.au",
  "Location": {
    "Street Address": "Vita Place 77 Hudson Rd",
    "City": "Albion",
    "Region": "QUEENSLAND",
    "Postal Code": "4010",
    "Country": "Australia"
  },
  "Phone": "+61-736246666\n                        \n                                        Call Us\n                                            \n                                            (866) 258-3217",
  "Description": "NEXT BYTE PTY LTD is located in Albion, QUEENSLAND, Australia and is part of the Retail Sector Industry. NEXT BYTE PTY LTD has 1,440 total employees across all of its locations and generates $505.96 million in sales (USD). There are 54 companies in the NEXT BYTE PTY LTD corporate family.",
  "Key Principal": "MAXINE JOAN HORNE",
  "Industry": [
    "Retail Sector",
    "Miscellaneous retail stores, nec",
    "Computer and software stores",
    "Computer related services, nec",
    "Services, nec"
  ],
  "Company Snapshot": {
    "Employees (This Site)": "",
    "Employees (All Sites)": "1,440",
    "Revenue": "505.96",
    "Year Started": "1997",
    "Incorporated": "1997",
    "Fiscal Year End": "JUN",
    "Assets": "",
    "Ticker Symbol": "",
    "Net Income Growth": "",
    "Sales Growth": ""
  },
  "Financial Statements": {
    "Cost Of Revenue": "",
    "Gross Profit": "",
    "Operating Income": "",
    "Income Before Tax": "",
    "Net income": "",
    "Diluted EPS": ""
  },
  "Competitors": [],
  "Principals": [
    {
      "Name": "MAXINE JOAN HORNE",
      "Position": "Director"
    },
    {
      "Name": "GEORGE EDWARD JAMES SOUTHGATE",
      "Position": "Director"
    }
  ],
  "Breadcrumbs": [
    "HOME",
    "BUSINESS DIRECTORY",
    "RETAIL",
    "AUSTRALIA",
    "QUEENSLAND",
    "ALBION"
  ]
}

Scraped DnB Article

The structure of each companies in DnB looks like this:

{
  "Url": "https://www.dnb.com/perspectives/corporate-compliance/achieve-greater-fatca-and-crs-compliance.html",
  "Title": "Achieve Greater FATCA and CRS Compliance More Efficiently",
  "Breadcrumbs": [
    "Home",
    "Perspectives",
    "Corporate Compliance"
  ],
  "Author": "David Bolner",
  "Date": "May 30, 2017",
  "Related Articles": [
    {
      "Name": "Six Degrees of Separation: Why You Need to Be Smarter with Data",
      "Link": "/perspectives/corporate-compliance/data-connectivity-relationships.html"
    },
    {
      "Name": "A Record Year for FCPA Fines",
      "Link": "/perspectives/corporate-compliance/2020-record-year-fcpa-settlement-amounts.html"
    },
    {
      "Name": "Beneficial Ownership",
      "Link": "/products/corporate-compliance/beneficial-ownership.html"
    },
    {
      "Name": "Direct for Compliance",
      "Link": "/products/corporate-compliance/direct-for-compliance.html"
    },
    {
      "Name": "D&B Compass",
      "Link": "/products/corporate-compliance/dnb-compass.html"
    },
    {
      "Name": "D&B Onboard",
      "Link": "/products/corporate-compliance/dnb-onboard.html"
    },
    {
      "Name": "",
      "Link": "/products.html"
    }
  ],
  "Cover Image": "https://www.dnb.com/content/dam/english/image-library/Modernization/workspaces/FACTA-and-crs-compliance.jpg",
  "Body": "\n\n                            <p>Foreign Account Tax Compliance Act (FATCA) 2016 deadlines may have passed, but financial institutions (FIs) can achieve Common Reporting Standards (CRS) and FATCA compliance more easily in 2017 using data and technology, as well as lessons learned from 2016.<b></b></p>\n<h2>Pre-existing Account Review Process Is People-Intensive</h2>\n<p>FIs were expected to review their pre-existing accounts (a financial account opened prior to July 1, 2014) to document their account holders’ FATCA status during 2016. Once the accounts’ FATCA statuses are established, FIs would monitor the accounts for any change in circumstances. Many organizations went to great expense and effort to meet this goal with varying results.&nbsp;</p>\n<p></p>"
}

Scraped DnB Industry

The structure of each companies in DnB looks like this:

{
  "SIC Codes": "7359",
  "NAICS Codes": "532420",
  "Related Industries": [
    "Computer Networking Equipment Manufacturing",
    "Commercial & Industrial Equipment Rental & Leasing",
    "Computer & Office Equipment Wholesalers",
    "Computer Manufacturing",
    "Rental & Leasing"
  ],
  "Description": "Companies in this industry lease technology and office equipment for use in business operations. Major companies include CSI Leasing, Electro Rent, Marlin Business Services, and SmartSource Rentals (all based in the US), along with Fuyo General Lease (Japan) and Syscap (the UK). Major manufacturers such as Hewlett Packard, Canon, and Xerox also offer technology leasing services.",
  "Competitive Landscape": "Demand is driven by business activity, especially in industries that rely heavily on technology. The profitability of individual companies depends on the merchandising mix and the cost of financing rental inventory. Large companies have economies of scale in buying equipment and having multiple outlets to lease the equipment. Smaller companies can compete by providing specialty products for local markets and superior customer service. The US industry is concentrated: the top 50 companies account for about 85% of revenue.",
  "Products, Operations & Technology": "Leasing of computers and peripheral equipment accounts for about 50% of industry revenue; leasing of office machinery, furniture, and fixtures accounts for about 30%."
}