Capterra Scraper

Features

Capterra doesn't provide a very flexible or free API, but this scraper acts as an unofficial Capterra API to help you extract the data you need, when you need it, and at scale.

Capterra Scraper supports the following features:

• Scrape lists

• Scrape resources

• Scrape categories

• Scrape products

• Scrape reviews

• Scrape services

Capterra provides "Best business software. With software reviews, rating infographics, and the most comprehensive list of the top". Scraping that content and extracting it in a structured format could give you invaluable business insights and an edge over the competition.

Tutorial

Check out this blog post on how to extract data from Capterra with unofficial Capterra API for more information on the scraper.

Bugs, fixes, updates, and changelog

This scraper is under active development. If you have any feature requests, you can create an issue from here.

Upcoming changes

• Retrieve comparisons.
• Enrich reviews and output of the products.

Input parameters

The input of this scraper should be JSON containing the list of pages o that should be visited. Possible fields are:

• startUrls: (Required) (Array) List of Capterra URLs. You should only provide list or detail URLs.

• includeReviews: (Optional) (Boolean) Adding reviews into the product objects is optional and by default, it is false. If you want to scrape the reviews of the companies, then you can set this option as true.

• endPage: (Optional) (Number) Final number of page that you want to scrape. The default is Infinite. This applies to all startUrls individually.

• maxItems: (Optional) (Number) You can limit scraped products. This should be useful when you search big lists.

• proxy: (Required) (Proxy Object) Proxy configuration.

• customMapFunction: (Optional) (String) Function that takes each object's handle as an argument and returns the object with executing the function.

This solution requires the use of proxy servers, either your own proxy servers or Apify Proxy.

Tips

When you want to scrape over a specific listing URL, just copy and paste the link as one of the startURL.

If you would like to scrape only the first page of a list, then add the link for the page and have the endPage as 1.

Please also keep in mind that the includeReviews parameter will add multiple requests per product. That's why the number of requests or CUs that are consumed might be higher if you set this option as true.

Compute unit consumption

Capterra Scraper is optimized to run extremely fast and scrape many listings as possible, so it forefronts all listing detail requests. If the actor doesn't get blocked very often, it will scrape 100 listings in 2 minutes and consume ~0.07-0.08 compute units.

Capterra Scraper input example

1{
2    "startUrls": [
3        "https://www.capterra.com/p/210664/CRYENGINE/",
4        "https://www.capterra.com/services/sp/178/accenture/",
5        "https://www.capterra.com/services/data-analytics/",
6        "https://www.capterra.com/business-intelligence-software/"
7    ],
8    "includeReviews": false,
9    "proxy": {
10        "useApifyProxy": true
11    },
12    "maxItems": 50
13}

During the run

During the run, the actor will output messages letting you know what is going on. Each message always contains a short label specifying which page from the provided list is currently specified.

When items are loaded from the page, you should see a message about this event with a loaded item count and total item count for each page.

If you provide incorrect input to the actor, it will immediately stop with a failure state and output an explanation of what is wrong.

Capterra export

During the run, the actor stores results into a dataset. Each item is a separate item in the dataset.

You can manage the results in any language (Python, PHP, Node.js/NPM). See the FAQ or our API reference to learn more about getting results from this Capterra actor.

Scraped Capterra Product example

The structure of each item in Capterra product looks like this:

1{
2	"productId": 207087,
3	"name": "Despatch Cloud",
4	"productUrl": "/p/207087/Desaptch-Cloud",
5	"slug": "Desaptch-Cloud",
6	"url": "https://despatchcloud.com",
7	"logoUrl": "https://gdm-catalog-fmapi-prod.imgix.net/ProductLogo/76422c6f-e87c-4d80-b2df-68d23a512681.png",
8	"isUpgraded": false,
9	"overallRating": 4.8,
10	"easeOfUseRating": 4.9,
11	"customerServiceRating": 4.6,
12	"functionalityRating": 4.7,
13	"valueForMoneyRating": 4.9,
14	"recommendationRating": 100,
15	"bestFor": "E-commerce Retailers, Subscription Businesses, High Growth Digital Startups, 3PL & Fulfilment Centres, Couriers and Courier Resellers, Software (SaaS) Providers",
16	"longDescription": "From order management and fulfilment, to shipping and stock control, we provide you with award winning software to simplify and streamline your operation using powerful automation technology.\n\nWith over 110+ couriers, and 50+ channels and marketplaces, Despatch Cloud helps your business grow through one simple connection with limitless possibilities. \n\nBuilt by e-Commerce experts, and the best developers in the market, we have solutions to fit all sizes of business.",
17	"pricingDetails": null,
18	"features": [
19		"Customizable Templates",
20		"Data Import/Export",
21		"Third Party Integrations",
22		"Order Tracking",
23		"eCommerce Management",
24		"Order Fulfillment",
25		"Real Time Reporting",
26		"Shipping Labels",
27		"Barcode/Ticket Scanning",
28		"Inventory Optimization",
29		"Warehouse Management",
30		"Inventory Management",
31		"Activity Dashboard",
32		"Supplier Management",
33		"API",
34		"Forecasting",
35		"Reporting/Analytics",
36		"Multi-Channel Management",
37		"Multi-Location",
38		"Real Time Data",
39		"Shipping Management",
40		"Returns Management"
41	],
42	"relatedProducts": [],
43	"media": [],
44	"category": {
45		"id": "9556b0c2-054a-4fde-8c30-70ce276e32b7",
46		"shortName": "orderman",
47		"longName": "Order Management",
48		"htmlName": "order-management-software"
49	},
50	"bestCategoryShortName": "orderman",
51	"bestCategory": "order-management-software",
52	"vendor": {
53		"id": 2148538,
54		"name": "Despatch Cloud",
55		"url": "https://despatchcloud.com",
56		"location": "UNITED KINGDOM OF GREAT BRITAIN AND NORTHERN IRELAND"
57	},
58	"showUpgraded": false,
59	"internationalProduct": {
60		"usProductId": 207087,
61		"productId": 207087,
62		"slug": "Desaptch-Cloud"
63	},
64	"reviewCount": 8,
65	"countryCode": "US",
66	"reviewUrl": "https://reviews.capterra.com/products/new/674f3956-fb78-4914-8cb1-1fe6b50693d4",
67	"reviews": [
68		{
69			"reviewId": "4965905",
70			"title": "Fantastic company to deal with!",
71			"writtenOn": "August 9, 2023",
72			"generalComments": "",
73			"incentivized": "NoIncentive",
74			"customerSupportRating": "5.0",
75			"easeOfUseRating": "5.0",
76			"functionalityRating": "5.0",
77			"valueForMoneyRating": "5.0",
78			"overallRating": "5.0",
79			"recommendationRating": "10.0",
80			"consText": "There was a few issues with the onboarding early on. We were able to speak to a manager, voice our concerns and a solution was found quickly, if anything a positive. ",
81			"prosText": "$1f",
82			"sourceSite": "Capterra",
83			"globalReviewId": "Capterra___4965905",
84			"anonymityOn": false,
85			"completenessScore": 1.25,
86			"adviceToOthers": null,
87			"chosenReasons": null,
88			"switchingReasons": "Cloud commerce pro were an awful company to deal with. Never ending bugs with their software, the customer support was atrocious. The management didn't care about your problems are were quick to point out how all providers experience the same issues. They spent far too much time talking instead of actually listening to the real issues and looking to resolve them. ",
89			"reviewSource": {
90				"code": "NO",
91				"tooltip": "No Incentive Offered: This review was submitted organically."
92			},
93			"reviewer": {
94				"companySize": "11-50 employees",
95				"industry": "Retail",
96				"timeUsedProduct": "6-12 months",
97				"fullName": "Freddie A.",
98				"jobTitle": "Managing Director",
99				"verifiedLinkedIn": false,
100				"profilePicUrl": null
101			},
102			"alternativeProducts": [],
103			"switchedProducts": [
104				{
105					"productId": "161987",
106					"productSlug": "Cloud-Commerce-Pro",
107					"productName": "Cloud Commerce Pro"
108				}
109			],
110			"vendorResponse": {}
111		},
112		{
113			"reviewId": "5003502",
114			"title": "Streamlining our eCommerce",
115			"writtenOn": "August 31, 2023",
116			"generalComments": "DC has made it easier and easier for us to process our ecom orders all the way through our company. We can follow every aspect of the order throughout our warehouse to know exactly what happened by who and what time with ease, so problem solving has become a very simple part of our day to day.",
117			"incentivized": "VendorReferredIncentivized",
118			"customerSupportRating": "5.0",
119			"easeOfUseRating": "5.0",
120			"functionalityRating": "5.0",
121			"valueForMoneyRating": "5.0",
122			"overallRating": "5.0",
123			"recommendationRating": "8.0",
124			"consText": "In our current system, I would look to integrate dimensional scales so that the packer could put their parcel onto the scales and DC would get exact measurements to pass onto the couriers.",
125			"prosText": "Setting up the shipping rules and changing to new couriers has never been easier",
126			"sourceSite": "Capterra",
127			"globalReviewId": "Capterra___5003502",
128			"anonymityOn": false,
129			"completenessScore": 1.24,
130			"adviceToOthers": null,
131			"chosenReasons": null,
132			"switchingReasons": "Linnworks raised their prices so we looked for alternatives and with Despatch Cloud being based so close we very quickly gained a close relationship with them.",
133			"reviewSource": {
134				"code": "VRI",
135				"tooltip": "Vendor Referred - Incentive Offered: This reviewer was invited by the software vendor to submit an honest review and offered a nominal incentive as a thank you."
136			},
137			"reviewer": {
138				"companySize": "201-500 employees",
139				"industry": "Retail",
140				"timeUsedProduct": "2+ years",
141				"fullName": "Nathan C.",
142				"jobTitle": "IT Manager",
143				"verifiedLinkedIn": false,
144				"profilePicUrl": null
145			},
146			"alternativeProducts": [],
147			"switchedProducts": [
148				{
149					"productId": "116088",
150					"productSlug": "Linnworks",
151					"productName": "Linnworks"
152				}
153			],
154			"vendorResponse": {}
155		},
156		{
157			"reviewId": "5002612",
158			"title": "Despatch Cloud for Rydale",
159			"writtenOn": "August 30, 2023",
160			"generalComments": null,
161			"incentivized": "VendorReferredIncentivized",
162			"customerSupportRating": "0.0",
163			"easeOfUseRating": "5.0",
164			"functionalityRating": "4.0",
165			"valueForMoneyRating": "0.0",
166			"overallRating": "4.0",
167			"recommendationRating": "8.0",
168			"consText": " The occasional frustrating bug can be a pain.",
169			"prosText": "We were able to arrange custom features with them to work better with our pre-existing systems.",
170			"sourceSite": "Capterra",
171			"globalReviewId": "Capterra___5002612",
172			"anonymityOn": false,
173			"completenessScore": 1.23,
174			"adviceToOthers": null,
175			"chosenReasons": null,
176			"switchingReasons": null,
177			"reviewSource": "$20",
178			"reviewer": {
179				"companySize": "201-500 employees",
180				"industry": "Retail",
181				"timeUsedProduct": "2+ years",
182				"fullName": "Alex M.",
183				"jobTitle": "Ecommerce Manager",
184				"verifiedLinkedIn": false,
185				"profilePicUrl": null
186			},
187			"alternativeProducts": [],
188			"switchedProducts": [
189				{
190					"productId": "116088",
191					"productSlug": "Linnworks",
192					"productName": "Linnworks"
193				}
194			],
195			"vendorResponse": {}
196		},
197		{
198			"reviewId": "4974194",
199			"title": "Simply the best APIs on the planet",
200			"writtenOn": "August 14, 2023",
201			"generalComments": "I have full visibility of my data, complete control over my work flows and I like that I don't need to contact them to make simple changes which i love. ",
202			"incentivized": "VendorReferredIncentivized",
203			"customerSupportRating": "4.0",
204			"easeOfUseRating": "5.0",
205			"functionalityRating": "5.0",
206			"valueForMoneyRating": "5.0",
207			"overallRating": "5.0",
208			"recommendationRating": "10.0",
209			"consText": "Support is sometimes slow to react but when they do they understand what I want and I get a response from the expert team and this has been getting better and better recently. ",
210			"prosText": "The APIs of Channels, Shipping and Billing are fast, configurable and ever evolving. Unlike the competition you can self serve and do things really quickly, access relevant logs and make changed on the fly. When it comes to the APIs I never need to contact DC.",
211			"sourceSite": "Capterra",
212			"globalReviewId": "Capterra___4974194",
213			"anonymityOn": false,
214			"completenessScore": 1.22,
215			"adviceToOthers": null,
216			"chosenReasons": "I bought into the ease of use and the competitive pricing. Also they have a very easy to understand API",
217			"switchingReasons": null,
218			"reviewSource": "$20",
219			"reviewer": {
220				"companySize": "Self-employed",
221				"industry": "Computer Software",
222				"timeUsedProduct": "6-12 months",
223				"fullName": "Ross J.",
224				"jobTitle": "Chief Technology Officer",
225				"verifiedLinkedIn": false,
226				"profilePicUrl": null
227			},
228			"alternativeProducts": [
229				{
230					"productId": "146518",
231					"productSlug": "Scurri",
232					"productName": "Scurri"
233				},
234				{
235					"productId": "84070",
236					"productSlug": "MetaPack-Delivery-Manager",
237					"productName": "Metapack"
238				},
239				{
240					"productId": "187753",
241					"productSlug": "SortedPRO",
242					"productName": "Sorted"
243				}
244			],
245			"switchedProducts": [],
246			"vendorResponse": {}
247		},
248		{
249			"reviewId": "4974215",
250			"title": "Fantastic product for a courier business",
251			"writtenOn": "August 14, 2023",
252			"generalComments": "It gives me access to lots of channels and they are always adding more and also over 100 couriers that I can self manage. ",
253			"incentivized": "VendorReferredIncentivized",
254			"customerSupportRating": "5.0",
255			"easeOfUseRating": "5.0",
256			"functionalityRating": "5.0",
257			"valueForMoneyRating": "5.0",
258			"overallRating": "5.0",
259			"recommendationRating": "10.0",
260			"consText": "The channels api was a lot trickier to setup than the shipping api which was really easy. If they could make that easier to understand it would make it more accessible but its a very powerful API. ",
261			"prosText": "Despatch Cloud gives me the ability to add many channels and couriers around my own piece of software giving me a huge advantage against my competitors.",
262			"sourceSite": "Capterra",
263			"globalReviewId": "Capterra___4974215",
264			"anonymityOn": false,
265			"completenessScore": 1.21,
266			"adviceToOthers": null,
267			"chosenReasons": null,
268			"switchingReasons": "Wanted more channels and a UK company to work with. ",
269			"reviewSource": "$20",
270			"reviewer": {
271				"companySize": "1-10 employees",
272				"industry": "Transportation/Trucking/Railroad",
273				"timeUsedProduct": "6-12 months",
274				"fullName": "Cosmin G.",
275				"jobTitle": "Director",
276				"verifiedLinkedIn": false,
277				"profilePicUrl": null
278			},
279			"alternativeProducts": [],
280			"switchedProducts": [
281				{
282					"productId": "239302",
283					"productSlug": "API2Cart",
284					"productName": "API2Cart"
285				}
286			],
287			"vendorResponse": {}
288		},
289		{
290			"reviewId": "4994801",
291			"title": "A Well-Rounded Logistics Solution",
292			"writtenOn": "August 25, 2023",
293			"generalComments": " I've been utilizing Despatch Cloud for a while now, and it's been a valuable addition to my business operations. The platform offers a comprehensive package of services that have streamlined my workflows and enhanced my control over data.",
294			"incentivized": "VendorReferredIncentivized",
295			"customerSupportRating": "4.0",
296			"easeOfUseRating": "5.0",
297			"functionalityRating": "4.0",
298			"valueForMoneyRating": "5.0",
299			"overallRating": "5.0",
300			"recommendationRating": "8.0",
301			"consText": "There have been moments when the support response time has been a bit sluggish. However, it's worth noting that there has been noticeable improvement in this aspect recently. While delays can be frustrating, the silver lining is that the support team does comprehend the issues well and provides meaningful assistance.",
302			"prosText": "One of the standout features is the impressive range of APIs, particularly for Channels, Shipping, and Billing. These APIs are not only speedy but also highly customizable, adapting to my unique requirements. What I find truly beneficial is the self-serve capability. Unlike other platforms, I can easily access pertinent logs and swiftly implement changes without relying on constant support assistance. This independence has saved me time and effort.",
303			"sourceSite": "Capterra",
304			"globalReviewId": "Capterra___4994801",
305			"anonymityOn": false,
306			"completenessScore": 1.2,
307			"adviceToOthers": null,
308			"chosenReasons": null,
309			"switchingReasons": null,
310			"reviewSource": "$20",
311			"reviewer": {
312				"companySize": "Self-employed",
313				"industry": "Computer Software",
314				"timeUsedProduct": "1-2 years",
315				"fullName": "Chris T.",
316				"jobTitle": "Frontend Developer",
317				"verifiedLinkedIn": false,
318				"profilePicUrl": null
319			},
320			"alternativeProducts": [],
321			"switchedProducts": [],
322			"vendorResponse": {}
323		},
324		{
325			"reviewId": "4991534",
326			"title": "Great WMS",
327			"writtenOn": "August 23, 2023",
328			"generalComments": "Excellent! ",
329			"incentivized": "NominalGift",
330			"customerSupportRating": "5.0",
331			"easeOfUseRating": "5.0",
332			"functionalityRating": "5.0",
333			"valueForMoneyRating": "5.0",
334			"overallRating": "5.0",
335			"recommendationRating": "10.0",
336			"consText": "Sometimes hard to contact for updates.  ",
337			"prosText": "Easy to use, great system. Always updated for new shipping partners and selling platforms. API always the latest versions. ",
338			"sourceSite": "Capterra",
339			"globalReviewId": "Capterra___4991534",
340			"anonymityOn": false,
341			"completenessScore": 1.19,
342			"adviceToOthers": null,
343			"chosenReasons": "Personal recommendation",
344			"switchingReasons": "Personal recommendation",
345			"reviewSource": {
346				"code": "NGC",
347				"tooltip": "Nominal Gift Card: This reviewer was invited by us to submit an honest review and was offered a nominal incentive as a thank you."
348			},
349			"reviewer": {
350				"companySize": "11-50 employees",
351				"industry": "Logistics and Supply Chain",
352				"timeUsedProduct": "6-12 months",
353				"fullName": "Nick S.",
354				"jobTitle": "Director ",
355				"verifiedLinkedIn": false,
356				"profilePicUrl": null
357			},
358			"alternativeProducts": [],
359			"switchedProducts": [
360				{
361					"productId": "236970",
362					"productSlug": "Access-Mintsoft",
363					"productName": "Access Mintsoft"
364				}
365			],
366			"vendorResponse": {}
367		},
368		{
369			"reviewId": "4992586",
370			"title": "Solid Solution ",
371			"writtenOn": "August 24, 2023",
372			"generalComments": "Proactive company who are revolutionary in what they offer.",
373			"incentivized": "NominalGift",
374			"customerSupportRating": "4.0",
375			"easeOfUseRating": "4.0",
376			"functionalityRating": "4.0",
377			"valueForMoneyRating": "4.0",
378			"overallRating": "4.0",
379			"recommendationRating": "8.0",
380			"consText": "Tricky to set up to start with unless you have experience.",
381			"prosText": "Ease of use and simplicity. Plenty of carriers to choose from ",
382			"sourceSite": "Capterra",
383			"globalReviewId": "Capterra___4992586",
384			"anonymityOn": false,
385			"completenessScore": 1.18,
386			"adviceToOthers": null,
387			"chosenReasons": null,
388			"switchingReasons": null,
389			"reviewSource": "$21",
390			"reviewer": {
391				"companySize": "Self-employed",
392				"industry": "Import and Export",
393				"timeUsedProduct": "6-12 months",
394				"fullName": "Russell S.",
395				"jobTitle": "Owner ",
396				"verifiedLinkedIn": false,
397				"profilePicUrl": null
398			},
399			"alternativeProducts": [],
400			"switchedProducts": [],
401			"vendorResponse": {}
402		}
403	]
404}

Scraped Capterra Single Review example

The structure of each reviews (single review) in Capterra looks like this:

1{
2	"reviewId": "3748991",
3	"title": "Useful tool but could be better",
4	"writtenOn": "August 11, 2022",
5	"generalComments": "A really useful tool, but has some kinks that need ironing out.",
6	"incentivized": "NominalGift",
7	"customerSupportRating": "0.0",
8	"easeOfUseRating": "3.0",
9	"functionalityRating": "3.0",
10	"valueForMoneyRating": "0.0",
11	"overallRating": "3.0",
12	"recommendationRating": "6.0",
13	"consText": "The notifications come through to your e-mail inbox quite a long time after comments were made. The latest update, despite making copying comments easier, isn't as straight forward as the old drag and drop interface.",
14	"prosText": "I really like that you can easily comment on a video project, graphic, written piece of work and pin point exactly where you need the changes, the user interface is relatively user friendly, however, I probably preferred it before the latest update.",
15	"sourceSite": "Capterra",
16	"globalReviewId": "Capterra___3748991",
17	"anonymityOn": false,
18	"completenessScore": 1.23,
19	"adviceToOthers": null,
20	"chosenReasons": null,
21	"switchingReasons": null,
22	"reviewSource": {
23		"code": "NGC",
24		"tooltip": "Nominal Gift Card: This reviewer was invited by us to submit an honest review and was offered a nominal incentive as a thank you."
25	},
26	"reviewer": {
27		"companySize": "10,001+ employees",
28		"industry": "Media Production",
29		"timeUsedProduct": "2+ years",
30		"fullName": "Thom H.",
31		"jobTitle": "Assistant Producer",
32		"verifiedLinkedIn": false,
33		"profilePicUrl": null
34	},
35	"alternativeProducts": [],
36	"switchedProducts": [],
37	"vendorResponse": {
38		"date": "September 15, 2022",
39		"text": "Hi Thom, thanks for your great feedback!\r\n\r\nWe really appreciate you've taken the time to leave this review.\r\n\r\nWe've shared your feedback with our team and they are looking into it, so you should look out for some exciting news about it very soon!\r\n\r\nThanks again,\r\nFotini Athineli, Social Media Manager ",
40		"name": "Filestage"
41	}
42}

Contact

Please visit us through epctex.com to see all the products that are available for you. If you are looking for any custom integration or so, please reach out to us through the chat box in epctex.com. In need of support? devops@epctex.com is at your service.