Question about using

Hey Shay Cohen!

Thank you very much for asking the question. Let me answer them one by one;

1. Yes, you need to get the list of the URLs that you'd like to scrape.
2. By default, the scraper encounters retrieves the information of any Phone number, Email, URL, API token, API Secret Key, SSH Key, RSA Key, Crypto wallet address, and many more important data.

Please let me know if you need anything else. Best

Hi Thanks! 1/ from where do I get the lists? do you dont have it Prebuilt? 2/ so in the json it contain all the data that scrap from the url right?

Thanks

Hey Shay Cohen!

1. This would be up to you. If you'd like to come up with a list of URLs, I'd suggest you to research it on the web and come up with a list. Because the URLs can be changed very easily and we don't store anything by default.
2. That's true.

best

1/ Do you have a clue from where can i get those lists? 2/ if i scarp data can we compere from previous scraps to get only new data?

1. I'd say it would be better to check the open web to find out these URLs. Unfortunately, the resources vary a lot. But for Dark Web 101, https://thehiddenwiki.org/ would be a good start.

2. Unfortunately, it doesn't compare the previous runs and get only the new data.

Best

Thank you, Where can i find example of all the json result?

Hey Shay,

The example result can be found on the actor information through this link: https://apify.com/epctex/darkweb-scraper#dark-web-export

Best

Hi, I saw it but you mention that you collect many things like tokens and etc, how can i see a full json result, i want to do some tests and then use the solution, but i need to prepare things from my hand

Now I understood, sorry for the misunderstanding. The following object contains all the possible fields that can come through the actor:

1{
2	"links": "array of strings",
3	"phones": "array of strings",
4	"emails": "array of strings",
5	"cryptoAddresses": {
6		"BTC Wallet": "array of strings"
7		"DASH Wallet": "array of strings"
8		"Monero Wallet": "array of strings"
9		"Ethereum Wallet": "array of strings"
10	},
11	misc: {
12		"Mailgun Private Key": "array of strings",
13		"Heroku API key": "array of strings",
14		"Slack API token": "array of strings",
15		"MailChimp API Key": "array of strings",
16		"Github Personal Access Token": "array of strings",
17		"Github OAuth Access Token": "array of strings",
18		"Github App Token": "array of strings",
19		"Github Refresh Token": "array of strings",
20		"GitHub Access Token": "array of strings",
21		"Stripe Restricted API Token": "array of strings",
22		"Stripe Standard API Token": "array of strings",
23		"PayPal/Braintree Access Token": "array of strings",
24		"Google OAuth Access Key": "array of strings",
25		"Google OAuth ID": "array of strings",
26		"StackHawk API Key": "array of strings",
27		"NuGet API Key": "array of strings",
28		"SendGrid Token": "array of strings",
29		"AWS Access Key": "array of strings",
30		"Google Cloud Platform API Key": "array of strings",
31		"New Relic Admin API Key": "array of strings",
32		"New Relic Insights Key": "array of strings",
33		"New Relic REST API Key": "array of strings",
34		"New Relic Synthetics Location Key": "array of ... [trimmed]

Hi, If i need a bash script that run a curl and get all the result and insert/update the db this is something can you do for me with extra money?