Google Shopping

Hello Abdessamad, As I see in the JSON results. There are 34 search queries. Most of them are successful and there are some searches are empty.

I enabled saveHTML option and find out that Google blocks some of our searches. This is related to the Apify proxy and I will notify Apify developer to fix this.

For now, I think it's better to retry these failed keywords again?

Thanks

Here is my search with HTML option: https://api.apify.com/v2/datasets/njakYUtJmDX6EvPyp/items?clean=true&format=json.

I sent the support requests to Apify and Apify will help us to solve proxy issues.

Hello,

Actually the problem is not the failed ones but the fact that you cannot download any of the results except the first one. Have you tried?

Dear Abdessamad,

I downloaded your searches in different formats: JSON, CSV(https://api.apify.com/v2/datasets/gP75tbmswgwqFZ2gG/items?clean=true&format=json), ... and it contains all 34 keyword searches and results.

Could you share how you download it? or a video so I can support

Thanks

Sure –

1. I click on export 34 results below [cid:image001.png@01D95E37.CAABCFD0]

2. I select all fields in excel or csv (it gives same result) [cid:image002.png@01D95E37.CAABCFD0]

Let me know what you think,

Oh. I see. Right now the response is JSON. To get the CSV, I will support csvFriendly option. Please wait.

Right now I recommend using JSON data and other tools to convert to CSV.

Sure – it will take time before you figure out? Just to know whether I look for alternatives.

No worry. I will finish in this weekend.

Hello – hope you are well,

Any update on the issue raised?

Hello Abdessamad, Thanks for waiting. The csvFriendlyOutput is supported. Enable this flag and you will get list of all shopping results.

Example: https://api.apify.com/v2/datasets/qUFHbZuDsxQ4dU3qi/items?attachment=true&clean=true&format=csv Table: https://api.apify.com/v2/datasets/qUFHbZuDsxQ4dU3qi/items?clean=true&format=html

Please let me know if you have any request.

Thank you – where should this flag be enabled?

[cid:image001.png@01D960B3.1A17F350]

The csvFriendlyOutput is one of the input parameters. You need to enable this when making the request.

Let me support this. Will be available this weekend.

I udpated the Google Shopping actor. You can sort or filter results by filterValue param:

• Input p_ord:p to sort Price- low to high: Example: https://api.apify.com/v2/datasets/pAYcZC0GOfcmFisqL/items?clean=true&format=json
• Input p_ord:pd to sort Price - high to low
• Input p_ord:rv to sort Review score

The default is relevance.

You also can filter by price, band, ...

Hi, Please the dataset does not contain a search query, can you please add it? Thank you!

The result contains the search query: https://api.apify.com/v2/datasets/liOfrmo83iPxzqncy/items?clean=true&format=json

Do you need to search query with csvFriendlyOutput enabled?

Yes, and also for table view (excel, HTML table...)

I included the query in each items: https://api.apify.com/v2/datasets/39df4ntuGrBxj7FQM/items?clean=true&format=json. Let me know if you need any feature.

The HTML table works too: https://api.apify.com/v2/datasets/39df4ntuGrBxj7FQM/items?clean=true&format=html

Please enable csvFriendlyOutput: true in your search. Thanks

The new run will include the query: https://api.apify.com/v2/datasets/1h5dudRRDeVnaMIIR/items?clean=true&format=html. Let me know if you request any feature.

All requests will be made via proxy. Apify will provide proxy. Mean Google will not block your IPs. The proxy is all around the world. All scrape content product use proxy to prevent blocking from Google.

Hi, I scrape 100 queries in one run. But the scraper skips some queries. "WARNING: Logging is too fast, some lines were skipped." How can I filter out the skipped queries after each run to make it easier to get complete data? Thanks!

Please can you answer?

Hi Mirka,

"WARNING: Logging is too fast, some lines were skipped." didn't affect to the results. The scraper didn't skip any queries. All queries and results will be in result file, can export to csv, html table, json....

Please let me know if you have any issue. I'm happy to answer

Hi, the problem still persists. When I have 100 queries (1 page) in 1 scraping run, I expect an export with 6000 rows. But the export never includes that. Currently last run 5400 rows. I need a list of queries that were not scraped after each run. Thanks, M.

Hello Mirka,

Are you using csv_friendly enabled?

Thanks,

Yes

Okay. Let me returns the list of empty results keywords

Thanks! How long do you think it will take?

I'm pretty busy this week. Maybe Thursday or Friday. Is this okay?

Yes, thanks!

It will be done soon?

Hi Mirka,

Yes, I am working on it. Will notify you soon.

Thanks for checking.

Thanks!