Replicate Search Scraper

What does Replicate Search Scraper do?

The Replicate Search Scraper allows you to scrape search results from Replicate.com based on a specified search query and entity types. It scrapes the data and provides it in structured formats such as JSON, which you can use in your own reports, spreadsheets, and applications. Replicate Search Scraper allows you to scrape:

• Search results from Replicate.com.
• Detailed information about each result, including title, description, categories, and more.

Why use Replicate Search Scraper?

Replicate Search Scraper simplifies the process of obtaining search results from Replicate.com by automating the scraping tasks. Instead of manually searching and extracting data, this tool handles it for you, saving time and ensuring you get exactly what you need.

How to use Replicate Search Scraper

• Specify the search query you want to scrape.
• Customize the results with entity type filters.
• The scraper will generate the results according to your specifications and provide you with the data.

Input parameters

If this actor is run on the Apify platform, our simple interface will help you configure all the necessary and optional parameters of this scraper before running it. This scraper recognizes the following input parameters:

• searchQuery - The search term to scrape.
• entityTypes - List of entity types to scrape. If empty, all entity types will be scraped.

Example:

1{
2    "searchQuery": "recraft-20b",
3    "entityTypes": [
4        "models",
5        "collections"
6    ]
7}

Output

The output from Replicate Search Scraper is stored in a dataset. Each item contains information about a search result. Here's an example of some of the output you would get if you used the input parameters above to scrape the search query "recraft-20b":

1{
2    "models": [
3        {
4            "description": "Affordable and fast images",
5            "name": "recraft-20b",
6            "owner_avatar": {
7                "kind": "organization",
8                "url": "https://github.com/recraft-ai.png"
9            },
10            "username": "recraft-ai",
11            "run_count": "21.6K",
12            "latest_enabled_version_id": "4441c81fea73ada6fcba2efef13b37b567894c18666120a534d0f34a96a40ee1",
13            "hardware": "cpu",
14            "is_official_model": true
15        },
16        {
17            "description": "Recraft V3 (code-named red_panda) is a text-to-image model with the ability to generate long texts, and images in a wide list of styles. As of today, it is SOTA in image generation, proven by the Text-to-Image Benchmark by Artificial Analysis",
18            "name": "recraft-v3",
19            "owner_avatar": {
20                "kind": "organization",
21                "url": "https://github.com/recraft-ai.png"
22            },
23            "username": "recraft-ai",
24            "run_count": "503.9K",
25            "latest_enabled_version_id": "e06217725b21e2c059a09b3f44b4aef56574173aee9976c9726bdc0f474d7f46",
26            "hardware": "cpu",
27            "is_official_model": true
28        },
29        {
30            "description": "Affordable and fast vector images",
31            "name": "recraft-20b-svg",
32            "owner_avatar": {
33                "kind": "organization",
34                "url": "https://github.com/recraft-ai.png"
35            },
36            "username": "recraft-ai",
37            "run_count": "1.1K",
38            "latest_enabled_version_id": "110b949db40d2d140280a4484c8c70eca855128ad04c06a8a8a680701121110e",
39            "hardware": "cpu",
40            "is_official_model": true
41        }...
42    ]
43}

How much will scraping Replicate.com cost you?

When it comes to scraping, it can be challenging to estimate the resources needed to extract data as use cases may vary significantly. That's why the best course of action is to run a test scrape with a small sample of input data and limited output. You’ll get your price per scrape, which you’ll then multiply by the number of scrapes you intend to do.

Integrations and Replicate Search Scraper

Last but not least, Replicate Search Scraper can be connected with almost any cloud service or web app thanks to integrations on the Apify platform. You can integrate with Make, Zapier, Slack, Airbyte, GitHub, Google Sheets, Google Drive, and more. Or you can use webhooks to carry out an action whenever an event occurs, e.g., get a notification whenever Replicate Search Scraper successfully finishes a run.

Using Replicate Search Scraper with the Apify API

The Apify API gives you programmatic access to the Apify platform. The API is organized around RESTful HTTP endpoints that enable you to manage, schedule, and run Apify actors. The API also lets you access any datasets, monitor actor performance, fetch results, create and update versions, and more.

To access the API using Node.js, use the apify-client NPM package. To access the API using Python, use the apify-client PyPI package.

Check out the Apify API reference docs for full details or click on the API tab for code examples.

Personal data

You should be aware that your results might contain personal data. Personal data is protected by GDPR in the European Union and other laws and regulations around the world. You should not scrape personal data unless you have a legitimate reason to do so. If you're unsure whether your reason is legitimate, consult your lawyers. You can read the basics of ethical web scraping in our blog post on the legality of web scraping.

Legal Considerations

Please note that this scraper is not associated with Replicate and is not intended for unauthorized use. Please read Replicate's Terms of Service before scraping their website. Make sure you are not violating their Terms of Service. The data scraped is for educational and research purposes only.

Your feedback

We’re always working on improving the performance of our Actors. So if you’ve got any technical feedback for Replicate Search Scraper or simply found a bug, please create an issue on the Actor’s Issues tab in Apify Console.