Pay $20.00 for 1,000 results

Ai Web Scraper - Extract Data With Ease

eloquent_mountain/ai-web-scraper-extract-data-with-ease

Pay $20.00 for 1,000 results

Ai Web Scraper enables scraping for everyone, including non-techies! It uses Google's Gemini LLM to scrape websites with natural language commands. It dynamically extracts data, no selector input needed, handles dynamic content and cookie consent, avoids bot detection, outputs JSON or other formats.

You can access the Ai Web Scraper - Extract Data With Ease programmatically from your own applications by using the Apify API. You can choose the language preference from below. To use the Apify API, you’ll need an Apify account and your API token, found in Integrations settings in Apify Console.

1{
2  "openapi": "3.0.1",
3  "info": {
4    "version": "0.0",
5    "x-build-id": "qvrHrIhsmguBrtINx"
6  },
7  "servers": [
8    {
9      "url": "https://api.apify.com/v2"
10    }
11  ],
12  "paths": {
13    "/acts/eloquent_mountain~ai-web-scraper-extract-data-with-ease/run-sync-get-dataset-items": {
14      "post": {
15        "operationId": "run-sync-get-dataset-items-eloquent_mountain-ai-web-scraper-extract-data-with-ease",
16        "x-openai-isConsequential": false,
17        "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.",
18        "tags": [
19          "Run Actor"
20        ],
21        "requestBody": {
22          "required": true,
23          "content": {
24            "application/json": {
25              "schema": {
26                "$ref": "#/components/schemas/inputSchema"
27              }
28            }
29          }
30        },
31        "parameters": [
32          {
33            "name": "token",
34            "in": "query",
35            "required": true,
36            "schema": {
37              "type": "string"
38            },
39            "description": "Enter your Apify token here"
40          }
41        ],
42        "responses": {
43          "200": {
44            "description": "OK"
45          }
46        }
47      }
48    },
49    "/acts/eloquent_mountain~ai-web-scraper-extract-data-with-ease/runs": {
50      "post": {
51        "operationId": "runs-sync-eloquent_mountain-ai-web-scraper-extract-data-with-ease",
52        "x-openai-isConsequential": false,
53        "summary": "Executes an Actor and returns information about the initiated run in response.",
54        "tags": [
55          "Run Actor"
56        ],
57        "requestBody": {
58          "required": true,
59          "content": {
60            "application/json": {
61              "schema": {
62                "$ref": "#/components/schemas/inputSchema"
63              }
64            }
65          }
66        },
67        "parameters": [
68          {
69            "name": "token",
70            "in": "query",
71            "required": true,
72            "schema": {
73              "type": "string"
74            },
75            "description": "Enter your Apify token here"
76          }
77        ],
78        "responses": {
79          "200": {
80            "description": "OK",
81            "content": {
82              "application/json": {
83                "schema": {
84                  "$ref": "#/components/schemas/runsResponseSchema"
85                }
86              }
87            }
88          }
89        }
90      }
91    },
92    "/acts/eloquent_mountain~ai-web-scraper-extract-data-with-ease/run-sync": {
93      "post": {
94        "operationId": "run-sync-eloquent_mountain-ai-web-scraper-extract-data-with-ease",
95        "x-openai-isConsequential": false,
96        "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.",
97        "tags": [
98          "Run Actor"
99        ],
100        "requestBody": {
101          "required": true,
102          "content": {
103            "application/json": {
104              "schema": {
105                "$ref": "#/components/schemas/inputSchema"
106              }
107            }
108          }
109        },
110        "parameters": [
111          {
112            "name": "token",
113            "in": "query",
114            "required": true,
115            "schema": {
116              "type": "string"
117            },
118            "description": "Enter your Apify token here"
119          }
120        ],
121        "responses": {
122          "200": {
123            "description": "OK"
124          }
125        }
126      }
127    }
128  },
129  "components": {
130    "schemas": {
131      "inputSchema": {
132        "type": "object",
133        "required": [
134          "start_urls",
135          "instructions"
136        ],
137        "properties": {
138          "start_urls": {
139            "title": "Start URLs",
140            "type": "array",
141            "description": "Provide one or more URLs",
142            "items": {
143              "type": "string"
144            }
145          },
146          "instructions": {
147            "title": "Instructions",
148            "type": "string",
149            "description": "Desired items to scrape in natural language. Example: 'product description and product price'"
150          }
151        }
152      },
153      "runsResponseSchema": {
154        "type": "object",
155        "properties": {
156          "data": {
157            "type": "object",
158            "properties": {
159              "id": {
160                "type": "string"
161              },
162              "actId": {
163                "type": "string"
164              },
165              "userId": {
166                "type": "string"
167              },
168              "startedAt": {
169                "type": "string",
170                "format": "date-time",
171                "example": "2025-01-08T00:00:00.000Z"
172              },
173              "finishedAt": {
174                "type": "string",
175                "format": "date-time",
176                "example": "2025-01-08T00:00:00.000Z"
177              },
178              "status": {
179                "type": "string",
180                "example": "READY"
181              },
182              "meta": {
183                "type": "object",
184                "properties": {
185                  "origin": {
186                    "type": "string",
187                    "example": "API"
188                  },
189                  "userAgent": {
190                    "type": "string"
191                  }
192                }
193              },
194              "stats": {
195                "type": "object",
196                "properties": {
197                  "inputBodyLen": {
198                    "type": "integer",
199                    "example": 2000
200                  },
201                  "rebootCount": {
202                    "type": "integer",
203                    "example": 0
204                  },
205                  "restartCount": {
206                    "type": "integer",
207                    "example": 0
208                  },
209                  "resurrectCount": {
210                    "type": "integer",
211                    "example": 0
212                  },
213                  "computeUnits": {
214                    "type": "integer",
215                    "example": 0
216                  }
217                }
218              },
219              "options": {
220                "type": "object",
221                "properties": {
222                  "build": {
223                    "type": "string",
224                    "example": "latest"
225                  },
226                  "timeoutSecs": {
227                    "type": "integer",
228                    "example": 300
229                  },
230                  "memoryMbytes": {
231                    "type": "integer",
232                    "example": 1024
233                  },
234                  "diskMbytes": {
235                    "type": "integer",
236                    "example": 2048
237                  }
238                }
239              },
240              "buildId": {
241                "type": "string"
242              },
243              "defaultKeyValueStoreId": {
244                "type": "string"
245              },
246              "defaultDatasetId": {
247                "type": "string"
248              },
249              "defaultRequestQueueId": {
250                "type": "string"
251              },
252              "buildNumber": {
253                "type": "string",
254                "example": "1.0.0"
255              },
256              "containerUrl": {
257                "type": "string"
258              },
259              "usage": {
260                "type": "object",
261                "properties": {
262                  "ACTOR_COMPUTE_UNITS": {
263                    "type": "integer",
264                    "example": 0
265                  },
266                  "DATASET_READS": {
267                    "type": "integer",
268                    "example": 0
269                  },
270                  "DATASET_WRITES": {
271                    "type": "integer",
272                    "example": 0
273                  },
274                  "KEY_VALUE_STORE_READS": {
275                    "type": "integer",
276                    "example": 0
277                  },
278                  "KEY_VALUE_STORE_WRITES": {
279                    "type": "integer",
280                    "example": 1
281                  },
282                  "KEY_VALUE_STORE_LISTS": {
283                    "type": "integer",
284                    "example": 0
285                  },
286                  "REQUEST_QUEUE_READS": {
287                    "type": "integer",
288                    "example": 0
289                  },
290                  "REQUEST_QUEUE_WRITES": {
291                    "type": "integer",
292                    "example": 0
293                  },
294                  "DATA_TRANSFER_INTERNAL_GBYTES": {
295                    "type": "integer",
296                    "example": 0
297                  },
298                  "DATA_TRANSFER_EXTERNAL_GBYTES": {
299                    "type": "integer",
300                    "example": 0
301                  },
302                  "PROXY_RESIDENTIAL_TRANSFER_GBYTES": {
303                    "type": "integer",
304                    "example": 0
305                  },
306                  "PROXY_SERPS": {
307                    "type": "integer",
308                    "example": 0
309                  }
310                }
311              },
312              "usageTotalUsd": {
313                "type": "number",
314                "example": 0.00005
315              },
316              "usageUsd": {
317                "type": "object",
318                "properties": {
319                  "ACTOR_COMPUTE_UNITS": {
320                    "type": "integer",
321                    "example": 0
322                  },
323                  "DATASET_READS": {
324                    "type": "integer",
325                    "example": 0
326                  },
327                  "DATASET_WRITES": {
328                    "type": "integer",
329                    "example": 0
330                  },
331                  "KEY_VALUE_STORE_READS": {
332                    "type": "integer",
333                    "example": 0
334                  },
335                  "KEY_VALUE_STORE_WRITES": {
336                    "type": "number",
337                    "example": 0.00005
338                  },
339                  "KEY_VALUE_STORE_LISTS": {
340                    "type": "integer",
341                    "example": 0
342                  },
343                  "REQUEST_QUEUE_READS": {
344                    "type": "integer",
345                    "example": 0
346                  },
347                  "REQUEST_QUEUE_WRITES": {
348                    "type": "integer",
349                    "example": 0
350                  },
351                  "DATA_TRANSFER_INTERNAL_GBYTES": {
352                    "type": "integer",
353                    "example": 0
354                  },
355                  "DATA_TRANSFER_EXTERNAL_GBYTES": {
356                    "type": "integer",
357                    "example": 0
358                  },
359                  "PROXY_RESIDENTIAL_TRANSFER_GBYTES": {
360                    "type": "integer",
361                    "example": 0
362                  },
363                  "PROXY_SERPS": {
364                    "type": "integer",
365                    "example": 0
366                  }
367                }
368              }
369            }
370          }
371        }
372      }
373    }
374  }
375}

Ai Web Scraper - Extract Data With Ease OpenAPI definition

OpenAPI is a standard for designing and describing RESTful APIs, allowing developers to define API structure, endpoints, and data formats in a machine-readable way. It simplifies API development, integration, and documentation.

OpenAPI is effective when used with AI agents and GPTs by standardizing how these systems interact with various APIs, for reliable integrations and efficient communication.

By defining machine-readable API specifications, OpenAPI allows AI models like GPTs to understand and use varied data sources, improving accuracy. This accelerates development, reduces errors, and provides context-aware responses, making OpenAPI a core component for AI applications.

You can download the OpenAPI definitions for Ai Web Scraper - Extract Data With Ease from the options below:

OpenAPI.json

If you’d like to learn more about how OpenAPI powers GPTs, read our blog post.

You can also check out our other API clients:

Ai Web Scraper - Extract Data With Ease API in Python

Ai Web Scraper - Extract Data With Ease API in JavaScript

Ai Web Scraper - Extract Data With Ease API through CLI

Ai Web Scraper - Extract Data With Ease API

Developer

Paco

Actor Metrics

79 monthly users
5 bookmarks
73% runs succeeded
15 hours response time
Created in Dec 2024
Modified 13 days ago

Categories

Google Maps Extractor

compass/google-maps-extractor

Extract data from hundreds of places fast. Scrape Google Maps by keyword, category, location, URLs & other filters. Get addresses, contact info, opening hours, popular times, prices, menus & more. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.

Compass

29.7k

745

Zillow Search Scraper

maxcopell/zillow-scraper

Extract data about properties for sale and rent on Zillow using the Zillow API, but with no daily call limits. Scrape millions of listings and download your data as HTML, JSON, CSV, Excel, XML. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.

Maximillian Copelli

1.3k

Amazon Scraper

junglee/free-amazon-product-scraper

Gets you product data from Amazon. Unofficial API. Scrapes and downloads product information without using the Amazon API, including reviews, prices, descriptions, and ASIN.

Junglee

📩📍 Google Maps Email Extractor

lukaskrivka/google-maps-with-contact-details

Extract Google Maps contact details. Scrape websites of Google Maps places for contact details and get email addresses, website, location, address, zipcode, phone number, social media links. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Lukáš Křivka

15.9k

497

Crunchbase Scraper: Reliable & Easy

scrapefull/crunchbase-scraper

Our Crunchbase data extractor reliably extracts comprehensive organization data from Crunchbase pages. Get clean, organized Crunchbase data to identify insights and seamlessly integrate into your workflow.

Scrapefull

Website Content Crawler

apify/website-content-crawler

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.

Apify

36.8k

Instagram Post Scraper

apify/instagram-post-scraper

Scrape Instagram posts. Just add one or more Instagram usernames and get your data in seconds including text, hashtags, mentions, comments, images, URLs, likes, locations, and metadata. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

26k

272

Youtube Video Summerize

mohamedgb00714/youtube-video-summerize

a powerful Apify actor that extracts and summarizes subtitles from YouTube videos, helping you quickly understand key points without watching the entire video. ✅ **AI-Powered Summarization:** Uses OpenAI’s GPT-4 to generate concise and insightful summaries.

mohamed el hadi msaid

Instagram Reel Scraper

apify/instagram-reel-scraper

Scrape data from Instagram reels. Just add one or more Instagram usernames and get your data in seconds including hashtags, mentions, comments, images, likes, locations, and metadata. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

8.9k

237