Website Checker Runner Puppeteer
Try for free
No credit card required
Go to Store
Website Checker Runner Puppeteer
lukaskrivka/website-checker-puppeteer
Try for free
No credit card required
Checks the provided website using Puppeteer. This is a low level runner, most likely you want to use the high level master actor - https://apify.com/lukaskrivka/website-checker
Developer
Lukáš KřivkaMaintained by Community
Actor Metrics
11 Monthly users
No reviews yet
13 bookmarks
>99% runs succeeded
Created in Nov 2021
Modified 2 years ago
Categories
You can access the Website Checker Runner Puppeteer programmatically from your own applications by using the Apify API. You can also choose the language preference from below. To use the Apify API, you’ll need an Apify account and your API token, found in Integrations settings in Apify Console.
1{
2 "openapi": "3.0.1",
3 "info": {
4 "version": "0.0",
5 "x-build-id": "YFs4buo68awDOZsPa"
6 },
7 "servers": [
8 {
9 "url": "https://api.apify.com/v2"
10 }
11 ],
12 "paths": {
13 "/acts/lukaskrivka~website-checker-puppeteer/run-sync-get-dataset-items": {
14 "post": {
15 "operationId": "run-sync-get-dataset-items-lukaskrivka-website-checker-puppeteer",
16 "x-openai-isConsequential": false,
17 "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.",
18 "tags": [
19 "Run Actor"
20 ],
21 "requestBody": {
22 "required": true,
23 "content": {
24 "application/json": {
25 "schema": {
26 "$ref": "#/components/schemas/inputSchema"
27 }
28 }
29 }
30 },
31 "parameters": [
32 {
33 "name": "token",
34 "in": "query",
35 "required": true,
36 "schema": {
37 "type": "string"
38 },
39 "description": "Enter your Apify token here"
40 }
41 ],
42 "responses": {
43 "200": {
44 "description": "OK"
45 }
46 }
47 }
48 },
49 "/acts/lukaskrivka~website-checker-puppeteer/runs": {
50 "post": {
51 "operationId": "runs-sync-lukaskrivka-website-checker-puppeteer",
52 "x-openai-isConsequential": false,
53 "summary": "Executes an Actor and returns information about the initiated run in response.",
54 "tags": [
55 "Run Actor"
56 ],
57 "requestBody": {
58 "required": true,
59 "content": {
60 "application/json": {
61 "schema": {
62 "$ref": "#/components/schemas/inputSchema"
63 }
64 }
65 }
66 },
67 "parameters": [
68 {
69 "name": "token",
70 "in": "query",
71 "required": true,
72 "schema": {
73 "type": "string"
74 },
75 "description": "Enter your Apify token here"
76 }
77 ],
78 "responses": {
79 "200": {
80 "description": "OK",
81 "content": {
82 "application/json": {
83 "schema": {
84 "$ref": "#/components/schemas/runsResponseSchema"
85 }
86 }
87 }
88 }
89 }
90 }
91 },
92 "/acts/lukaskrivka~website-checker-puppeteer/run-sync": {
93 "post": {
94 "operationId": "run-sync-lukaskrivka-website-checker-puppeteer",
95 "x-openai-isConsequential": false,
96 "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.",
97 "tags": [
98 "Run Actor"
99 ],
100 "requestBody": {
101 "required": true,
102 "content": {
103 "application/json": {
104 "schema": {
105 "$ref": "#/components/schemas/inputSchema"
106 }
107 }
108 }
109 },
110 "parameters": [
111 {
112 "name": "token",
113 "in": "query",
114 "required": true,
115 "schema": {
116 "type": "string"
117 },
118 "description": "Enter your Apify token here"
119 }
120 ],
121 "responses": {
122 "200": {
123 "description": "OK"
124 }
125 }
126 }
127 }
128 },
129 "components": {
130 "schemas": {
131 "inputSchema": {
132 "type": "object",
133 "required": [
134 "urlsToCheck"
135 ],
136 "properties": {
137 "urlsToCheck": {
138 "title": "URLs to check",
139 "type": "array",
140 "description": "A static list of URLs to check for captchas. To be able to add new URLs on the fly, enable the <b>Use request queue</b> option.<br><br>For details, see <a href='https://apify.com/apify/web-scraper#start-urls' target='_blank' rel='noopener'>Start URLs</a> in README.",
141 "items": {
142 "type": "object",
143 "required": [
144 "url"
145 ],
146 "properties": {
147 "url": {
148 "type": "string",
149 "title": "URL of a web page",
150 "format": "uri"
151 }
152 }
153 }
154 },
155 "proxyConfiguration": {
156 "title": "Proxy Configuration",
157 "type": "object",
158 "description": "Specifies proxy servers that will be used by the scraper in order to hide its origin.<br><br>For details, see <a href='https://apify.com/apify/web-scraper#proxy-configuration' target='_blank' rel='noopener'>Proxy configuration</a> in README.",
159 "default": {}
160 },
161 "saveSnapshot": {
162 "title": "Enabled",
163 "type": "boolean",
164 "description": "Will save HTML for Cheerio and HTML + screenshot for Puppeteer/Playwright"
165 },
166 "linkSelector": {
167 "title": "Link Selector",
168 "minLength": 1,
169 "type": "string",
170 "description": "A CSS selector saying which links on the page (<code><a></code> elements with <code>href</code> attribute) shall be followed and added to the request queue. This setting only applies if <b>Use request queue</b> is enabled. To filter the links added to the queue, use the <b>Pseudo-URLs</b> setting.<br><br>If <b>Link selector</b> is empty, the page links are ignored.<br><br>For details, see <a href='https://apify.com/apify/web-scraper#link-selector' target='_blank' rel='noopener'>Link selector</a> in README."
171 },
172 "pseudoUrls": {
173 "title": "Pseudo-URLs",
174 "type": "array",
175 "description": "Specifies what kind of URLs found by <b>Link selector</b> should be added to the request queue. A pseudo-URL is a URL with regular expressions enclosed in <code>[]</code> brackets, e.g. <code>http://www.example.com/[.*]</code>. This setting only applies if the <b>Use request queue</b> option is enabled.<br><br>If <b>Pseudo-URLs</b> are omitted, the actor enqueues all links matched by the <b>Link selector</b>.<br><br>For details, see <a href='https://apify.com/apify/web-scraper#pseudo-urls' target='_blank' rel='noopener'>Pseudo-URLs</a> in README.",
176 "default": [],
177 "items": {
178 "type": "object",
179 "required": [
180 "purl"
181 ],
182 "properties": {
183 "purl": {
184 "type": "string",
185 "title": "Pseudo-URL of a web page"
186 }
187 }
188 }
189 },
190 "repeatChecksOnProvidedUrls": {
191 "title": "Repeat checks on provided URLs",
192 "type": "integer",
193 "description": "Will access each URL multiple times. Useful to test the same URL or bypass blocking of the first page."
194 },
195 "maxNumberOfPagesCheckedPerDomain": {
196 "title": "Max number of pages checked per domain",
197 "type": "integer",
198 "description": "The maximum number of pages that the checker will load. The checker will stop when this limit is reached. It's always a good idea to set this limit in order to prevent excess platform usage for misconfigured scrapers. Note that the actual number of pages loaded might be slightly higher than this value.<br><br>If set to <code>0</code>, there is no limit.",
199 "default": 100
200 },
201 "maxConcurrentPagesCheckedPerDomain": {
202 "title": "Maximum concurrent pages checked per domain",
203 "minimum": 1,
204 "type": "integer",
205 "description": "Specifies the maximum number of pages that can be processed by the checker in parallel for one domain. The checker automatically increases and decreases concurrency based on available system resources. This option enables you to set an upper limit, for example to reduce the load on a target website.",
206 "default": 50
207 },
208 "maxConcurrentDomainsChecked": {
209 "title": "Maximum number of concurrent domains checked",
210 "minimum": 1,
211 "maximum": 10,
212 "type": "integer",
213 "description": "Specifies the maximum number of domains that should be checked at a time. This setting is relevant when passing in more than one URL to check.",
214 "default": 5
215 },
216 "retireBrowserInstanceAfterRequestCount": {
217 "title": "Retire browser instance after request count",
218 "minimum": 1,
219 "type": "integer",
220 "description": "How often will the browser itself rotate. Pick a higher number for smaller consumption, pick a lower number to rotate (test) more proxies.",
221 "default": 10
222 },
223 "puppeteer.headfull": {
224 "title": "Headfull browser (XVFB)",
225 "type": "boolean",
226 "description": "Only works for Puppeteer type!"
227 },
228 "puppeteer.useChrome": {
229 "title": "Use Chrome",
230 "type": "boolean",
231 "description": "Only works for Puppeteer type! Be careful that Chrome is not guaranteed to work with Puppeteer."
232 },
233 "puppeteer.waitFor": {
234 "title": "Wait for",
235 "type": "string",
236 "description": "Only works for Puppeteer type. Will wait on each page. You can provide number in ms or a selector."
237 }
238 }
239 },
240 "runsResponseSchema": {
241 "type": "object",
242 "properties": {
243 "data": {
244 "type": "object",
245 "properties": {
246 "id": {
247 "type": "string"
248 },
249 "actId": {
250 "type": "string"
251 },
252 "userId": {
253 "type": "string"
254 },
255 "startedAt": {
256 "type": "string",
257 "format": "date-time",
258 "example": "2025-01-08T00:00:00.000Z"
259 },
260 "finishedAt": {
261 "type": "string",
262 "format": "date-time",
263 "example": "2025-01-08T00:00:00.000Z"
264 },
265 "status": {
266 "type": "string",
267 "example": "READY"
268 },
269 "meta": {
270 "type": "object",
271 "properties": {
272 "origin": {
273 "type": "string",
274 "example": "API"
275 },
276 "userAgent": {
277 "type": "string"
278 }
279 }
280 },
281 "stats": {
282 "type": "object",
283 "properties": {
284 "inputBodyLen": {
285 "type": "integer",
286 "example": 2000
287 },
288 "rebootCount": {
289 "type": "integer",
290 "example": 0
291 },
292 "restartCount": {
293 "type": "integer",
294 "example": 0
295 },
296 "resurrectCount": {
297 "type": "integer",
298 "example": 0
299 },
300 "computeUnits": {
301 "type": "integer",
302 "example": 0
303 }
304 }
305 },
306 "options": {
307 "type": "object",
308 "properties": {
309 "build": {
310 "type": "string",
311 "example": "latest"
312 },
313 "timeoutSecs": {
314 "type": "integer",
315 "example": 300
316 },
317 "memoryMbytes": {
318 "type": "integer",
319 "example": 1024
320 },
321 "diskMbytes": {
322 "type": "integer",
323 "example": 2048
324 }
325 }
326 },
327 "buildId": {
328 "type": "string"
329 },
330 "defaultKeyValueStoreId": {
331 "type": "string"
332 },
333 "defaultDatasetId": {
334 "type": "string"
335 },
336 "defaultRequestQueueId": {
337 "type": "string"
338 },
339 "buildNumber": {
340 "type": "string",
341 "example": "1.0.0"
342 },
343 "containerUrl": {
344 "type": "string"
345 },
346 "usage": {
347 "type": "object",
348 "properties": {
349 "ACTOR_COMPUTE_UNITS": {
350 "type": "integer",
351 "example": 0
352 },
353 "DATASET_READS": {
354 "type": "integer",
355 "example": 0
356 },
357 "DATASET_WRITES": {
358 "type": "integer",
359 "example": 0
360 },
361 "KEY_VALUE_STORE_READS": {
362 "type": "integer",
363 "example": 0
364 },
365 "KEY_VALUE_STORE_WRITES": {
366 "type": "integer",
367 "example": 1
368 },
369 "KEY_VALUE_STORE_LISTS": {
370 "type": "integer",
371 "example": 0
372 },
373 "REQUEST_QUEUE_READS": {
374 "type": "integer",
375 "example": 0
376 },
377 "REQUEST_QUEUE_WRITES": {
378 "type": "integer",
379 "example": 0
380 },
381 "DATA_TRANSFER_INTERNAL_GBYTES": {
382 "type": "integer",
383 "example": 0
384 },
385 "DATA_TRANSFER_EXTERNAL_GBYTES": {
386 "type": "integer",
387 "example": 0
388 },
389 "PROXY_RESIDENTIAL_TRANSFER_GBYTES": {
390 "type": "integer",
391 "example": 0
392 },
393 "PROXY_SERPS": {
394 "type": "integer",
395 "example": 0
396 }
397 }
398 },
399 "usageTotalUsd": {
400 "type": "number",
401 "example": 0.00005
402 },
403 "usageUsd": {
404 "type": "object",
405 "properties": {
406 "ACTOR_COMPUTE_UNITS": {
407 "type": "integer",
408 "example": 0
409 },
410 "DATASET_READS": {
411 "type": "integer",
412 "example": 0
413 },
414 "DATASET_WRITES": {
415 "type": "integer",
416 "example": 0
417 },
418 "KEY_VALUE_STORE_READS": {
419 "type": "integer",
420 "example": 0
421 },
422 "KEY_VALUE_STORE_WRITES": {
423 "type": "number",
424 "example": 0.00005
425 },
426 "KEY_VALUE_STORE_LISTS": {
427 "type": "integer",
428 "example": 0
429 },
430 "REQUEST_QUEUE_READS": {
431 "type": "integer",
432 "example": 0
433 },
434 "REQUEST_QUEUE_WRITES": {
435 "type": "integer",
436 "example": 0
437 },
438 "DATA_TRANSFER_INTERNAL_GBYTES": {
439 "type": "integer",
440 "example": 0
441 },
442 "DATA_TRANSFER_EXTERNAL_GBYTES": {
443 "type": "integer",
444 "example": 0
445 },
446 "PROXY_RESIDENTIAL_TRANSFER_GBYTES": {
447 "type": "integer",
448 "example": 0
449 },
450 "PROXY_SERPS": {
451 "type": "integer",
452 "example": 0
453 }
454 }
455 }
456 }
457 }
458 }
459 }
460 }
461 }
462}Website Checker Runner Puppeteer OpenAPI definition
OpenAPI is a standard for designing and describing RESTful APIs, allowing developers to define API structure, endpoints, and data formats in a machine-readable way. It simplifies API development, integration, and documentation.
OpenAPI is effective when used with AI agents and GPTs by standardizing how these systems interact with various APIs, for reliable integrations and efficient communication.
By defining machine-readable API specifications, OpenAPI allows AI models like GPTs to understand and use varied data sources, improving accuracy. This accelerates development, reduces errors, and provides context-aware responses, making OpenAPI a core component for AI applications.
You can download the OpenAPI definitions for Website Checker Runner Puppeteer from the options below:
If you’d like to learn more about how OpenAPI powers GPTs, read our blog post.
You can also check out our other API clients:
