# Cmg Refresh Werknl Token Actor (`obedient_stars/cmg-refresh-werknl-token-actor`) Actor Refreshes Werk.nl session - **URL**: https://apify.com/obedient\_stars/cmg-refresh-werknl-token-actor.md - **Developed by:** [Synthwave Solutions](https://apify.com/obedient_stars) (community) - **Categories:** Automation - **Stats:** 1 total users, 1 monthly users, 0.0% runs succeeded, NaN bookmarks - **User rating**: No ratings yet ## Pricing Pay per usage This Actor is paid per platform usage. The Actor is free to use, and you only pay for the Apify platform usage, which gets cheaper the higher subscription plan you have. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-usage ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## Werk.nl Search Service This service allows searching and extracting candidate profiles from Werk.nl using Playwright for browser automation. ### Features - **Automated Search**: Searches for candidate profiles in Werk.nl based on specific criteria. - **Profile Extraction**: Extracts detailed information from candidate profiles. - **Two-Factor Authentication with Telegram**: Handles the 2FA process through a Telegram bot. - **Firebase Integration**: Stores and manages extracted data. - **Candidate Ranking**: Evaluates and ranks candidates according to predefined criteria. ### Technologies Used - **[Playwright](https://pypi.org/project/playwright/)**: Browser automation library. - **[Apify SDK](https://docs.apify.com/sdk/python/)**: Toolkit for building Python scrapers. - **[Firebase](https://firebase.google.com/)**: Cloud database for data storage. - **[Telegram Bot API](https://core.telegram.org/bots/api)**: For handling two-factor authentication. ### Setup 1. Clone this repository 2. Copy `.env.example` to `.env` and configure environment variables 3. Install dependencies with `pip install -r requirements.txt` 4. Run the service with `python -m src` ### Two-Factor Authentication with Telegram This service includes support for two-factor authentication (2FA) through a Telegram bot. When Werk.nl requests a two-factor authentication code during login, the service: 1. Sends a message to the user through Telegram informing that 2FA is required. 2. Requests an authentication code through the Telegram bot API. 3. Waits to receive the code through a streaming connection. 4. Enters the code in Werk.nl's 2FA form. 5. Notifies the user when login is successful. #### Telegram Bot Setup To use this functionality, you need to: 1. Create a Telegram bot using [BotFather](https://t.me/botfather). 2. Implement a bot API that supports the following endpoints: - `/2fa`: For requesting a 2FA code. - `/request_two_factor/{id}`: For receiving the code through streaming. - `/send_message`: For sending messages to the user. 3. Configure the environment variables `TELEGRAM_BOT_API_URL` and `TELEGRAM_USER_ID` in your `.env` file. #### 2FA Workflow 1. The service attempts to log in to Werk.nl with the provided credentials. 2. If Werk.nl requests 2FA, the service sends a message to the user through Telegram. 3. The user receives the authentication code (via SMS, email, etc.) and provides it to the Telegram bot. 4. The service receives the code through the bot API and enters it in Werk.nl. 5. Login is completed and the service continues with the search process. ### Resources - [Playwright for web scraping in 2023](https://blog.apify.com/how-to-scrape-the-web-with-playwright-ece1ced75f73/) - [Scraping single-page applications with Playwright](https://blog.apify.com/scraping-single-page-applications-with-playwright/) - [How to scale Puppeteer and Playwright](https://blog.apify.com/how-to-scale-puppeteer-and-playwright/) - [Integration with Zapier](https://apify.com/integrations), Make, GitHub, Google Drive and other apps - [Video guide on getting data using Apify API](https://www.youtube.com/watch?v=ViYYDHSBAKM) - [Telegram Bot API documentation](https://core.telegram.org/bots/api) # Actor input Schema ## `user_id` (type: `string`): User ID for retrieving LinkedIn session from Firebase ## Actor input object example ```json {} ```` # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = {}; // Run the Actor and wait for it to finish const run = await client.actor("obedient_stars/cmg-refresh-werknl-token-actor").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = {} # Run the Actor and wait for it to finish run = client.actor("obedient_stars/cmg-refresh-werknl-token-actor").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{}' | apify call obedient_stars/cmg-refresh-werknl-token-actor --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=obedient_stars/cmg-refresh-werknl-token-actor", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Cmg Refresh Werknl Token Actor", "description": "Refreshes Werk.nl session", "version": "0.0", "x-build-id": "MlgMpc61pfYG7Be5o" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/obedient_stars~cmg-refresh-werknl-token-actor/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-obedient_stars-cmg-refresh-werknl-token-actor", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/obedient_stars~cmg-refresh-werknl-token-actor/runs": { "post": { "operationId": "runs-sync-obedient_stars-cmg-refresh-werknl-token-actor", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/obedient_stars~cmg-refresh-werknl-token-actor/run-sync": { "post": { "operationId": "run-sync-obedient_stars-cmg-refresh-werknl-token-actor", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "required": [ "user_id" ], "properties": { "user_id": { "title": "User ID", "type": "string", "description": "User ID for retrieving LinkedIn session from Firebase" } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```