Robots Txt Parser
Pricing
from $10.00 / 1,000 results
Go to Apify Store
Robots Txt Parser
Robots Txt Parser - Parse and extract structured data from various formats. Clean, reliable output.
Robots Txt Parser - Parse and extract structured data from various formats. Clean, reliable output.
Features
- Fast and reliable data extraction
- Clean JSON/CSV output
- Handles errors gracefully
- Easy to integrate with other tools
Input
| Field | Type | Description |
|---|---|---|
urls | array | List of URLs to process |
maxResults | integer | Maximum number of results (default: 100) |
Output
Results are stored in a dataset that can be exported as JSON, CSV, or Excel.
Usage
Run this actor from the Apify Console or via API.
