Smart Url Extractor
Pricing
Pay per usage
Go to Apify Store

Smart Url Extractor
Intelligent web scraping Actor that automatically detects content types (products, jobs, articles, profiles) and extracts structured data with 15+ fields. Perfect for e-commerce monitoring, job aggregation, and content curation.
Pricing
Pay per usage
Rating
0.0
(0)
Developer

Mamadou Diao Bah
Maintained by Community
Actor stats
0
Bookmarked
2
Total users
1
Monthly active users
2 days ago
Last modified
Categories
Share
Smart URL Data Extractor
Intelligent web scraping Actor that automatically detects content types and extracts structured data from any URL.
🚀 Features
- Automatic Content Detection: Identifies if a URL contains products, job listings, articles, or profiles
- Intelligent Data Extraction: Extracts 15+ relevant fields based on detected content type
- Multiple Content Types Supported:
- 🛍️ Products: price, brand, rating, images, availability, SKU
- 💼 Jobs: title, company, location, salary, description, employment type
- 📰 Articles: headline, author, publish date, content, tags, category
- 👤 Profiles: name, bio, avatar, location, social links
📥 Input Configuration
{"startUrls": [{ "url": "https://example.com/product" }],"maxConcurrency": 5,"outputFormat": "json"}
Parameters:
- startUrls (required): Array of URLs to scrape
- maxConcurrency (optional): Max number of concurrent requests (default: 5)
- outputFormat (optional): Output format - "json" or "csv" (default: "json")
📤 Output
The Actor returns structured JSON data with automatically detected fields based on content type.
Example Output (Product):
{"type": "product","url": "https://example.com/product","title": "Product Name","price": "$99.99","brand": "Brand Name","rating": "4.5 stars","availability": "In Stock","detectedType": "product","extractedAt": "2025-11-23T19:13:16.454Z"}
🛠️ Use Cases
- E-commerce price monitoring
- Job board aggregation
- Content curation and analysis
- Profile data collection
- Competitive intelligence
📖 Documentation
For detailed documentation, visit Apify Docs
👨💻 Author
Created by Diao-Bah-timbi
📝 License
Open-source (Apache 2.0)