Website Services Finder

Automatically extract and analyze company services from any business website using advanced AI. Choose from 5 AI providers (OpenAI, Anthropic, Groq, Gemini, Hugging Face) and 23+ models to intelligently categorize and extract comprehensive service listings — perfect for lead generation, market research, competitive analysis, and business intelligence.

Flexible pricing based on your chosen AI provider — from free tiers to premium models.

Features

• Multiple AI Providers

  • Groq - Fast and cost-effective (Llama 3.3, Mixtral, Gemma)
  • OpenAI - Industry-leading models (GPT-4o, GPT-4o-mini, GPT-3.5-turbo)
  • Anthropic - Advanced Claude models (Claude 3.5 Sonnet, Haiku, Opus)
  • Google Gemini - Latest Google AI (Gemini 1.5 Pro/Flash, 2.0 Flash)
  • Hugging Face - Open-source models (Llama, Mistral, Phi-3, Qwen)

• AI-Powered Service Extraction

  • Automatic service categorization from company websites
  • Comprehensive service listings extracted via AI
  • Support for 23+ different AI models
  • Custom prompt support for tailored extraction

• Detailed Business Information

  • Extract services from any company website
  • Flexible URL input (single or multiple websites)
  • Configurable crawl limits
  • Custom AI prompts for specific extraction needs

• Flexible Configuration

  • Choose your preferred AI provider and model
  • Bring your own API keys for all providers
  • Support for Hugging Face inference providers (Cerebras, Together AI, Cohere, etc.)
  • Proxy configuration support

• Fast and reliable scraping with retry mechanisms

• Supports proxies for anonymity and bypassing restrictions

Pricing

• Pay As You Go: Based on your usage and chosen AI provider
• Groq offers generous free tier for cost-effective scraping
• OpenAI, Anthropic, Gemini, and Hugging Face - competitive pricing

---

Input

The actor accepts the following input parameters:

Required Parameters

• urls (array[string], required): List of company website URLs to extract services from

  • Example: ["https://www.gotomyerp.com/", "https://www.example.com/"]

• provider (string, required): AI provider to use for service extraction

  • Options: "groq", "openai", "anthropic", "gemini", "huggingface"
  • Default: "openai"

Optional Parameters

• custom_prompt (string, optional): Custom prompt to guide the AI in extracting services

  • Use this to tailor the extraction to your specific needs

• model_name (string, optional): Specific AI model to use

  • Groq Models:
    • llama-3.3-70b-versatile, llama-3.1-70b-versatile, llama-3.1-8b-instant, mixtral-8x7b-32768, gemma2-9b-it
  • OpenAI Models:
    • gpt-4o (default), gpt-4o-mini, gpt-4-turbo, gpt-4, gpt-3.5-turbo
  • Anthropic Models:
    • claude-3-5-sonnet-latest, claude-3-5-haiku-latest, claude-3-opus-latest, claude-3-sonnet-20240229, claude-3-haiku-20240307
  • Gemini Models:
    • gemini-1.5-pro, gemini-1.5-flash, gemini-2.0-flash-exp
  • Hugging Face Models:
    • meta-llama/Meta-Llama-3-8B-Instruct, meta-llama/Meta-Llama-3.1-8B-Instruct, mistralai/Mistral-7B-Instruct-v0.3, microsoft/Phi-3-mini-4k-instruct, Qwen/Qwen2.5-7B-Instruct

• provider_name (string, optional): Hugging Face inference provider name

  • Examples: Cerebras, Together AI, Cohere, etc.
  • See: https://hf.co/settings/inference-providers

• maxRequestsPerCrawl (integer, optional): Maximum number of pages to scrape

  • Default: 100
  • Set to 0 for unlimited

• proxyConfiguration (object, optional): Proxy settings for web scraping

  • Default: {"useApifyProxy": false}

API Keys (Required based on provider)

• openai_api_key (string): Your OpenAI API key (required if using OpenAI)
• anthropic_api_key (string): Your Anthropic API key (required if using Anthropic)
• groq_api_key (string): Your Groq API key (required if using Groq)
• gemini_api_key (string): Your Google Gemini API key (required if using Gemini)
• huggingface_api_key (string): Your Hugging Face API key (required if using Hugging Face)

📝 Input Examples:

Using OpenAI (GPT-4o):

{
  "urls": ["https://www.gotomyerp.com/"],
  "provider": "openai",
  "model_name": "gpt-4o",
  "openai_api_key": "sk-your-api-key-here",
  "maxRequestsPerCrawl": 100,
  "proxyConfiguration": {
    "useApifyProxy": false
  }
}

Using Groq (Llama 3.3 - Fast & Free):

{
  "urls": ["https://www.gotomyerp.com/"],
  "provider": "groq",
  "model_name": "llama-3.3-70b-versatile",
  "groq_api_key": "gsk_your-api-key-here",
  "maxRequestsPerCrawl": 100
}

Using Anthropic (Claude 3.5 Sonnet):

{
  "urls": ["https://www.gotomyerp.com/"],
  "provider": "anthropic",
  "model_name": "claude-3-5-sonnet-latest",
  "anthropic_api_key": "sk-ant-your-api-key-here",
  "maxRequestsPerCrawl": 100
}

Using Hugging Face (Llama 3):

{
  "urls": ["https://www.gotomyerp.com/"],
  "provider": "huggingface",
  "model_name": "meta-llama/Meta-Llama-3-8B-Instruct",
  "huggingface_api_key": "hf_your-api-key-here",
  "provider_name": "nebius",
  "maxRequestsPerCrawl": 100
}

With Custom Prompt:

{
  "urls": ["https://www.gotomyerp.com/"],
  "provider": "openai",
  "model_name": "gpt-4o-mini",
  "openai_api_key": "sk-your-api-key-here",
  "custom_prompt": "Extract only the main service categories, not subcategories. Focus on the primary business offerings.",
  "maxRequestsPerCrawl": 50
}

---

Why Choose This Scraper?

• Affordable: Unlimited scraping for just $30/month.
• Comprehensive: Extracts business details and AI-analyzed services.
• Easy to Use: Simple setup and integration with the Apify platform.
• Reliable: Built with retry mechanisms to handle network issues.
• AI-Powered: Multiple AI providers for intelligent service extraction.

---

Recommended Proxy Providers

• Shifter

  • Reliable residential proxies all over the world.
  • Cheap rates
  • Order Shifter Now
  • Get 10% Off any product, use coupan rigelbytes-YoBB.

• OxyLabs

  • 100M+ Proxies
  • Fastest proxies in the market
  • Real profile, human-like Residential IPs
  • Quality assurance framework for most reliable IPs
  • Get Proxies

• DataImpulse

  • Covers 200+ Counties
  • Reliable Residential Proxies for just $1/GB
  • Get Residential Proxies

🙌 Why Buy Through Our Affiliate Link?

• Exclusive Deals: Some providers may offer special discounts or bonuses when you use our link.
• Support Our Work: Each purchase helps us maintain and improve the tools and services we provide.
• No Extra Cost: You pay the same price, but part of it goes to supporting our efforts.

Running via Apify Console

You can run this actor from the Apify Console by providing the necessary input parameters.

Running via API

You can trigger this actor using the Apify API, passing the required input in the request body.

API Request Example (Python)

from apify_client import ApifyClient

# Initialize the ApifyClient with your API token
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = {
  "openai_api_key": "",
  "urls": [
    "https://www.gotomyerp.com/"
  ],
  "provider": "openai",
  "model_name": "gpt-4o",
  "maxRequestsPerCrawl": 100,
  "proxyConfiguration": {
    "useApifyProxy": false
  }
}

# Run the Actor and wait for it to finish
run = client.actor("rigelbytes/website-services-finder").call(run_input=run_input)

JavaScript

import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your API token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {
  "openai_api_key": "",
  "urls": [
    "https://www.gotomyerp.com/"
  ],
  "provider": "openai",
  "model_name": "gpt-4o",
  "maxRequestsPerCrawl": 100,
  "proxyConfiguration": {
    "useApifyProxy": false
  }
};

(async () => {
    // Run the Actor and wait for it to finish
    const run = await client.actor("rigelbytes/website-services-finder").call(input);

})();

Running with cURL

# Set API token
API_TOKEN=<YOUR_API_TOKEN>

# Prepare Actor input
cat > input.json <<'EOF'
{
  "openai_api_key": "",
  "urls": [
    "https://www.gotomyerp.com/"
  ],
  "provider": "openai",
  "model_name": "gpt-4o",
  "maxRequestsPerCrawl": 100,
  "proxyConfiguration": {
    "useApifyProxy": false
  }
}
EOF

# Run the Actor
curl "https://api.apify.com/v2/acts/rigelbytes/website-services-finder/runs?token=$API_TOKEN" \
  -X POST \
  -d @input.json \
  -H 'Content-Type: application/json'

🚀 Other Tools by Rigel Bytes

Extract property listings, prices, and details from Zillow effortlessly.

Gather Airbnb listings, including prices, reviews, and availability.

A versatile tool to crawl and scrape data from any website.

Dive deeper into Zillow listings with detailed property information.

Scrape product details, prices, and reviews from Daraz.

Download high-quality images from Airbnb listings with ease.

Extract UNLIMITED business leads with Google Maps Scraper in different languages.

Export Unlimited Instagram Profiles with Instagram Profile Scraper

Search Companies and Services they provide from Google/Google Maps by city and state.

Understanding Proxies:

When scraping data or browsing anonymously, proxies are essential. They act as intermediaries, masking your original IP address and allowing you to send requests from another location.

Why Use Proxies?

• Avoid IP Blocks: By routing requests through proxies, you prevent the target website from recognizing your IP as a scraper or spammer.
• Access Geo-restricted Content: Proxies let you access content or websites restricted by location.
• Enhance Anonymity: Hide your actual IP, ensuring privacy while scraping or browsing.

Types of Proxies

1. Residential Proxies
   • Real IP addresses provided by ISPs to home users.
   • They mimic regular users, making them harder to detect.
   • Best for: Long-term, undetectable scraping, and avoiding blocks.
2. Data Center Proxies
   • IP addresses from servers in data centers.
   • Faster and cheaper than residential proxies but easier to detect and block.
   • Best for: High-speed scraping, but with a higher risk of detection.
3. Mobile Proxies
   • IPs provided by mobile carriers (3G/4G/5G networks).
   • Very difficult to detect, as they appear as regular mobile users.
   • Best for: Mobile-related scraping or avoiding sophisticated blocks.

Rotating Proxies vs. Straight Proxies

• Rotating Proxies: Every request you send goes through a different proxy, making it harder for websites to detect patterns.
• Straight Proxies: All requests are sent through the same proxy, making it easier to track your IP.

About Rigel Bytes

Rigel Bytes specializes in web scraping, automation, and data analytics. We help businesses extract and leverage valuable data for informed decision-making.

Contact Us

Ready to unlock the power of data? Reach out to us at (contact@rigelbytes.com) or book an appointment with us to learn more about how we can help you achieve your data goals.

Detailed Data

[
  {
    "website": "https://www.gotomyerp.com/",
    "services": [
      "ERP Hosting",
      "QuickBooks Hosting",
      "Sage Cloud Hosting",
      "Sage 50 Cloud Hosting",
      "Sage 100 Cloud Hosting",
      "Sage 300 Cloud Hosting",
      "GovCloud Hosting",
      "Business Apps",
      "ERP Software",
      "Sage Intacct",
      "Sage 100",
      "Sage 300",
      "Managed Server Hosting",
      "Private Server Hosting",
      "Application Hosting",
      "Custom Integrations",
      "Sage Consulting Services",
      "Sage Authorized Reseller",
      "QuickBooks Authorized Reseller",
      "Partner Program",
      "Security",
      "Compliance",
      "Continuity Plans",
      "Disaster Recovery",
      "Identity Access Management",
      "MultiFactor Authentication"
    ]
  }
]