CrewAI MCP Tester

It is important to ensure that your MCP server is functioning correctly and that all tools are available and working as expected. This Actor automates the manual testing process and provides a detailed report on the status of each tool.

Since MCP servers are often used in agentic-based applications, it is essential to test the MCP server using an agentic approach.

ℹ️ Notice:
This Actor internally uses the Apify Openrouter Actor to call an LLM. You will be billed for LLM usage through this Actor.

🔥 Features

• Connects to MCP servers via URL and tests all available tools
• Uses GPT-4.1 Mini to interact with MCP tools and evaluate responses
• Generates test reports with pass/fail status and findings
• Supports custom headers for authentication
• Token-based pricing model using Pay per Event
• Runs on Apify platform

📊 Output Data

Field	Type	Description
mcpUrl	String	The tested MCP server URL
allTestsPassed	Boolean	Overall pass/fail status of all MCP server tests
toolsStatus	Object	Detailed status of each tool with passed boolean and detail string

🚀 Usage

1. Navigate to the Actor page
2. Provide the MCP server URL
3. Add authentication headers for the MCP server (if required)
4. Start the test
5. Review the generated report

💰 Pricing

You will be charged based on LLM token usage. For a simple MCP server with a few tools, the cost should be under $0.05 per test run.

💾 Input

The Actor accepts the following input parameters:

{
  "mcpUrl": "https://your-mcp-server.com/mcp",
  "headers": {
    "Authorization": "Bearer your-token",
    "X-Custom-Header": "custom-value"
  }
}

Parameters:

• mcpUrl (required): MCP server endpoint URL
• headers (optional): HTTP headers for authentication or configuration

🔢 Output

The Actor returns structured data in JSON format:

{
  "mcpUrl": "https://mcp.apify.com",
  "allTestsPassed": true,
  "toolsStatus": {
    "get-actor-details": {
      "passed": true,
      "detail": "Successfully retrieved detailed information about the actor 'apify/proxy-test'."
    },
    "search-actors": {
      "passed": true,
      "detail": "Successfully searched for actors with the keyword 'test' and received valid results."
    },
    "search-apify-docs": {
      "passed": true,
      "detail": "Successfully searched Apify documentation for the keyword 'test' and received relevant documentation links."
    },
    "fetch-apify-docs": {
      "passed": true,
      "detail": "Successfully fetched full content of an Apify documentation page about automated testing."
    },
    "add-actor": {
      "passed": true,
      "detail": "Successfully added the actor 'apify/proxy-test' to the available tools."
    },
    "apify-slash-rag-web-browser": {
      "passed": true,
      "detail": "Successfully ran a basic operation querying 'san francisco weather' and received results without errors."
    }
  }
}

🔧 Configuration

Custom Headers

For MCP servers requiring authentication:

{
  "mcpUrl": "https://secure-mcp-server.com/mcp",
  "headers": {
    "Authorization": "Bearer your-secure-token",
    "X-API-Key": "your-api-key",
  }
}

🌐 Open Source

This Actor is open source and available on GitHub.

📚 Resources

• Apify Actor CrewAI template
• How to Build an AI Agent with CrewAI
• How to use MCP with Apify Actors
• Webinar: Building and monetizing MCP servers on Apify