AI-augmented Playwright + pytest framework for testing MCP servers and UI flows, with optional self-healing, visual triage, fuzzing, and flaky-test analysis.
MCP Test Framework (Playwright + Python + AI)
An AI-augmented test automation framework for Model Context Protocol (MCP) servers and any UI in front of them, built on Playwright (Python) and pytest.
It gives you two things at once: 1. A normal, deterministic test framework (page objects, fixtures, MCP client, reporting) that works with zero AI dependency. 2. A set of opt-in AI modules (ai/) that plug into that framework to reduce maintenance burden and catch things static assertions miss — self-healing locators, visual regression triage, MCP fuzzing, flaky-test root-causing, and more.
Every AI feature is behind a flag in .env / config/settings.py and degrades gracefully (raises a clear error or skips) if ANTHROPICAPIKEY isn't set — the core suite never depends on AI to run.
Out of the box, tests/mcp/ runs against the bundled examples/demoserver.py (a ~40-line FastMCP server with example tools, a resource, and a prompt), so make test-mcp is green on a fresh clone with no external setup. To test your real server, point MCPSERVERCOMMAND / MCPSERVERARGS (or the mcpserver block in config/environments.yaml) at it — a python/python3 command is automatically resolved to the interpreter running pytest, so the server sees the same virtualenv.
TESTENV=staging pytest switches which block of config/environments.yaml is loaded.
By default, the UI examples point at https://rahulshettyacademy.com/practice. If you want to override it for local experimentation, set BASEURL before running pytest.
From the project README.
Add the radar badge to your README — it shows your project was picked up by MCP Radar and links to this page:
[](https://mcp.liqiwa.com/s/vidhyampp--MCP-Test-Framework.html)
Turn scattered notes, docs and transcripts into a queryable Markdown wiki — an LLM knowledge-base compiler with MCP access, no embeddings, self-hosted.
alxgntv/substack-api-mcpMCP server for Substack posts (FastMCP + substack-api-client)
sm18lr88/STT-MCPFast, local speech-to-text MCP server
simonw/mcp-explorerCLI tool for exploring an MCP server
sandeepbazar/ocm-mcp-serverAn MCP server that lets AI agents operate a multi-cluster Kubernetes fleet through an Open Cluster Management hub, with policy, approval, and audit between the model and your clusters.
Vladimir-Human/ru-marketplace-mcpДевять российских маркетплейсов и китайский Taobao как MCP-серверы: Wildberries, Ozon, Яндекс Маркет, Детский мир, Авито, Мегамаркет, Lamoda, DNS, Ситилинк. Плюс сравнение цен по всем сразу. Только чт
The top new MCP servers of the week, every Monday. No spam, unsubscribe anytime.