Skip to content

fix(loadtest): eliminate harness false-positives across 30+ admin endpoints #5456

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
Lang-Akshay wants to merge 3 commits into
base: main
Choose a base branch
from
+177 −80
Open

fix(loadtest): eliminate harness false-positives across 30+ admin endpoints #5456

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
d219976
fix(loadtest): eliminate harness false-positives in load test suite
Lang-Akshay Jun 30, 2026
a6a954e
fix(loadtest): improve JSON response validation and error handling
Lang-Akshay Jul 3, 2026
6fb2141
fix(loadtest): implement feature-flag-aware user weights for admin cl…
Lang-Akshay Jul 3, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion docker-compose.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -1954,7 +1954,7 @@ services:
'name': 'Fast Time SSE Server',
'description': 'Virtual server exposing Fast Time MCP tools via SSE transport',
'associated_tools': tool_ids,
'associated_resources': resource_ids,
'associated_resources': [],
'associated_prompts': prompt_ids
}
}
Expand Down
11 changes: 10 additions & 1 deletion docs/docs/testing/performance.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -386,14 +386,23 @@ The Locust UI provides a class picker to select different user behavior profiles
|------------|--------|-------------|
| `HealthCheckUser` | 5 | Health endpoint only |
| `ReadOnlyAPIUser` | 30 | GET endpoints (tools, servers, etc.) |
| `AdminUIUser` | 10 | Admin dashboard pages |
| `AdminUIUser` | 3 | Admin dashboard pages |
| `MCPJsonRpcUser` | 15 | MCP JSON-RPC protocol |
| `WriteAPIUser` | 5 | POST/PUT/DELETE operations |
| `StressTestUser` | 1 | High-frequency requests |
| `FastTimeUser` | 20 | Fast Time MCP server |
| `RealisticUser` | 10 | Mixed realistic workload |
| `HighThroughputUser` | - | Maximum RPS (separate file) |

!!! note "Feature-flag-aware weights"
Several admin-facing user classes are feature-flag aware and run with **weight 0** when the corresponding feature is disabled:

- Classes requiring Admin API (`MCPGATEWAY_ADMIN_API_ENABLED=false`): `ObservabilityUser`, `AdminObservabilityExtendedUser`, `AdminPerformanceExtendedUser`, `AdminPluginsUser`, `AdminSystemExtendedUser`, `AdminSectionsUser`, `AdminSearchUser`, `AdminCacheConfigUser`, `AdminLoginLogoutUser`, `AdminLogsExtendedUser`, `AdminSupportBundleUser`, `AdminEntityDetailUser`, `AdminMetricsResetUser`, `AdminTeamsMembershipUser`, `AdminResourcesTestUser`, `AdminDetailReadExtendedUser`, `AdminGrpcCRUDUser`, `AdminMCPRegistryOpsUser`, `AdminUsersOpsUser`
- Classes requiring Admin UI (`MCPGATEWAY_UI_ENABLED=false`): `AdminGrpcUser`, `AdminHTMXPartialsUser`
- Classes requiring both: `AdminUIUser`, `AdminHTMXEntityOpsUser`, `AdminHTMXEntityCRUDUser`, `AdminTeamsHTMXOpsUser`

This prevents false failures when load-testing a deployment with the Admin UI or Admin API disabled.

### High-Concurrency Testing (4000+ Users)

For testing with 4000+ concurrent users:
Expand Down
Loading