Files
Charon/docs/issues/created/20260208-manual_test_shard_validation.md
akanealw eec8c28fb3
Some checks are pending
Go Benchmark / Performance Regression Check (push) Waiting to run
Cerberus Integration / Cerberus Security Stack Integration (push) Waiting to run
Upload Coverage to Codecov / Backend Codecov Upload (push) Waiting to run
Upload Coverage to Codecov / Frontend Codecov Upload (push) Waiting to run
CodeQL - Analyze / CodeQL analysis (go) (push) Waiting to run
CodeQL - Analyze / CodeQL analysis (javascript-typescript) (push) Waiting to run
CrowdSec Integration / CrowdSec Bouncer Integration (push) Waiting to run
Docker Build, Publish & Test / build-and-push (push) Waiting to run
Docker Build, Publish & Test / Security Scan PR Image (push) Blocked by required conditions
Quality Checks / Auth Route Protection Contract (push) Waiting to run
Quality Checks / Codecov Trigger/Comment Parity Guard (push) Waiting to run
Quality Checks / Backend (Go) (push) Waiting to run
Quality Checks / Frontend (React) (push) Waiting to run
Rate Limit integration / Rate Limiting Integration (push) Waiting to run
Security Scan (PR) / Trivy Binary Scan (push) Waiting to run
Supply Chain Verification (PR) / Verify Supply Chain (push) Waiting to run
WAF integration / Coraza WAF Integration (push) Waiting to run
changed perms
2026-04-22 18:19:14 +00:00

1.1 KiB
Executable File

Manual Test Plan: Shard Isolation Verification

Objective

Verify that the e2e-integration shard (non-security) no longer executes tests requiring Cerberus, WAF, or CrowdSec, and that the e2e-security shard picks up the migrated tests.

Test Cases

1. Verify Non-Security Shard

  • Action: Run the tests/integration folder with Cerberus DISABLED.
  • Expected Outcome:
    • All tests in multi-feature-workflows.spec.ts (Groups A, C, D) pass.
    • No tests attempt to navigate to /security/waf, /security/crowdsec, or toggle WAF features.
    • No 404s or timeouts related to missing security components.

2. Verify Security Shard

  • Action: Run the tests/security folder with Cerberus ENABLED.
  • Expected Outcome:
    • workflow-security.spec.ts runs and executes the 4 extracted tests.
    • WAF, CrowdSec, and ACL features are successfully configured.

3. CI Pipeline Verification

  • Action: Trigger a full CI run.
  • Expected Outcome:
    • e2e-tests / shard (1, 2) (Non-security) passes green.
    • e2e-tests / security-shard passes green (or fails only on genuine bugs, not configuration mismatches).