mirror of
https://github.com/seaweedfs/seaweedfs.git
synced 2026-11-20 03:13:53 +01:00
docs(testops): mark G15b manifest registration executable
This commit is contained in:
1 parent
ea2ca11f73
commit
83b953b613
2 files changed
+20
-12
No files matched your search
@@ -1,7 +1,7 @@
|
||||
# V3 Phase 15 TestOps Plan
|
||||
|
||||
**Date**: 2026-05-03
|
||||
**Status**: DRAFT v0.2; V3 `internal/testops` contract skeleton implemented
|
||||
**Status**: DRAFT v0.3; V3 `internal/testops` contract skeleton implemented; first registered `go-test` scenario executable at `f51b79b`
|
||||
**Scope**: end-to-end V3 test operations covering dev loop, gate close, regression, debug, hardware, K8s, chaos
|
||||
**Code repo**: `seaweed_block` (V3 binaries / per-package go test)
|
||||
**Docs repo**: `seaweedfs/sw-block/design/test/`
|
||||
@@ -100,9 +100,15 @@ Implementation note:
|
||||
- `Driver`
|
||||
- `Registry`
|
||||
- `ShellDriver`
|
||||
- `GoTestDriver`
|
||||
- registration decoding / driver construction
|
||||
- This package is the code-level insertion point for V3 scenarios. A future
|
||||
ported V2 testrunner should plug in by implementing `Driver`; it should not
|
||||
replace the contract.
|
||||
- Slice 1 landed at `seaweed_block@f51b79b`: `testops/registry/g15b-manifest.json`
|
||||
loads into the registry, executes the G15b manifest/harness `go test`, and
|
||||
writes standard `run-request.json`, `result.json`, and `test-stdout.log`
|
||||
artifacts.
|
||||
|
||||
### 3.1 Layout
|
||||
|
||||
@@ -385,7 +391,7 @@ Each scenario has: a driver in `bridge/scenarios/`, a test instruction in
|
||||
|---|---|---|---|---|
|
||||
| `g15a-privileged` | `g15a-privileged.sh` | `v3-phase-15-g15a-privileged-qa-test-instruction.md` | `ac49adb` | L3 |
|
||||
| `g15a-non-privileged` | `g15a-non-privileged.sh` | `v3-phase-15-g15a-qa-test-instruction.md` | `ac49adb` | L2 |
|
||||
| `g15b-manifest` | `g15b-manifest.sh` | `v3-phase-15-g15b-manifest-qa-test-instruction.md` | `62325c9` | L1/L2 |
|
||||
| `g15b-manifest` | `go-test` via `testops/registry/g15b-manifest.json` | `v3-phase-15-g15b-k8s-qa-test-instruction.md` | `f51b79b` | L1/L2 |
|
||||
| `g15b-k8s-static` | `g15b-k8s-static.sh` | `v3-phase-15-g15b-k8s-qa-test-instruction.md` | `5375add` | L5 |
|
||||
| `g9g-l2` | `g9g-l2.sh` | `v3-phase-15-g9g-qa-test-instruction.md` | `7ed9ab2` | L2 |
|
||||
| `g8-failover-l2` | `g8-failover-l2.sh` | (forward-carry: derive from G8 mini-plan §12) | `b320336` | L2 |
|
||||
@@ -439,7 +445,7 @@ Architect should override defaults before P1 starts.
|
||||
Current sw recommendation:
|
||||
|
||||
- Ratify Q1/Q3/Q4 as default.
|
||||
- Start P1 on top of `internal/testops`, not directly on raw shell scripts.
|
||||
- Continue P1 on top of `internal/testops`, not directly on raw shell scripts; first executable registration is `g15b-manifest` at `f51b79b`.
|
||||
- Treat V2 testrunner port as a future `Driver` implementation.
|
||||
|
||||
---
|
||||
|
||||
@@ -3,7 +3,7 @@
|
||||
**Date**: 2026-05-03
|
||||
**Status**: architect draft; complements `v3-phase-15-testops-plan.md`
|
||||
**Scope**: how V3 gates/projects expose test scenarios so TestOps can discover, register, and run them independently
|
||||
**Code anchor**: `seaweed_block/internal/testops` introduced at `c2b5d9a`
|
||||
**Code anchor**: `seaweed_block/internal/testops` introduced at `c2b5d9a`; first registered `go-test` scenario landed at `f51b79b`
|
||||
|
||||
---
|
||||
|
||||
@@ -169,7 +169,7 @@ Initial driver types:
|
||||
| Driver | Purpose | Current status |
|
||||
|---|---|---|
|
||||
| `shell` | Runs an existing script that reads normalized request and writes result. | Implemented as `internal/testops.ShellDriver`. |
|
||||
| `go-test` | Runs `go test` package/focus commands and maps output to result. | Next recommended implementation. |
|
||||
| `go-test` | Runs `go test` package/focus commands and maps output to result. | Implemented as `internal/testops.GoTestDriver` at `f51b79b`. |
|
||||
| `k8s` | Applies manifests, waits for resources, collects logs. | Can start as shell wrapper; later native. |
|
||||
| `privileged-host` | Runs sudo/host OS checks and captures pre/post state. | Can start as shell wrapper. |
|
||||
| `yaml` | Runs future ported V2 testrunner parser/engine. | Future; conditional. |
|
||||
@@ -220,7 +220,7 @@ The last rule is strict:
|
||||
|
||||
| Scenario | Driver | Layer | Known green | Status |
|
||||
|---|---|---|---|---|
|
||||
| `g15b-manifest` | `go-test` | L1/L2 | `62325c9` | ready to register |
|
||||
| `g15b-manifest` | `go-test` | L1/L2 | `eb13105` | registered and executable at `f51b79b` |
|
||||
| `g15b-k8s-static` | `shell` | L5 | `5375add` preflight only; K8s run pending | ready to register as pending-lab |
|
||||
| `g15a-privileged` | `shell` | L3 | `ac49adb` | ready to register |
|
||||
| `g15a-non-privileged` | `go-test` | L2 | `ac49adb` | ready to register |
|
||||
@@ -230,24 +230,26 @@ The last rule is strict:
|
||||
|
||||
---
|
||||
|
||||
## §9 Recommended Next Slice
|
||||
## §9 Slice 1 Result
|
||||
|
||||
Implement `testops/registry/g15b-manifest.json` and a minimal `go-test` driver.
|
||||
`testops/registry/g15b-manifest.json` and a minimal `go-test` driver landed at `seaweed_block@f51b79b`.
|
||||
|
||||
Why this first:
|
||||
Why this was first:
|
||||
|
||||
- It is non-privileged.
|
||||
- It is fast.
|
||||
- It proves the registration path without requiring K8s or m01.
|
||||
- It gives QA an example registration file to copy.
|
||||
|
||||
Pass condition:
|
||||
Pass condition, verified on `p15-g15b/k8s-static-pv@f51b79b`:
|
||||
|
||||
```powershell
|
||||
go test ./internal/testops ./cmd/blockcsi -count=1
|
||||
```
|
||||
|
||||
plus a small smoke that loads `g15b-manifest.json`, runs the registered scenario, and emits a valid `result.json` in a temp artifact dir.
|
||||
The `internal/testops` suite includes the smoke that loads `g15b-manifest.json`, runs the registered scenario through `GoTestDriver`, and emits a valid `result.json` in a temp artifact dir.
|
||||
|
||||
Next slice: register `g15b-k8s-static` as a shell-driver scenario once the M02 rerun is green on the `eb13105+` manifest/harness fix.
|
||||
|
||||
---
|
||||
|
||||
@@ -255,6 +257,6 @@ plus a small smoke that loads `g15b-manifest.json`, runs the registered scenario
|
||||
|
||||
| Role | Status | Basis |
|
||||
|---|---|---|
|
||||
| sw | draft | captured V3 pluggable TestOps path after `internal/testops` skeleton |
|
||||
| sw | draft | captured V3 pluggable TestOps path after `internal/testops` skeleton; Slice 1 executable registration landed at `f51b79b` |
|
||||
| QA | pending | review registration shape and artifact expectations |
|
||||
| architect | pending | ratify product/runtime non-plugin boundary |
|
||||
Reference in new issue
Block a user