Skip to content

ci(e2e): add DVP-over-DVP matrix testing with parallel execution #1577

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Draft
wants to merge 240 commits into
base: main
Choose a base branch
from
Draft

ci(e2e): add DVP-over-DVP matrix testing with parallel execution #1577

wants to merge 240 commits into from

Conversation

@yachmenevas
Copy link
Contributor

@yachmenevas yachmenevas commented Oct 15, 2025 •
edited by universal-itengineer
Loading

Description

Implement isolated DVP-over-DVP testing with parallel matrix execution for storage profiles (sds, cephrbd). Includes modular workflow architecture, CLI wrapper, and automatic cleanup for nightly runs.

Why do we need it, and what problem does it solve?

What is the expected result?

Checklist

  • The code is covered by unit tests.
  • e2e tests passed.
  • Documentation updated according to the changes.
  • Changes were tested in the Kubernetes cluster manually.

Changelog entries

section: ci
type: chore
summary: add DVP-over-DVP matrix e2e testing

sourcery-ai[bot]
sourcery-ai bot reviewed Oct 15, 2025
View reviewed changes
Copy link
Contributor

@sourcery-ai sourcery-ai bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sorry @asyachmenevflant, your pull request is larger than the review limit of 150000 diff characters

z9r5
z9r5 previously approved these changes Oct 15, 2025
View reviewed changes
@yachmenevas yachmenevas marked this pull request as draft October 15, 2025 08:25
@yachmenevas
ci(e2e): add DVP-over-DVP matrix testing with parallel execution
df15f9f 
Signed-off-by: Yachmenev Anton <anton.yachmenev@flant.com>
@yachmenevas
ci: drop artifacts/binaries from VCS; update .gitignore
7c7689c 
Signed-off-by: Yachmenev Anton <anton.yachmenev@flant.com>
@yachmenevas
ci(e2e): restore workflow, Taskfiles, charts, scripts and docs
395d32e 
Signed-off-by: Yachmenev Anton <anton.yachmenev@flant.com>
@yachmenevas yachmenevas added this to the v1.2.0 milestone Oct 15, 2025
@yachmenevas
dvcr: make templates nil-safe; remove temporary root values.yaml
09542e3 
Signed-off-by: Yachmenev Anton <anton.yachmenev@flant.com>
Antony added 30 commits November 6, 2025 10:43
ci: trim redundant waits in e2e matrix
78ef047
ci: wire prod registry and fix sds crd wait
a4f514a
ci: keep dev registry login for dhctl bootstrap
71bd66b
ci: include dev registry in dockercfg
662025c
ci: stabilize nested kubeconfig and sds setup
3bfa399
chore(ci): add ingress publish smoke to nested e2e matrix (ingress-ng…
c072e51 
…inx HostPort, in-cluster curl)
ci: harden module apply and nested ssh retries
0d1b715
ci: simplify cleanup workflow
930aa11
chore(ci): remove leftover comment from nested e2e matrix flow
619b5e4
ci: fix sds module heredoc
767f5ac
chore(ci): split e2e preparation and test jobs
a2d40a0
ci(e2e): fix heredoc EOFs; route Ceph setup via Taskfile and add wait…
313e58c 
…s for CRDs/cluster connection
ci: fix YAML by reindenting heredoc EOF markers
1af34ac
ci(e2e): route storage selection via shell case; drop ingress smoke s…
ca6b4a8 
…teps
ci(e2e): fix SDS ModuleConfig apply to avoid heredoc; generate YAML v…
cf63d5d 
…ia yq
ci(e2e): fix relative paths for ceph manifests; add cwd debug; remove…
5286743 
… early Go setup in prepare
ci(e2e): stop polling Deckhouse Module states; wait for CRDs/operator…
de4bd6d 
… instead (SDS/Ceph)
ci(e2e): deflake SA token retrieval — wait for SA + fallback to token…
ba7f2c5 
… Secret if TokenRequest fails
ci(e2e): use parent token from GitHub secret for bootstrap; prefer ku…
9c65c95 
…beconfig token; keep TokenRequest as last resort
ci(e2e): revert kubeconfig token flow to TokenRequest to avoid breaki…
c59e549 
…ng bootstrap; remove PARENT_SA_TOKEN wiring
ci(e2e): ensure ModuleSource for SDS; set ModuleConfig.source=deckhou…
06d2d51 
…se-prod; apply SDS manifests; use profile storage class
ci(sds): fix LVMVolumeGroup apiVersion to storage.deckhouse.io/v1alpha1
d972515
ci: trim noisy debug in Ceph task; fix SDS LVMVolumeGroup spec to Loc…
f18c600 
…al with selector
ci(sds): fix LVMVolumeGroup schema (spec.local) and use LVM pool; ci(…
84743c5 
…ceph): wait for operator-ceph OR rook-ceph-operator
ci(ceph): wait only for deploy/operator-ceph (drop rook-ceph-operator…
f7710a7 
… fallback)
ci: normalize waits to 50 iterations (was 36/60) and update log counters
1d8243b
ci(sds): fix module source conflict (use Embedded) and yq env var for…
3c9b4f1 
… per-node LVMVG generation
ci(sds): use deckhouse-prod (io) via REGISTRY_DOCKER_CFG; fix yq env(…
33a5c37 
…NODE) in per-node LVMVG generation
ci(e2e-matrix): use profile SC; drop aliases; fix summary; stable RUN…
01ca717 
…_ID (no SHA); no docker prune
ci(e2e-matrix): keep Ceph SC for bootstrap and worker hotplug as base…
b9ca786 
… fast storage
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@sourcery-ai sourcery-ai[bot] sourcery-ai[bot] left review comments

@universal-itengineer universal-itengineer universal-itengineer left review comments

@Isteb4k Isteb4k Isteb4k requested changes

@z9r5 z9r5 z9r5 left review comments

@hardcoretime hardcoretime Awaiting requested review from hardcoretime hardcoretime is a code owner

@danilrwx danilrwx Awaiting requested review from danilrwx danilrwx is a code owner

@fl64 fl64 Awaiting requested review from fl64 fl64 is a code owner

@goganat goganat Awaiting requested review from goganat

@nevermarine nevermarine Awaiting requested review from nevermarine nevermarine is a code owner

Requested changes must be addressed to merge this pull request.

Assignees

@yachmenevas yachmenevas

Labels

None yet

Projects

None yet

Milestone

v1.2.0

Development

Successfully merging this pull request may close these issues.

5 participants

@yachmenevas @z9r5 @Isteb4k @universal-itengineer