-
Notifications
You must be signed in to change notification settings - Fork 5.1k
Open
Description
Minikube CI has may jobs that always fail.
- This is very bad the project, looking like poorly maintained project. Users and contributors are unlikely to use or contribute to project in this state.
- This is bad for developers, having to depend time checking the unrelated failures
- This is bad for the project, since developers are likely to ignore the entire failed build since it know to always fail. New issues will not be discovered since nobody checks the failed builds.
How it should work:
- All tests pass in all builds
- New failures are investigated and fix before merging new changes
- Known failures skipped
- Known flaky tests re-run automatically by the system to avoid flakiness. If this does not fix the test, test should be skipped
- Open issue for every known test failure or flakiness
Example failures from #21800
This is one example, but every build contains similar errors, usually all of these errors.
- Docker_Linux_crio
Docker_Linux_crio — Jenkins: completed with 37 / 326 failures in 50.15 minutes. - Docker_Linux_crio_arm64
Docker_Linux_crio_arm64 — Jenkins: completed with 36 / 326 failures in 75.50 minutes. - Docker_Windows
Docker_Windows — Jenkins: completed with 2 / 343 failures in 85.47 minutes. - integration-docker-containerd-linux-x86-64
integration-docker-containerd-linux-x86-64 — Job failed. BaseSHA:5ca02f9f576d2f3fd8ffc33bc1ce011b281a7e09
Required - integration-docker-crio-linux-x86-64
integration-docker-crio-linux-x86-64 — Job failed. BaseSHA:5ca02f9f576d2f3fd8ffc33bc1ce011b281a7e09
Required - integration-docker-docker-linux-x86-64
integration-docker-docker-linux-x86-64 — Job failed. BaseSHA:5ca02f9f576d2f3fd8ffc33bc1ce011b281a7e09
Required - integration-kvm-containerd-linux-x86-64
integration-kvm-containerd-linux-x86-64 — Job failed. BaseSHA:5ca02f9f576d2f3fd8ffc33bc1ce011b281a7e09
Required - integration-kvm-crio-linux-x86-64
integration-kvm-crio-linux-x86-64 — Job failed. BaseSHA:5ca02f9f576d2f3fd8ffc33bc1ce011b281a7e09
Required - integration-kvm-docker-linux-x86-64
integration-kvm-docker-linux-x86-64 — Job failed. BaseSHA:5ca02f9f576d2f3fd8ffc33bc1ce011b281a7e09
Required - integration-none-docker-linux-x86-64
integration-none-docker-linux-x86-64 — Job failed. BaseSHA:5ca02f9f576d2f3fd8ffc33bc1ce011b281a7e09
Required - KVM_Linux_crio
KVM_Linux_crio — Jenkins: completed with 2 / 329 failures in 70.78 minutes.
henry3260
Metadata
Metadata
Assignees
Labels
No labels