Skip to content

Minikube CI fails in all builds, should always pass #21804

@nirs

Description

@nirs

Minikube CI has may jobs that always fail.

  • This is very bad the project, looking like poorly maintained project. Users and contributors are unlikely to use or contribute to project in this state.
  • This is bad for developers, having to depend time checking the unrelated failures
  • This is bad for the project, since developers are likely to ignore the entire failed build since it know to always fail. New issues will not be discovered since nobody checks the failed builds.

How it should work:

  • All tests pass in all builds
  • New failures are investigated and fix before merging new changes
  • Known failures skipped
  • Known flaky tests re-run automatically by the system to avoid flakiness. If this does not fix the test, test should be skipped
  • Open issue for every known test failure or flakiness

Example failures from #21800

This is one example, but every build contains similar errors, usually all of these errors.

  • Docker_Linux_crio
    Docker_Linux_crio — Jenkins: completed with 37 / 326 failures in 50.15 minutes.
  • Docker_Linux_crio_arm64
    Docker_Linux_crio_arm64 — Jenkins: completed with 36 / 326 failures in 75.50 minutes.
  • Docker_Windows
    Docker_Windows — Jenkins: completed with 2 / 343 failures in 85.47 minutes.
  • integration-docker-containerd-linux-x86-64
    integration-docker-containerd-linux-x86-64 — Job failed.                     BaseSHA:5ca02f9f576d2f3fd8ffc33bc1ce011b281a7e09
    Required
  • integration-docker-crio-linux-x86-64
    integration-docker-crio-linux-x86-64 — Job failed.                     BaseSHA:5ca02f9f576d2f3fd8ffc33bc1ce011b281a7e09
    Required
  • integration-docker-docker-linux-x86-64
    integration-docker-docker-linux-x86-64 — Job failed.                     BaseSHA:5ca02f9f576d2f3fd8ffc33bc1ce011b281a7e09
    Required
  • integration-kvm-containerd-linux-x86-64
    integration-kvm-containerd-linux-x86-64 — Job failed.                     BaseSHA:5ca02f9f576d2f3fd8ffc33bc1ce011b281a7e09
    Required
  • integration-kvm-crio-linux-x86-64
    integration-kvm-crio-linux-x86-64 — Job failed.                     BaseSHA:5ca02f9f576d2f3fd8ffc33bc1ce011b281a7e09
    Required
  • integration-kvm-docker-linux-x86-64
    integration-kvm-docker-linux-x86-64 — Job failed.                     BaseSHA:5ca02f9f576d2f3fd8ffc33bc1ce011b281a7e09
    Required
  • integration-none-docker-linux-x86-64
    integration-none-docker-linux-x86-64 — Job failed.                     BaseSHA:5ca02f9f576d2f3fd8ffc33bc1ce011b281a7e09
    Required
  • KVM_Linux_crio
    KVM_Linux_crio — Jenkins: completed with 2 / 329 failures in 70.78 minutes.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions