When deploying node to Kubernetes it times out

[PaX101]

When deploying a node on Kubernetes in Cloudstack 4.19.0.0 it times out when it tries to list the VM's:

Error syncing load balancer: failed to ensure load balancer: error retrieving list of hosts: Get https://my.url.com/client/api?apiKey=myapikeyhere&command=listVirtualMachines&listall=true&response=json&signature=mysignature: net/http: request canceled (Client.Timeout exceeded while awaiting headers)

When i try and load the page myself if takes around 5-10 minutes to load the VM list similar to the bug in 4.18 when trying to list VM's. If i change the command to: listVirtualMachinesMetrics in my broswer it loads instantly.

[rohityadavcloud]

@PaX101 yes because you're listing the listVirtualMachinesMetrics API which by default returns VM stats (which slows down the API request). If you don't need all the details, you can pass details=min to the API response (or specific details you'd expect).

If you're not able to control this API request, one way to address this could be to change the default behaviour that's change-able via global setting.

[rohityadavcloud]

@PaX101 I've proposed a PR here which might help your case - #8985
Can you try to disable vm.stats.increment.metrics global setting in your environment and see if it helps speed you listVIrtualMachines API calls?

[weizhouapache]

@PaX101 yes because you're listing the listVirtualMachinesMetrics API which by default returns VM stats (which slows down the API request). If you don't need all the details, you can pass details=min to the API response (or specific details you'd expect).

If you're not able to control this API request, one way to address this could be to change the default behaviour that's change-able via global setting.

good idea to list virtualmachine with details parameters
I created a PR to address it in ccm: apache/cloudstack-kubernetes-provider#60

[rohityadavcloud]

Additionally fixed in #9177
To make the listing faster, the new global setting will need to be set to false.