monitoring

VirtControllerRESTErrorsHigh

Meaning

More than 5% of REST calls failed in virt-controller in the last 60 minutes.

This is most likely because virt-controller has partially lost connection to the API server.

This error is frequently caused by one of the following problems:

Impact

Node-related actions, such as starting and migrating, and scheduling virtual machines, are delayed. Running workloads are not affected, but reporting their current status might be delayed.

Diagnosis

  1. Set the NAMESPACE environment variable:

    $ export NAMESPACE="$(kubectl get kubevirt -A -o custom-columns="":.metadata.namespace)"
    
  2. List the available virt-controller pods:

    $ kubectl get pods -n $NAMESPACE -l=kubevirt.io=virt-controller
    
  3. Check the virt-controller logs for error messages when connecting to the API server:

    $ kubectl logs -n $NAMESPACE <virt-controller>
    

Mitigation

If you cannot resolve the issue, see the following resources: