Skip to content

[Installation Error] err="couldn't get resource list for metrics.k8s.io/v1beta1: the server is currently unable to handle the request"

Description

On this method of installing CODECO, the following error keeps appearing in the logs:

E1121 14:48:13.015474 1615649 memcache.go:287] "Unhandled Error" err="couldn't get resource list for metrics.k8s.io/v1beta1: the server is currently unable to handle the request" logger="UnhandledError"

Following are the state of the pods:

State of the Pods
$ kubectl get pods -A 

NAMESPACE                NAME                                                    READY   STATUS              RESTARTS         AGE
cert-manager             cert-manager-655ff476d-2gblx                            0/1     ContainerCreating   0                62m
cert-manager             cert-manager-cainjector-6654f55cb7-fb92h                0/1     ContainerCreating   0                62m
cert-manager             cert-manager-webhook-6db4d44ff-5pqts                    0/1     ContainerCreating   0                62m
he-codeco-acm            acm-operator-controller-manager-5ddb744c9c-qv7t7        0/2     ContainerCreating   0                63m
he-codeco-mdm            freshness-connector-check-connection-6c8b6f5f55-r7542   0/1     ContainerCreating   0                50m
he-codeco-mdm            k8s-connector-check-connection-665d468d8f-49688         0/1     ContainerCreating   0                50m
he-codeco-mdm            kubescape-connector-check-connection-6b9749855c-fk6vh   0/1     ContainerCreating   0                50m
he-codeco-mdm            mdm-api-0                                               0/1     ContainerCreating   0                50m
he-codeco-mdm            mdm-controller-0                                        0/1     ContainerCreating   0                50m
he-codeco-mdm            mdm-kafka-0                                             0/1     Pending             0                55m
he-codeco-mdm            mdm-kafka-provisioning-z7h5p                            0/1     Init:0/1            0                55m
he-codeco-mdm            mdm-neo4j-0                                             0/1     Pending             0                50m
he-codeco-mdm            mdm-zookeeper-0                                         0/1     Pending             0                55m
he-codeco-netma          l2sm-controller-dcb994477-lqmxk                         0/1     ContainerCreating   0                60m
he-codeco-netma          l2sm-controller-manager-6d4565c879-fz8kf                0/2     ContainerCreating   0                60m
he-codeco-netma          l2sm-operator-7748d55c4d-nlqsp                          0/1     Init:0/1            0                60m
he-codeco-netma          l2sm-switch-fkdk9                                       0/1     Init:0/1            0                60m
he-codeco-netma          l2sm-switch-gs5qz                                       0/1     Init:0/1            0                60m
he-codeco-netma          l2sm-switch-m299h                                       0/1     Init:0/1            0                60m
he-codeco-netma          mysql-pod                                               0/1     ContainerCreating   0                60m
he-codeco-netma          nemesys-5b59566f85-sjg52                                0/1     ContainerCreating   0                57m
he-codeco-netma          network-probe-daemonset-djpd6                           0/1     ContainerCreating   0                57m
he-codeco-netma          network-probe-daemonset-md9tk                           0/1     ContainerCreating   0                57m
he-codeco-netma          network-probe-daemonset-pw4pp                           0/1     ContainerCreating   0                57m
he-codeco-pdlc           gnn-controller-7c65cbc66f-r62mh                         0/1     ContainerCreating   0                42m
he-codeco-pdlc           pdlc-ca-dbbdc8754-qjkc4                                 0/1     ContainerCreating   0                45m
he-codeco-pdlc           pdlc-dp-859b798445-zddq4                                0/1     ContainerCreating   0                50m
he-codeco-pdlc           pdlc-gnn-inference-79d877d964-b9z7q                     0/1     ContainerCreating   0                42m
he-codeco-pdlc           pdlc-rl-589756767f-p86bm                                0/1     ContainerCreating   0                39m
he-codeco-swm            controller-manager-79778d9c88-qr7pq                     0/2     ContainerCreating   0                34m
he-codeco-swm            solver-6f8f47857f-tbjm5                                 0/1     ContainerCreating   0                34m
kepler                   kepler-exporter-gc4m4                                   0/1     ContainerCreating   0                33m
kepler                   kepler-exporter-ggtmr                                   0/1     ContainerCreating   0                33m
kepler                   kepler-exporter-gtdmq                                   0/1     ContainerCreating   0                33m
kube-flannel             kube-flannel-ds-grvs6                                   0/1     Error               17 (5m19s ago)   62m
kube-flannel             kube-flannel-ds-hg7xq                                   0/1     CrashLoopBackOff    17 (23s ago)     62m
kube-flannel             kube-flannel-ds-pzd42                                   0/1     CrashLoopBackOff    17 (22s ago)     62m
kube-system              coredns-787d4945fb-2mlbl                                0/1     ContainerCreating   0                72m
kube-system              coredns-787d4945fb-zcn75                                0/1     ContainerCreating   0                72m
kube-system              etcd-kind-control-plane                                 1/1     Running             0                72m
kube-system              kube-apiserver-kind-control-plane                       1/1     Running             0                72m
kube-system              kube-controller-manager-kind-control-plane              1/1     Running             0                72m
kube-system              kube-multus-ds-6vbqv                                    1/1     Running             0                62m
kube-system              kube-multus-ds-f8lcw                                    1/1     Running             0                62m
kube-system              kube-multus-ds-mhpgz                                    1/1     Running             0                62m
kube-system              kube-proxy-9l9cf                                        1/1     Running             0                72m
kube-system              kube-proxy-g8qms                                        1/1     Running             0                71m
kube-system              kube-proxy-gzddn                                        1/1     Running             0                71m
kube-system              kube-scheduler-kind-control-plane                       1/1     Running             0                72m
kube-system              nodedaemon-6q2db                                        0/1     CrashLoopBackOff    8 (4m22s ago)    34m
kube-system              nodedaemon-gqwtm                                        0/1     CrashLoopBackOff    8 (4m20s ago)    34m
kube-system              nodedaemon-jjpx6                                        0/1     CrashLoopBackOff    8 (4m22s ago)    34m
kube-system              qos-scheduler-68f4d5b6b9-76gkf                          0/1     ContainerCreating   0                34m
local-path-storage       local-path-provisioner-6bd6454576-nl8xx                 0/1     ContainerCreating   0                72m
monitoring               blackbox-exporter-556858c76d-m2m4c                      0/3     ContainerCreating   0                63m
monitoring               grafana-77fd45b954-sp26r                                0/1     ContainerCreating   0                63m
monitoring               kube-state-metrics-6ddd8b6986-f4bsm                     0/3     ContainerCreating   0                63m
monitoring               node-exporter-g47wf                                     2/2     Running             0                63m
monitoring               node-exporter-tbmzn                                     2/2     Running             0                63m
monitoring               node-exporter-vm7s9                                     2/2     Running             0                63m
monitoring               prometheus-adapter-7585f5c8bc-6rpg5                     0/1     ContainerCreating   0                63m
monitoring               prometheus-adapter-7585f5c8bc-znnh4                     0/1     ContainerCreating   0                63m
monitoring               prometheus-operator-6b7cbdb8cc-hmvxd                    0/2     ContainerCreating   0                63m
network-k8s-namespace    network-base-859688c6dd-m5vxk                           0/1     ContainerCreating   0                34m
network-l2sm-namespace   network-l2sm-8664d6bf5-ht6rt                            0/1     ContainerCreating   0                34m

Installation Logs

In this file, there are all the logs from the installation: log.txt

Found by: @kkeijzer

Edited by Panagiotis Karamolegkos