Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

helm globalizations generated empty raw to description sometime #620

Open
jasine opened this issue Feb 28, 2023 · 3 comments
Open

helm globalizations generated empty raw to description sometime #620

jasine opened this issue Feb 28, 2023 · 3 comments
Labels
kind/bug Something isn't working

Comments

@jasine
Copy link
Contributor

jasine commented Feb 28, 2023

What happened:

sometimes after installing or upgrading helm packages, helm values lost and Raw field in Description is empty value

restart clusternet-hub and delete description can solve this problem

image

  • log of clusternet hub

I0228 06:12:08.748784       1 aggregatestatus.go:329] handle AggregateStatus dipper/dipper
I0228 06:12:08.853746       1 subscription.go:275] successfully synced Subscription "dipper/dipper"
I0228 06:12:08.948363       1 aggregatestatus.go:241] successfully synced Subscription "dipper/dipper"
W0228 06:12:19.606851       1 reflector.go:324] pkg/mod/k8s.io/client-go@v0.23.5/tools/cache/reflector.go:167: failed to list *v1alpha1.ServiceImport: the server could not find the requested resource (get serviceimports.multicluster.x-k8s.io)
E0228 06:12:19.606877       1 reflector.go:138] pkg/mod/k8s.io/client-go@v0.23.5/tools/cache/reflector.go:167: Failed to watch *v1alpha1.ServiceImport: failed to list *v1alpha1.ServiceImport: the server could not find the requested resource (get serviceimports.multicluster.x-k8s.io)
I0228 06:12:41.134681       1 clusterlifecycle_controller.go:183] successfully synced ManagedCluster "dev-186/dev-186"
I0228 06:12:41.436665       1 clusterlifecycle_controller.go:183] successfully synced ManagedCluster "dev-189/dev-189"
I0228 06:12:41.550835       1 clusterregistrationrequest_controller.go:207] successfully synced ClusterRegistrationRequest "clusternet-54e1271b-0230-4666-b45b-e54c007ea55d"
I0228 06:12:41.648272       1 subscription.go:275] successfully synced Subscription "dipper/dipper"
I0228 06:12:41.748134       1 base.go:269] successfully synced Base "dev-189/dipper"
I0228 06:12:41.751290       1 description.go:312] successfully synced Description "dev-189/dipper-helm"
E0228 06:12:41.751349       1 description.go:317] error syncing 'dev-189/dipper-helm': unknown AppPusher for ManagedCluster with uid=7193d810-a233-4719-9918-19c01bac35be, requeuing
E0228 06:12:41.756787       1 description.go:317] error syncing 'dev-189/dipper-helm': unknown AppPusher for ManagedCluster with uid=7193d810-a233-4719-9918-19c01bac35be, requeuing
E0228 06:12:41.766973       1 description.go:317] error syncing 'dev-189/dipper-helm': unknown AppPusher for ManagedCluster with uid=7193d810-a233-4719-9918-19c01bac35be, requeuing
E0228 06:12:41.787238       1 description.go:317] error syncing 'dev-189/dipper-helm': unknown AppPusher for ManagedCluster with uid=7193d810-a233-4719-9918-19c01bac35be, requeuing
E0228 06:12:41.827824       1 description.go:317] error syncing 'dev-189/dipper-helm': unknown AppPusher for ManagedCluster with uid=7193d810-a233-4719-9918-19c01bac35be, requeuing
I0228 06:12:41.832939       1 base.go:269] successfully synced Base "dev-189/dipper"
I0228 06:12:41.841592       1 description.go:312] successfully synced Description "dev-189/dipper-helm"
E0228 06:12:41.841658       1 description.go:317] error syncing 'dev-189/dipper-helm': unknown AppPusher for ManagedCluster with uid=7193d810-a233-4719-9918-19c01bac35be, requeuing
E0228 06:12:41.908334       1 description.go:317] error syncing 'dev-189/dipper-helm': unknown AppPusher for ManagedCluster with uid=7193d810-a233-4719-9918-19c01bac35be, requeuing
E0228 06:12:42.229070       1 description.go:317] error syncing 'dev-189/dipper-helm': unknown AppPusher for ManagedCluster with uid=7193d810-a233-4719-9918-19c01bac35be, requeuing
E0228 06:12:42.870114       1 description.go:317] error syncing 'dev-189/dipper-helm': unknown AppPusher for ManagedCluster with uid=7193d810-a233-4719-9918-19c01bac35be, requeuing
E0228 06:12:44.150689       1 description.go:317] error syncing 'dev-189/dipper-helm': unknown AppPusher for ManagedCluster with uid=7193d810-a233-4719-9918-19c01bac35be, requeuing
E0228 06:12:46.711627       1 description.go:317] error syncing 'dev-189/dipper-helm': unknown AppPusher for ManagedCluster with uid=7193d810-a233-4719-9918-19c01bac35be, requeuing
I0228 06:12:47.863512       1 secret.go:214] successfully synced Secret "dev-189/child-cluster-deployer"
time="2023-02-28T06:12:47Z" level=info msg="Handling backend connection request [54e1271b-0230-4666-b45b-e54c007ea55d]"
I0228 06:12:47.932760       1 clusterlifecycle_controller.go:183] successfully synced ManagedCluster "dev-189/dev-189"
I0228 06:12:51.839533       1 description.go:312] successfully synced Description "dev-189/dipper-helm"
I0228 06:12:53.418496       1 request.go:665] Waited for 1.170369371s due to client-side throttling, not priority and fairness, request: GET:https://10.43.0.1:443/apis/proxies.clusternet.io/v1alpha1/sockets/54e1271b-0230-4666-b45b-e54c007ea55d/proxy/direct/apis/admissionregistration.k8s.io/v1
I0228 06:13:04.019029       1 request.go:665] Waited for 1.182202607s due to client-side throttling, not priority and fairness, request: GET:https://10.43.0.1:443/apis/proxies.clusternet.io/v1alpha1/sockets/54e1271b-0230-4666-b45b-e54c007ea55d/proxy/direct/apis/authentication.k8s.io/v1
W0228 06:13:08.666533       1 reflector.go:324] pkg/mod/k8s.io/client-go@v0.23.5/tools/cache/reflector.go:167: failed to list *v1alpha1.ServiceImport: the server could not find the requested resource (get serviceimports.multicluster.x-k8s.io)
E0228 06:13:08.666560       1 reflector.go:138] pkg/mod/k8s.io/client-go@v0.23.5/tools/cache/reflector.go:167: Failed to watch *v1alpha1.ServiceImport: failed to list *v1alpha1.ServiceImport: the server could not find the requested resource (get serviceimports.multicluster.x-k8s.io)
E0228 06:13:12.340721       1 helmrelease.go:215] error syncing 'dev-189/dipper-helm-dipper-dipper': unable to build kubernetes objects from release manifest: [unable to recognize "": no matches for kind "Alertmanager" in version "monitoring.coreos.com/v1", unable to recognize "": no matches for kind "Prometheus" in version "monitoring.coreos.com/v1", unable to recognize "": no matches for kind "PrometheusRule" in version "monitoring.coreos.com/v1", unable to recognize "": no matches for kind "ServiceMonitor" in version "monitoring.coreos.com/v1"], requeuing
I0228 06:13:14.138790       1 request.go:665] Waited for 1.365732176s due to client-side throttling, not priority and fairness, request: GET:https://10.43.0.1:443/apis/proxies.clusternet.io/v1alpha1/sockets/54e1271b-0230-4666-b45b-e54c007ea55d/proxy/direct/apis/apiextensions.k8s.io/v1
E0228 06:13:27.862478       1 wrap.go:54] timeout or abort while handling: method=GET URI="/apis/proxies.clusternet.io/v1alpha1/sockets/54e1271b-0230-4666-b45b-e54c007ea55d" audit-ID="55c69647-9ecb-4aec-bb73-6ec6bdcb69c9"
W0228 06:13:47.527771       1 reflector.go:324] pkg/mod/k8s.io/client-go@v0.23.5/tools/cache/reflector.go:167: failed to list *v1alpha1.ServiceImport: the server could not find the requested resource (get serviceimports.multicluster.x-k8s.io)
E0228 06:13:47.527809       1 reflector.go:138] pkg/mod/k8s.io/client-go@v0.23.5/tools/cache/reflector.go:167: Failed to watch *v1alpha1.ServiceImport: failed to list *v1alpha1.ServiceImport: the server could not find the requested resource (get serviceimports.multicluster.x-k8s.io)
W0228 06:14:41.248487       1 reflector.go:324] pkg/mod/k8s.io/client-go@v0.23.5/tools/cache/reflector.go:167: failed to list *v1alpha1.ServiceImport: the server could not find the requested resource (get serviceimports.multicluster.x-k8s.io)
E0228 06:14:41.248512       1 reflector.go:138] pkg/mod/k8s.io/client-go@v0.23.5/tools/cache/reflector.go:167: Failed to watch *v1alpha1.ServiceImport: failed to list *v1alpha1.ServiceImport: the server could not find the requested resource (get serviceimports.multicluster.x-k8s.io)
E0228 06:15:07.486495       1 writers.go:117] apiserver was unable to write a JSON response: http2: stream closed
E0228 06:15:07.486521       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http2: stream closed"}: http2: stream closed
E0228 06:15:07.486542       1 wrap.go:54] timeout or abort while handling: method=GET URI="/apis/shadow/v1alpha1" audit-ID="bc4a9b8d-ea89-4739-9362-40c89061eea3"
E0228 06:15:07.487118       1 writers.go:117] apiserver was unable to write a JSON response: http2: stream closed
E0228 06:15:07.487143       1 wrap.go:54] timeout or abort while handling: method=GET URI="/apis/shadow/v1alpha1" audit-ID="afe5c023-2e21-448d-8725-b49e3978226a"
E0228 06:15:07.487156       1 writers.go:117] apiserver was unable to write a JSON response: http2: stream closed
E0228 06:15:07.487172       1 wrap.go:54] timeout or abort while handling: method=GET URI="/apis/shadow/v1alpha1" audit-ID="1b37c23b-6517-461d-ac36-a934d4607436"
E0228 06:15:07.487292       1 writers.go:117] apiserver was unable to write a JSON response: http2: stream closed
E0228 06:15:07.487318       1 wrap.go:54] timeout or abort while handling: method=GET URI="/apis/shadow/v1alpha1" audit-ID="ab26f06c-c6c6-4c99-bfed-5411ef1fc848"
E0228 06:15:07.487329       1 writers.go:117] apiserver was unable to write a JSON response: http2: stream closed
E0228 06:15:07.487342       1 wrap.go:54] timeout or abort while handling: method=GET URI="/apis/shadow/v1alpha1" audit-ID="e3626f52-8731-45fd-822d-2e64d3b3d771"
E0228 06:15:07.487548       1 writers.go:130] apiserver was unable to write a fallback JSON response: http: Handler timeout
E0228 06:15:07.490009       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http2: stream closed"}: http2: stream closed
E0228 06:15:07.491086       1 writers.go:130] apiserver was unable to write a fallback JSON response: http: Handler timeout
E0228 06:15:07.493249       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http2: stream closed"}: http2: stream closed
E0228 06:15:07.495401       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http2: stream closed"}: http2: stream closed
E0228 06:15:07.497564       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http2: stream closed"}: http2: stream closed
E0228 06:15:07.499745       1 timeout.go:137] post-timeout activity - time-elapsed: 13.18807ms, GET "/apis/shadow/v1alpha1" result: <nil>
E0228 06:15:07.500812       1 timeout.go:137] post-timeout activity - time-elapsed: 13.654876ms, GET "/apis/shadow/v1alpha1" result: <nil>
E0228 06:15:07.501872       1 writers.go:130] apiserver was unable to write a fallback JSON response: http: Handler timeout
E0228 06:15:07.502956       1 writers.go:130] apiserver was unable to write a fallback JSON response: http: Handler timeout
E0228 06:15:07.504026       1 writers.go:130] apiserver was unable to write a fallback JSON response: http: Handler timeout
E0228 06:15:07.507251       1 timeout.go:137] post-timeout activity - time-elapsed: 20.067435ms, GET "/apis/shadow/v1alpha1" result: <nil>
E0228 06:15:07.508365       1 timeout.go:137] post-timeout activity - time-elapsed: 21.032627ms, GET "/apis/shadow/v1alpha1" result: <nil>
E0228 06:15:07.509434       1 timeout.go:137] post-timeout activity - time-elapsed: 22.078901ms, GET "/apis/shadow/v1alpha1" result: <nil>
W0228 06:15:14.840817       1 reflector.go:324] pkg/mod/k8s.io/client-go@v0.23.5/tools/cache/reflector.go:167: failed to list *v1alpha1.ServiceImport: the server could not find the requested resource (get serviceimports.multicluster.x-k8s.io)
E0228 06:15:14.840841       1 reflector.go:138] pkg/mod/k8s.io/client-go@v0.23.5/tools/cache/reflector.go:167: Failed to watch *v1alpha1.ServiceImport: failed to list *v1alpha1.ServiceImport: the server could not find the requested resource (get serviceimports.multicluster.x-k8s.io)
I0228 06:15:41.148854       1 clusterlifecycle_controller.go:183] successfully synced ManagedCluster "dev-186/dev-186"
I0228 06:15:47.948472       1 clusterlifecycle_controller.go:183] successfully synced ManagedCluster "dev-189/dev-189"
W0228 06:15:57.865685       1 reflector.go:324] pkg/mod/k8s.io/client-go@v0.23.5/tools/cache/reflector.go:167: failed to list *v1alpha1.ServiceImport: the server could not find the requested resource (get serviceimports.multicluster.x-k8s.io)
E0228 06:15:57.865708       1 reflector.go:138] pkg/mod/k8s.io/client-go@v0.23.5/tools/cache/reflector.go:167: Failed to watch *v1alpha1.ServiceImport: failed to list *v1alpha1.ServiceImport: the server could not find the requested resource (get serviceimports.multicluster.x-k8s.io)
I0228 06:16:45.646484       1 clusterlifecycle_controller.go:183] successfully synced ManagedCluster "429c8b2cc68ae5309f37/429c8b2cc68ae5309f37"
I0228 06:16:54.854511       1 clusterlifecycle_controller.go:183] successfully synced ManagedCluster "dev-189/dev-189"
W0228 06:16:56.983003       1 reflector.go:324] pkg/mod/k8s.io/client-go@v0.23.5/tools/cache/reflector.go:167: failed to list *v1alpha1.ServiceImport: the server could not find the requested resource (get serviceimports.multicluster.x-k8s.io)
E0228 06:16:56.983028       1 reflector.go:138] pkg/mod/k8s.io/client-go@v0.23.5/tools/cache/reflector.go:167: Failed to watch *v1alpha1.ServiceImport: failed to list *v1alpha1.ServiceImport: the server could not find the requested resource (get serviceimports.multicluster.x-k8s.io)

Environment:

  • Clusternet version: v0.14.0 (v0.13.0 and before occured)
    • Clusternet-agent version (user clusternet-agent --version=json): v0.14.0
    • Clusternet-hub version (user clusternet-hub --version=json): v0.14.0
  • Kubernetes version (use kubectl version): v1.25.6+k3s1 （older k3s version occured）
  • OS (e.g: cat /etc/os-release): ubuntu 20.04.5
  • Kernel (e.g. uname -a): 5.4.0-131-generic
@jasine jasine added the kind/bug Something isn't working label Feb 28, 2023
@dixudx
Copy link
Member

dixudx commented Feb 28, 2023

IA== is the base64 encoded string of whitespace character .

@jasine Has matching globalization objects been deleted during the upgrading?

Any steps that can help us reproduce this issue?

@jasine
Copy link
Contributor Author

jasine commented Feb 28, 2023 •
edited

IA== is the base64 encoded string of whitespace character .

yes, contents all lost

@jasine Has matching globalization objects been deleted during the upgrading?

no, globalization not modified or deleted ever

Any steps that can help us reproduce this issue?

sorry, I did not find how to reproduce it

@dixudx

@dixudx
Copy link
Member

dixudx commented Mar 1, 2023

@jasine Let's keep on watching this issue.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
kind/bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@jasine @dixudx