Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Kiali Version 1.84 caused issue in Traffic graph #7349

Closed
preshit1505 opened this issue May 8, 2024 · 3 comments · Fixed by #7376
Closed

Kiali Version 1.84 caused issue in Traffic graph #7349

preshit1505 opened this issue May 8, 2024 · 3 comments · Fixed by #7376
Assignees
Labels
bug Something isn't working

Comments

@preshit1505
Copy link

Describe the bug

We have recently upgraded the kiali version to 1.84 after I opened a issue of not able to see the trace details/span tab. But now we are seeing a different issue i.e. traffic graph is showing error "Cannot load the graph: K8s Cache [bdrck-preview-ctrlpln] is not found or is not accessible for Kiali" once we increasing the time duration in the tab.
image

So we have two environments one is preview and other is Live. We have never experienced seeing this error before as in a live environment we do see preview env's istio NS graph and vice-versa.

Expected Behavior

once we downgrade the version back to 1.81, i dont see the issue anymore.

image image

Once we downgrade,

image
image
image

What are the steps to reproduce this bug?

  1. Version upgrade to 1.84
    2 increase the time duration to more than 2m in traffic graph tab

Environment

Learn about how to determine versions here.

  • **Kiali version: 1.84
  • **Istio version: 1.20.3
  • Kubernetes impl:
  • **Kubernetes version: v1.27.11-gke.1118000
  • Other notable environmental factors:
@preshit1505 preshit1505 added the bug Something isn't working label May 8, 2024
@preshit1505
Copy link
Author

Error Seeing in the logs:

{"level":"error","time":"2024-05-09T06:39:16Z","message":"cluster [bdrck-live-ctrlpln] is not found or is not accessible for Kiali: goroutine 17076262 [running]:\nruntime/debug.Stack()\n\t/opt/hostedtoolcache/go/1.22.1/x64/src/runtime/debug/stack.go:24 +0x5e\ngithub.com/kiali/kiali/handlers.handlePanic({0x254bab0, 0xc005bad278})\n\t/home/runner/work/kiali/kiali/handlers/graph.go:86 +0x1ad\npanic({0x1d3c140?, 0xc00b78dc80?})\n\t/opt/hostedtoolcache/go/1.22.1/x64/src/runtime/panic.go:770 +0x132\ngithub.com/kiali/kiali/graph.CheckError(...)\n\t/home/runner/work/kiali/kiali/graph/util.go:38\ngithub.com/kiali/kiali/graph/telemetry/istio/appender.WorkloadEntryAppender.applyWorkloadEntries({{0xc009ba0670?, 0x1?}}, 0xc003cf7b90, 0xc003cf7a40, 0xc0095dbc68)\n\t/home/runner/work/kiali/kiali/graph/telemetry/istio/appender/workload_entry.go:62 +0x5a9\ngithub.com/kiali/kiali/graph/telemetry/istio/appender.WorkloadEntryAppender.AppendGraph({{0xc00981343a?, 0xc18739c51a6ae2aa?}}, 0xc003cf7b90, 0xc003cf7a40, 0xc0095dbc68)\n\t/home/runner/work/kiali/kiali/graph/telemetry/istio/appender/workload_entry.go:41 +0x96\ngithub.com/kiali/kiali/graph/telemetry/istio.BuildNamespacesTrafficMap({_, _}, {0xc003cf7890, {0x0, {0xc00d575440, 0x6, 0x6}}, 0x0, 0x1, 0xc003cf7770, ...}, ...)\n\t/home/runner/work/kiali/kiali/graph/telemetry/istio/istio.go:80 +0x674\ngithub.com/kiali/kiali/graph/api.graphNamespacesIstio({_, _}, _, _, {{0x21f5871, 0x9}, {0x21efbd9, 0x5}, {{0xc00981347c, 0x15}, ...}, ...})\n\t/home/runner/work/kiali/kiali/graph/api/api.go:52 +0xf0\ngithub.com/kiali/kiali/graph/api.GraphNamespaces({_, _}, _, {{0x21f5871, 0x9}, {0x21efbd9, 0x5}, {{0xc00981347c, 0x15}, {0x13a52453c000, ...}}, ...})\n\t/home/runner/work/kiali/kiali/graph/api/api.go:33 +0x2f3\ngithub.com/kiali/kiali/handlers.GraphNamespaces({0x254bab0, 0xc005bad278}, 0xc00995b560)\n\t/home/runner/work/kiali/kiali/handlers/graph.go:51 +0x165\nnet/http.HandlerFunc.ServeHTTP(0x21ff85d?, {0x254bab0?, 0xc005bad278?}, 0x120?)\n\t/opt/hostedtoolcache/go/1.22.1/x64/src/net/http/server.go:2166 +0x29\ngithub.com/kiali/kiali/routing.NewRouter.metricHandler.func6({0x25557c0, 0xc00d575200}, 0xc00995b560)\n\t/home/runner/work/kiali/kiali/routing/router.go:237 +0x11f\nnet/http.HandlerFunc.ServeHTTP(0xc00995aea0?, {0x25557c0?, 0xc00d575200?}, 0xc0032e9200?)\n\t/opt/hostedtoolcache/go/1.22.1/x64/src/net/http/server.go:2166 +0x29\ngithub.com/kiali/kiali/routing.NewRouter.AuthenticationHandler.Handle.func7({0x25557c0, 0xc00d575200}, 0xc00995aea0)\n\t/home/runner/work/kiali/kiali/handlers/authentication.go:70 +0x31f\nnet/http.HandlerFunc.ServeHTTP(0xc00bdb8f40?, {0x25557c0?, 0xc00d575200?}, 0xc0013fde70?)\n\t/opt/hostedtoolcache/go/1.22.1/x64/src/net/http/server.go:2166 +0x29\ngithub.com/kiali/kiali/server.plainHttpMiddleware.func1({0x25557c0?, 0xc00d575200?}, 0x0?)\n\t/home/runner/work/kiali/kiali/server/server.go:182 +0x5c\nnet/http.HandlerFunc.ServeHTTP(0x254ba20?, {0x25557c0?, 0xc00d575200?}, 0xc0040d2b40?)\n\t/opt/hostedtoolcache/go/1.22.1/x64/src/net/http/server.go:2166 +0x29\ngo.opentelemetry.io/contrib/instrumentation/github.com/gorilla/mux/otelmux.traceware.ServeHTTP({{0x21efc79, 0x5}, {0x253dd68, 0xc0004dabe0}, {0x254b1b0, 0xc0013dbb48}, {0x252eb40, 0xc005bad1a0}, 0x231ddf0, 0x0, ...}, ...)\n\t/home/runner/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/github.com/gorilla/mux/otelmux@v0.47.0/mux.go:180 +0xbb2\ngithub.com/gorilla/mux.(*Router).ServeHTTP(0xc0093ec6c0, {0x254ba20, 0xc008438540}, 0xc00995a360)\n\t/home/runner/go/pkg/mod/github.com/gorilla/mux@v1.8.1/mux.go:212 +0x1e2\ngithub.com/NYTimes/gziphandler.GzipHandlerWithOpts.func1.1({0x25450c0, 0xc002257420}, 0xc00995a360)\n\t/home/runner/go/pkg/mod/github.com/!n!y!times/gziphandler@v1.1.1/gzip.go:336 +0x27e\nnet/http.HandlerFunc.ServeHTTP(0xc0035d0ea0?, {0x25450c0?, 0xc002257420?}, 0x6fc37a?)\n\t/opt/hostedtoolcache/go/1.22.1/x64/src/net/http/server.go:2166 +0x29\nnet/http.(*ServeMux).ServeHTTP(0x471639?, {0x25450c0, 0xc002257420}, 0xc00995a360)\n\t/opt/hostedtoolcache/go/1.22.1/x64/src/net/http/server.go:2683 +0x1ad\nnet/http.serverHandler.ServeHTTP({0xc003cf7200?}, {0x25450c0?, 0xc002257420?}, 0x6?)\n\t/opt/hostedtoolcache/go/1.22.1/x64/src/net/http/server.go:3137 +0x8e\nnet/http.(*conn).serve(0xc00836cf30, {0x25576b0, 0xc006edecc0})\n\t/opt/hostedtoolcache/go/1.22.1/x64/src/net/http/server.go:2039 +0x5e8\ncreated by net/http.(*Server).Serve in goroutine 1443\n\t/opt/hostedtoolcache/go/1.22.1/x64/src/net/http/server.go:3285 +0x4b4\n"}

@nrfox
Copy link
Contributor

nrfox commented May 9, 2024

This might actually be a duplicate of: #7305

@preshit1505
Copy link
Author

@nrfox yes Nick, seems like its a similar kind of error. Do we have any update on that then? Can we resolve this with any configuration change?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
Development

Successfully merging a pull request may close this issue.

3 participants