Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Changing otel backend address failed #10157

Open
lahabana opened this issue May 3, 2024 · 0 comments
Open

Changing otel backend address failed #10157

lahabana opened this issue May 3, 2024 · 0 comments
Labels
area/observability kind/bug A bug triage/accepted The issue was reviewed and is complete enough to start working on it

Comments

@lahabana
Copy link
Contributor

lahabana commented May 3, 2024

What happened?

Had to restart my pods for this to work.

Here's the sidecar logs:

➜  kuma git:(useOverview) ✗ kubectl logs -n kuma-demo demo-app-c7cd6588b-gtwjg  -c kuma-sidecar
2024-05-03T08:55:05.687Z	INFO	config	skipping reading config from file
2024-05-03T08:55:05.688Z	INFO	kuma-dp.run	effective configuration	{"config": "{\"controlPlane\":{\"caCert\":\"-----BEGIN CERTIFICATE-----\\nMIIDEDCCAfigAwIBAgIRALsvUEdIOuHrvvQsVIrY32MwDQYJKoZIhvcNAQELBQAw\\nEjEQMA4GA1UEAxMHa3VtYS1jYTAeFw0yNDA0MzAxNjMwMjdaFw0zNDA0MjgxNjMw\\nMjdaMBIxEDAOBgNVBAMTB2t1bWEtY2EwggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAw\\nggEKAoIBAQC/i5Eu/5kgGNkjNeuC1VZsp8c6lJQ0GpHA0BnL5rhH/pWeRnzHnBGn\\nm2OdmbaVNqieYJIBHk7RTD9wkDO4ICZS9SHGXNYyXXu0LqQ8n2qioT+ni71PU8DB\\njB2dOhckYTdbaG7I8AeJAUnVEGjC/IFKvtS9y5Dg71wgIIUTs6CG/IL2JX4UIoBw\\ng0qizAbVH7zF5QEZr1TseiLnks44LAYvRmH0XoJG7MAP3Ee+E6VXim37/y3z3oYW\\nwgfKcZ/DtI5p10t9j5FN5Fz3xIew3ITW4kLmkMTtMfOAHkI2Y/u3JpML2lThUJ81\\nUq4dbmnYDXZArEPVI/BPHgbSK6Mf8S51AgMBAAGjYTBfMA4GA1UdDwEB/wQEAwIC\\npDAdBgNVHSUEFjAUBggrBgEFBQcDAQYIKwYBBQUHAwIwDwYDVR0TAQH/BAUwAwEB\\n/zAdBgNVHQ4EFgQULwoebFmOYZ/vyPkYXeNwkfimC4owDQYJKoZIhvcNAQELBQAD\\nggEBAITV1/Ctfa3L5SbmuOlIqMwuogEMp83rOEIchxU0NIir79EpSyvBYCNTWiba\\n1mqmGqMIzC9JUL91NnPr3EozRuMjYIYt0n6WMUP+/utnGJP2vTMch7t63fmywWfv\\nI3Z9FZmCOVm7VtBYoun5r1ldh0MmFZJcIQBViIqiwJ4RlHGlgFEiTurP2Zp0XjnO\\n4gR3SksRinBD3A4aHg3abXRyor94AS7QMUt2NZ0ne+u6L7zjo4H7f3PyyZn1PjB1\\n4t+j6vz9LV2k2ZXgYaQ4qsV4HXSBeAFF/PeTDNomqyG9jJRDp+/ymoA7vVvUh514\\nrjU2FR9rkpBXfdQERh5lZkaGojQ=\\n-----END CERTIFICATE-----\\n\",\"caCertFile\":\"\",\"retry\":{\"backoff\":\"3s\",\"maxDuration\":\"5m0s\"},\"url\":\"https://kuma-control-plane.kuma-system:5678\"},\"dataplane\":{\"drainTime\":\"30s\",\"mesh\":\"default\",\"name\":\"demo-app-c7cd6588b-gtwjg.kuma-demo\",\"proxyType\":\"dataplane\"},\"dataplaneRuntime\":{\"binaryPath\":\"envoy\",\"concurrency\":2,\"dataplaneTokenPath\":\"/var/run/secrets/kubernetes.io/serviceaccount/token\",\"dynamicConfiguration\":{\"refreshInterval\":\"10s\"},\"metrics\":{},\"resources\":{}},\"dns\":{\"coreDnsBinaryPath\":\"coredns\",\"coreDnsEmptyPort\":15054,\"coreDnsPort\":15053,\"enabled\":true,\"envoyDnsPort\":15055,\"prometheusPort\":19153}}"}
2024-05-03T08:55:05.688Z	INFO	kuma-dp.run	generated configurations will be stored in a temporary directory	{"dir": "/tmp/kuma-dp-3619012669"}
2024-05-03T08:55:05.805Z	INFO	kuma-dp.run	fetched Envoy version	{"version": {"Build":"8eef22b927682e9ff6f59cf9f26e440b41219fe6/1.29.4/Modified/RELEASE/BoringSSL","Version":"1.29.4","KumaDpCompatible":true}}
2024-05-03T08:55:05.805Z	INFO	kuma-dp.run	generating bootstrap configuration
2024-05-03T08:55:05.805Z	INFO	dataplane	trying to fetch bootstrap configuration from the Control Plane
2024-05-03T08:55:05.832Z	INFO	kuma-dp.run	received bootstrap configuration	{"adminPort": 9901}
2024-05-03T08:55:05.840Z	INFO	kuma-dp.run	starting Kuma DP	{"version": "2.7.2"}
2024-05-03T08:55:05.841Z	INFO	kuma-dp.run.mesh-metric-config-fetcher	starting resilient component ...
2024-05-03T08:55:05.841Z	INFO	kuma-dp.run.envoy	bootstrap configuration saved to a file	{"file": "/tmp/kuma-dp-3619012669/bootstrap.yaml"}
2024-05-03T08:55:05.841Z	INFO	kuma-dp.run.access-log-streamer	starting resilient component ...
2024-05-03T08:55:05.841Z	INFO	mesh-metric-config-fetcher	starting Dynamic Mesh Metrics Configuration Scraper	{"socketPath": "unix:///tmp/kuma-dp-3619012669/kuma-mesh-metric-config.sock"}
2024-05-03T08:55:05.841Z	INFO	kuma-dp.run.envoy	starting Envoy	{"path": "/usr/bin/envoy", "arguments": ["--config-path", "/tmp/kuma-dp-3619012669/bootstrap.yaml", "--drain-time-s", "30", "--drain-strategy", "immediate", "--disable-hot-restart", "--log-level", "info", "--concurrency", "2"]}
2024-05-03T08:55:05.841Z	INFO	access-log-streamer	cleaning existing access log pipe	{"file": "/tmp/kuma-dp-3619012669/kuma-al-demo-app-c7cd6588b-gtwjg.kuma-demo-default.sock"}
2024-05-03T08:55:05.841Z	INFO	access-log-streamer	creating access log pipe	{"file": "/tmp/kuma-dp-3619012669/kuma-al-demo-app-c7cd6588b-gtwjg.kuma-demo-default.sock"}
2024-05-03T08:55:05.841Z	INFO	metrics-hijacker	starting Metrics Hijacker Server	{"socketPath": "unix:///tmp/kuma-dp-3619012669/kuma-mh-demo-app-c7cd6588b-gtwjg.kuma-demo-default.sock"}
2024-05-03T08:55:05.843Z	INFO	kuma-dp.run.dns-server	configuration saved to a file	{"file": "/tmp/kuma-dp-3619012669/Corefile"}
2024-05-03T08:55:05.843Z	INFO	kuma-dp.run.dns-server	starting DNS Server (coredns)	{"args": ["-conf", "/tmp/kuma-dp-3619012669/Corefile", "-quiet"]}
[2024-05-03 08:55:05.870][24][info][main] [source/server/server.cc:430] initializing epoch 0 (base id=0, hot restart version=disabled)
[2024-05-03 08:55:05.870][24][info][main] [source/server/server.cc:432] statically linked extensions:
[2024-05-03 08:55:05.870][24][info][main] [source/server/server.cc:434]   envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple
[2024-05-03 08:55:05.870][24][info][main] [source/server/server.cc:434]   envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche
[2024-05-03 08:55:05.870][24][info][main] [source/server/server.cc:434]   envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator
[2024-05-03 08:55:05.870][24][info][main] [source/server/server.cc:434]   envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter
[2024-05-03 08:55:05.870][24][info][main] [source/server/server.cc:434]   envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.http_capsule
[2024-05-03 08:55:05.870][24][info][main] [source/server/server.cc:434]   envoy.load_balancing_policies: envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset
[2024-05-03 08:55:05.870][24][info][main] [source/server/server.cc:434]   envoy.tracers: envoy.dynamic.ot, envoy.tracers.datadog, envoy.tracers.dynamic_ot, envoy.tracers.opencensus, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin
[2024-05-03 08:55:05.870][24][info][main] [source/server/server.cc:434]   envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua
[2024-05-03 08:55:05.870][24][info][main] [source/server/server.cc:434]   envoy.bootstrap: envoy.bootstrap.internal_listener, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface
[2024-05-03 08:55:05.870][24][info][main] [source/server/server.cc:434]   envoy.dubbo_proxy.serializers: dubbo.hessian2
[2024-05-03 08:55:05.870][24][info][main] [source/server/server.cc:434]   envoy.regex_engines: envoy.regex_engines.google_re2
[2024-05-03 08:55:05.870][24][info][main] [source/server/server.cc:434]   network.connection.client: default, envoy_internal
[2024-05-03 08:55:05.870][24][info][main] [source/server/server.cc:434]   envoy.formatter: envoy.formatter.cel, envoy.formatter.metadata, envoy.formatter.req_without_query
[2024-05-03 08:55:05.870][24][info][main] [source/server/server.cc:434]   envoy.common.key_value: envoy.key_value.file_based
[2024-05-03 08:55:05.870][24][info][main] [source/server/server.cc:434]   envoy.health_checkers: envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift
[2024-05-03 08:55:05.870][24][info][main] [source/server/server.cc:434]   envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation
[2024-05-03 08:55:05.870][24][info][main] [source/server/server.cc:434]   envoy.resource_monitors: envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource
[2024-05-03 08:55:05.870][24][info][main] [source/server/server.cc:434]   envoy.request_id: envoy.request_id.uuid
[2024-05-03 08:55:05.870][24][info][main] [source/server/server.cc:434]   envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation
[2024-05-03 08:55:05.870][24][info][main] [source/server/server.cc:434]   envoy.connection_handler: envoy.connection_handler.default
[2024-05-03 08:55:05.870][24][info][main] [source/server/server.cc:434]   envoy.route.early_data_policy: envoy.route.early_data_policy.default
[2024-05-03 08:55:05.870][24][info][main] [source/server/server.cc:434]   envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor
[2024-05-03 08:55:05.870][24][info][main] [source/server/server.cc:434]   envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls
[2024-05-03 08:55:05.870][24][info][main] [source/server/server.cc:434]   envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action
[2024-05-03 08:55:05.870][24][info][main] [source/server/server.cc:434]   envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.header
[2024-05-03 08:55:05.870][24][info][main] [source/server/server.cc:434]   envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest
[2024-05-03 08:55:05.870][24][info][main] [source/server/server.cc:434]   envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.spiffe
[2024-05-03 08:55:05.870][24][info][main] [source/server/server.cc:434]   envoy.thrift_proxy.transports: auto, framed, header, unframed
[2024-05-03 08:55:05.870][24][info][main] [source/server/server.cc:434]   envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls
[2024-05-03 08:55:05.870][24][info][main] [source/server/server.cc:434]   envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.trie_matcher
[2024-05-03 08:55:05.870][24][info][main] [source/server/server.cc:434]   envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable
[2024-05-03 08:55:05.870][24][info][main] [source/server/server.cc:434]   envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory
[2024-05-03 08:55:05.870][24][info][main] [source/server/server.cc:434]   envoy.filters.listener: envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector
[2024-05-03 08:55:05.870][24][info][main] [source/server/server.cc:434]   envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd
[2024-05-03 08:55:05.870][24][info][main] [source/server/server.cc:434]   envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme
[2024-05-03 08:55:05.870][24][info][main] [source/server/server.cc:434]   envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router
[2024-05-03 08:55:05.870][24][info][main] [source/server/server.cc:434]   envoy.access_loggers: envoy.access_loggers.file, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log
[2024-05-03 08:55:05.870][24][info][main] [source/server/server.cc:434]   envoy.dubbo_proxy.protocols: dubbo
[2024-05-03 08:55:05.870][24][info][main] [source/server/server.cc:434]   envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso
[2024-05-03 08:55:05.870][24][info][main] [source/server/server.cc:434]   envoy.matching.input_matchers: envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.ip, envoy.matching.matchers.runtime_fraction
[2024-05-03 08:55:05.870][24][info][main] [source/server/server.cc:434]   envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case
[2024-05-03 08:55:05.870][24][info][main] [source/server/server.cc:434]   envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.udp_proxy
[2024-05-03 08:55:05.870][24][info][main] [source/server/server.cc:434]   envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor
[2024-05-03 08:55:05.870][24][info][main] [source/server/server.cc:434]   envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy
[2024-05-03 08:55:05.870][24][info][main] [source/server/server.cc:434]   envoy.matching.action: envoy.matching.actions.format_string, filter-chain-name
[2024-05-03 08:55:05.870][24][info][main] [source/server/server.cc:434]   quic.http_server_connection: quic.http_server_connection.default
[2024-05-03 08:55:05.870][24][info][main] [source/server/server.cc:434]   envoy.upstream_options: envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options
[2024-05-03 08:55:05.870][24][info][main] [source/server/server.cc:434]   envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector
[2024-05-03 08:55:05.870][24][info][main] [source/server/server.cc:434]   envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff
[2024-05-03 08:55:05.870][24][info][main] [source/server/server.cc:434]   envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port
[2024-05-03 08:55:05.870][24][info][main] [source/server/server.cc:434]   envoy.path.match: envoy.path.match.uri_template.uri_template_matcher
[2024-05-03 08:55:05.870][24][info][main] [source/server/server.cc:434]   envoy.resolvers: envoy.ip
[2024-05-03 08:55:05.870][24][info][main] [source/server/server.cc:434]   envoy.clusters: envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.dynamic_forward_proxy, envoy.clusters.redis
[2024-05-03 08:55:05.871][24][info][main] [source/server/server.cc:434]   envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment
[2024-05-03 08:55:05.871][24][info][main] [source/server/server.cc:434]   envoy.upstreams: envoy.filters.connection_pools.tcp.generic
[2024-05-03 08:55:05.871][24][info][main] [source/server/server.cc:434]   envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter
[2024-05-03 08:55:05.871][24][info][main] [source/server/server.cc:434]   envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v8
[2024-05-03 08:55:05.871][24][info][main] [source/server/server.cc:434]   envoy.quic.connection_id_generator: envoy.quic.deterministic_connection_id_generator
[2024-05-03 08:55:05.871][24][info][main] [source/server/server.cc:434]   envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.fault, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_system_buffer, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router
[2024-05-03 08:55:05.871][24][info][main] [source/server/server.cc:434]   envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts
[2024-05-03 08:55:05.871][24][info][main] [source/server/server.cc:434]   envoy.grpc_credentials: envoy.grpc_credentials.aws_iam, envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata
[2024-05-03 08:55:05.871][24][info][main] [source/server/server.cc:434]   envoy.http.header_validators: envoy.http.header_validators.envoy_default
[2024-05-03 08:55:05.871][24][info][main] [source/server/server.cc:434]   envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on
[2024-05-03 08:55:05.871][24][info][main] [source/server/server.cc:434]   envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.trie_matcher
[2024-05-03 08:55:05.871][24][info][main] [source/server/server.cc:434]   envoy.filters.http.upstream: envoy.buffer, envoy.filters.http.admission_control, envoy.filters.http.buffer, envoy.filters.http.header_mutation, envoy.filters.http.upstream_codec
[2024-05-03 08:55:05.871][24][info][main] [source/server/server.cc:434]   envoy.health_check.event_sinks: envoy.health_check.event_sink.file
[2024-05-03 08:55:05.871][24][info][main] [source/server/server.cc:434]   envoy.dubbo_proxy.filters: envoy.filters.dubbo.router
[2024-05-03 08:55:05.871][24][info][main] [source/server/server.cc:434]   envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr
[2024-05-03 08:55:05.871][24][info][main] [source/server/server.cc:434]   envoy.retry_priorities: envoy.retry_priorities.previous_priorities
[2024-05-03 08:55:05.871][24][info][main] [source/server/server.cc:434]   envoy.quic.proof_source: envoy.quic.proof_source.filter_chain
[2024-05-03 08:55:05.871][24][info][main] [source/server/server.cc:434]   filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.network.application_protocols, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port
[2024-05-03 08:55:05.871][24][info][main] [source/server/server.cc:434]   envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san
[2024-05-03 08:55:05.871][24][info][main] [source/server/server.cc:434]   envoy.quic.server_preferred_address: quic.server_preferred_address.fixed
[2024-05-03 08:55:05.871][24][info][main] [source/server/server.cc:434]   envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel
[2024-05-03 08:55:05.871][24][info][main] [source/server/server.cc:434]   envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.http_connection_manager, envoy.filters.network.kafka_broker, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy
[2024-05-03 08:55:05.871][24][info][main] [source/server/server.cc:434]   envoy.geoip_providers: envoy.geoip_providers.maxmind
[2024-05-03 08:55:05.871][24][info][main] [source/server/server.cc:434]   envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params
[2024-05-03 08:55:05.871][24][info][main] [source/server/server.cc:434]   envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo
[2024-05-03 08:55:05.875][24][info][main] [source/server/server.cc:488] HTTP header map info:
[2024-05-03 08:55:05.877][24][info][main] [source/server/server.cc:491]   request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-ot-span-context,x-request-id
[2024-05-03 08:55:05.877][24][info][main] [source/server/server.cc:491]   request trailer map: 120 bytes:
[2024-05-03 08:55:05.877][24][info][main] [source/server/server.cc:491]   response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id
[2024-05-03 08:55:05.877][24][info][main] [source/server/server.cc:491]   response trailer map: 144 bytes: grpc-message,grpc-status
[2024-05-03 08:55:05.885][24][info][main] [source/server/server.cc:845] runtime: layers:
  - name: kuma
    static_layer:
      re2.max_program_size.error_level: 4294967295
      re2.max_program_size.warn_level: 1000
[2024-05-03 08:55:05.886][24][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:9901
[2024-05-03 08:55:05.887][24][info][config] [source/server/configuration_impl.cc:160] loading tracing configuration
[2024-05-03 08:55:05.887][24][info][config] [source/server/configuration_impl.cc:119] loading 1 static secret(s)
[2024-05-03 08:55:05.887][24][info][config] [source/server/configuration_impl.cc:125] loading 2 cluster(s)
[2024-05-03 08:55:05.905][24][info][config] [source/server/configuration_impl.cc:129] loading 0 listener(s)
[2024-05-03 08:55:05.905][24][info][config] [source/server/configuration_impl.cc:146] loading stats configuration
[2024-05-03 08:55:05.907][24][warning][main] [source/server/server.cc:910] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.downstream_connections` resource monitor.
[2024-05-03 08:55:05.907][24][info][main] [source/server/server.cc:951] starting main dispatch loop
[2024-05-03 08:55:05.911][24][info][runtime] [source/common/runtime/runtime_impl.cc:584] RTDS has finished initialization
[2024-05-03 08:55:05.911][24][info][upstream] [source/common/upstream/cluster_manager_impl.cc:236] cm init: initializing cds
[2024-05-03 08:55:06.985][24][info][upstream] [source/common/upstream/cds_api_helper.cc:32] cds: add 18 cluster(s), remove 2 cluster(s)
[2024-05-03 08:55:07.111][24][info][upstream] [source/common/upstream/cds_api_helper.cc:71] cds: added/updated 18 cluster(s), skipped 0 unmodified cluster(s)
[2024-05-03 08:55:07.112][24][info][upstream] [source/common/upstream/cluster_manager_impl.cc:214] cm init: initializing secondary clusters
[2024-05-03 08:55:07.113][24][info][upstream] [source/common/upstream/cluster_manager_impl.cc:240] cm init: all clusters initialized
[2024-05-03 08:55:07.113][24][info][main] [source/server/server.cc:932] all clusters initialized. initializing init manager
[2024-05-03 08:55:07.115][24][info][upstream] [source/common/listener_manager/lds_api.cc:99] lds: add/update listener 'outbound:240.0.0.16:80'
[2024-05-03 08:55:07.116][24][info][upstream] [source/common/listener_manager/lds_api.cc:99] lds: add/update listener 'outbound:240.0.0.5:80'
[2024-05-03 08:55:07.117][24][info][upstream] [source/common/listener_manager/lds_api.cc:99] lds: add/update listener 'outbound:240.0.0.1:9092'
[2024-05-03 08:55:07.118][24][info][upstream] [source/common/listener_manager/lds_api.cc:99] lds: add/update listener 'outbound:240.0.0.0:80'
[2024-05-03 08:55:07.118][24][info][upstream] [source/common/listener_manager/lds_api.cc:99] lds: add/update listener 'outbound:240.0.0.18:9092'
[2024-05-03 08:55:07.119][24][info][upstream] [source/common/listener_manager/lds_api.cc:99] lds: add/update listener 'outbound:240.0.0.20:9092'
[2024-05-03 08:55:07.120][24][info][upstream] [source/common/listener_manager/lds_api.cc:99] lds: add/update listener 'outbound:240.0.0.8:80'
[2024-05-03 08:55:07.121][24][info][upstream] [source/common/listener_manager/lds_api.cc:99] lds: add/update listener 'outbound:240.0.0.12:80'
[2024-05-03 08:55:07.122][24][info][upstream] [source/common/listener_manager/lds_api.cc:99] lds: add/update listener 'outbound:240.0.0.10:80'
[2024-05-03 08:55:07.123][24][info][upstream] [source/common/listener_manager/lds_api.cc:99] lds: add/update listener 'outbound:240.0.0.14:80'
[2024-05-03 08:55:07.124][24][info][upstream] [source/common/listener_manager/lds_api.cc:99] lds: add/update listener 'outbound:240.0.0.23:80'
[2024-05-03 08:55:07.125][24][info][upstream] [source/common/listener_manager/lds_api.cc:99] lds: add/update listener 'outbound:240.0.0.9:80'
[2024-05-03 08:55:07.126][24][info][upstream] [source/common/listener_manager/lds_api.cc:99] lds: add/update listener 'inbound:passthrough:ipv6'
[2024-05-03 08:55:07.127][24][info][upstream] [source/common/listener_manager/lds_api.cc:99] lds: add/update listener 'outbound:10.43.96.154:5000'
[2024-05-03 08:55:07.128][24][info][upstream] [source/common/listener_manager/lds_api.cc:99] lds: add/update listener 'outbound:240.0.0.11:9092'
[2024-05-03 08:55:07.129][24][info][upstream] [source/common/listener_manager/lds_api.cc:99] lds: add/update listener 'outbound:240.0.0.21:9092'
[2024-05-03 08:55:07.130][24][info][upstream] [source/common/listener_manager/lds_api.cc:99] lds: add/update listener 'outbound:240.0.0.4:80'
[2024-05-03 08:55:07.131][24][info][upstream] [source/common/listener_manager/lds_api.cc:99] lds: add/update listener 'outbound:passthrough:ipv4'
[2024-05-03 08:55:07.132][24][info][upstream] [source/common/listener_manager/lds_api.cc:99] lds: add/update listener 'outbound:240.0.0.0:9092'
[2024-05-03 08:55:07.133][24][info][upstream] [source/common/listener_manager/lds_api.cc:99] lds: add/update listener 'outbound:240.0.0.11:80'
[2024-05-03 08:55:07.134][24][info][upstream] [source/common/listener_manager/lds_api.cc:99] lds: add/update listener 'outbound:240.0.0.18:80'
[2024-05-03 08:55:07.135][24][info][upstream] [source/common/listener_manager/lds_api.cc:99] lds: add/update listener 'outbound:240.0.0.19:9092'
[2024-05-03 08:55:07.136][24][info][upstream] [source/common/listener_manager/lds_api.cc:99] lds: add/update listener 'outbound:240.0.0.7:9092'
[2024-05-03 08:55:07.138][24][info][upstream] [source/common/listener_manager/lds_api.cc:99] lds: add/update listener 'plugins:bootstrap:k8s:hooks:apiServerBypass'
[2024-05-03 08:55:07.138][24][info][upstream] [source/common/listener_manager/lds_api.cc:99] lds: add/update listener 'outbound:240.0.0.15:80'
[2024-05-03 08:55:07.139][24][info][upstream] [source/common/listener_manager/lds_api.cc:99] lds: add/update listener 'outbound:240.0.0.20:80'
[2024-05-03 08:55:07.140][24][info][upstream] [source/common/listener_manager/lds_api.cc:99] lds: add/update listener 'outbound:240.0.0.3:80'
[2024-05-03 08:55:07.141][24][info][upstream] [source/common/listener_manager/lds_api.cc:99] lds: add/update listener 'outbound:240.0.0.9:9092'
[2024-05-03 08:55:07.143][24][info][upstream] [source/common/listener_manager/lds_api.cc:99] lds: add/update listener 'kuma:dns'
[2024-05-03 08:55:07.144][24][info][upstream] [source/common/listener_manager/lds_api.cc:99] lds: add/update listener 'outbound:240.0.0.17:80'
[2024-05-03 08:55:07.145][24][info][upstream] [source/common/listener_manager/lds_api.cc:99] lds: add/update listener 'outbound:240.0.0.6:80'
[2024-05-03 08:55:07.146][24][info][upstream] [source/common/listener_manager/lds_api.cc:99] lds: add/update listener 'outbound:240.0.0.6:9092'
[2024-05-03 08:55:07.147][24][info][upstream] [source/common/listener_manager/lds_api.cc:99] lds: add/update listener 'outbound:passthrough:ipv6'
[2024-05-03 08:55:07.162][24][info][upstream] [source/common/listener_manager/lds_api.cc:99] lds: add/update listener 'kuma:envoy:admin'
[2024-05-03 08:55:07.163][24][info][upstream] [source/common/listener_manager/lds_api.cc:99] lds: add/update listener 'outbound:240.0.0.21:80'
[2024-05-03 08:55:07.164][24][info][upstream] [source/common/listener_manager/lds_api.cc:99] lds: add/update listener 'outbound:240.0.0.2:80'
[2024-05-03 08:55:07.165][24][info][upstream] [source/common/listener_manager/lds_api.cc:99] lds: add/update listener 'outbound:10.43.207.215:6379'
[2024-05-03 08:55:07.166][24][info][upstream] [source/common/listener_manager/lds_api.cc:99] lds: add/update listener 'outbound:240.0.0.13:9092'
[2024-05-03 08:55:07.167][24][info][upstream] [source/common/listener_manager/lds_api.cc:99] lds: add/update listener 'outbound:240.0.0.17:9092'
[2024-05-03 08:55:07.168][24][info][upstream] [source/common/listener_manager/lds_api.cc:99] lds: add/update listener 'outbound:240.0.0.3:9092'
[2024-05-03 08:55:07.174][24][info][upstream] [source/common/listener_manager/lds_api.cc:99] lds: add/update listener 'inbound:10.42.0.40:5000'
[2024-05-03 08:55:07.175][24][info][upstream] [source/common/listener_manager/lds_api.cc:99] lds: add/update listener 'outbound:240.0.0.12:9092'
[2024-05-03 08:55:07.176][24][info][upstream] [source/common/listener_manager/lds_api.cc:99] lds: add/update listener 'outbound:240.0.0.15:9092'
[2024-05-03 08:55:07.177][24][info][upstream] [source/common/listener_manager/lds_api.cc:99] lds: add/update listener 'outbound:240.0.0.2:9092'
[2024-05-03 08:55:07.178][24][info][upstream] [source/common/listener_manager/lds_api.cc:99] lds: add/update listener 'outbound:240.0.0.4:9092'
[2024-05-03 08:55:07.179][24][info][upstream] [source/common/listener_manager/lds_api.cc:99] lds: add/update listener 'outbound:240.0.0.19:80'
[2024-05-03 08:55:07.180][24][info][upstream] [source/common/listener_manager/lds_api.cc:99] lds: add/update listener 'outbound:240.0.0.22:80'
[2024-05-03 08:55:07.181][24][info][upstream] [source/common/listener_manager/lds_api.cc:99] lds: add/update listener 'outbound:240.0.0.8:9092'
[2024-05-03 08:55:07.182][24][info][upstream] [source/common/listener_manager/lds_api.cc:99] lds: add/update listener 'outbound:240.0.0.10:9092'
[2024-05-03 08:55:07.183][24][info][upstream] [source/common/listener_manager/lds_api.cc:99] lds: add/update listener 'outbound:240.0.0.16:9092'
[2024-05-03 08:55:07.184][24][info][upstream] [source/common/listener_manager/lds_api.cc:99] lds: add/update listener 'outbound:240.0.0.1:80'
[2024-05-03 08:55:07.184][24][info][upstream] [source/common/listener_manager/lds_api.cc:99] lds: add/update listener 'outbound:240.0.0.7:80'
[2024-05-03 08:55:07.190][24][info][upstream] [source/common/listener_manager/lds_api.cc:99] lds: add/update listener 'probe:listener'
[2024-05-03 08:55:07.192][24][info][upstream] [source/common/listener_manager/lds_api.cc:99] lds: add/update listener 'inbound:passthrough:ipv4'
[2024-05-03 08:55:07.192][24][info][upstream] [source/common/listener_manager/lds_api.cc:99] lds: add/update listener 'outbound:240.0.0.13:80'
[2024-05-03 08:55:07.193][24][info][upstream] [source/common/listener_manager/lds_api.cc:99] lds: add/update listener 'outbound:240.0.0.14:9092'
[2024-05-03 08:55:07.194][24][info][upstream] [source/common/listener_manager/lds_api.cc:99] lds: add/update listener 'outbound:240.0.0.5:9092'
[2024-05-03 08:55:07.194][24][info][config] [source/common/listener_manager/listener_manager_impl.cc:926] all dependencies initialized. starting workers
[2024-05-03 08:55:15.933][24][info][upstream] [source/common/listener_manager/lds_api.cc:99] lds: add/update listener 'outbound:10.43.207.215:6379'
[2024-05-03 08:55:15.934][24][info][upstream] [source/common/listener_manager/lds_api.cc:99] lds: add/update listener 'outbound:240.0.0.23:80'
[2024-05-03 08:55:19.958][24][info][upstream] [source/common/listener_manager/lds_api.cc:99] lds: add/update listener 'outbound:240.0.0.22:80'
[2024-05-03 08:55:19.970][24][info][upstream] [source/common/listener_manager/lds_api.cc:99] lds: add/update listener 'outbound:10.43.96.154:5000'
[2024-05-03 08:55:19.971][24][info][upstream] [source/common/upstream/cds_api_helper.cc:32] cds: add 18 cluster(s), remove 2 cluster(s)
[2024-05-03 08:55:19.983][24][info][upstream] [source/common/upstream/cds_api_helper.cc:71] cds: added/updated 1 cluster(s), skipped 17 unmodified cluster(s)
[2024-05-03 09:13:58.967][24][info][upstream] [source/common/listener_manager/lds_api.cc:99] lds: add/update listener '_kuma:metrics:opentelemetry:opentelemetry-collector.observability.svc-4317'
[2024-05-03 09:13:58.985][24][info][upstream] [source/common/listener_manager/lds_api.cc:99] lds: add/update listener '_kuma:dynamicconfig:observability'
[2024-05-03 09:13:58.986][24][info][upstream] [source/common/upstream/cds_api_helper.cc:32] cds: add 19 cluster(s), remove 2 cluster(s)
[2024-05-03 09:13:59.014][24][info][upstream] [source/common/upstream/cds_api_helper.cc:71] cds: added/updated 1 cluster(s), skipped 18 unmodified cluster(s)
2024-05-03T09:14:05.835Z	INFO	mesh-metric-config-fetcher	Starting OpenTelemetry exporter	{"backend": "opentelemetry-collector.observability.svc-4317"}
2024/05/03 09:15:15 failed to upload metrics: context deadline exceeded: rpc error: code = Unavailable desc = no healthy upstream
2024/05/03 09:16:15 failed to upload metrics: context deadline exceeded: rpc error: code = Unavailable desc = no healthy upstream
2024/05/03 09:17:15 failed to upload metrics: context deadline exceeded: rpc error: code = Unavailable desc = no healthy upstream
2024/05/03 09:18:15 failed to upload metrics: context deadline exceeded: rpc error: code = Unavailable desc = no healthy upstream
2024/05/03 09:19:15 failed to upload metrics: context deadline exceeded: rpc error: code = Unavailable desc = no healthy upstream
2024/05/03 09:20:15 failed to upload metrics: context deadline exceeded: rpc error: code = Unavailable desc = no healthy upstream
2024/05/03 09:21:15 failed to upload metrics: context deadline exceeded: rpc error: code = Unavailable desc = no healthy upstream
2024/05/03 09:22:15 failed to upload metrics: context deadline exceeded: rpc error: code = Unavailable desc = no healthy upstream
2024/05/03 09:23:15 failed to upload metrics: context deadline exceeded: rpc error: code = Unavailable desc = no healthy upstream
2024/05/03 09:24:15 failed to upload metrics: context deadline exceeded: rpc error: code = Unavailable desc = no healthy upstream
2024/05/03 09:25:15 failed to upload metrics: context deadline exceeded: rpc error: code = Unavailable desc = no healthy upstream
2024/05/03 09:26:15 failed to upload metrics: context deadline exceeded: rpc error: code = Unavailable desc = no healthy upstream
[2024-05-03 09:26:26.907][24][info][upstream] [source/common/listener_manager/lds_api.cc:63] lds: remove listener '_kuma:metrics:opentelemetry:opentelemetry-collector.observability.svc-4317'
[2024-05-03 09:26:26.947][24][info][upstream] [source/common/listener_manager/lds_api.cc:99] lds: add/update listener '_kuma:metrics:opentelemetry:otl-collector-opentelemetry-collector.observability.svc-4317'
[2024-05-03 09:26:26.966][24][info][upstream] [source/common/listener_manager/lds_api.cc:99] lds: add/update listener '_kuma:dynamicconfig:observability'
[2024-05-03 09:26:26.966][24][info][upstream] [source/common/upstream/cds_api_helper.cc:32] cds: add 19 cluster(s), remove 3 cluster(s)
[2024-05-03 09:26:26.997][24][info][upstream] [source/common/upstream/cds_api_helper.cc:71] cds: added/updated 1 cluster(s), skipped 18 unmodified cluster(s)
2024-05-03T09:26:45.821Z	INFO	mesh-metric-config-fetcher	Starting OpenTelemetry exporter	{"backend": "otl-collector-opentelemetry-collector.observability.svc-4317"}
2024-05-03T09:26:45.822Z	INFO	mesh-metric-config-fetcher	Shutting down OpenTelemetry exporter	{"backend": "opentelemetry-collector.observability.svc-4317"}
2024-05-03T09:26:55.831Z	ERROR	mesh-metric-config-fetcher	Configuring OpenTelemetry Exporter failed	{"error": "failed to upload metrics: context deadline exceeded: rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing: dial unix /tmp/kuma-dp-3619012669/kuma-otel-opentelemetry-collector.observability.svc-4317.sock: connect: connection refused\""}
2024-05-03T09:26:55.832Z	INFO	mesh-metric-config-fetcher	Shutting down OpenTelemetry exporter	{"backend": "opentelemetry-collector.observability.svc-4317"}
@lahabana lahabana added triage/pending This issue will be looked at on the next triage meeting kind/bug A bug labels May 3, 2024
@jakubdyszkiewicz jakubdyszkiewicz added triage/accepted The issue was reviewed and is complete enough to start working on it area/observability and removed triage/pending This issue will be looked at on the next triage meeting labels May 6, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
area/observability kind/bug A bug triage/accepted The issue was reviewed and is complete enough to start working on it
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@lahabana @jakubdyszkiewicz