-
Notifications
You must be signed in to change notification settings - Fork 23.5k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[CRASH] Redis 7.0.12 crashed in zsetDel #13247
Comments
Hi Team, Can we get a support here |
@SarthakSahu hi, see you again, thanks for your report again. |
We are seeing this issue occasionally, and still seeing it now on 7.0.15. Only on replicas. I have a fear that it may be memory corruption related to cluster bus messaging, as our application does attempt to send messages from replica to master, using a background thread, to verify synchronization of application non-database variables. (We have another thread discussing the unreliability of these messages.) On the other hand, those traces don't make sense for that if everything is transaction-locked -- but come to think of it, as we're not writing to the database there might not be any lockout on our message send. Or the message receipt and callback, The various crashes occur in different locations. Here's one from a 12-hour stability run session today/yesterday. (Our tester said two restarts across our seven replicas, but only gave me a log for one.) 9:S 29 May 2024 23:37:47.452 # !!! Software Failure. Press left mouse button ! ------ STACK TRACE ------ Backtrace: ------ INFO OUTPUT ------ Serverredis_version:7.0.15 |
how did you use a background thread to send message from replica to master? did you implement by changing the source code? |
Module code, so "no and yes" -- redis source not touched, but it is application code running on the redis server. But the crashes don't occur in the module code itself, or we'd have a chance to debug it on our own. |
@astruble58 can you share an example of what the module does? thanks. |
Crashed in https://github.com/redis/redis/blob/7.0.12/src/t_zset.c#L1473
The text was updated successfully, but these errors were encountered: