I'm not sure the best way to bring this up but I figured this will probably get to the right people. We ran into the voice notification cert issue at one site so we had to deploy a snapshot build to fix that. Since then we've been having the gateway crash periodically.
It's running on a docker container. The JVM is crashing when it calls "pthread_getcpuclockid". Eventually the crash dumps from that fill the drive and it goes down. I'll relay the information that has been passed along to me from the tech that has been troubleshooting it. I asked for the information so the root cause can hopefully be fixed.
Let me know if you need more details.
Crash: SIGSEGV
Problem frame: libc.so.6 pthread_getcpuclockid
Called from JVM: jmm_GetThreadCpuTimeWithKind
Called by Ignition: PerformanceMonitor.updateThreads() → getCpuUsage()
Thread: gateway-shared-exec-engine-5
Runtime:
Zulu OpenJDK 17.0.18
OS: Ubuntu 24.04.4 LTS
Uptime before crash: ~16h 44m
Here's a crash log
hs_err_pid231890.log (534.2 KB)
He asked Chat GPT about it and it came up with this
What version did you upgrade from?
JDK 17.0.18 happened in 8.3.5... so it's not new for 8.3.7, but could be new for you.
This system has jumped through a lot of hoops over the last few years and I didn't set the infrastructure up for this last hop. It was running 8.1.x on a physical server for a few years. We eventually moved it to a container and then updated the container when we encountered the cert issue with voice notification.
I'm told that we restored a gateway backup to a new install in a container running the 8.3.7 nightly build.
A little clarification. the JDK version is baked into the docker image so that must be where we're getting the older JDK.
It's not old, it's still 17.0.18 for 8.3.7.
I'm trying to figure out whether this started for you when the JDK version changed.
We may have been experiencing this issue since 8.3.5 - unfortunately I don't have prior error logs, and we only recently started digging into the root cause of Java crashing. So this may not be an issue specific to 8.3.7
Im looking into this a bit now. there are some threads to pull here that look like its been resolved in 17.0.19, which should be in the next release, but i haven't been able to confirm that. ill post an update here when we get one.
Thanks,
JJ Coffman
