# Blocked Threads **URL:** \ **Category:** Ignition\ **Created:** [May 8, 2021, 2:36pm UTC](https://forum.inductiveautomation.com/t/blocked-threads/46503 "2021-05-08T14:36:28Z")\ **Posts on this page:** 9\ **Page:** 1
**Author:** ![kevin.deyoung](https://sea1.discourse-cdn.com/inductiveautomation/user_avatar/forum.inductiveautomation.com/kevin.deyoung/32/9558_2.png) [@kevin.deyoung](https://forum.inductiveautomation.com/u/kevin.deyoung)\ **Post date:** [May 8, 2021, 2:36pm UTC](https://forum.inductiveautomation.com/t/blocked-threads/46503/1 "2021-05-08T14:36:28Z")
We have an Ignition Gateway that seems to die a slow death over the course of a couple of hours. It then restarts and the process begins again. The symptoms that we see are high CPU utilization on the Gateway Status page. We see threads accumulating on the threads page with a state of Blocked. We’ve deployed this application to a number of sites and this is the first that has experienced this problem. This is a Perspective application running on Ignition v8.1.3 and incorporating SepaSoft OEE/Performance. Is there a way to determine what these threads are and what resource they seemed to be blocked by? ---
**Author:** ![pturmel](https://sea1.discourse-cdn.com/inductiveautomation/user_avatar/forum.inductiveautomation.com/pturmel/32/3295_2.png) [@pturmel](https://forum.inductiveautomation.com/u/pturmel)\ **Post date:** [May 8, 2021, 3:31pm UTC](https://forum.inductiveautomation.com/t/blocked-threads/46503/2 "2021-05-08T15:31:02Z")
The definitive answer is to use Flight Recorder or the JDK's debugging tools to examine the problem threads. Not particularly simple to execute. Support can probably help with those. In the meantime, these topics might help you trim the list of possible culprits: > [@8.0.16 Upgrade thousands of timed Waiting Threads Lower Performance OPC UA and Perspective](http://forum.inductiveautomation.com/t/8-0-16-upgrade-thousands-of-timed-waiting-threads-lower-performance-opc-ua-and-perspective/41100/12): > > Thanks Kevin, I’m doing a bit of a sweep on all new additions added since the problem started. Hopefully this is a quick find. > [@Is anyone else having crippling issues after adding Perspective to projects?](http://forum.inductiveautomation.com/t/is-anyone-else-having-crippling-issues-after-adding-perspective-to-projects/44306): > > Since we rolled out v8.1.0 and Perspective to one of our largest clients (280k tags, 70 Vision clients, + now 8 Perspective clients running inside of Vision’s Web Browser component), we’ve had non-stop issues with extremely high server CPU usage (90-100%) and incredibly slow clients (due to server CPU). We’ve been in contact with support, however have yet to find a reliable cause and solution. We removed all Alarm Status Table components from the Perspective Views as these seemed to be causing e… > [@Perspective Workers High CPU Usage](http://forum.inductiveautomation.com/t/perspective-workers-high-cpu-usage/28115): > > Greetings, My organization has an Ignition Gateway instance running version 8.0.3-rc2 (b2019072512). The Java version is 11.0.3+7-LTS running on an Ubuntu Linux instance on amd64. On average the entire Gateway runtime is eating up ~80% CPU usage. The significant offenders appear to be perspective-worker threads, as shown: Our team will attempt to disable a potential resource intensive page and investigate further. I don’t think this should be normal b… > [@Performance slow after upgrade from 8.1.1 to 8.1.2/3](http://forum.inductiveautomation.com/t/performance-slow-after-upgrade-from-8-1-1-to-8-1-2-3/44187/5): > > I had planned to Monday, thanks. ---
**Author:** ![Kevin.Herron](https://sea1.discourse-cdn.com/inductiveautomation/user_avatar/forum.inductiveautomation.com/kevin.herron/32/7259_2.png) [@Kevin.Herron](https://forum.inductiveautomation.com/u/Kevin.Herron)\ **Post date:** [May 8, 2021, 3:32pm UTC](https://forum.inductiveautomation.com/t/blocked-threads/46503/3 "2021-05-08T15:32:04Z")
In addition to Phil’s suggestion an easy place to start would be to download a thread dump from the threads page once the blocked threads begin accumulating and post it here for us to look at. Sometimes blocked threads are expected or otherwise okay, sometimes they aren’t. ---
**Author:** ![kevin.deyoung](https://sea1.discourse-cdn.com/inductiveautomation/user_avatar/forum.inductiveautomation.com/kevin.deyoung/32/9558_2.png) [@kevin.deyoung](https://forum.inductiveautomation.com/u/kevin.deyoung)\ **Post date:** [May 18, 2021, 12:21pm UTC](https://forum.inductiveautomation.com/t/blocked-threads/46503/4 "2021-05-18T12:21:07Z")
Kevin I thought I better check back in on this topic. The problem we were seeing just disappeared and we cannot explain what started the situation or what ended it at this point. ---
**Author:** ![tmahaf](https://sea1.discourse-cdn.com/inductiveautomation/user_avatar/forum.inductiveautomation.com/tmahaf/32/23492_2.png) [@tmahaf](https://forum.inductiveautomation.com/u/tmahaf)\ **Post date:** [April 1, 2022, 12:20am UTC](https://forum.inductiveautomation.com/t/blocked-threads/46503/5 "2022-04-01T00:20:40Z")
We just had a problem with our mqtt having over 100 blocked threads at one time with CPU and memory maxing out. Nothing fixed it until we did a fresh install of ignition, tried to go back to the nightly backup first and it still was maxing out. One of our guys said sometimes the ignition install can become corrupted, he had to do this before. I’ve personally never had to resort to reinstalling ignition, but I figured to share this here. ---
**Author:** ![Kevin.Herron](https://sea1.discourse-cdn.com/inductiveautomation/user_avatar/forum.inductiveautomation.com/kevin.herron/32/7259_2.png) [@Kevin.Herron](https://forum.inductiveautomation.com/u/Kevin.Herron)\ **Post date:** [April 1, 2022, 12:22am UTC](https://forum.inductiveautomation.com/t/blocked-threads/46503/6 "2022-04-01T00:22:27Z")
Please call either IA or Cirrus Link support next time. Reinstalling Ignition in response to a problem like this is nonsense. A thread dump, logs, and/or a live look at the system would help. ---
**Author:** ![tmahaf](https://sea1.discourse-cdn.com/inductiveautomation/user_avatar/forum.inductiveautomation.com/tmahaf/32/23492_2.png) [@tmahaf](https://forum.inductiveautomation.com/u/tmahaf)\ **Post date:** [April 1, 2022, 1:07pm UTC](https://forum.inductiveautomation.com/t/blocked-threads/46503/7 "2022-04-01T13:07:57Z")
[Ignition-AC-IGN-PGW01\_thread\_dump20220331-123728.json](https://forum.inductiveautomation.com/uploads/short-url/qWke17z953J4kZhAfB4MW7HFqxj.json) (1.0 MB) [Ignition-AC-IGN-PGW01\_thread\_dump20220331-120458.json](https://forum.inductiveautomation.com/uploads/short-url/RMOGN3vpKCwsNVLAgoJ2AXctIi.json) (1.3 MB) [Ignition-AC-IGN-PGW01\_thread\_dump20220331-120357.json](https://forum.inductiveautomation.com/uploads/short-url/iEFOslIYdHofatbLNCNL8liF7oL.json) (999.8 KB) I’m going to leave my opinion on my co-workers troubleshooting approach out of it, I wasn’t involved, but I did log in and grab several thread dumps, and observed over 100 MQTT blocked threads, and I downloaded three of them. The threads would remain blocked only for a few moments, clear out, and then shorty after get blocked again. Mind taking a peek and providing any insight to what may have been the problem, maybe the stacktract can give you any clues? ![image](https://us1.discourse-cdn.com/inductiveautomation/original/3X/7/6/76e627528c9055eeffec03481f83bea11ad0be13.png) ---
**Author:** ![Kevin.Herron](https://sea1.discourse-cdn.com/inductiveautomation/user_avatar/forum.inductiveautomation.com/kevin.herron/32/7259_2.png) [@Kevin.Herron](https://forum.inductiveautomation.com/u/Kevin.Herron)\ **Post date:** [April 1, 2022, 1:12pm UTC](https://forum.inductiveautomation.com/t/blocked-threads/46503/8 "2022-04-01T13:12:28Z")
I think we need @wes0johnson from Cirrus Link to take a look as well, but it looks to me like one edge node being rebrowsed after a reconnect is blocking the rest of MQTT engine from processing incoming message payloads. ---
**Author:** ![wes0johnson](https://avatars.discourse-cdn.com/v4/letter/w/7ab992/32.png) [@wes0johnson](https://forum.inductiveautomation.com/u/wes0johnson)\ **Post date:** [May 15, 2022, 4:44pm UTC](https://forum.inductiveautomation.com/t/blocked-threads/46503/9 "2022-05-15T16:44:59Z")
At first glance it looks like lots of Edge Nodes are not able to stay connected. Specifically, lots of rebirth requests are being sent out. This can happen for a number of reasons. I’d recommend taking a look at this: [I have data that is toggling between stale and healthy at my subscribing MQTT Client - MQTT Modules for Ignition 8.x - Confluence](https://docs.chariot.io/display/CLD80/I+have+data+that+is+toggling+between+stale+and+healthy+at+my+subscribing+MQTT+Client). It might be best to send a note to [support@cirrus-link.com](mailto:support@cirrus-link.com) if this is still and issue. If you do open a ticket - make sure to note your MQTT Engine version and Transmission/client versions as well.