# Odd CPU Usage Fixed by Logging onto Server **URL:** \ **Category:** General Discussion\ **Created:** [December 19, 2021, 2:57pm UTC](https://forum.inductiveautomation.com/t/odd-cpu-usage-fixed-by-logging-onto-server/54280 "2021-12-19T14:57:26Z")\ **Posts on this page:** 17\ **Page:** 1
**Author:** ![mcgheeiv](https://avatars.discourse-cdn.com/v4/letter/m/71c47a/32.png) [@mcgheeiv](https://forum.inductiveautomation.com/u/mcgheeiv)\ **Post date:** [December 19, 2021, 2:57pm UTC](https://forum.inductiveautomation.com/t/odd-cpu-usage-fixed-by-logging-onto-server/54280/1 "2021-12-19T14:57:26Z")
Windows Server 12 Ignition 7.8.3 - CPU used by Ignition climbs steadily - Memory usage is very stable - When CPU usage gets to ~20% Ignition starts to log many PLC comm errors - Logging onto the Server (Windows) causes the CPU usage to drop immediately and comm errors to end In the image below that trends CPU usage, comm errors started at the peak, logging into the server caused the errors to end and the cpu usage to decrease. ![Annotation 2021-12-15 083903](https://us1.discourse-cdn.com/inductiveautomation/original/3X/1/1/115dfc35be80d1cfce4190f7ae70bc6a35424794.png) ---
**Author:** ![Matrix\_Engineering](https://sea1.discourse-cdn.com/inductiveautomation/user_avatar/forum.inductiveautomation.com/matrix_engineering/32/19781_2.png) [@Matrix\_Engineering](https://forum.inductiveautomation.com/u/Matrix_Engineering)\ **Post date:** [December 19, 2021, 5:29pm UTC](https://forum.inductiveautomation.com/t/odd-cpu-usage-fixed-by-logging-onto-server/54280/2 "2021-12-19T17:29:03Z")
Hi Mack, firstly, no need to start a new thread: > [@High CPU Usage, PLC Comm Issue, Resource Monitor](https://forum.inductiveautomation.com/t/high-cpu-usage-plc-comm-issue-resource-monitor/54153): > > Ignition 7.8.3, Windows Server 10, Enterprise. We are having PLC connection issues that are causing the CPU utilization to gradually increase and eventually cause loss of functionality. It has been noticed that logging onto the server and launching the Resource Monitor causes the CPU utilization to decrease significantly back to “normal”. Can anyone provide any insight into why we might be seeing this? Thanks, Mack Secondly, your image has no reference. ```auto from java.lang.management import ManagementFactory bean = ManagementFactory.getOperatingSystemMXBean() print bean.getSystemCpuLoad() * 100.0 ``` Run the above in a gateway timer script, dedicated threading, create a memory tag and write to it. Then you can view from the client. From your previous thread you have been advised that the best route forward is to upgrade your hardware (server), Ignition Version, and server OS (Windows Server 2012 R2) as all are out of support. ---
**Author:** ![pturmel](https://sea1.discourse-cdn.com/inductiveautomation/user_avatar/forum.inductiveautomation.com/pturmel/32/3295_2.png) [@pturmel](https://forum.inductiveautomation.com/u/pturmel)\ **Post date:** [December 19, 2021, 5:35pm UTC](https://forum.inductiveautomation.com/t/odd-cpu-usage-fixed-by-logging-onto-server/54280/3 "2021-12-19T17:35:02Z")
> [@Matrix\_Engineering](#): > > no need to start a new thread Not just no need, but against the forum rules: [https://forum.inductiveautomation.com/faq](https://forum.inductiveautomation.com/faq) If you don't get an answer on a topic, it is fine to reply to yourself after a few days to bring a bit more attention. Once. Getting an answer that one _ **doesn't like** _ isn't an excuse to post again. ---
**Author:** ![mcgheeiv](https://avatars.discourse-cdn.com/v4/letter/m/71c47a/32.png) [@mcgheeiv](https://forum.inductiveautomation.com/u/mcgheeiv)\ **Post date:** [December 19, 2021, 5:42pm UTC](https://forum.inductiveautomation.com/t/odd-cpu-usage-fixed-by-logging-onto-server/54280/4 "2021-12-19T17:42:28Z")
I apologize. My intent was to present the information at hand in a cleaner manner. ---
**Author:** ![Matrix\_Engineering](https://sea1.discourse-cdn.com/inductiveautomation/user_avatar/forum.inductiveautomation.com/matrix_engineering/32/19781_2.png) [@Matrix\_Engineering](https://forum.inductiveautomation.com/u/Matrix_Engineering)\ **Post date:** [December 19, 2021, 5:47pm UTC](https://forum.inductiveautomation.com/t/odd-cpu-usage-fixed-by-logging-onto-server/54280/5 "2021-12-19T17:47:07Z")
If you implement the code I posted you can then trend it _within Ignition_, an easyChart with X-trace would help more. If your purchasing manager is dead set on not going to new hardware, a free (other than time) suggestion is rip out Windows and replace with Ubuntu Server 20.04 LTS etc. Supported until 2025, and may cure that Java issue you have that prevents you from moving to 7.9.18 (/ and eventually 8.1.12+). Or rip out your purchasing manager and replace with someone who understands the role Ignition plays within your facility 🙂 ---
**Author:** ![pturmel](https://sea1.discourse-cdn.com/inductiveautomation/user_avatar/forum.inductiveautomation.com/pturmel/32/3295_2.png) [@pturmel](https://forum.inductiveautomation.com/u/pturmel)\ **Post date:** [December 19, 2021, 8:08pm UTC](https://forum.inductiveautomation.com/t/odd-cpu-usage-fixed-by-logging-onto-server/54280/6 "2021-12-19T20:08:40Z")
What happens if it turns out to be an Ignition bug? The answer is _still_ going to be “upgrade”. Software on commodity hardware isn’t like machinery. Lifespans in the decades just doesn’t happen. ---
**Author:** ![mcgheeiv](https://avatars.discourse-cdn.com/v4/letter/m/71c47a/32.png) [@mcgheeiv](https://forum.inductiveautomation.com/u/mcgheeiv)\ **Post date:** [December 19, 2021, 8:48pm UTC](https://forum.inductiveautomation.com/t/odd-cpu-usage-fixed-by-logging-onto-server/54280/7 "2021-12-19T20:48:39Z")
The Ignition projects have been running with no issues for years. There have been no substantial changes to anything in about 2 years. PLCs and tags have actually been removed from the platform. Up until Friday, 10 Dec, all was well. Starting around 7:30 AM on 13 Dec things started breaking. Everyone agrees that an upgrade is way past due but silos that exist in global companies make it difficult at best to upgrade. They actually tried to upgrade to 7.9.x over 4 years ago and were not successful due to the software running on most of the client computers. The upgrade worked fine, but none of the clients could access Ignition anymore. I was not personally involved in the upgrade, so I don’t have a good feel for the issue. My current theory is that one to many applications has been added to the network that is interfering with PLC communication. Right now we know that logging onto the server reduces Ignitions CPU load and heads off any problems. Currently we are logging into the server every 15 minutes or so. ---
**Author:** ![pturmel](https://sea1.discourse-cdn.com/inductiveautomation/user_avatar/forum.inductiveautomation.com/pturmel/32/3295_2.png) [@pturmel](https://forum.inductiveautomation.com/u/pturmel)\ **Post date:** [December 19, 2021, 9:48pm UTC](https://forum.inductiveautomation.com/t/odd-cpu-usage-fixed-by-logging-onto-server/54280/8 "2021-12-19T21:48:35Z")
It is a possible a network traffic change triggered the current situation. But I can’t think of any way logging into the server could mitigate any such situation. Which makes me think it is a bug. At the very least, you should upgrade to v7.8.5. ---
**Author:** ![Matrix\_Engineering](https://sea1.discourse-cdn.com/inductiveautomation/user_avatar/forum.inductiveautomation.com/matrix_engineering/32/19781_2.png) [@Matrix\_Engineering](https://forum.inductiveautomation.com/u/Matrix_Engineering)\ **Post date:** [December 19, 2021, 10:50pm UTC](https://forum.inductiveautomation.com/t/odd-cpu-usage-fixed-by-logging-onto-server/54280/9 "2021-12-19T22:50:27Z")
@mcgheeiv Well, I certainly hope the Server OS has had its security patches in the last 2 years, or lives in a tight DMZ if not. Windows updates can break many things. ---
**Author:** ![mcgheeiv](https://avatars.discourse-cdn.com/v4/letter/m/71c47a/32.png) [@mcgheeiv](https://forum.inductiveautomation.com/u/mcgheeiv)\ **Post date:** [December 19, 2021, 11:37pm UTC](https://forum.inductiveautomation.com/t/odd-cpu-usage-fixed-by-logging-onto-server/54280/10 "2021-12-19T23:37:15Z")
Server is 2012 R2, gets patches once per month, the last was mid November, and lives in a difficult to touch network. ---
**Author:** ![Kevin.Collins](https://sea1.discourse-cdn.com/inductiveautomation/user_avatar/forum.inductiveautomation.com/kevin.collins/32/13497_2.png) [@Kevin.Collins](https://forum.inductiveautomation.com/u/Kevin.Collins)\ **Post date:** [December 19, 2021, 11:49pm UTC](https://forum.inductiveautomation.com/t/odd-cpu-usage-fixed-by-logging-onto-server/54280/11 "2021-12-19T23:49:32Z")
To me this sounds like an anti-virus situation that thinks it is being very kind to everyone by doing its aggressive scans when there are no interactive sessions active. I’ve definitely seen a lot of Windows systems in the past blasting away, then when I log in everything goes back to normal because now “I’m using it”… 😑 EDIT: Just re-read the details and saw that it is _Ignition_ CPU usage, so my statement above probably doesn’t apply… ---
**Author:** ![mcgheeiv](https://avatars.discourse-cdn.com/v4/letter/m/71c47a/32.png) [@mcgheeiv](https://forum.inductiveautomation.com/u/mcgheeiv)\ **Post date:** [December 20, 2021, 12:02pm UTC](https://forum.inductiveautomation.com/t/odd-cpu-usage-fixed-by-logging-onto-server/54280/12 "2021-12-20T12:02:27Z")
We are on 7.8.3, which does use an older version of log4j. Any thoughts about virus protection not being smart enough to know the difference? ---
**Author:** ![mcgheeiv](https://avatars.discourse-cdn.com/v4/letter/m/71c47a/32.png) [@mcgheeiv](https://forum.inductiveautomation.com/u/mcgheeiv)\ **Post date:** [December 20, 2021, 12:51pm UTC](https://forum.inductiveautomation.com/t/odd-cpu-usage-fixed-by-logging-onto-server/54280/13 "2021-12-20T12:51:47Z")
The issue started around 7:30 AM on Dec 13, only a few days after the log4j vulnerability was found. We are using Ignition 7.8.3, which uses log4j, albeit not a version with the issue. Conditions get worse when viewing the Ignition console Condition is “fixed” when a user logs onto the computer ---
**Author:** ![pturmel](https://sea1.discourse-cdn.com/inductiveautomation/user_avatar/forum.inductiveautomation.com/pturmel/32/3295_2.png) [@pturmel](https://forum.inductiveautomation.com/u/pturmel)\ **Post date:** [December 20, 2021, 2:04pm UTC](https://forum.inductiveautomation.com/t/odd-cpu-usage-fixed-by-logging-onto-server/54280/14 "2021-12-20T14:04:54Z")
If anti-virus is intercepting http traffic at the WIndows TCP/IP stack level, then yes, that would appear to increase Ignition CPU usage. Another reason to _ **not** _ deploy SCADA software on Windows. (Well, a variant of a reason.) ---
**Author:** ![mcgheeiv](https://avatars.discourse-cdn.com/v4/letter/m/71c47a/32.png) [@mcgheeiv](https://forum.inductiveautomation.com/u/mcgheeiv)\ **Post date:** [December 21, 2021, 12:23pm UTC](https://forum.inductiveautomation.com/t/odd-cpu-usage-fixed-by-logging-onto-server/54280/15 "2021-12-21T12:23:55Z")
Anti virus was disabled for 80 minutes yesterday. During this time there were no CPU spikes or comm failures. My top working theory is that AV is interfering with the logging process, 7.8.3 uses an older version of log4j. We notice a faster, steady climb in CPU usage when the Ignition console is open. I will mark Kevin’s comment as as the solution if/when we are able to verify. We are exploring options to 7.9.x. **Any suggestion as to which minor level we should go to first is greatly appreciated.** OS issues on the computers running Vision clients prevented this upgrade around 5 years ago. ---
**Author:** ![Matrix\_Engineering](https://sea1.discourse-cdn.com/inductiveautomation/user_avatar/forum.inductiveautomation.com/matrix_engineering/32/19781_2.png) [@Matrix\_Engineering](https://forum.inductiveautomation.com/u/Matrix_Engineering)\ **Post date:** [December 21, 2021, 1:07pm UTC](https://forum.inductiveautomation.com/t/odd-cpu-usage-fixed-by-logging-onto-server/54280/16 "2021-12-21T13:07:27Z")
Hi again Mack, good to hear you're getting closer to the root cause. Please view this thread on advice on going from 7.8.x to 7.9.x and beyond; > [@Upgrading from 7.8.5](https://forum.inductiveautomation.com/t/upgrading-from-7-8-5/54276): > > I am looking to plan how long it would take me to upgrade from 7.8.5 to 8.1 I see a guide for 7.9 to 8. Would that be the same as 7.8 to 8 and suffice as a guide? Or might there be additional things I should be concerned about? Also I really didn’t see in the guide, do you just import the 7.8 project into 8.1 and correct the differences in the guide, Or do you need to manually recreate windows? Thank you in advance > [@mcgheeiv](#): > > Any suggestion as to which minor level we should go to first is greatly appreciated. I did 7.8.4 to 7.9.12 in one step with no issues, however, all systems vary. > [@mcgheeiv](#): > > OS issues on the computers running Vision clients prevented this upgrade around 5 years ago. Ignition 7.9.10(+) uses an embedded Java 9 JRE for Vision client. 7.9.10 wasn't available in 2016, from memory it was circa 2018. ---
**Author:** ![mcgheeiv](https://avatars.discourse-cdn.com/v4/letter/m/71c47a/32.png) [@mcgheeiv](https://forum.inductiveautomation.com/u/mcgheeiv)\ **Post date:** [December 23, 2021, 12:58pm UTC](https://forum.inductiveautomation.com/t/odd-cpu-usage-fixed-by-logging-onto-server/54280/17 "2021-12-23T12:58:45Z")
My client modified their AV settings and the issue appears to have gone away. @Kevin.Collins, thanks so much for the clue. Thanks to everyone else for all the other advice and recommendations.