Perspective data crash

Hello everybody,

I regularly (around once a day) have a problem with perspective crashing and not displaying data anymore :

It affects the 3 differents projects that are hosted on the gateway and the only way I can solve it is by stopping and starting the gateway.

This 'central' gateway is collecting tags from 16 remote gateways (Ignition edge) and manages a total of 5360 tags.

Information
Ignition version : 8.1.25
Server OS : Windows server 2016
Java version : 11.0.17+8-LTS

Here is an extract from the log file around the time it hapenned yesterday :
wrapper.log.txt (773.6 KB)

Thank you in advance for reading in proposing clues on how to solve this problem.

BR,
Antoine.

It all depends on the circumstances, and it might be something totally different

I am no expert in this, but I see Timeout in your log, which can means a connectivity problem or a load problem. As there is no Clock Drift in the logs, I would check connectivity problem.

I see also warning in a user management view, making me think of authentication cookie expiration.

I also noticed in the past that depending on how a gateway is closed, Perspective sessions does not react in the same way. In Windows, if I use gwcmd to close or restart the gateway, Perspective sessions will not get restored. If I close or restart the windows service, Perspective sessions are restored

I would also fix some of the small issues I see in the log, to help identify the main cause.

  • NoneType handling: You have some script that crash due to NoneType, and it might causes other issues
  • Syntax error, bad indentation: some of your script are not runnable because of syntax error, and it might prevent other code to run
  • Theme manager issue: Some Apple users looked at the folder and created .ds_store in the folder causing issue

I also don't like this part of the log

INFO   | jvm 1    | 2023/04/25 10:07:24 | WARNING: An illegal reflective access operation has occurred
INFO   | jvm 1    | 2023/04/25 10:07:24 | WARNING: Illegal reflective access by com.inductiveautomation.ignition.gateway.util.IgnitionSocketImplFactory (file:/C:/Program%20Files/Inductive%20Automation/Ignition/lib/core/gateway/gateway-8.1.25.jar) to constructor java.net.SocksSocketImpl()
INFO   | jvm 1    | 2023/04/25 10:07:24 | WARNING: Please consider reporting this to the maintainers of com.inductiveautomation.ignition.gateway.util.IgnitionSocketImplFactory
INFO   | jvm 1    | 2023/04/25 10:07:24 | WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
INFO   | jvm 1    | 2023/04/25 10:07:24 | WARNING: All illegal access operations will be denied in a future release

Don't worry about that, it's ugly, but that happens on startup for everybody.

Ok, so I was going to look at our own logs, so I will skip this step