Frequent 'Bad_Stale' reconnects on only one client

We're on 8.1.35 and have an issue with only 1 client based on Win 11 (all others are Win 10 or Ubuntu). Same steps for reproducing as THIS and happens about every other minute.

I don't know how to tell if I'm doing same anything akin to what THIS original poster did (very possible, as almost all 'problems' I've faced with ignition turned out to be 100% my fault).

Gateway is windows 10 based, <5% CPU utilization.
Redundancy is configured but not working*
Ignition Platform: 8.1.35 (b2023120517)
OPC-UA Module: 9.1.35 (b2023120517) Activated
DNP3 Driver Module: 4.1.35 (b2023120517) Activated
MQTT Engine Module: 4.0.20 (b2023112216) Activated
Vision Module: 11.1.35 (b2023120517) Activated

All other clients are fine. Win11 client happens to be my new office PC, so I'm keen on resolving this issue.

12:39:05.128 [AWT-EventQueue-0] WARN  Vision.Binding.TagHistoryAdapter - Error running query:
TagHistory(paths=[prov:default:/tag:sensors/cloud/oven_blue/tempc], start=Mon Feb 17 06:39:05 EST 2025, end=Mon Feb 17 12:39:05 EST 2025, flags=0)@5000ms
On: 01-Main Window Super.Root Container.Sparkline Chart 16.data
java.lang.Exception: Error running query:
TagHistory(paths=[prov:default:/tag:sensors/cloud/oven_blue/tempc], start=Mon Feb 17 06:39:05 EST 2025, end=Mon Feb 17 12:39:05 EST 2025, flags=0)@5000ms
On: 01-Main Window Super.Root Container.Sparkline Chart 16.data
	at com.inductiveautomation.factorypmi.application.gateway.QueryManager$QueryExecutor.run(QueryManager.java:311)
	at java.base/java.lang.Thread.run(Unknown Source)
Caused by: com.inductiveautomation.ignition.client.gateway_interface.GatewayException: No session found. You must re-login. (QueryTagHistory)
	at com.inductiveautomation.ignition.client.gateway_interface.GatewayInterface.newGatewayException(GatewayInterface.java:360)
	at com.inductiveautomation.ignition.client.gateway_interface.GatewayInterface.sendMessage(GatewayInterface.java:334)
	at com.inductiveautomation.ignition.client.gateway_interface.GatewayInterface.runTagHistoryQuery(GatewayInterface.java:802)
	at com.inductiveautomation.ignition.client.gateway_interface.GatewayInterface.runTagHistoryQuery(GatewayInterface.java:770)
	at com.inductiveautomation.factorypmi.application.gateway.GwiTagHistoryProvider.query(GwiTagHistoryProvider.java:16)
	at com.inductiveautomation.ignition.common.sqltags.history.cache.StandardCacheBucket.loadData(StandardCacheBucket.java:232)
	at com.inductiveautomation.ignition.common.sqltags.history.cache.StandardCacheBucket.getData(StandardCacheBucket.java:192)
	at com.inductiveautomation.ignition.common.sqltags.history.cache.SubCache$BucketHit.getData(SubCache.java:215)
	at com.inductiveautomation.ignition.common.sqltags.history.cache.SubCache.getData(SubCache.java:158)
	at com.inductiveautomation.ignition.common.sqltags.history.cache.TagHistoryCache.query(TagHistoryCache.java:273)
	at com.inductiveautomation.factorypmi.application.gateway.TagHistoryQuery.execute(TagHistoryQuery.java:34)
	at com.inductiveautomation.factorypmi.application.gateway.QueryManager$Query.execute(QueryManager.java:668)
	at com.inductiveautomation.factorypmi.application.gateway.QueryManager$QueryExecutor.run(QueryManager.java:308)
	... 1 common frames omitted
12:39:05.089 [GatewayConnection-1] INFO  c.i.i.c.g.GatewayConnectionManager - Skipping local challenge - directory doesn't exist.
12:39:05.101 [GatewayConnection-1] INFO  c.i.i.c.g.GatewayConnectionManager - Updated login state. Logged in? true, Username: monitor, Roles: [], Security Zones: null
12:39:05.123 [GatewayConnection-1] INFO  c.i.i.c.g.GatewayConnectionManager - Stopping reconnect thread.
12:39:05.318 [ClientExecEngine-4] WARN  tags.subscriptions - Subscription crc mismatch, will resubscribe.
12:39:40.130 [ClientExecEngine-1] WARN  c.i.i.c.g.GatewayConnectionManager - Connection to Gateway lost, due to exception.
com.inductiveautomation.ignition.client.gateway_interface.GatewayException: Connect timed out
	at com.inductiveautomation.ignition.client.gateway_interface.GatewayInterface.newGatewayException(GatewayInterface.java:360)
	at com.inductiveautomation.ignition.client.gateway_interface.GatewayInterface.getResponse(GatewayInterface.java:556)
	at com.inductiveautomation.ignition.client.gateway_interface.GatewayInterface.getResponse(GatewayInterface.java:366)
	at com.inductiveautomation.ignition.client.gateway_interface.GatewayInterface.ping(GatewayInterface.java:1024)
	at com.inductiveautomation.ignition.client.gateway_interface.GatewayInterface.ping(GatewayInterface.java:1009)
	at com.inductiveautomation.ignition.client.tags.impl.GatewayTagInterface.runPoll(GatewayTagInterface.java:128)
	at com.inductiveautomation.ignition.common.execution.impl.BasicExecutionEngine$TrackedTask.run(BasicExecutionEngine.java:587)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
	at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
	at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketTimeoutException: Connect timed out
	at java.base/sun.nio.ch.NioSocketImpl.timedFinishConnect(Unknown Source)
	at java.base/sun.nio.ch.NioSocketImpl.connect(Unknown Source)
	at java.base/java.net.SocksSocketImpl.connect(Unknown Source)
	at java.base/java.net.Socket.connect(Unknown Source)
	at java.base/sun.security.ssl.SSLSocketImpl.connect(Unknown Source)
	at java.base/sun.net.NetworkClient.doConnect(Unknown Source)
	at java.base/sun.net.www.http.HttpClient.openServer(Unknown Source)
	at java.base/sun.net.www.http.HttpClient.openServer(Unknown Source)
	at java.base/sun.net.www.protocol.https.HttpsClient.<init>(Unknown Source)
	at java.base/sun.net.www.protocol.https.HttpsClient.New(Unknown Source)
	at java.base/sun.net.www.protocol.https.AbstractDelegateHttpsURLConnection.getNewHttpClient(Unknown Source)
	at java.base/sun.net.www.protocol.http.HttpURLConnection.plainConnect0(Unknown Source)
	at java.base/sun.net.www.protocol.http.HttpURLConnection.plainConnect(Unknown Source)
	at java.base/sun.net.www.protocol.https.AbstractDelegateHttpsURLConnection.connect(Unknown Source)
	at java.base/sun.net.www.protocol.http.HttpURLConnection.getOutputStream0(Unknown Source)
	at java.base/sun.net.www.protocol.http.HttpURLConnection.getOutputStream(Unknown Source)
	at java.base/sun.net.www.protocol.https.HttpsURLConnectionImpl.getOutputStream(Unknown Source)
	at com.inductiveautomation.ignition.client.gateway_interface.GatewayInterface.getResponse(GatewayInterface.java:423)
	... 11 common frames omitted
12:39:40.130 [ClientExecEngine-1] INFO  tags.subscriptions - Changing connected quality to 'Bad_Stale'
12:39:40.133 [ClientExecEngine-1] INFO  Scripting.ScriptManager.Bradley2023C - Pausing scripts...
12:39:40.133 [ClientExecEngine-1] INFO  c.i.i.c.g.GatewayConnectionManager - Starting reconnect thread.
12:39:41.140 [GatewayConnection-1] INFO  tags.subscriptions - Changing connected quality to 'Good'
12:39:41.147 [GatewayConnection-1] INFO  Scripting.ScriptManager.Bradley2023C - Resuming scripts...
12:39:41.148 [QueryExecuter 2] INFO  c.i.i.c.g.GatewayConnectionManager - Session no longer valid.
12:39:41.192 [AWT-EventQueue-0] WARN  Vision.Binding.TagHistoryAdapter - Error running query:
TagHistory(paths=[prov:default:/tag:sensors/cloud/roof_shack_cap2/tempc], start=Mon Feb 17 00:39:41 EST 2025, end=Mon Feb 17 12:39:41 EST 2025, flags=0)@5000ms
On: 01-Main Window Super.Root Container.Sparkline Chart 15.data
java.lang.Exception: Error running query:
TagHistory(paths=[prov:default:/tag:sensors/cloud/roof_shack_cap2/tempc], start=Mon Feb 17 00:39:41 EST 2025, end=Mon Feb 17 12:39:41 EST 2025, flags=0)@5000ms
On: 01-Main Window Super.Root Container.Sparkline Chart 15.data
	at com.inductiveautomation.factorypmi.application.gateway.QueryManager$QueryExecutor.run(QueryManager.java:311)
	at java.base/java.lang.Thread.run(Unknown Source)
Caused by: com.inductiveautomation.ignition.client.gateway_interface.GatewayException: No session found. You must re-login. (QueryTagHistory)
	at com.inductiveautomation.ignition.client.gateway_interface.GatewayInterface.newGatewayException(GatewayInterface.java:360)
	at com.inductiveautomation.ignition.client.gateway_interface.GatewayInterface.sendMessage(GatewayInterface.java:334)
	at com.inductiveautomation.ignition.client.gateway_interface.GatewayInterface.runTagHistoryQuery(GatewayInterface.java:802)
	at com.inductiveautomation.ignition.client.gateway_interface.GatewayInterface.runTagHistoryQuery(GatewayInterface.java:770)
	at com.inductiveautomation.factorypmi.application.gateway.GwiTagHistoryProvider.query(GwiTagHistoryProvider.java:16)
	at com.inductiveautomation.ignition.common.sqltags.history.cache.StandardCacheBucket.loadData(StandardCacheBucket.java:232)
	at com.inductiveautomation.ignition.common.sqltags.history.cache.StandardCacheBucket.getData(StandardCacheBucket.java:192)
	at com.inductiveautomation.ignition.common.sqltags.history.cache.SubCache$BucketHit.getData(SubCache.java:215)
	at com.inductiveautomation.ignition.common.sqltags.history.cache.SubCache.getData(SubCache.java:158)
	at com.inductiveautomation.ignition.common.sqltags.history.cache.TagHistoryCache.query(TagHistoryCache.java:273)
	at com.inductiveautomation.factorypmi.application.gateway.TagHistoryQuery.execute(TagHistoryQuery.java:34)
	at com.inductiveautomation.factorypmi.application.gateway.QueryManager$Query.execute(QueryManager.java:668)
	at com.inductiveautomation.factorypmi.application.gateway.QueryManager$QueryExecutor.run(QueryManager.java:308)
	... 1 common frames omitted
12:39:41.198 [AWT-EventQueue-0] WARN  Vision.Binding.TagHistoryAdapter - Error running query:
TagHistory(paths=[prov:default:/tag:Fils/VDU2_tags/SOL102], start=Mon Feb 17 00:39:41 EST 2025, end=Mon Feb 17 12:39:41 EST 2025, flags=0)@5000ms
On: 01-Main Window Super.Root Container.Group 9.Sparkline Chart 11.data
java.lang.Exception: Error running query:
TagHistory(paths=[prov:default:/tag:Fils/VDU2_tags/SOL102], start=Mon Feb 17 00:39:41 EST 2025, end=Mon Feb 17 12:39:41 EST 2025, flags=0)@5000ms
On: 01-Main Window Super.Root Container.Group 9.Sparkline Chart 11.data
	at com.inductiveautomation.factorypmi.application.gateway.QueryManager$QueryExecutor.run(QueryManager.java:311)
	at java.base/java.lang.Thread.run(Unknown Source)
Caused by: com.inductiveautomation.ignition.client.gateway_interface.GatewayException: No session found. You must re-login. (QueryTagHistory)
	at com.inductiveautomation.ignition.client.gateway_interface.GatewayInterface.newGatewayException(GatewayInterface.java:360)
	at com.inductiveautomation.ignition.client.gateway_interface.GatewayInterface.sendMessage(GatewayInterface.java:334)
	at com.inductiveautomation.ignition.client.gateway_interface.GatewayInterface.runTagHistoryQuery(GatewayInterface.java:802)
	at com.inductiveautomation.ignition.client.gateway_interface.GatewayInterface.runTagHistoryQuery(GatewayInterface.java:770)
	at com.inductiveautomation.factorypmi.application.gateway.GwiTagHistoryProvider.query(GwiTagHistoryProvider.java:16)
	at com.inductiveautomation.ignition.common.sqltags.history.cache.StandardCacheBucket.loadData(StandardCacheBucket.java:232)
	at com.inductiveautomation.ignition.common.sqltags.history.cache.StandardCacheBucket.getData(StandardCacheBucket.java:192)
	at com.inductiveautomation.ignition.common.sqltags.history.cache.SubCache$BucketHit.getData(SubCache.java:215)
	at com.inductiveautomation.ignition.common.sqltags.history.cache.SubCache.getData(SubCache.java:158)
	at com.inductiveautomation.ignition.common.sqltags.history.cache.TagHistoryCache.query(TagHistoryCache.java:273)
	at com.inductiveautomation.factorypmi.application.gateway.TagHistoryQuery.execute(TagHistoryQuery.java:34)
	at com.inductiveautomation.factorypmi.application.gateway.QueryManager$Query.execute(QueryManager.java:668)
	at com.inductiveautomation.factorypmi.application.gateway.QueryManager$QueryExecutor.run(QueryManager.java:308)
	... 1 common frames omitted
[...]
12:40:47.354 [AWT-EventQueue-0] WARN  Vision.Binding.TagHistoryAdapter - Error running query:
TagHistory(paths=[prov:default:/tag:Fils/LRVP_vdu2_delta], start=Mon Feb 17 11:40:47 EST 2025, end=Mon Feb 17 12:40:47 EST 2025, flags=0)@5000ms
On: 01-Main Window Super.Root Container.Group 9.VDU2_LRVP.data
java.lang.Exception: Error running query:
TagHistory(paths=[prov:default:/tag:Fils/LRVP_vdu2_delta], start=Mon Feb 17 11:40:47 EST 2025, end=Mon Feb 17 12:40:47 EST 2025, flags=0)@5000ms
On: 01-Main Window Super.Root Container.Group 9.VDU2_LRVP.data
	at com.inductiveautomation.factorypmi.application.gateway.QueryManager$QueryExecutor.run(QueryManager.java:311)
	at java.base/java.lang.Thread.run(Unknown Source)
Caused by: com.inductiveautomation.ignition.client.gateway_interface.GatewayException: No session found. You must re-login. (QueryTagHistory)
	at com.inductiveautomation.ignition.client.gateway_interface.GatewayInterface.newGatewayException(GatewayInterface.java:360)
	at com.inductiveautomation.ignition.client.gateway_interface.GatewayInterface.sendMessage(GatewayInterface.java:334)
	at com.inductiveautomation.ignition.client.gateway_interface.GatewayInterface.runTagHistoryQuery(GatewayInterface.java:802)
	at com.inductiveautomation.ignition.client.gateway_interface.GatewayInterface.runTagHistoryQuery(GatewayInterface.java:770)
	at com.inductiveautomation.factorypmi.application.gateway.GwiTagHistoryProvider.query(GwiTagHistoryProvider.java:16)
	at com.inductiveautomation.ignition.common.sqltags.history.cache.TagHistoryCache.query(TagHistoryCache.java:211)
	at com.inductiveautomation.factorypmi.application.gateway.TagHistoryQuery.execute(TagHistoryQuery.java:34)
	at com.inductiveautomation.factorypmi.application.gateway.QueryManager$Query.execute(QueryManager.java:668)
	at com.inductiveautomation.factorypmi.application.gateway.QueryManager$QueryExecutor.run(QueryManager.java:308)
	... 1 common frames omitted
12:40:47.335 [GatewayConnection-1] INFO  c.i.i.c.g.GatewayConnectionManager - Skipping local challenge - directory doesn't exist.
12:40:47.341 [GatewayConnection-1] INFO  c.i.i.c.g.GatewayConnectionManager - Updated login state. Logged in? true, Username: monitor, Roles: [], Security Zones: null
12:40:47.366 [GatewayConnection-1] INFO  c.i.i.c.g.GatewayConnectionManager - Stopping reconnect thread.
12:40:47.546 [ClientExecEngine-4] WARN  tags.subscriptions - Subscription crc mismatch, will resubscribe.

I had dashboard open and watching client diagnostics (performance tab) and the dashboard turns red & logs show reconnects in line with red lines I've added, but I don't know if that's cause and effect or consequence of reconnect:

Any ideas are welcome. Thank you.

PS. *issue with redundancy is "I'm confused what is wrong or what to do about it" so am asking our integrator to correct this for us (just mentioning this in case it's contributing to my issue with Win11 client):
Gateway status, 12 clients connected:


As far as 8.1.35 gateway is concerned, a backup/failover gateway has been configured (master is running):

But as far as clients are concerned, there isn’t one:

When I force failover, backup gateway doesn't respond and clients remain dead. So I know I have a problem somewhere, but ran out of ideas personally.

No, that screen shot shows the gateway that is master has activity level "Active". Not failed over.

1 Like

Please mark post as solved - problem is definitely hardware or drivers (or mix of the two) on my new, high-end work laptop.