# Ignition Backup Gateway, Out Of Date Sync issue **URL:** \ **Category:** Ignition\ **Tags:** ignition81\ **Created:** [September 7, 2023, 7:31am UTC](https://forum.inductiveautomation.com/t/ignition-backup-gateway-out-of-date-sync-issue/78846 "2023-09-07T07:31:31Z")\ **Posts on this page:** 16\ **Page:** 1
**Author:** ![Jobin\_Samuel](https://avatars.discourse-cdn.com/v4/letter/j/54ee81/32.png) [@Jobin\_Samuel](https://forum.inductiveautomation.com/u/Jobin_Samuel)\ **Post date:** [September 7, 2023, 7:31am UTC](https://forum.inductiveautomation.com/t/ignition-backup-gateway-out-of-date-sync-issue/78846/1 "2023-09-07T07:31:31Z")
Hi There, The Ignition version we are using is V 8.1.14 Master Sync status : Good Backup Sync status : Out Of Date 1. Force Re-Sync both from Master and Backup gateway, no change 2. move the config.idb file and restarted the backup gateway, no change PROD 1 log: ```auto |InternalDb|07Sep2023 12:38:18|Error sending system backup to other gateway.| | --- | --- | --- | |com.inductiveautomation.metro.api.ex.RemoteException: Exception occurred on remote machine, message id='4895', error code=GENERAL_PROTOCOL_EXCEPTION [100] at com.inductiveautomation.metro.impl.protocol.handler.AckErrorHandler.handleMessage(AckErrorHandler.java:76) at com.inductiveautomation.metro.impl.protocol.websocket.MetroWebSocket.onMessage(MetroWebSocket.java:366) at jdk.internal.reflect.GeneratedMethodAccessor20.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.eclipse.jetty.websocket.common.events.annotated.CallableMethod.call(CallableMethod.java:70) at org.eclipse.jetty.websocket.common.events.annotated.OptionalSessionCallableMethod.call(OptionalSessionCallableMethod.java:72) at org.eclipse.jetty.websocket.common.events.JettyAnnotatedEventDriver.lambda$onBinaryFrame$0(JettyAnnotatedEventDriver.java:113) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034) at java.base/java.lang.Thread.run(Unknown Source)| ``` PROD 2 log: ```auto |WebSocketConnection|07Sep2023 12:38:18|-> outgoing local='XXXprd01ignt_AAAXXXvlping01-backup' remote='XXXprd01ignt_AAAXXXvlping01-master' method=Metro-RunDownloadThread: Exception occurred in the local system, message id='4895'| | --- | --- | --- | |java.io.FileNotFoundException: /tmp/metro/8317a818-ca23-4b51-aa9c-1df38592868e___statetransfer.gwbk (Permission denied) at java.base/java.io.FileOutputStream.open0(Native Method) at java.base/java.io.FileOutputStream.open(Unknown Source) at java.base/java.io.FileOutputStream.(Unknown Source) at java.base/java.io.FileOutputStream.(Unknown Source) at com.inductiveautomation.metro.impl.codecs.FileStreamCodec.decode(FileStreamCodec.java:143) at com.inductiveautomation.metro.impl.CentralManagerImpl.handleLocal(CentralManagerImpl.java:429) at com.inductiveautomation.metro.impl.ConnectionWatcher.handle(ConnectionWatcher.java:429) at com.inductiveautomation.metro.impl.ConnectionWatcher.handle(ConnectionWatcher.java:44) at com.inductiveautomation.metro.impl.protocol.websocket.WebSocketConnection.forward(WebSocketConnection.java:1357) at com.inductiveautomation.metro.impl.protocol.websocket.WebSocketConnection$RunDownload.run(WebSocketConnection.java:1926) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source)| |Intent|07Sep2023 12:38:18|Unhandled Intent failure.| | --- | --- | --- | |java.io.FileNotFoundException: /tmp/metro/8317a818-ca23-4b51-aa9c-1df38592868e___statetransfer.gwbk (Permission denied) at java.base/java.io.FileOutputStream.open0(Native Method) at java.base/java.io.FileOutputStream.open(Unknown Source) at java.base/java.io.FileOutputStream.(Unknown Source) at java.base/java.io.FileOutputStream.(Unknown Source) at com.inductiveautomation.metro.impl.codecs.FileStreamCodec.decode(FileStreamCodec.java:143) at com.inductiveautomation.metro.impl.CentralManagerImpl.handleLocal(CentralManagerImpl.java:429) at com.inductiveautomation.metro.impl.ConnectionWatcher.handle(ConnectionWatcher.java:429) at com.inductiveautomation.metro.impl.ConnectionWatcher.handle(ConnectionWatcher.java:44) at com.inductiveautomation.metro.impl.protocol.websocket.WebSocketConnection.forward(WebSocketConnection.java:1357) at com.inductiveautomation.metro.impl.protocol.websocket.WebSocketConnection$RunDownload.run(WebSocketConnection.java:1926) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source)| ``` PROD 1 status log image. ![PROD1 Status Log](https://us1.discourse-cdn.com/inductiveautomation/original/3X/b/b/bb939f7a6a2096d14139934aa809971cf4b6fe2d.jpeg) PROD 2 status log image. ![PROD2 Status Log](https://us1.discourse-cdn.com/inductiveautomation/original/3X/5/1/510e0e99fd88cd782e99efbc9019e3c8a29c06a1.jpeg) ---
**Author:** ![pturmel](https://sea1.discourse-cdn.com/inductiveautomation/user_avatar/forum.inductiveautomation.com/pturmel/32/3295_2.png) [@pturmel](https://forum.inductiveautomation.com/u/pturmel)\ **Post date:** [September 7, 2023, 11:55am UTC](https://forum.inductiveautomation.com/t/ignition-backup-gateway-out-of-date-sync-issue/78846/2 "2023-09-07T11:55:11Z")
Permission denied suggests something is wrong with the backup gateway's folder permissions. Consider deactivating it, uninstalling, re-installing (making sure you get just the matching modules), and configuring its backup role again (so it will try to resync). Or, perhaps, the disk is full. ---
**Author:** ![Jobin\_Samuel](https://avatars.discourse-cdn.com/v4/letter/j/54ee81/32.png) [@Jobin\_Samuel](https://forum.inductiveautomation.com/u/Jobin_Samuel)\ **Post date:** [September 7, 2023, 12:11pm UTC](https://forum.inductiveautomation.com/t/ignition-backup-gateway-out-of-date-sync-issue/78846/3 "2023-09-07T12:11:48Z")
Thank you for the comments. The disk is not full. When you say de-activate, do you mean to make the master independent and then reinstall the backup? Thanks in advance. ---
**Author:** ![pturmel](https://sea1.discourse-cdn.com/inductiveautomation/user_avatar/forum.inductiveautomation.com/pturmel/32/3295_2.png) [@pturmel](https://forum.inductiveautomation.com/u/pturmel)\ **Post date:** [September 7, 2023, 12:13pm UTC](https://forum.inductiveautomation.com/t/ignition-backup-gateway-out-of-date-sync-issue/78846/4 "2023-09-07T12:13:25Z")
No, I meant move the license back to IA's license servers so you can completely wipe the install folders (otherwise you'd lose the license). ---
**Author:** ![kcollins](https://sea1.discourse-cdn.com/inductiveautomation/user_avatar/forum.inductiveautomation.com/kcollins/32/19646_2.png) [@kcollins](https://forum.inductiveautomation.com/u/kcollins)\ **Post date:** [September 7, 2023, 2:01pm UTC](https://forum.inductiveautomation.com/t/ignition-backup-gateway-out-of-date-sync-issue/78846/5 "2023-09-07T14:01:52Z")
My spidey sense is firing related to your `/tmp` folder. What OS are you running? If you run `findmnt`, are there any special mount configurations for `/tmp`? I'm remembering some situations where some hardening efforts on `/tmp` can cause compatibility problems (in which case you can configure a temp folder in Ignition and direct it to use that versus the system-default temp location). ---
**Author:** ![Jobin\_Samuel](https://avatars.discourse-cdn.com/v4/letter/j/54ee81/32.png) [@Jobin\_Samuel](https://forum.inductiveautomation.com/u/Jobin_Samuel)\ **Post date:** [September 8, 2023, 6:03am UTC](https://forum.inductiveautomation.com/t/ignition-backup-gateway-out-of-date-sync-issue/78846/6 "2023-09-08T06:03:24Z")
Hi, The Ignition is installed on a Linux server. ---
**Author:** ![Jobin\_Samuel](https://avatars.discourse-cdn.com/v4/letter/j/54ee81/32.png) [@Jobin\_Samuel](https://forum.inductiveautomation.com/u/Jobin_Samuel)\ **Post date:** [September 15, 2023, 11:02am UTC](https://forum.inductiveautomation.com/t/ignition-backup-gateway-out-of-date-sync-issue/78846/7 "2023-09-15T11:02:42Z")
Hi, Thank you for the reply, but I did not understand the suggested method. ---
**Author:** ![kcollins](https://sea1.discourse-cdn.com/inductiveautomation/user_avatar/forum.inductiveautomation.com/kcollins/32/19646_2.png) [@kcollins](https://forum.inductiveautomation.com/u/kcollins)\ **Post date:** [September 15, 2023, 1:50pm UTC](https://forum.inductiveautomation.com/t/ignition-backup-gateway-out-of-date-sync-issue/78846/8 "2023-09-15T13:50:00Z")
I probably should have been more specific to ask what flavor of Linux OS that you're running? Ubuntu? RHEL? Ultimately taking a look at the permissions and mount configuration of `/tmp` (as Phil suggested) will probably be enlightening. ---
**Author:** ![Jobin\_Samuel](https://avatars.discourse-cdn.com/v4/letter/j/54ee81/32.png) [@Jobin\_Samuel](https://forum.inductiveautomation.com/u/Jobin_Samuel)\ **Post date:** [September 21, 2023, 9:08am UTC](https://forum.inductiveautomation.com/t/ignition-backup-gateway-out-of-date-sync-issue/78846/9 "2023-09-21T09:08:16Z")
> [@kcollins](#): > > findmnt Hi, The system is Linux 7. While executing the findmnt, we found below results. Could you please help with next step. ![image](https://us1.discourse-cdn.com/inductiveautomation/original/3X/7/0/7047f698b2523898e5afb41903bbf6cebb370447.jpeg) ---
**Author:** ![pturmel](https://sea1.discourse-cdn.com/inductiveautomation/user_avatar/forum.inductiveautomation.com/pturmel/32/3295_2.png) [@pturmel](https://forum.inductiveautomation.com/u/pturmel)\ **Post date:** [September 21, 2023, 12:33pm UTC](https://forum.inductiveautomation.com/t/ignition-backup-gateway-out-of-date-sync-issue/78846/10 "2023-09-21T12:33:32Z")
> [@Jobin\_Samuel](#): > > Linux 7 Never heard of this. Do you mean RHEL 7 ? (If so, I must say it is really old and troublesome.) ---
**Author:** ![Jobin\_Samuel](https://avatars.discourse-cdn.com/v4/letter/j/54ee81/32.png) [@Jobin\_Samuel](https://forum.inductiveautomation.com/u/Jobin_Samuel)\ **Post date:** [September 21, 2023, 12:55pm UTC](https://forum.inductiveautomation.com/t/ignition-backup-gateway-out-of-date-sync-issue/78846/11 "2023-09-21T12:55:42Z")
Hi, Sorry for the confusion. I have no knowledge on Linux, from one of the playbook I found something like this, **Red Hat Enterprise Linux 7 & OpenJDK8**. Not sure whether this makes sense to the team's question. ---
**Author:** ![Jobin\_Samuel](https://avatars.discourse-cdn.com/v4/letter/j/54ee81/32.png) [@Jobin\_Samuel](https://forum.inductiveautomation.com/u/Jobin_Samuel)\ **Post date:** [September 21, 2023, 12:57pm UTC](https://forum.inductiveautomation.com/t/ignition-backup-gateway-out-of-date-sync-issue/78846/12 "2023-09-21T12:57:16Z")
Now, I believe the answer is RHEL 7 ( **Red Hat Enterprise Linux** 7). ---
**Author:** ![kcollins](https://sea1.discourse-cdn.com/inductiveautomation/user_avatar/forum.inductiveautomation.com/kcollins/32/19646_2.png) [@kcollins](https://forum.inductiveautomation.com/u/kcollins)\ **Post date:** [September 21, 2023, 2:08pm UTC](https://forum.inductiveautomation.com/t/ignition-backup-gateway-out-of-date-sync-issue/78846/13 "2023-09-21T14:08:28Z")
It does look like perhaps you've got some extra hardening on that system. At this point, I'd probably direct Ignition to use a tmp folder under its own installation folder (instead of the global tmp folder at `/tmp`) for better compatibility. It might be worth touching base with Support for this. ---
**Author:** ![Jobin\_Samuel](https://avatars.discourse-cdn.com/v4/letter/j/54ee81/32.png) [@Jobin\_Samuel](https://forum.inductiveautomation.com/u/Jobin_Samuel)\ **Post date:** [September 22, 2023, 5:17am UTC](https://forum.inductiveautomation.com/t/ignition-backup-gateway-out-of-date-sync-issue/78846/14 "2023-09-22T05:17:20Z")
Thank you for the support, I have raised a support ticket and pasted this link to it. Will update over here once the solution has been found. ---
**Author:** ![Jobin\_Samuel](https://avatars.discourse-cdn.com/v4/letter/j/54ee81/32.png) [@Jobin\_Samuel](https://forum.inductiveautomation.com/u/Jobin_Samuel)\ **Post date:** [October 19, 2023, 3:57am UTC](https://forum.inductiveautomation.com/t/ignition-backup-gateway-out-of-date-sync-issue/78846/15 "2023-10-19T03:57:12Z")
Status issue resolved by providing necessary permission to “/tmp/metro” folder in the backup server. ---
**Author:** ![Jobin\_Samuel](https://avatars.discourse-cdn.com/v4/letter/j/54ee81/32.png) [@Jobin\_Samuel](https://forum.inductiveautomation.com/u/Jobin_Samuel)\ **Post date:** [October 19, 2023, 3:57am UTC](https://forum.inductiveautomation.com/t/ignition-backup-gateway-out-of-date-sync-issue/78846/16 "2023-10-19T03:57:56Z")
Thank you all for the support.