Ignition Voice Notification Module Failure

Ignition
1

My voice notification module started to fail suddenly. No changes were made to the gateway. It fails to register with the SIP server, saying "Registration failed with message 'unknown [-1]'"

wrapper log says the following:

INFO   | jvm 2    | 2024/04/24 11:18:14 | I [g.ModuleManager               ] [16:18:14]: Starting up module 'com.inductiveautomation.phone-notification' v6.1.35 (b2023120517)... module-name=Voice Notification
INFO   | jvm 2    | 2024/04/24 11:18:14 | E [g.ModuleManager               ] [16:18:14]: Error starting module com.inductiveautomation.phone-notification module-name=Voice Notification
INFO   | jvm 2    | 2024/04/24 11:18:14 | java.lang.RuntimeException: Error initializing tts engine. This engine will not be available for use.
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at com.inductiveautomation.services.tts.cere.CereSystem.startup(CereSystem.java:171)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at com.inductiveautomation.alarming.notification.phone.PhoneNotificationModuleHook.lambda$startup$0(PhoneNotificationModuleHook.java:57)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at java.base/java.util.Optional.ifPresent(Unknown Source)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at com.inductiveautomation.alarming.notification.phone.PhoneNotificationModuleHook.startup(PhoneNotificationModuleHook.java:57)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at com.inductiveautomation.ignition.gateway.modules.ModuleManagerImpl$LoadedModule.startup(ModuleManagerImpl.java:2390)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at com.inductiveautomation.ignition.gateway.modules.ModuleManagerImpl.startupModule(ModuleManagerImpl.java:1180)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at com.inductiveautomation.ignition.gateway.modules.ModuleManagerImpl$4.call(ModuleManagerImpl.java:835)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at com.inductiveautomation.ignition.gateway.modules.ModuleManagerImpl.executeModuleOperation(ModuleManagerImpl.java:901)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at com.inductiveautomation.ignition.gateway.modules.ModuleManagerImpl.restartModuleInternal(ModuleManagerImpl.java:815)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at com.inductiveautomation.ignition.gateway.modules.ModuleManagerImpl.restartModule(ModuleManagerImpl.java:807)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at com.inductiveautomation.ignition.gateway.web.pages.config.ModulePage$RestartAction.execute(ModulePage.java:575)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at com.inductiveautomation.ignition.gateway.web.components.ConfirmationPanel$1.onClick(ConfirmationPanel.java:49)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at org.apache.wicket.markup.html.link.Link.onLinkClicked(Link.java:190)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at java.base/java.lang.reflect.Method.invoke(Unknown Source)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at org.apache.wicket.RequestListenerInterface.internalInvoke(RequestListenerInterface.java:258)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at org.apache.wicket.RequestListenerInterface.invoke(RequestListenerInterface.java:216)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at org.apache.wicket.core.request.handler.ListenerInterfaceRequestHandler.invokeListener(ListenerInterfaceRequestHandler.java:243)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at org.apache.wicket.core.request.handler.ListenerInterfaceRequestHandler.respond(ListenerInterfaceRequestHandler.java:236)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at org.apache.wicket.request.cycle.RequestCycle$HandlerExecutor.respond(RequestCycle.java:890)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at org.apache.wicket.request.RequestHandlerStack.execute(RequestHandlerStack.java:64)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at org.apache.wicket.request.cycle.RequestCycle.execute(RequestCycle.java:261)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at org.apache.wicket.request.cycle.RequestCycle.processRequest(RequestCycle.java:218)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at org.apache.wicket.request.cycle.RequestCycle.processRequestAndDetach(RequestCycle.java:289)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at org.apache.wicket.protocol.http.WicketFilter.processRequestCycle(WicketFilter.java:259)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at org.apache.wicket.protocol.http.WicketFilter.processRequest(WicketFilter.java:201)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at org.apache.wicket.protocol.http.WicketFilter.doFilter(WicketFilter.java:282)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:210)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1635)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:527)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:131)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:578)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:122)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:223)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1570)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:221)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1384)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:176)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:484)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1543)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:174)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1306)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:129)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:122)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at com.inductiveautomation.catapult.handlers.RemoteHostNameLookupHandler.handle(RemoteHostNameLookupHandler.java:121)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:122)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:301)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at org.eclipse.jetty.server.handler.HandlerList.handle(HandlerList.java:51)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:141)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:122)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at org.eclipse.jetty.server.Server.handle(Server.java:563)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at org.eclipse.jetty.server.HttpChannel.lambda$handle$0(HttpChannel.java:505)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:762)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:497)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:282)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:314)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:100)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:558)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:379)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:146)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:100)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at org.eclipse.jetty.io.SelectableChannelEndPoint$1.run(SelectableChannelEndPoint.java:53)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.runTask(AdaptiveExecutionStrategy.java:416)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.consumeTask(AdaptiveExecutionStrategy.java:385)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.tryProduce(AdaptiveExecutionStrategy.java:272)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.lambda$new$0(AdaptiveExecutionStrategy.java:140)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:411)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:969)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.doRunJob(QueuedThreadPool.java:1194)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1149)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at java.base/java.lang.Thread.run(Unknown Source)
INFO   | jvm 2    | 2024/04/24 11:18:14 | Caused by: java.io.FileNotFoundException: temp\cerevoice_eng.dll (The process cannot access the file because it is being used by another process)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at java.base/java.io.FileOutputStream.open0(Native Method)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at java.base/java.io.FileOutputStream.open(Unknown Source)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at java.base/java.io.FileOutputStream.<init>(Unknown Source)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at java.base/java.io.FileOutputStream.<init>(Unknown Source)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at com.inductiveautomation.services.tts.cere.CereSystem.copyFile(CereSystem.java:149)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at com.inductiveautomation.services.tts.cere.CereSystem.setupNativeFiles(CereSystem.java:96)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	at com.inductiveautomation.services.tts.cere.CereSystem.startup(CereSystem.java:168)
INFO   | jvm 2    | 2024/04/24 11:18:14 | 	... 72 common frames omitted
INFO   | jvm 2    | 2024/04/24 11:18:15 | I [g.ModuleManager               ] [16:18:15]: Starting dependent module "ia.voice.en_us_katherine" 
INFO   | jvm 2    | 2024/04/24 11:18:15 | W [g.ModuleManager               ] [16:18:15]: Module "ia.voice.en_us_katherine" depends on "ModuleManagerImpl$LoadedModule[id="com.inductiveautomation.phone-notification", state="FAULTED"]", but it is not started. (state=FAULTED) 
INFO   | jvm 2    | 2024/04/24 11:18:15 | I [g.ModuleManager               ] [16:18:15]: Starting up module 'ia.voice.en_us_katherine' v5.0.2 (b2021110908)... module-name=TTS Voice - en_us_katherine
INFO   | jvm 2    | 2024/04/24 11:18:15 | E [g.ModuleManager               ] [16:18:15]: Error starting module ia.voice.en_us_katherine module-name=TTS Voice - en_us_katherine
INFO   | jvm 2    | 2024/04/24 11:18:15 | java.lang.NoClassDefFoundError: com/inductiveautomation/services/tts/cere/CereVoiceManager
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at com.inductiveautomation.services.tts.cere.VoiceModuleHook.startup(VoiceModuleHook.java:83)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at com.inductiveautomation.ignition.gateway.modules.ModuleManagerImpl$LoadedModule.startup(ModuleManagerImpl.java:2390)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at com.inductiveautomation.ignition.gateway.modules.ModuleManagerImpl.startupModule(ModuleManagerImpl.java:1180)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at com.inductiveautomation.ignition.gateway.modules.ModuleManagerImpl.executeModuleOperation(ModuleManagerImpl.java:921)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at com.inductiveautomation.ignition.gateway.modules.ModuleManagerImpl.restartModuleInternal(ModuleManagerImpl.java:815)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at com.inductiveautomation.ignition.gateway.modules.ModuleManagerImpl.restartModule(ModuleManagerImpl.java:807)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at com.inductiveautomation.ignition.gateway.web.pages.config.ModulePage$RestartAction.execute(ModulePage.java:575)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at com.inductiveautomation.ignition.gateway.web.components.ConfirmationPanel$1.onClick(ConfirmationPanel.java:49)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at org.apache.wicket.markup.html.link.Link.onLinkClicked(Link.java:190)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at java.base/java.lang.reflect.Method.invoke(Unknown Source)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at org.apache.wicket.RequestListenerInterface.internalInvoke(RequestListenerInterface.java:258)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at org.apache.wicket.RequestListenerInterface.invoke(RequestListenerInterface.java:216)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at org.apache.wicket.core.request.handler.ListenerInterfaceRequestHandler.invokeListener(ListenerInterfaceRequestHandler.java:243)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at org.apache.wicket.core.request.handler.ListenerInterfaceRequestHandler.respond(ListenerInterfaceRequestHandler.java:236)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at org.apache.wicket.request.cycle.RequestCycle$HandlerExecutor.respond(RequestCycle.java:890)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at org.apache.wicket.request.RequestHandlerStack.execute(RequestHandlerStack.java:64)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at org.apache.wicket.request.cycle.RequestCycle.execute(RequestCycle.java:261)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at org.apache.wicket.request.cycle.RequestCycle.processRequest(RequestCycle.java:218)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at org.apache.wicket.request.cycle.RequestCycle.processRequestAndDetach(RequestCycle.java:289)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at org.apache.wicket.protocol.http.WicketFilter.processRequestCycle(WicketFilter.java:259)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at org.apache.wicket.protocol.http.WicketFilter.processRequest(WicketFilter.java:201)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at org.apache.wicket.protocol.http.WicketFilter.doFilter(WicketFilter.java:282)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:210)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1635)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:527)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:131)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:578)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:122)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:223)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1570)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:221)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1384)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:176)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:484)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1543)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:174)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1306)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:129)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:122)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at com.inductiveautomation.catapult.handlers.RemoteHostNameLookupHandler.handle(RemoteHostNameLookupHandler.java:121)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:122)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:301)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at org.eclipse.jetty.server.handler.HandlerList.handle(HandlerList.java:51)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:141)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:122)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at org.eclipse.jetty.server.Server.handle(Server.java:563)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at org.eclipse.jetty.server.HttpChannel.lambda$handle$0(HttpChannel.java:505)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:762)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:497)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:282)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:314)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:100)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:558)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:379)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:146)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:100)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at org.eclipse.jetty.io.SelectableChannelEndPoint$1.run(SelectableChannelEndPoint.java:53)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.runTask(AdaptiveExecutionStrategy.java:416)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.consumeTask(AdaptiveExecutionStrategy.java:385)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.tryProduce(AdaptiveExecutionStrategy.java:272)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.lambda$new$0(AdaptiveExecutionStrategy.java:140)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:411)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:969)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.doRunJob(QueuedThreadPool.java:1194)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1149)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at java.base/java.lang.Thread.run(Unknown Source)
INFO   | jvm 2    | 2024/04/24 11:18:15 | Caused by: java.lang.ClassNotFoundException: com.inductiveautomation.services.tts.cere.CereVoiceManager
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at java.base/java.net.URLClassLoader.findClass(Unknown Source)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at com.inductiveautomation.ignition.gateway.modules.ModuleClassLoader.findClass(ModuleClassLoader.java:37)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at com.inductiveautomation.ignition.gateway.modules.ModuleClassLoader.loadClass(ModuleClassLoader.java:104)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	at java.base/java.lang.ClassLoader.loadClass(Unknown Source)
INFO   | jvm 2    | 2024/04/24 11:18:15 | 	... 69 common frames omitted

If I reboot the gateway, the module starts up ok but still does not register with the server.

2

Restart your server, or look for any rogue Java processes. And/or use a tool like OpenedFilesView to see what's actually locking that file.

3

I rebooted the server, this didn't fix the issue. More wrapper log:

INFO   | jvm 1    | 2024/04/24 11:38:57 | I [a.N.V.CallManager             ] [16:38:57]: Registration failed with message 'unknown [-1]' 
INFO   | jvm 1    | 2024/04/24 11:40:30 | I [a.N.V.CallManager             ] [16:40:30]: Registration failed with message 'unknown [-1]' 
INFO   | jvm 1    | 2024/04/24 11:42:02 | I [a.N.V.CallManager             ] [16:42:02]: Registration failed with message 'unknown [-1]' 
INFO   | jvm 1    | 2024/04/24 11:42:45 | I [P.InternalDatabase            ] [16:42:45]: Creating auto-backup of internal database "config.idb"... 
INFO   | jvm 1    | 2024/04/24 11:42:45 | I [P.InternalDatabase            ] [16:42:45]: Created auto-backup of internal database "config.idb" in 296 ms 
INFO   | jvm 1    | 2024/04/24 11:43:34 | I [a.N.V.CallManager             ] [16:43:34]: Registration failed with message 'unknown [-1]' 
INFO   | jvm 1    | 2024/04/24 11:45:06 | I [a.N.V.CallManager             ] [16:45:06]: Registration failed with message 'unknown [-1]' 
INFO   | jvm 1    | 2024/04/24 11:45:34 | I [o.a.w.r.PropertiesFactory     ] [16:45:34]: Loading properties files from jar:file:/C:/Program%20Files/Inductive%20Automation/Ignition/lib/core/gateway/wicket-core-6.30.0.jar!/org/apache/wicket/Application.properties with loader org.apache.wicket.resource.IsoPropertiesFilePropertiesLoader@4b877e0a 
INFO   | jvm 1    | 2024/04/24 11:45:34 | I [o.a.w.r.PropertiesFactory     ] [16:45:34]: Loading properties files from jar:file:/C:/Program%20Files/Inductive%20Automation/Ignition/lib/core/gateway/wicket-extensions-6.30.0.jar!/org/apache/wicket/extensions/Initializer.properties with loader org.apache.wicket.resource.IsoPropertiesFilePropertiesLoader@4b877e0a 
INFO   | jvm 1    | 2024/04/24 11:46:38 | I [a.N.V.CallManager             ] [16:46:38]: Registration failed with message 'unknown [-1]' 
INFO   | jvm 1    | 2024/04/24 11:46:45 | I [P.InternalDatabase            ] [16:46:45]: Creating auto-backup of internal database "config.idb"... 
INFO   | jvm 1    | 2024/04/24 11:46:45 | I [P.InternalDatabase            ] [16:46:45]: Created auto-backup of internal database "config.idb" in 142 ms
4

I think the 'registration failed' are symptoms; you need the root cause, which may or may not be somewhere in your wrapper log. You're going to have a much easier time troubleshooting this live with an actual support rep:
https://support.inductiveautomation.com/hc/en-us

5

Thank you, I'll do that. If I get a cause I'll update this ticket in case someone else has this issue.

1 Like
6

Turns out IT did some maintenance on the network the day this failed. The routing didn't revert back when everything came back up, so the registration request was failing.

This is solved, it wasn't an issue with Ignition or the modules.

2 Likes