Sorry, I really don’t have any suggestions.
In my experience so far using UDP protocols over VPN hasn’t been very reliable. My setup is a little different though, where I’m binding to the virtual adapter / IP assigned to my VPN connection, and when the connection goes down the adapter is destroyed.
Maybe your VPN connection is going down and up though, and this when the problem starts?