# Gateway network queues (lots of them)

**URL:** <https://forum.inductiveautomation.com/t/gateway-network-queues-lots-of-them/54673>\
**Category:** Ignition\
**Created:** [January 5, 2022, 12:45pm UTC](https://forum.inductiveautomation.com/t/gateway-network-queues-lots-of-them/54673 "2022-01-05T12:45:01Z")\
**Posts on this page:** 13\
**Page:** 1

<div class="post-metadata">

**Author:** ![pascal.fragnoud](https://sea1.discourse-cdn.com/inductiveautomation/user_avatar/forum.inductiveautomation.com/pascal.fragnoud/32/24728_2.png) [@pascal.fragnoud](https://forum.inductiveautomation.com/u/pascal.fragnoud)\
**Post date:** [January 5, 2022, 12:45pm UTC](https://forum.inductiveautomation.com/t/gateway-network-queues-lots-of-them/54673/1 "2022-01-05T12:45:01Z")

</div>

Hello folks,

I just opened the ‘Queue Management’ tab on the ‘Gateway Network’ page, and immediately started scratching my head. Here’s why:

 ![image](https://us1.discourse-cdn.com/inductiveautomation/original/3X/0/5/059e9da47a0cee39d829db00c60a364b9aad896e.png)

1938 queues ! And they’re all there, it’s not just a name !  
I checked 4 projects that are configured in the same way: a remote tag provider on a field gateway, and a front on a server somewhere. For all of them, the same thing: no extra queues on the front gateway, and a varying amount (from 194 to 1938) on the field gateway.

Can someone tell me what’s going on ? Where are they coming from, how can I find what’s generating them ?

---

<div class="post-metadata">

**Author:** ![pascal.fragnoud](https://sea1.discourse-cdn.com/inductiveautomation/user_avatar/forum.inductiveautomation.com/pascal.fragnoud/32/24728_2.png) [@pascal.fragnoud](https://forum.inductiveautomation.com/u/pascal.fragnoud)\
**Post date:** [January 5, 2022, 12:57pm UTC](https://forum.inductiveautomation.com/t/gateway-network-queues-lots-of-them/54673/2 "2022-01-05T12:57:09Z")

</div>

In the 10 minutes since I posted this, one new queue was added to at least 2 out of 4 projects.

I now have 1939 queues instead of 1938 for the biggest offender.

---

<div class="post-metadata">

**Author:** ![kcollins](https://sea1.discourse-cdn.com/inductiveautomation/user_avatar/forum.inductiveautomation.com/kcollins/32/19646_2.png) [@kcollins](https://forum.inductiveautomation.com/u/kcollins)\
**Post date:** [January 5, 2022, 2:34pm UTC](https://forum.inductiveautomation.com/t/gateway-network-queues-lots-of-them/54673/3 "2022-01-05T14:34:18Z")

</div>

Just to try and help narrow the scope a little, do you have any third-party modules installed? Also, what version?

---

<div class="post-metadata">

**Author:** ![pascal.fragnoud](https://sea1.discourse-cdn.com/inductiveautomation/user_avatar/forum.inductiveautomation.com/pascal.fragnoud/32/24728_2.png) [@pascal.fragnoud](https://forum.inductiveautomation.com/u/pascal.fragnoud)\
**Post date:** [January 5, 2022, 2:43pm UTC](https://forum.inductiveautomation.com/t/gateway-network-queues-lots-of-them/54673/4 "2022-01-05T14:43:24Z")

</div>

Hello Kevin,  
On the field gateways: 8.1.3 and 8.1.4  
On the front gateway (no queue multiplication there): 8.10

modules:

 ![image](https://us1.discourse-cdn.com/inductiveautomation/original/3X/b/c/bcb9301e765e563a5d4b3fd2ce70dad88066a80b.png)

---

<div class="post-metadata">

**Author:** ![kcollins](https://sea1.discourse-cdn.com/inductiveautomation/user_avatar/forum.inductiveautomation.com/kcollins/32/19646_2.png) [@kcollins](https://forum.inductiveautomation.com/u/kcollins)\
**Post date:** [January 5, 2022, 3:28pm UTC](https://forum.inductiveautomation.com/t/gateway-network-queues-lots-of-them/54673/5 "2022-01-05T15:28:09Z")

</div>

From what I can see in the code, every queue creation is correctly accompanied by a name, which results in the other “normal-looking” queues you typically see. The `_queue_<incrementing id>` is a fallback name when no name property is supplied on a creation request. You might try turning on DEBUG against `metro.queues.queue` logger to see if you can get some insight on what types of messages are being put into those.

---

<div class="post-metadata">

**Author:** ![pascal.fragnoud](https://sea1.discourse-cdn.com/inductiveautomation/user_avatar/forum.inductiveautomation.com/pascal.fragnoud/32/24728_2.png) [@pascal.fragnoud](https://forum.inductiveautomation.com/u/pascal.fragnoud)\
**Post date:** [January 5, 2022, 3:36pm UTC](https://forum.inductiveautomation.com/t/gateway-network-queues-lots-of-them/54673/6 "2022-01-05T15:36:00Z")

</div>

Thanks,

I can’t tell if there’s anything interesting in the logs…  
They look like this:

 ![image](https://us1.discourse-cdn.com/inductiveautomation/original/3X/b/d/bd4feadd8e8f028b3281dd2b1ee1e508cafac989.png)

edit: I thought this might be interesting:  
In the Outgoing Queues:

 ![image](https://us1.discourse-cdn.com/inductiveautomation/original/3X/3/6/36f44b4d8fb250f2dc8872fe78773b8cf8eb1be1.png)

In the Outgoing Task Statistics:

 ![image](https://us1.discourse-cdn.com/inductiveautomation/original/3X/1/b/1be9d6ea0a984e351a6427877a64800a4772fa79.png)

---

<div class="post-metadata">

**Author:** ![kcollins](https://sea1.discourse-cdn.com/inductiveautomation/user_avatar/forum.inductiveautomation.com/kcollins/32/19646_2.png) [@kcollins](https://forum.inductiveautomation.com/u/kcollins)\
**Post date:** [January 5, 2022, 4:40pm UTC](https://forum.inductiveautomation.com/t/gateway-network-queues-lots-of-them/54673/7 "2022-01-05T16:40:56Z")

</div>

It looks like these queues are being created to facilitate remote alarm provider subscriptions. I was able to recreate this scenario locally between a 8.1.3 and 8.1.10 pair of gateways (with remote tag provider configured on 8.1.10 side against 8.1.3 source provider and _Subscribed_ mode for alarming).

 ![2022-01-05 at 10.32 AM](https://us1.discourse-cdn.com/inductiveautomation/original/3X/2/a/2a40112dd56b25b58959e98a71743dd5d0798bbb.png)

Tracing this down further, it looks like this behavior was addressed in 8.1.10. Confirmed by upgrading my test bench:

 ![2022-01-05 at 10.38 AM](https://us1.discourse-cdn.com/inductiveautomation/original/3X/6/4/644d19211afee86aec34071033a4428e991d3e12.png)

It looks like as of 8.1.10+, all _Alarm Event Publishing_ is done through this named queue now.

---

<div class="post-metadata">

**Author:** ![pascal.fragnoud](https://sea1.discourse-cdn.com/inductiveautomation/user_avatar/forum.inductiveautomation.com/pascal.fragnoud/32/24728_2.png) [@pascal.fragnoud](https://forum.inductiveautomation.com/u/pascal.fragnoud)\
**Post date:** [January 5, 2022, 4:54pm UTC](https://forum.inductiveautomation.com/t/gateway-network-queues-lots-of-them/54673/8 "2022-01-05T16:54:21Z")

</div>

Alright, thanks a lot !  
Do you think this has any impact on anything besides the gigantic listing of queues on the Queue Management tab ?

I guess it’s time to upgrade the field gateways…

---

<div class="post-metadata">

**Author:** ![kcollins](https://sea1.discourse-cdn.com/inductiveautomation/user_avatar/forum.inductiveautomation.com/kcollins/32/19646_2.png) [@kcollins](https://forum.inductiveautomation.com/u/kcollins)\
**Post date:** [January 5, 2022, 5:16pm UTC](https://forum.inductiveautomation.com/t/gateway-network-queues-lots-of-them/54673/9 "2022-01-05T17:16:49Z")

</div>

Are any of these other queues processing messages? (i.e. is their total count increasing). I imagine that something is just not deregistering/destroying those old queues when the subscription is recreated–not sure at the moment why that is happening. There might be some memory impact for those lingering queues. There look to be some good performance improvements in the way the queue is now implemented that should help for really busy alarming scenarios.

---

<div class="post-metadata">

**Author:** ![pascal.fragnoud](https://sea1.discourse-cdn.com/inductiveautomation/user_avatar/forum.inductiveautomation.com/pascal.fragnoud/32/24728_2.png) [@pascal.fragnoud](https://forum.inductiveautomation.com/u/pascal.fragnoud)\
**Post date:** [January 6, 2022, 9:21am UTC](https://forum.inductiveautomation.com/t/gateway-network-queues-lots-of-them/54673/10 "2022-01-06T09:21:31Z")

</div>

The one in the outgoing task statistics appears to be processing things:

 ![image](https://us1.discourse-cdn.com/inductiveautomation/original/3X/9/d/9dd799a945f0181a0ef6270d255a8d6e268d6183.png)

It’s _queue\_1_, its total did increase (getting close to 1,000,000 !), and I have no idea what it does. Given its name, it might have something to do with alarm updates, though I don’t recognize this particular name.

Only _queue\_1_ appears in the outgoing task statistics, but only the last one (_queue\_1941_ as of now) appears in the outgoing queues. The total for _queue\_1941_ may or may not be still increasing, I’ll have to check back later.  
The total number of queues on the queue management page keeps increasing: it’s up to 1941, 4 more than when I first posted this thread.

Not-entirely-unrelated note: Sorting by total completely fails. It sorts alpha-numerically, which doesn’t help.

---

<div class="post-metadata">

**Author:** ![pascal.fragnoud](https://sea1.discourse-cdn.com/inductiveautomation/user_avatar/forum.inductiveautomation.com/pascal.fragnoud/32/24728_2.png) [@pascal.fragnoud](https://forum.inductiveautomation.com/u/pascal.fragnoud)\
**Post date:** [January 6, 2022, 11:08am UTC](https://forum.inductiveautomation.com/t/gateway-network-queues-lots-of-them/54673/11 "2022-01-06T11:08:18Z")

</div>

I’ve been monitoring things a bit more closely, and I believe the _queue\_1_ entry in the outgoing statistic tasks gets incremented by 1 when a new queue is created (and/or used, maybe).  
I had a new _queue\_1942_ in the queues list, and noticed _queue\_1_’s total had been incremented by 1, and I witnessed the same thing right now when _queue\_1943_ appeared.

Both 1942 and 1943 totals were 1.

I’m note sure what information is relevant, so I’m adding everything I see.

---

<div class="post-metadata">

**Author:** ![kcollins](https://sea1.discourse-cdn.com/inductiveautomation/user_avatar/forum.inductiveautomation.com/kcollins/32/19646_2.png) [@kcollins](https://forum.inductiveautomation.com/u/kcollins)\
**Post date:** [January 6, 2022, 3:36pm UTC](https://forum.inductiveautomation.com/t/gateway-network-queues-lots-of-them/54673/12 "2022-01-06T15:36:33Z")

</div>

You will see messages in those queues to communicate changes in alarm states to the remote tag providers (the queue is for sending those updates). If those subscriptions are being recreated (perhaps due to bad network quality, etc), the queues should be destroyed and recreated (with an incremented index number). Additionally, you might have individual outgoing queues (at the field gateway) for each subscriber (i.e. remote tag provider reaching into this gateway).

---

<div class="post-metadata">

**Author:** ![pascal.fragnoud](https://sea1.discourse-cdn.com/inductiveautomation/user_avatar/forum.inductiveautomation.com/pascal.fragnoud/32/24728_2.png) [@pascal.fragnoud](https://forum.inductiveautomation.com/u/pascal.fragnoud)\
**Post date:** [January 6, 2022, 4:10pm UTC](https://forum.inductiveautomation.com/t/gateway-network-queues-lots-of-them/54673/13 "2022-01-06T16:10:31Z")

</div>

> [@kcollins](#):
>
> If those subscriptions are being recreated (perhaps due to bad network quality, etc), the queues should be destroyed and recreated (with an incremented index number)

Why would \_queue\_1\_ keep being incremented then ?  
It's now up to \_queue\_1948\_, so that's 6 more queues, and \_queue\_1\_'s total has been incremented by 6. I guess what I'm trying to figure out what's going on there.  
It's not just out of curiosity, I actually encountered this queue issue while investigating something else (suspiciously high traffic on the field gateways).

> [@kcollins](#):
>
> Additionally, you might have individual outgoing queues (at the field gateway) for each subscriber (i.e. remote tag provider reaching into this gateway)

There should be only one.

Thanks again for your help !
