Fairly certain it doesn't matter if they're being displayed or not. If they are on the active view they're being processed. Not that 130 is a massive number of tags to be active. I haven't done any testing to verify this, but I believe that this is true even of things hidden behind a tab. Willing to be corrected on that though.
This is definitely not helping performance, at least not when the view is loading/refreshing. I know that @YF129701 says they have nesting up to 3 levels deep, but this has been a known performance hit for some time. Recommendation is to avoid nesting over 1 level. A few here and there will not hurt, but get many of them on a view and you'll take a hit.
Are there any other applications running on the Gateway?
Otherwise, here is a "generalized list" of things to look for when looking at performance in perspective: