First post to the forum. Hello everyone. Thanks in advance for any advice, and sorry if this is a noob question.
This pertains to optimizing efficiency for storage and review of a number of tags. Here is the situation:
Let’s say I have 1000 tags that I want to store the data at 1 or 10 minute (or longer) intervals so that they can be reviewed long term. For those same 1000 tags, I would also like to be able to have the operators view in a real-time trend (or maybe just a sparkline) with a resolution of 1 second. However, it would only need to be going back in time a short period of time. Some tags for 5 or 10 minutes, others for an hour at most.
So, what is the most efficient way to set this up?
Currently I have a transaction group at 1 second interval that deletes after x time, plus I set up a separate historical tag with a longer scan class. This seems to be working well so far.
I worry that the constant deleting of the transaction group history once the tags go beyond x time takes up unnecessary resources. Perhaps, an automatic periodic delete or something instead? Perhaps something completely different?
The other thought I had was just to go ahead and save the high resolution data, even though I don’t need it. However, it seems pointless to store many times the data to SQL long term and take up the space unnecessarily.
As my system grows, I wonder what is best and most efficient. I foresee there are many more items that would be like this. Suggestions?