Hey Folks,
Curious to know what people have found to be the most straightforward way of setting up long term data storage.
Essentially i'm looking to store high(ish) resolution data (1 second) on the Ignition Server for a few months, long term however i would like to record on 10 minute aggregate data of those same tags (min/max/avg) onto an SQL historian perpetually.
Anyone else got a similar setup and which route did you find yourself going down?
I'd look at setting up a true time-series database with something like Timescale with Postgres. @michael.flagler wrote up a great guide here: Historian using TimescaleDB w/ Postgres - #2 by michael.flagler
Second for TimescaleDB with PostgreSQL. It uses columnar compression to reduce your storage size by 80-95%, which is going to be a big help with a long time range of 1s resolution data. Also, TimescaleDB maintains continuous aggregates which can be used to perfectly suit your needs. The only real downside is that it doesn't play nicely with Ignition historians out of the box (due to conflicting partitioning rules), but the available setup guides should help to resolve that.