I am using queryHistory() in my module to retrieve historical data, then preprocess the data in a specific way before using it elsewhere in the module. I have found that preprocessing after getting the query return is actually faster than formatting my query params to get the same result. However, by using the preprocessing step between the query and the usage of the data, I am hobbling the memory-saving abilities of the BasicStreamingDataset. Is there a way to peek at the underlying structure of queryHistory() to write my own stripped version? I have a feeling that there might be a way to combine my methodology and Inductive’s to make a faster data retrieval.
This is all in the name of reducing query time, as I am usually querying for 3-24 hours worth of historical data for 50-700 tags at a time, which can be quite intense. For instance, a query for 3 hours of data on 266 tags takes about 40 seconds to complete.