# Querying Apache Parquet Data Files (AWS)

**URL:** <https://forum.inductiveautomation.com/t/querying-apache-parquet-data-files-aws/46125>\
**Category:** Ignition\
**Created:** [April 28, 2021, 3:19pm UTC](https://forum.inductiveautomation.com/t/querying-apache-parquet-data-files-aws/46125 "2021-04-28T15:19:28Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![Justin.Finley](https://avatars.discourse-cdn.com/v4/letter/j/58956e/32.png) [@Justin.Finley](https://forum.inductiveautomation.com/u/Justin.Finley)\
**Post date:** [April 28, 2021, 3:19pm UTC](https://forum.inductiveautomation.com/t/querying-apache-parquet-data-files-aws/46125/1 "2021-04-28T15:19:28Z")

</div>

Did a quick search and didn’t see anything pop up, so wanted to see if anyone else has tried or been able to query parquet formatted data in Ignition. I am looking at querying historical measurement data that has been converted from AWS Sitewise to S3 as a set of .parquet files.

I am able to pull the file down to my PC via Ignition http request, and can manually run an SQL query via Apache Drill. But have not figured out if I can query within Ignition, or if I would need to convert to CSV or another format.

Appreciate any suggestions, thanks.  
Justin

---

<div class="post-metadata">

**Author:** ![Justin.Finley](https://avatars.discourse-cdn.com/v4/letter/j/58956e/32.png) [@Justin.Finley](https://forum.inductiveautomation.com/u/Justin.Finley)\
**Post date:** [April 28, 2021, 5:35pm UTC](https://forum.inductiveautomation.com/t/querying-apache-parquet-data-files-aws/46125/2 "2021-04-28T17:35:43Z")

</div>

I should add that I have also had some level of success reading the file directly in a Python script, after installing Apache Spark. So I’m also trying to see how doable it would be to import Spark and its dependencies to Ignition - open to feedback if there may be a more efficient way to do it.  
Thanks

---

<div class="post-metadata">

**Author:** ![paul-griffith](https://sea1.discourse-cdn.com/inductiveautomation/user_avatar/forum.inductiveautomation.com/paul-griffith/32/37249_2.png) [@paul-griffith](https://forum.inductiveautomation.com/u/paul-griffith)\
**Post date:** [April 28, 2021, 5:42pm UTC](https://forum.inductiveautomation.com/t/querying-apache-parquet-data-files-aws/46125/3 "2021-04-28T17:42:34Z")

</div>

You will probably have the best results, and certainly the best performance, by implementing a custom module that loads the first-party Java library for Parquet. You _might_ be able to get by with the hacky workaround mentioned on the forums (dropping a built third party .jar in the right filesystem location so the gateway automatically recognizes it) but a module would be recommended.

---

<div class="post-metadata">

**Author:** ![Justin.Finley](https://avatars.discourse-cdn.com/v4/letter/j/58956e/32.png) [@Justin.Finley](https://forum.inductiveautomation.com/u/Justin.Finley)\
**Post date:** [April 28, 2021, 5:55pm UTC](https://forum.inductiveautomation.com/t/querying-apache-parquet-data-files-aws/46125/4 "2021-04-28T17:55:23Z")

</div>

Gotcha, thanks, I’ll check that out.
