Our company is looking at possibly integrating Google’s BigQuery database into our processes. We already use their Firestore/Firebase offering (which was painful to integrate due to the access token security) and we have a number of MySQL cloud databases. Just wondering if anyone here has tried integrating BigQuery with Ignition? They do have a JDBC driver but I’ve read that it has some differences that could be problematic. I’ll be digging into it and doing some testing but was hoping others may have already tried.
1 Like
I have this type of system design as well, but the Cloud Function meant to detect the pub/sub message is not handling the Schema of the JSON payload well… I am requesting a walk through like the one they have fore AZURE to explain in more detail the setup needed for the table entries so they map correctly.
1 Like
I wish I had some additional insight to offer but we ended up using Elastic instead of BigQuery and it was fairly straight forward to get data into Ignition via Elastic’s REST API. If you end up with any additional learnings, please post back here as I would be very interested!
btw - welcome to the community!
Did you get Big Query working? I didn't see any connectors?
We have it working.
Download JDBC driver from google: ODBC and JDBC drivers for BigQuery | Google Cloud
To avoid adding every individual file in the next step, from the downloaded file, copy all JAR file to %Ignition%/user-lib/jdbc
In Database -> Drivers, add a new driver
You can then create a new connection using this driver using a connection string like: jdbc:bigquery://https://www.googleapis.com/bigquery/v2:443;ProjectId=your-project-name;OAuthType=0;OAuthServiceAcctEmail=service-account-name@project-full-name.something.com;OAuthPvtKeyPath=/full/path/connection-credential-from-google.json;
No need to specify username or password.
For further information, in the link above, in JDBC, Installation and configuration guide, look at the section "Using a Google Service Account"
2 Likes
Thanks!