A quick answer to my own question, adding
-Dawt.useSystemAAFontSettings=on
To the JVM args fixed the issue.