The embedded web browser frame doesn’t use Java’s keystore - it uses the OSes. Since you’re using a self-signed certificate, you have to trust your certificate in the operating system’s trust store, at which point the embedded browser engine will recognize it.
This is an issue we’re aware of and plan to fix, but that’s the workaround for now.