Browser security wont let you add unsecure content to a secure website.
Had the same problem with Guacamole VNC recently.
Like Kevin says, reverse proxy like Nginx is the way to solve this. Or upgrade your http site to https.
You can also open the website in a new tab with a button.