Is there a way to automate creating a user source on a gateway? I can automate adding users and roles via the system.security and it will even let me specify the user source, but I don't see a method to create a user source.
No, not currently (in any supported way).
It'll be possible in 8.3, though.