Sure, it's possible. The connection wouldn't disappear though, just stop working.
Each JDBC driver's documentation usually has some kind of supported version Matrix, and it's possible that you could be connected to a really old DB version with a really old JDBC driver and that JDBC driver stops working if your DB gets upgraded to something too new.