If you are using a single process, you can store the connection and reuse it (you may want to have a look at sshkit connection pooling)
If you want to reuse the same connection in several ruby processes, I guess there is no easy solution since ControlMaster is not supported : https://net-ssh.github.io/net-ssh/classes/Net/SSH/Config.html.