Just get rid of passwords and use SSH Keys to connect to your target systems. Even the manpage of sshpass says under "Security Considerations":

"[...] users of sshpass should consider whether ssh's public key authentication provides the same end-user experience, while involving less hassle and being more secure."