If databricks is the only option available for this work, try using below configuration for SMB client: smbclient.ClientConfig(username='user', password= 'password', min_protocol="SMB3", socket_options="TCP_NODELAY IPTOS_LOWDELAY)
Also, sometimes the source url itself have problem with downlaoding speed. Try different download URLs to check the environment performance.