I suggest using a third-party module like Reown for wallet connectivity.
As you may know, the Solana Wallet Adapter has migrated to the Reown module. In my experience, using Reown eliminates issues with wallet connection, signing messages, and processing transactions.
For reference, here is the official documentation: Reown AppKit Overview