I can force the composer to use my current PHP version set by phpbrew by using an alias. For example in my config.fish:
composer
phpbrew
alias composer="php $(which composer)"