Elias Schoof provides the best answer. You will presumably have an AWS user and associated sso profile setup via IAM Identity Center.

Then from your terminal type;

export AWS_PROFILE=<my-profile-name> 

Afterwards, cdk commands work as expected. This profile will be used for duration of shell.