You can remove your resource from StackA and deploy it using:

cdk deploy -e StackA

Once done, you can update StackB.

-e:

--exclusively, -e BOOLEAN Only deploy requested stacks and don't include dependencies.