AWS recently announced multisession support which allows you to access multiple AWS accounts in single browser. As of now it only support 5 simultaneous session which can be any combination of root, IAM, or federated roles in different accounts or in the same account.

For more details:

https://docs.aws.amazon.com/awsconsolehelpdocs/latest/gsg/multisession.html