You can't get this from Azure. You have to purchase a FIPS validated SSL and upload it to your keyvault in Azure. App Gateway V2 and KeyVault use are required. The references I found are vague answers. Microsoft has FIPS validated modules for their services and resources, but you have to bring your own when you establish your network in their system.