The most powerful capability of Feature Store in Vertex AI and any other cloud platform, is monitoring capability. It helps to detect anomalies and drifts and eventually build Continuous Training (CT) pipeline. These are all embedded and can be activated for any Feature Store, connect it to Vertex AI monitoring systems, activated drift-based triggers and much more.

As others mentioned, Online Serving is also another powerful capability (its not cheap though).