When we use Azure DevOps server 2019, we can directly see the folder icon in the Build tab.
For example:
In Azure DevOps Server 2022, the Pipeline Folder view has been moved to the Pipelines -> All tab.
You can check if you can see the Pipeline folder view in the Pipelines -> All tab.