OK, As is mentioned in GDAL page there are few ways to install GDAL inside an isolated package manager environment.

For those who want to import gdal from inside python probably these two solutions are interesting :

• conda

• pixi (also relying on conda in a minimalistic way)

  I tried the pixi solution as is explained here and it works fast and clean.