I had to expose my home directory to the container in the configg file

apptainer {  
runOptions = "-B ${HOME}"  
}