According to ?withVisible (which informs about visibility), it is used by source and indeed, I have not found a way to circumvent that.
I would therefore suggest to wrap source in an anonymous function, keeping only its value:
lapply(list_of_scripts,
function(file) { source(file)$value } )