I have the exact same issue but my greek letters should go into the xlabel.
I've already tried set xlabel "{/Symbol a}/{\U+00B0}" enhanced font ",12" and it didn't work. More precisely the alpha looks weird and just like the latin "a" (and gamma also looks as in the example above).

My minimal example would be:

set encoding utf8
set xlabel "{/Symbol a}"
plot 1