Beacause the '\t' is in qoutes you do not need to escape the backslash....
select replace('\tTest','\t','') from dual;
Returns Test as you require