Just use
=INDEX(GOOGLEFINANCE("CURRENCY:AUDUSD", "price", DATE(2021,7,1)), 2,2)
In this function, changed QUERY(...) formula by INDEX(datatable,row,column) and removed unnecessary GOOGLEFINANCE() parameters.
QUERY(...)
INDEX(datatable,row,column)
GOOGLEFINANCE()
INDEX