Something like
=OFFSET([Reference.xlsx]Sheet1!$B$1,COLUMN()-COLUMN($B$1),ROW()-ROW($B$1))
should work for you.