That is because the bare metal gdb is expecting to connect to a remote gdbstub which understands how to implement breakpoints. As you are running the program under linux you should be able to use the normal aarch64 GDB to debug this.