I had the same issue until I realised I had not run the qemu system command before jumping to gdb. Make sure qemu is running...