The most likely situation here is that you were failing the DBT alignment rules, which for arm systems need to be loaded at a 8-byte boundary (https://www.kernel.org/doc/Documentation/arm64/booting.txt).

Setting UBOOT_DTB_LOADADDRESS = "0x83000000" like you did will guarantee that.