Take a look at hyx. It's a minimalistic, vim-inspired hex-editor. I just tried it and it was possible to insert/modify/delete without restrictions.

https://yx7.cc/code/