Greetings from the future. Thanks for this post, it helped me solve similar case. However, I'm getting error when I try to write a file in that volume:

root@nginx:/opt/platform-int/udm# echo test > test2

bash: echo: write error: Operation not permitted

Despite the error file actually gets created.

root@nginx:/opt/platform-int/udm# ls -la

total 0

drwxrwxrwx. 2 root root 2 Dec 12 19:03 .

drwxr-xr-x. 3 root root 17 Dec 12 19:03 ..

-rw-r--r--. 1 root root 0 Dec 12 18:06 test

-rw-r--r--. 1 root root 0 Dec 12 19:03 test2

My ceph subVolume and subVolumeGroup both have rwx permissions for all.My dest setup of PV and PVC is almost identical with yours. I don't see any errors in the seph provisioner or ceph nodeplugin. An ideas what's causing this error?