Whats needed for rocksdb is the rocksdbjni jar. To fix the the issue .. Did the below

RUN /opt/infinispan/bin/cli.sh install org.rocksdb:rocksdbjni:9.0.1

RUN cp /opt/infinispan/server/lib/rocksdbjni-9.0.1.jar /opt/infinispan/lib/

Note : I did try the below with no help , so had to manually copy jars .. Not ideal solution, but does works as expected.

ENV SERVER_LIBS="org.rocksdb:rocksdbjni:9.0.1"