if you are building in unity there is direct plugin called oculus XR plugin. There you are able to directly rig the controllers to object and write specific script for controllers to to. There are youtube tutorials out ther guiding each step. Please be more detailed about the problem.