If you are in Expo project you don't need to add:

plugins: [
      ...
      'react-native-worklets/plugin',
    ],

to you app.json file, expo will do the job automatically. So just remove it and it should start working.

(It's just very confusing in the react-native-reanimated docs)