You should set env inside Build Job. For example:

- name: Build
    run: npm run build
    env: 
      MY_SECRET_1: ${{ secrets.MY_SECRET_1 }}
      MY_SECRET_2: ${{ secrets.MY_SECRET_2 }}
      MY_SECRET_3: ${{ secrets.MY_SECRET_3 }}