It seems like you're looking for einsum.

Should be something like:

result = torch.einsum('bi,bijk,bk->bj', x, second_order_derivative, x)