My problem was in not using source for my LineupSerializer. After adding this the problem got solved and the serialised had access to all objects, including foreign keys in my models:
class LineupSerializer(serializers.ModelSerializer):
players = LineupPlayerSerializer(source='lineup',many=True)