Like @Marridi said, 'node_labels[key]= None' is right, I use：

    api_core.read_node(node_name)

    node.metadata.labels[label_key] = None

    api_core.patch_node(node_name, node)

to remove the label successfully.