As @markalex already said you must match whole value of the label, but beware, if you want to match a special symbol which must be escaped - you must use two backslashes, not one. For example, to filter out all index names that begin with a dot, you must use the following regexp:

label_values(elk_indices_some_metric{indice_name!~"^\\..*"},indice_name)