If someone gets there using Solr 9.8+ A new feature disables <lib> by default so our solrConfig.xml cannot load libraries. You must run Solr with the SOLR_CONFIG_LIB_ENABLED=true environment var to bypass this.
<lib>
SOLR_CONFIG_LIB_ENABLED=true