You'll need to install Rtools before updating htmltools.
WARNING: Rtools is required to build R packages but is not currently installed. Please download and install the appropriate version of Rtools before proceeding: https://cran.rstudio.com/bin/windows/Rtools/
After installing Rtools, you can search for the htmltools package to update or navigate to Navigate Tools -> Check For package updates.