I'm coming back to answer my own question in case anyone finds this. The reason I cannot install Cassandra 4.1.8 on Amazon Linux 2 is because the RPM version that ships with AML2 is to old. If you want to install Cassandra 4.1.8 on Amazon Linux 2 you must use the manual binary install option.