The problem was with me declaring the cassandra version in properties as:
cassandra-driver.version
I went through the spring-boot parent pom, it also declares the java-driver-bom:pom with the same properties and it was causing a conflict.
Hence I changed it to cassandra.version and it started working.