For Android version greater than 23 you can override the default stateListAnimator of the FAB:

android:stateListAnimator="@null" 
android:elevation="0dp"

From code:

view.stateListAnimator = null
view.elevation = 0f