As mentioned in the comment, the test works when using the Activity context and checking the orientation.

    val orientation = activity.resources.configuration.orientation