It is actually caused by LocalMinimumInteractiveComponentSize as mentioned by @tyg. This is fixed Using CompositionLocalProvider.
CompositionLocalProvider(LocalMinimumInteractiveComponentSize provides Dp.Unspecified) {
Row {
OutlinedButton(onClick = {}) {
Text("Button")
}
}
}