It might the default padding of ListView. You could try

ListView.builder(
  padding: EdgeInsets.zero,
  itemBuilder: (BuildContext context, int index) {
    return Text("answers[$index]");
  }),
)