You need to remove the border before exporting the chart. In your With
block, include this line:
.Chart.ChartArea.Format.Line.Visible = msoFalse
As a side note, if you plan to ask more questions on StackOverflow in the future, I strongly recommend learning about Minimal Reproducible Examples: