By default, screen readers will announce the <svg> content if it is accessible. So yeah, you should hide it using aria-hidden :)
<svg>
aria-hidden
<svg width="1em" class="inline" aria-hidden="true"><use href="#start-icon"></use></svg>