I think you are referring to the the wrapper that adds the "Back to #{Build Number}", And Download Zip links at the top of the report.

There is no current way of having the link work without an iframe as it needs it for the navigation functionality.

There is an option: useWrapperFileDirectly "By default, each archived reports access generates a new wrapper file. If checked, the legacy wrapper file will be used instead of generate it each time. Must only be used if wrapper file was been transformed and saved with checksum" but I don't believe this actually removes it, however, it's worth setting this to false and seeing what happens.