I was running into this today. Select statement by itself took 6 seconds to return 10 rows. As part of an insert into an empty table it took 40 plus seconds. Ended up putting a WITH(NOLOCK) hint on the select statement and that got me right back to 6 seconds.