I had Rails.application.load_tasks at the top of my file, and didn't realize that it was also in spec/support/tasks.rb

Not sure why loading tasks again would cause my task to be called for each load within a spec, but removing the extra load fixed the issue for me.