It's likely that you have executed rake assets:precompile. This compiles assets and saves them in the public/assets folder.

As mentioned in comments, you should be able to remove these with bundle exec rake assets:clean, which will cause your tests to build them from source each time.