If you are working with I think you have to add a scrapy.cfg file which hold this configuration: [settings] default = <name_of_your_scrapy project>.settings this works as an entry point where the process of crawling strats.