Scrapy Not Giving Any Output

I was following this link and i was able to run a basespider successfully. How ever when i tried using the same with a crawlspider, i was not getting any output. My spider is as fo

Solution 1:

It is not about your rules, the problem is in allowed_domains:

allowed_domains = ['msi-openhire.silkroad.com']

Also, note that your parse() function contains a serious problem. You are overwriting the titles. Replace:

fortitlesin titles:

with:

fortitlein titles:

And every item field definition should use title.

Also, note that HtmlXPathSelector and select() are deprecated, use Selector and xpath().