Craigslist has aggressive blocking for excessive GET requests. The RSS feed contains only the first 250 characters of text description of the ad. Thus, you will see that something got added but you will not see its details. More importantly, attributes are not available as part of the RSS feed.
That means that you were interested in specific colors of a car, you would need to define a separate RSS feed for red, yellow, and so on.
It is hard to test whether the RSS search results are additionally throttled, but you will likely get blocked while testing. :)
While legitimately shopping, I got blocked multiple times for becoming more efficient.
If you look at the XML returned for RSS feeds, you will notice:
<syn:updateBase>2014-07-16T14:25:18-07:00</syn:updateBase> <syn:updateFrequency>1</syn:updateFrequency> <syn:updatePeriod>hourly</syn:updatePeriod>
That is the configuration setting for RSS readers to not update more than once per hour.
See spec: http://web.resource.org/rss/1.0/modules/syndication/
Craigslist has aggressive blocking for excessive GET requests. The RSS feed contains only the first 250 characters of text description of the ad. Thus, you will see that something got added but you will not see its details. More importantly, attributes are not available as part of the RSS feed.
That means that you were interested in specific colors of a car, you would need to define a separate RSS feed for red, yellow, and so on.
It is hard to test whether the RSS search results are additionally throttled, but you will likely get blocked while testing. :)
While legitimately shopping, I got blocked multiple times for becoming more efficient.
RSS is not hard to read. Here are some red manual transmission cars in San Francisco Bay Area http://sfbay.craigslist.org/search/cto?auto_paint=7&auto_tra...