Deploy your Scrapy spiders from GitHub
Up until now, your deployment process using Scrapy Cloud has probably been something like this: code and test your spiders locally, commit and push your changes to a GitHub repository, and finally dep...
Looking back at 2016
We started 2016 with an eye on blowing 2015 out of the water. Mission accomplished....
An introduction to XPath: How to get started
Let's start with what is XPath? XPath is a powerful language that is often used for scraping the web. It allows you to select nodes or compute values from an XML or HTML document and is actually one o...
Interview: How Up Hail uses Scrapy to increase transparency
During the 2016 Collision Conference held in New Orleans, Zyte Content Strategist Cecilia Haynes had the opportunity to interview the brains and the brawn behind Up Hail, the rideshare comparison app....
