Rethinking Web Scraping with AutoScrape

Web scraping is tedious. In this article, I explore patterns for building scrapers and introduce a new tool, AutoScrape.

Tue 02 April 2019 ~ Brandon Roberts

This article was released in the first issue of Artificial Informer.

Following my research paper about AutoScrape, I wrote this article that explores the pitfalls of current web scraping technologies and some new methods that can be used to improve reliability of scrapers. Unlike the research paper, this article is targeted at less technologically sophisticated people who may be frustrated with their current web scrapers or are looking to reduce the amount of time they spend maintaining them.

You can find it here: