ScraperWiki: brief description

ScraperWiki: brief description
Svetlana Komarova

Svetlana Komarova

The author. System Administrator, Oracle DBA. Information technology, internet, telecom. More details.

ScraperWiki is a hosted environment for writing automated processes to scan public websites and extract structured information from the pages they’ve published. It handles all of the boilerplate code that you normally have to write to handle crawling websites, gives you a simple online editor for your Ruby, Python, or PHP scripts, and automatically runs your crawler as a background process.

What I really like, though, is the way that most of the scripts are published on the site, so new users have a lot of existing examples to start with, and as websites change their structures, popular older scrapers can be updated by the community.

Вас заинтересует / Intresting for you:

WordPress: using JavaScript Fr...
WordPress: using JavaScript Fr... 63 views dbstalker Wed, 19 Jan 2022, 19:02:15
WordPress: Custom Post Types, ...
WordPress: Custom Post Types, ... 89 views dbstalker Mon, 17 Jan 2022, 18:02:30
WSDL Basics and Why it Learnin...
WSDL Basics and Why it Learnin... 1118 views sepia Tue, 11 Sep 2018, 08:15:26
WordPress Development and Host...
WordPress Development and Host... 66 views dbstalker Mon, 17 Jan 2022, 07:08:49