Diggernaut

Diggernaut runs web scrapers in the cloud or on a user's own PC, collecting content from websites and returning it as tidy, structured data. It describes itself as a service for scraping, data extraction and wider ETL work. A typical user is a reseller whose supplier will not hand over product data in a usable file, leaving it to be copied by hand from the supplier's site.

What Diggernaut does

• Diggers: small configured scraping robots that pull data from a target site, normalise it and store the results in the cloud.
• Data delivery: output downloadable as CSV, XLS or JSON, or fetched through a REST API.
• Visual Extractor: a point-and-click tool for building a digger's configuration with no coding, supported by video lessons on a sandbox site.
• Meta-language: a configuration language for developers tackling harder extraction jobs, with documentation and blog walkthroughs.
• Custom-built scrapers: a Diggernaut developer can build the digger so the customer simply receives the data.

Clients

Its listed uses include retailer prices, reviews and ratings, event listings, news headlines, statistics, police and fire department reports, court documents, municipal licences and permits, forum and social media comments, and property records.

Key facts

• Based in: United States
• Integrations: Zapier, Tableau and 2captcha