Habitening Logo A cup of water.

.NET package IronWebScraper

Iron WebScraper is a C# web scraping library, allowing developers to simulate & automate human browsing behavior to extract content, files & images from web applications as native .Net objects. Iron Web Scraper manages politeness & multithreading in the background, leaving a developer’s own application easy to understand & maintain. Iron Web Scraper can be used to migrate content from existing websites as well as build search indexes and monitor website structure & content changes. It's functionality includes: » Read & extract structured content from web pages using html DOM, Javascript, Xpath, jQuery Style CSS Selectors. » Fast multi threading allows hundreds of simultaneous requests. » Politely avoid over stalling remote servers using IP/domain level throttling & optionally respecting robots.txt » Manage multiple identities, DNS, proxies, user agents, request methods, custom headers, cookies & logins. » Data exported from websites becomes native C# objects which can be stored or used immediately. » Exceptions managed in all but the developers own code. Errors and captchas auto re


Count 3 occurrences
State Alive
Last occurred
Habitening next
Trend None
In degree 0
Out degree 0
External links

Probability of Occurrence

Breakdown by day of the week

Breakdown by day of the month

Breakdown by month

lightbulb_outline Didn't find what you were looking for? Create your own!