php-crawler supplies a good, fast way to crawl any website into structured data.