Usage

• First, select a crawler of your choice
• Second, (if the crawler doesn't already support cookie tracking, otherwise skip this item) get a valid cookie after requesting http://www.webguvenligi.org/wivet/index.php. Introduce the cookie and URL (http://www.webguvenligi.org/wivet/index.php) in the target crawler
• Make sure that the crawler won't logout itself by following the logout link (100.php).
• Lastly run the crawler. During the crawling check out the current run progress at http://www.webguvenligi.org/wivet/offscanpages/current.php and when the crawling done, you can check out the general statistics page at http://www.webguvenligi.org/wivet/offscanpages/statistics.php