Issue 54: Webharvester seems to download/crawl duplicate pages
Status:  Fixed
Owner:
Closed:  Mar 2010
Project Member Reported by blake.ol...@gmail.com, Mar 2, 2010
Webharvester seems to download/crawl duplicate pages.  It happens if the
prefix of the same URL differs slightly, like "www." vs. "http://wwww. vs.
no prefix at all.

Mar 2, 2010
Project Member #1 blake.ol...@gmail.com
Improved URL comparison function.
Status: Fixed