Issue 114: Webharvester: user-defined domains doesn't restricted to defined subdomain or folder structure
Status:  Fixed
Owner:
Closed:  Nov 2010
Project Member Reported by blake.ol...@gmail.com, Nov 15, 2010
I tired the web harvester but it ended up frustrating me.

The results I want are specific and it tries to pick everything up under the sun. 

Say I want the contents of links on this page:


http://news.yahoo.com/science/animals-and-pets

Well, when you use the "user-defined Domain(s)" I enter these wildcard
addresses:

http://news.yahoo.com/s/ap/
http://news.yahoo.com/s/afp/

The fully qualified web address is:

http://news.yahoo.com/s/ap/20101031/ap_on_re_as/as_australia_shark_attack
http://news.yahoo.com/s/afp/20101103/ts_alt_afp/usanimalspandachina

However, it overrides me and just makes it "yahoo.com" which gives me a
zillion things.


Nov 15, 2010
Project Member #1 blake.ol...@gmail.com
Fixed an backported to 2009.
Status: Fixed