My favorites | Sign in
Project Home Downloads Wiki Issues Source
READ-ONLY: This project has been archived. For more information see this post.
Search
for
  Advanced search   Search tips   Subscriptions
Issue 114: Webharvester: user-defined domains doesn't restricted to defined subdomain or folder structure
1 person starred this issue and may be notified of changes. Back to list
Status:  Fixed
Owner:  blake.ol...@gmail.com
Closed:  Nov 2010


 
Project Member Reported by blake.ol...@gmail.com, Nov 15, 2010
I tired the web harvester but it ended up frustrating me.

The results I want are specific and it tries to pick everything up under the sun. 

Say I want the contents of links on this page:


http://news.yahoo.com/science/animals-and-pets

Well, when you use the "user-defined Domain(s)" I enter these wildcard
addresses:

http://news.yahoo.com/s/ap/
http://news.yahoo.com/s/afp/

The fully qualified web address is:

http://news.yahoo.com/s/ap/20101031/ap_on_re_as/as_australia_shark_attack
http://news.yahoo.com/s/afp/20101103/ts_alt_afp/usanimalspandachina

However, it overrides me and just makes it "yahoo.com" which gives me a
zillion things.


Nov 15, 2010
Project Member #1 blake.ol...@gmail.com
Fixed an backported to 2009.
Status: Fixed

Powered by Google Project Hosting