My favorites | Sign in
Project Logo
                
Search
for
Updated Jan 18, 2008 by thejaswi...@gmail.com
Labels: Phase-Requirements, Featured
ToDo  
Things left to be done.

ToDo

  • Canonicalize IP Numbers and include for lookups.
  • Any other sane request from users :)

Comment by yolabingo, Nov 20, 2009

Thanks for sharing this helpful code. I use it daily to check about 10000 urls. On pretty new hardware, this script would take about 10 minutes to execute. I made some ugly hacks to copy the url_hashes_table to an in-memory sqlite DB before querying, and running time is down to about 15 seconds. I'd be happy to share the changes I've made - let me know.

Comment by thejaswi...@gmail.com, Nov 22, 2009

@yolabingo: Yes, I would love to hear from you on the changes. I actually use postgres and it returns results within 3 seconds.

There is already a patch that uses a key-value store(memcached), which gives blazing fast results.

I would like to actually love to benchmark both and decide for myself.

Comment by yolabingo, Nov 23, 2009

Here's a tarball of the code I'm using. README file has some notes. Hope it's useful for you.

http://www.lincolnlattonsoftware.com/safebrowsing.tar.gz


Sign in to add a comment
Hosted by Google Code