My favorites | Sign in
Project Home Wiki Issues Source
READ-ONLY: This project has been archived. For more information see this post.
Search
for
Update  
Version Update Introductions
Update
Updated Oct 6, 2014 by Robby@Zeitfuchs.org

Update Introductions

Update from Version 0.02.10 to 0.05.2

Install Tor Anonymous Proxy

Linux install instructions can be found on the following pages:

ragpicker/config/crawler.conf

Add the following setting in the crawler.conf:

[clientConfig]
#Route Malware requests through the TOR SOCKS proxy
#https://www.torproject.org/docs/debian
tor_enabled = yes
tor_proxyadress = localhost
tor_proxyport = 9050

#browserHeaders
browser_accept_language = de-de, de, en;q=0.5, fr;q=0.2

#Internet Explorer 8.0 on Windows XP
browser_user_agent = Mozilla/5.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0; SLCC1; .NET CLR 3.0.4506.2152; .NET CLR 3.5.30729; .NET CLR 1.1.4322)

...

Configurable HTTP Accept-Language

Samples:

  • "de-de, de, en;q=0.5, fr;q=0.2"
  • "en-US,en;q=0.8"
  • "en-US"

Configurable HTTP User-Agent

Samples:

  • Internet Explorer 8.0 on Windows XP: "Mozilla/5.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0; SLCC1; .NET CLR 3.0.4506.2152; .NET CLR 3.5.30729; .NET CLR 1.1.4322)"
  • Internet Explorer 8.0 on Windows 7: "Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.1; WOW64; Trident/4.0; SLCC2; Media Center PC 6.0; InfoPath.2; MS-RTC LM 8)"
  • Firefox 12 on Windows XP: "Mozilla/5.0 (Windows NT 5.1; rv:12.0) Gecko/20120403211507 Firefox/12.0"

List of User Agent Strings: http://www.useragentstring.com/pages/useragentstring.php

Update from Version 0.2.6 to 0.02.10

verify-sigs DEPENDENCIES

You need pyasn1 == 0.13b or >= pyasn1-0.1.4rc4 and M2Crypto to parse and validate signatures.

To exercise some demonstrator code, you may need pefile.

----

 sudo apt-get install python-m2crypto
 sudo apt-get install python-pyasn1
 

subfile DEPENDENCIES

Find subfile in any binary stream hachoir-subfile is a tool based on hachoir-parser to find subfiles in any binary stream.

----

 sudo pip install hachoir-core
 sudo pip install hachoir-parser
 sudo pip install hachoir-regex
 sudo pip install hachoir-subfile
 

Powered by Google Project Hosting