1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103

###########################################################################
##
## THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS 
## "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT 
## LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR 
## A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT 
## HOLDER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, 
## SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT 
## LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, 
## DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY 
## THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT 
## (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE 
## OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
##
###########################################################################

This directory contains scripts for use in the automation (specifically
Mozilla Firefox) and benefit greatly from the following patch which will
be applied to the Google Page Speed v1.7 tree:

    http://page-speed-codereview.appspot.com/151001

The script(s) here are still under heavy development, but are seeing 
production use and monitoring hundreds of URLs via simple linux virtual
machine zombies.

Instructions:

    0.  Setup Xvfb (virtual X11, essentially headless).  A good method to 
        test the configuration and setup the Firefox profiles as well as 
	the execution of the script/process is to use vncserver and 
	initially pass the automation script the appropriate DISPLAY 
	value without having to install a full x11 instance.  Then once 
	everything is setup run the script against Xvfb.

            Xvfb <display> -screen <screen#> <height>x<width>x<color depth>
                display 	= DISPLAY ASSIGNMENT (DISPLAY=:1)
		screen  	= screen number
                height  	= virtual screen height
		width   	= virtual screen width
		color depth  	= color bit depth (e.g. 24)

            Example:
	        Xvfb :1 -screen 0 1152x864x24 +extension RANDR &

    1.  Create a text file of URLs to be monitored, each URL on a separate
        line and make it available via HTTP to the zombies:

            http://www.example.com/test_urls.txt:
 
	        http://www.google.com/
	        http://www.yahoo.com/

    2.  Create Mozilla Firefox profile(s) (see STEP 0 for advice).  An
	interactive process is NOT required.  Edit the prefs.js file with
	appropriate values after cloning a working profile.  Install and 
	configure both YSlow and Page Speed.  Session crash recovery _MUST_
	be disabled via about:config. 

            ** SESSION RECOVERY MUST BE DISABLED **

            user_pref("browser.sessionstore.resume_from_crash", false);

	Other variables to consider:
	    
            * cache size
            * pop-up suppression
            * disable java script resize & position
            * disable update checks
            * delete history data (cookies)
            * disable all warnings
            * where to dump Google Page Speed optimization data

	To clone or backup an existing profile see the following Mozilla
	documentation:

        http://support.mozilla.com/en-US/kb/Profiles#Moving_your_profile_information  

    3.  Manually run and confirm the test_harness.pl script execution.  Simply run
	the script without any args for usage.
	
	usage:  test_harness.pl --display <DISPLAY> --firefox <PATH> --source <URL> \
                    --profile <PATH> [--timeout <SECONDS>] [--quiet] [--verbose]

    		--display  x11 display ( e.g. ':99' )
   	 	--firefox  path to Firefox binary ( default = /usr/bin/firefox )
    		--profile  path to Firefox profile ( e.g. /home/foo/profile )
    		--source   uniform resource locator ( e.g. http://www.example.com/list )
    		--quiet    supress debug messages ( default TRUE )
    		--timeout  thread execution timeout in seconds ( default = 60 )
    		--verbose  enable verbose ouput to STDOUT ( default FALSE )

    4.  Edit the monitor.sh script to reflect your desired settings.  The script can
	be run manually and once tested (see STEP 0) added to cron and exists as a 
	wrapper for execution of the test_harness.pl script.  I have a number of post
	execution clean-up commands which purge Page Speed optimization data, Flash
	plug-in data, any "downloads" automatically attempted, etc., which run after
	each pass.

	    Example:

    	        0,15,30,45 * * * * /home/tmnz/monitor.sh >> /home/tmnz/monitor.log 2>&1