Author |
Date |
Commit |
Message |
James Long |
Jul 9, 2012 |
cd736a4a0b9e |
had to add -t testing to the littler apt-get as well. |
James Long |
Jul 9, 2012 |
090243f03668 |
rolled up to version 0.05 on account of the gcc fix |
James Long |
Jul 9, 2012 |
3406ee8a9ced |
added apt-get install gcc to the bootstrap script so that R would install |
James Long |
Jun 5, 2012 |
b86d4f39d645 |
added some messaging to report what step is taking place
also changed logic so s |
James Long |
Jun 5, 2012 |
22fd5c9332a4 |
rolled up to version 0.04 |
James Long |
Jun 5, 2012 |
a2f707fee90a |
for some reason a couple of files were not under version control. At least one w |
James Long |
May 30, 2012 |
b8ca27e1ea53 |
upgraded to the latest aws-java-sdk
had to change the download from s3 function
|
James Long |
May 30, 2012 |
53514366fe5e |
oops… crane source dir was wrong. commented out. |
James Long |
May 29, 2012 |
3270b90c9419 |
VERSION CHANGE… now 0.03. |
James Long |
May 29, 2012 |
0244b7f8a0a2 |
altered sources.list to fix repo url |
James Long |
May 29, 2012 |
de31164e91f3 |
fixed issue with sources.list which was causing the latest R not to be loaded on |
James Long |
Apr 17, 2012 |
e841e51df04f |
changed the region to use us-east-1c instead of us-east-1a |
James Long |
Mar 28, 2012 |
e98a00ee8027 |
updated the bootstrapLatestR.sh to account for Squeeze (instead of Lenny) being |
James Long |
Dec 22, 2011 |
fda8fd551d40 |
rolled in EMR spot instance changes as well as commenting out key info in the bo |
Radek Maciaszek |
Nov 16, 2011 |
fb8353f002d8 |
Fixed createCluster() usage declaration |
Radek Maciaszek |
Nov 16, 2011 |
7e17c80fa21f |
Added support for EMR spot instances |
jal |
Jul 7, 2011 |
04354ec4e139 |
added the code for customPackages |
jal |
Jul 7, 2011 |
d7786d893540 |
altered the mapper to use .libpath() |
jal |
Jun 28, 2011 |
61ea41450b98 |
fixed bootstrap! |
James Long |
Mar 24, 2011 |
f8f173875672 |
changed compression on emrlapply |
James Long |
Mar 24, 2011 |
a63ed8c9dd42 |
changed the compression on the save.image function. switched from xz to just TRU |
James Long |
Feb 28, 2011 |
ab139e4ad468 |
seems the real issue is that R is wanting to install a bunch of crap on 64 bit i |
James Long |
Feb 28, 2011 |
51abe92ab351 |
made littler install manually because apt-get not working on 64 bit |
James Long |
Feb 25, 2011 |
fc57dbd59cf3 |
changed the mapper.R to load all packages before loading the saved workspace fil |
James Long |
Feb 24, 2011 |
393d4391a0b3 |
did a merge. No idea if I did it right. Holding breath. |
James Long |
Feb 24, 2011 |
849cd7b545a2 |
added sourcePackagesToInstall param which allows, surprisingly, source packages |
James Long |
Feb 22, 2011 |
5247310ccce5 |
changed the bootstrapLatestR.sh file so the latest R would load. libc6 confirm p |
eqm |
Jan 27, 2011 |
c3963054c52b |
address issue #7: "timeout needs to be set" |
James Long |
Jan 23, 2011 |
a05ec51fcce2 |
fixed an issue with brackets not matching
added extra function for post processi |
James Long |
Jan 19, 2011 |
494603882098 |
fixed a bug with emrlapply() which resulted in lists being improperly formed
The |
James Long |
Jan 14, 2011 |
5d9d136ab3a3 |
fixed a typo in mapred.tasktracker.reduce.tasks.maximum
changed cat to the mappe |
James Long |
Jan 14, 2011 |
ce0abd808a17 |
renamed trimWhiteSpace() to trim() to be consistent with other packages I use |
James Long |
Jan 14, 2011 |
42eba626e11c |
added clean up code to delete the log bucket on S3 since I renamed it in the pre |
James Long |
Jan 14, 2011 |
e9e4a744a62c |
i broke the package by setting the log directory to have an underscore. Changed |
James Long |
Jan 14, 2011 |
54a8eb090517 |
fixed a funny character in segue-package.R
added install for gfortran in the boo |
James Long |
Jan 12, 2011 |
e4cc7de08987 |
brought in changes from Q |
eqm |
Jan 27, 2011 |
bf4e28ef9ad1 |
issue 7: "timeout needs to be set"
added a timeout to emrlapply() |
James Long |
Jan 12, 2011 |
3ace534df55e |
changed the mkdir system call to use dir.create |
eqm |
Jan 7, 2011 |
972929c93eec |
now supports multiple bootstrap options |
James Long |
Dec 29, 2010 |
b5fea7503fac |
trying to stop warnings |
James Long |
Dec 29, 2010 |
ae31d9304753 |
trying to get segue-package.R to not throw a warning
not working so well |
James Long |
Dec 29, 2010 |
be68809a712c |
added the update.R script
somehow bootstrapLatest.R was missing
as was csvTransf |
James Long |
Dec 29, 2010 |
e8adfd54ad4b |
switched to hadoop v .20
fixed bootstrap logic
added the update.R script for upd |
James Long |
Dec 24, 2010 |
fdb0a61159f6 |
mapper.R was not install.packages() before trying to load. I fixed that mess. |
James Long |
Dec 24, 2010 |
2c64ea7b35fd |
added copy.image argument to createCluster. Allows copying an entire local defau |
James Long |
Dec 23, 2010 |
f2821759ea39 |
changed CRAN mirror to the main CRAN site
added extra sleep in the terminateClus |
James Long |
Dec 23, 2010 |
699f0030a4b7 |
caught a bug in the mapper.R file that caused it to fail if there were NOT extra |
James Long |
Dec 22, 2010 |
1ee99a131e1a |
file upload to the nodes really works now. No really. |
James Long |
Dec 22, 2010 |
619728e12fe3 |
file uploading seems to work. holla! |
James Long |
Dec 20, 2010 |
2da9b172a0b1 |
added stopClusterOnComplete argument to submitJob |
James Long |
Dec 17, 2010 |
70a1ec8fb80c |
added log4j logging. |
James Long |
Dec 17, 2010 |
9221a7bb0c91 |
built the docs again |
James Long |
Dec 17, 2010 |
25563d62e660 |
round trip test finally worked! woot. |
James Long |
Dec 16, 2010 |
343606853095 |
more debugging.... sooo close. something still up with the streaming jar call |
James Long |
Dec 16, 2010 |
7fb1b50653d0 |
cleaning up and debugging of the AWS calls. |
James Long |
Dec 15, 2010 |
e73b63b6b708 |
finished porting shutdowncluster and stopcluster.
also deleting out a temp RData |
James Long |
Dec 15, 2010 |
3178ca1367a3 |
added a debugging file: result.RData |
James Long |
Dec 15, 2010 |
4ab234c2899a |
finally got the basic ability to spin up an EMR cluster. |
James Long |
Dec 13, 2010 |
535433a5bbe2 |
still migrating to JAVA api from command line |
James Long |
Dec 10, 2010 |
074dd02eae9a |
added jets3t jar
changing from command line system calls to Java API |
James Long |
Dec 8, 2010 |
961e5fc47837 |
finally have the build clean(ish). Moved rJava as a require instead of an import |
James Long |
Dec 7, 2010 |
30d76e7ea05e |
wrestling with Name Spaces and Roxygen a little more. |
James Long |
Dec 7, 2010 |
b420b33929e8 |
updated Roxygen documentation. now builds clean... woot. |
James Long |
Dec 7, 2010 |
eca3be491b3b |
now with the docs created by Roxygen |
James Long |
Dec 7, 2010 |
4c8dc01c896a |
Got Roxygen running... I think. First commit after Roxygenization |
James Long |
Dec 7, 2010 |
f5cc57429f7a |
created awsFunctions.R and edited segue.R to fix some sdk path issues. Going to |
James Long |
Dec 7, 2010 |
223c78549c2c |
changes so it will actually build. Still one warning with the docs. |
James Long |
Dec 6, 2010 |
05275b1c39ce |
making build work |
James Long |
Dec 6, 2010 |
12fad9c800ef |
removed unused testing file |
James Long |
Dec 6, 2010 |
ae6569c89dbd |
added AWS SDK |
James Long |
Dec 6, 2010 |
a3c21cc123ed |
added google code repo |
James Long |
Dec 6, 2010 |
fad8bff6586f |
initial check in |