Export to GitHub

segue - default

Source Commits


Commits

Author Date Commit Message
James Long Jul 9, 2012 cd736a4a0b9e had to add -t testing to the littler apt-get as well.
James Long Jul 9, 2012 090243f03668 rolled up to version 0.05 on account of the gcc fix
James Long Jul 9, 2012 3406ee8a9ced added apt-get install gcc to the bootstrap script so that R would install
James Long Jun 5, 2012 b86d4f39d645 added some messaging to report what step is taking place also changed logic so s
James Long Jun 5, 2012 22fd5c9332a4 rolled up to version 0.04
James Long Jun 5, 2012 a2f707fee90a for some reason a couple of files were not under version control. At least one w
James Long May 30, 2012 b8ca27e1ea53 upgraded to the latest aws-java-sdk had to change the download from s3 function
James Long May 30, 2012 53514366fe5e oops… crane source dir was wrong. commented out.
James Long May 29, 2012 3270b90c9419 VERSION CHANGE… now 0.03.
James Long May 29, 2012 0244b7f8a0a2 altered sources.list to fix repo url
James Long May 29, 2012 de31164e91f3 fixed issue with sources.list which was causing the latest R not to be loaded on
James Long Apr 17, 2012 e841e51df04f changed the region to use us-east-1c instead of us-east-1a
James Long Mar 28, 2012 e98a00ee8027 updated the bootstrapLatestR.sh to account for Squeeze (instead of Lenny) being
James Long Dec 22, 2011 fda8fd551d40 rolled in EMR spot instance changes as well as commenting out key info in the bo
Radek Maciaszek Nov 16, 2011 fb8353f002d8 Fixed createCluster() usage declaration
Radek Maciaszek Nov 16, 2011 7e17c80fa21f Added support for EMR spot instances
jal Jul 7, 2011 04354ec4e139 added the code for customPackages
jal Jul 7, 2011 d7786d893540 altered the mapper to use .libpath()
jal Jun 28, 2011 61ea41450b98 fixed bootstrap!
James Long Mar 24, 2011 f8f173875672 changed compression on emrlapply
James Long Mar 24, 2011 a63ed8c9dd42 changed the compression on the save.image function. switched from xz to just TRU
James Long Feb 28, 2011 ab139e4ad468 seems the real issue is that R is wanting to install a bunch of crap on 64 bit i
James Long Feb 28, 2011 51abe92ab351 made littler install manually because apt-get not working on 64 bit
James Long Feb 25, 2011 fc57dbd59cf3 changed the mapper.R to load all packages before loading the saved workspace fil
James Long Feb 24, 2011 393d4391a0b3 did a merge. No idea if I did it right. Holding breath.
James Long Feb 24, 2011 849cd7b545a2 added sourcePackagesToInstall param which allows, surprisingly, source packages
James Long Feb 22, 2011 5247310ccce5 changed the bootstrapLatestR.sh file so the latest R would load. libc6 confirm p
eqm Jan 27, 2011 c3963054c52b address issue #7: "timeout needs to be set"
James Long Jan 23, 2011 a05ec51fcce2 fixed an issue with brackets not matching added extra function for post processi
James Long Jan 19, 2011 494603882098 fixed a bug with emrlapply() which resulted in lists being improperly formed The
James Long Jan 14, 2011 5d9d136ab3a3 fixed a typo in mapred.tasktracker.reduce.tasks.maximum changed cat to the mappe
James Long Jan 14, 2011 ce0abd808a17 renamed trimWhiteSpace() to trim() to be consistent with other packages I use
James Long Jan 14, 2011 42eba626e11c added clean up code to delete the log bucket on S3 since I renamed it in the pre
James Long Jan 14, 2011 e9e4a744a62c i broke the package by setting the log directory to have an underscore. Changed
James Long Jan 14, 2011 54a8eb090517 fixed a funny character in segue-package.R added install for gfortran in the boo
James Long Jan 12, 2011 e4cc7de08987 brought in changes from Q
eqm Jan 27, 2011 bf4e28ef9ad1 issue 7: "timeout needs to be set" added a timeout to emrlapply()
James Long Jan 12, 2011 3ace534df55e changed the mkdir system call to use dir.create
eqm Jan 7, 2011 972929c93eec now supports multiple bootstrap options
James Long Dec 29, 2010 b5fea7503fac trying to stop warnings
James Long Dec 29, 2010 ae31d9304753 trying to get segue-package.R to not throw a warning not working so well
James Long Dec 29, 2010 be68809a712c added the update.R script somehow bootstrapLatest.R was missing as was csvTransf
James Long Dec 29, 2010 e8adfd54ad4b switched to hadoop v .20 fixed bootstrap logic added the update.R script for upd
James Long Dec 24, 2010 fdb0a61159f6 mapper.R was not install.packages() before trying to load. I fixed that mess.
James Long Dec 24, 2010 2c64ea7b35fd added copy.image argument to createCluster. Allows copying an entire local defau
James Long Dec 23, 2010 f2821759ea39 changed CRAN mirror to the main CRAN site added extra sleep in the terminateClus
James Long Dec 23, 2010 699f0030a4b7 caught a bug in the mapper.R file that caused it to fail if there were NOT extra
James Long Dec 22, 2010 1ee99a131e1a file upload to the nodes really works now. No really.
James Long Dec 22, 2010 619728e12fe3 file uploading seems to work. holla!
James Long Dec 20, 2010 2da9b172a0b1 added stopClusterOnComplete argument to submitJob
James Long Dec 17, 2010 70a1ec8fb80c added log4j logging.
James Long Dec 17, 2010 9221a7bb0c91 built the docs again
James Long Dec 17, 2010 25563d62e660 round trip test finally worked! woot.
James Long Dec 16, 2010 343606853095 more debugging.... sooo close. something still up with the streaming jar call
James Long Dec 16, 2010 7fb1b50653d0 cleaning up and debugging of the AWS calls.
James Long Dec 15, 2010 e73b63b6b708 finished porting shutdowncluster and stopcluster. also deleting out a temp RData
James Long Dec 15, 2010 3178ca1367a3 added a debugging file: result.RData
James Long Dec 15, 2010 4ab234c2899a finally got the basic ability to spin up an EMR cluster.
James Long Dec 13, 2010 535433a5bbe2 still migrating to JAVA api from command line
James Long Dec 10, 2010 074dd02eae9a added jets3t jar changing from command line system calls to Java API
James Long Dec 8, 2010 961e5fc47837 finally have the build clean(ish). Moved rJava as a require instead of an import
James Long Dec 7, 2010 30d76e7ea05e wrestling with Name Spaces and Roxygen a little more.
James Long Dec 7, 2010 b420b33929e8 updated Roxygen documentation. now builds clean... woot.
James Long Dec 7, 2010 eca3be491b3b now with the docs created by Roxygen
James Long Dec 7, 2010 4c8dc01c896a Got Roxygen running... I think. First commit after Roxygenization
James Long Dec 7, 2010 f5cc57429f7a created awsFunctions.R and edited segue.R to fix some sdk path issues. Going to
James Long Dec 7, 2010 223c78549c2c changes so it will actually build. Still one warning with the docs.
James Long Dec 6, 2010 05275b1c39ce making build work
James Long Dec 6, 2010 12fad9c800ef removed unused testing file
James Long Dec 6, 2010 ae6569c89dbd added AWS SDK
James Long Dec 6, 2010 a3c21cc123ed added google code repo
James Long Dec 6, 2010 fad8bff6586f initial check in