My favorites | Sign in
Project Home Downloads Wiki Issues Source
READ-ONLY: This project has been archived. For more information see this post.
Search
for
ServerConfiguration  
SSS Mapreduce server side configuration
ja , en
Updated Feb 27, 2013

Server side configuration

SSS Mapreduce worker server reads the setting from ${MAPREDUCE_HOME}/conf/mapreduce.server.properties. The list of settings is shown below.

name type default value explanation
mapreduce.server.io.get.batchcount integer 1024 The maximum number of tuples gotten from DB by one request
mapreduce.server.io.get.limit_nbytes integer 131072 The maximum size of tuples gotten from DB by one request(bytes)
mapreduce.server.io.put.batchcount integer 1024 The maximum number of tuples written to DB by one request
mapreduce.server.input.threads.max integer 16 The maximum number of threads of thread pool for reading
mapreduce.server.output.threads.max integer 16 The maximum number of threads of thread pool for writing
mapreduce.server.worker.threads.max integer 16 The maximum number of threads of thread pool for working
mapreduce.server.map.output.cache.nbytes integer 131072 The thread local buffer size using on map output
mapreduce.server.reduce.output.cache.nbytes integer 131072 The thread local buffer size using on reduce output
mapreduce.server.inputtp.workqueue.limit integer 16 The maximum size of queue of thread pool for reading
mapreduce.server.outputtp.workqueue.limit integer 16 The maximum size of queue of thread pool for writing
mapreduce.server.wktp.workqueue.limit integer 16 The maximum size of queue of thread pool for working
mapreduce.server.map.output_queue.multiplicity integer 2 The number of output buffers for writing the tuples generated by mapper and combiner
mapreduce.server.map.output_queue.limit_nbytes integer 2097152 The maximum size of output buffers for writing the tuples generated by mapper and combiner. The unit is a byte
mapreduce.server.reduce.output_queue.multiplicity integer 2 The number of output buffers for writing the tuples generated by reducer
mapreduce.server.reduce.output_queue.limit_nbytes integer 2097152 The maximum size of output buffers for writing the tuples generated by reducer. The unit is a byte
mapreduce.server.combine.queue.multiplicity integer 2 The number of buffers for tuples which will be process by a combiner
mapreduce.server.combine.queue.limit_nbytes integer 2097152 The mapreduce size of buffers for tuples which will be process by a combiner. The unit is a byte.
mapreduce.server.db.factory.class DB class org.sss.mapreduce.TTDBFactory The factory class of backend database
mapreduce.server.db.use.vanilla boolean false Indicate whether SSS uses Tokyo Tyrant's extended features or not
mapreduce.server.io.stream.protocol boolean false Indicate whether SSS uses DataServer or not

Powered by Google Project Hosting