My favorites | Sign in
Project Home Downloads Wiki Issues Source
READ-ONLY: This project has been archived. For more information see this post.
Search
for
CommandLineTools  
SSS Mapreduce command line tools
ja , en
Updated Feb 27, 2013 by tatsuhik...@gmail.com

Command line tools

This page explains the command line tools which is contained SSS Mapreduce packages. $MAPREDUCE_HOME in this page shows environment variable MAPREDUCE_HOME specified on the installation. It is the full path of the directory where SSS Mapreduce is installed.

There are the all command line tools in $MAPREDUCE_HOME/bin.

get list of TupleGroup -- lstg.sh

"lstg.sh" is the script to get list of the all TupleGroup from SSS storage servers.

The example:

$ ${MAPREDUCE_HOME}/bin/lstg.sh
1f99f70f5-f0b2-43fe-9055-c8c4ead3ee2b
18e256df6-9809-46db-8b98-635cfcb8617f
16cef36b6-2e9d-4ec1-9a8a-de9b0d0a566d
$

In above example, three GroupID is printed, so any tuples in storage servers is belong to either of three TupleGroups.

Count the tuples -- cnttuples.sh

"cnttuples.sh" is the script count number of tuples in the specified GroupID.

The example:

$ ${MAPREDUCE_HOME}/bin/cnttuples.sh 1f99f70f5-f0b2-43fe-9055-c8c4ead3ee2b
WARNING: this command is very very slow.
1073741824
$

In above example, TupleGroup 1f99f70f5-f0b2-43fe-9055-c8c4ead3ee2b has 1073741824 tuples.

Remove TupleGroup -- rmtg.sh

"rmtg.sh" is the script to remove the specified TupleGroup from storage servers.

The example:

$ ${MAPREDUCE_HOME}/bin/lstg.sh
1f99f70f5-f0b2-43fe-9055-c8c4ead3ee2b
18e256df6-9809-46db-8b98-635cfcb8617f
16cef36b6-2e9d-4ec1-9a8a-de9b0d0a566d
$ ${MAPREDUCE_HOME}/bin/rmtg.sh 1f99f70f5-f0b2-43fe-9055-c8c4ead3ee2b
Removed 1073741824 items.
$ ${MAPREDUCE_HOME}/bin/lstg.sh
18e256df6-9809-46db-8b98-635cfcb8617f
16cef36b6-2e9d-4ec1-9a8a-de9b0d0a566d
$

In above example, TupleGroup 1f99f70f5-f0b2-43fe-9055-c8c4ead3ee2b does not exist after the execution of rmtg.sh.

Powered by Google Project Hosting