Requirements

• Java 1.6.0 or greater
• Hadoop 0.20.0 or greater

Download and install

• Install Java (install from download page)
• Install Hadoop (see Hadoop Quick Start)
• Install Oluolu
1. download the file from download page
2. decompress by the command,

     tar zxvf oluolu.***.tar.gz

3. set path

adding the oluolu jar file into HADOOP_CLASSPATH in $HADOOP_HOME/conf/hadoop-env.sh)

     export HADOOP_CLASSPATH=$CLASSPATH:/home/username/oluolu/oluolu-***.jar

Running examples

Now let's run Oluolu with a sample input file attached in the Oluolu source (oluolu/src/test/resources/testInput.txt). I describes the sample usage of Oluolu to make spell checking dictionary and related query dictionary with the sample file.

Spelling correction dictionary creation

Copy a sample input file into HDFS.

$ hadoop dfs -put src/test/resources/testInput.txt /blah/blah/path/

Next run oluolu with the following parameters.

$ bin/oluolu spellcheck -input /blah/blah/path/testInput.txt -output testOutput

Then, we can see the result by the following command.

$ hadoop dfs -cat /blah/blah/path/testOutput.rq
yhao    yahoo

Context dictionary creation

To create the context dictionary, run the following command.

bin/oluolu context -input /blah/blah/path/testInput.txt -output testOutput

We can get the result by

$ hadoop dfs -cat /blah/blah/path/testOutput.rq
yahoo    yahoo news