PTStemmer - A Stemming toolkit for the Portuguese language

FEATURES

• Java, Python, and .NET C# implementations of Orengo, Porter, and Savoy stemmers

• Fast: can stem more than 1.5M words/second on a normal desktop

• Least Recently Used (LRU) stem cache

• Support for lists of words to ignore (useful for stopword and named entity removal)

MINIMUM REQUIREMENTS

• Java
• Java 1.5
• Python
• Python 2.5
• .NET
• .NET Framework 2.0 or Mono 2.0

USAGE EXAMPLES

More usage examples on the wiki: UsageExamples

Java

Stemmer stemmer = new OrengoStemmer();
stemmer.enableCaching(1000);   //Optional
stemmer.ignore(PTStemmerUtilities.fileToSet("data/namedEntities.txt"));  //Optional
System.out.println(stemmer.getWordStem("extremamente"));

Python

stemmer = OrengoStemmer()
stemmer.enableCaching(1000)   #Optional
stemmer.ignore(PTStemmerUtilities.fileToSet("data/namedEntities.txt"))   #Optional
print stemmer.getWordStem("extremamente")

C#

Stemmer stemmer = new OrengoStemmer();
stemmer.enableCaching(1000);   //Optional
stemmer.ignore(PTStemmerUtilities.fileToList("data/namedEntities.txt"));   //Optional
Console.WriteLine(stemmer.getWordStem("extremamente"));

TODO

• Add more programming languages (PHP, Ruby)
• Implement a portuguese language specific tokenizer

DEVELOPED & SUPPORTED

• Pedro Oliveira
• http://www.cpdomina.net