I am developing various small tools to do some quick code analysis. The project is combination of all such tools and common utilities.

These tools require Pygments Python Syntax Highliger.

Code Duplication Detector(CDD)

Code duplication detector is similar to Copy Paste Detector (CPD) or Simian. It uses Pygments Lexer to parse the source files and uses Rabin Karp algorithm to detect the duplicates. Hence it supports all languages supported by Pygments.

Check the CDD results for Apache httpd and Apache Tomcat here.

You can read more details on my blog on why I wrote CDD.

Token Tag Cloud (TTC)

Sometime back I read the blog article 'See How Noisy Your Code Is'. TTC is tool for creating various tag clouds based on token types (e.g. keywords, names, classnames etc).

Treemap Visualization for Source Monitor Metrics data (SMTreemap)

Source Monitor is an excellent tool to generate various metrics from the source code (e.g. maxium complexity, averge compelxity, line count, block depth etc). However, it is difficult to quickly analyse this data for large code bases. Treemaps are excellent to visualize the hierarchicaldata on two dimensions (as size and color). This tool uses Tkinter to display the SourceMonitor data as treemap. You have to export the source monitor data as CSV or XML. smtreemap.py can then use this CSV or XML file as input to display the treemap