When I ran this on 6000 small documents it ran for 6+ hours without completing.

With the attached performance fixes that same test runs in just a few minutes.

Thank you very much that is indeed very much appreciated! I have integrated the changes in the code in svn. Will also include these in the later release.

(ps pls also let me know how you would like to be referred to so I will give you credits for this.)