Just don't expect too much, it is just a first shot.... i hope you manage to make it run at your site...Wow, sounds very cool. How do you feel about sharing/donating that code?
I'd very interesting in working on that.
SearchResult: Total Hits: 13
I will check it out...
The Cocoon CLI does crawling internally without the overhead of HTTP
Follow the flow at Cocoon.main() to know how that is done.