manifoldcf-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
Subject [CONF] Apache Connectors Framework > FAQ
Date Tue, 12 Oct 2010 20:31:00 GMT
Space: Apache Connectors Framework (
Page: FAQ (

Comment added by Farzad:

How big was the file share you crawled?  I have 280,000 files spread across a lot of directories.
 It starts out 29-31 docs / sec, but as it crawls it gets slower.  For example, at 98000,
it was doing 31 docs a second, at 203000 it is doing 16 docs a second.  So I'm just curious
how long have you been able to sustain the ~30 doc/sec.

In reply to a comment by Karl Wright:
You really need to run your database on a fast disk if you want decent performance from MCF.

Change your notification preferences:

View raw message