incubator-connectors-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From conflue...@apache.org
Subject [CONF] Apache Connectors Framework > FAQ
Date Tue, 12 Oct 2010 20:31:00 GMT
Space: Apache Connectors Framework (https://cwiki.apache.org/confluence/display/CONNECTORS)
Page: FAQ (https://cwiki.apache.org/confluence/display/CONNECTORS/FAQ)
Comment: https://cwiki.apache.org/confluence/display/CONNECTORS/FAQ?focusedCommentId=24182785#comment-24182785

Comment added by Farzad:
---------------------------------------------------------------------

How big was the file share you crawled?  I have 280,000 files spread across a lot of directories.
 It starts out 29-31 docs / sec, but as it crawls it gets slower.  For example, at 98000,
it was doing 31 docs a second, at 203000 it is doing 16 docs a second.  So I'm just curious
how long have you been able to sustain the ~30 doc/sec.

In reply to a comment by Karl Wright:
You really need to run your database on a fast disk if you want decent performance from MCF.


Change your notification preferences: https://cwiki.apache.org/confluence/users/viewnotifications.action

Mime
View raw message