lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From bugzi...@apache.org
Subject DO NOT REPLY [Bug 34930] - [PATCH] IndexWriter.maybeMergeSegments() takes lots of CPU resources
Date Tue, 24 May 2005 05:43:05 GMT
DO NOT REPLY TO THIS EMAIL, BUT PLEASE POST YOUR BUG·
RELATED COMMENTS THROUGH THE WEB INTERFACE AVAILABLE AT
<http://issues.apache.org/bugzilla/show_bug.cgi?id=34930>.
ANY REPLY MADE TO THIS MESSAGE WILL NOT BE COLLECTED AND·
INSERTED IN THE BUG DATABASE.

http://issues.apache.org/bugzilla/show_bug.cgi?id=34930





------- Additional Comments From psmith@apache.org  2005-05-24 07:43 -------
Created an attachment (id=15139)
 --> (http://issues.apache.org/bugzilla/attachment.cgi?id=15139&action=view)
HPROF output of the same test with the patch applied

This HPROF shows the CPU savings of the patch.

In summary, the original was this:

   1 24.14% 24.14%     859 300342
org.apache.lucene.index.IndexWriter.maybeMergeSegments
   2  4.83% 28.97%     172 300306 java.lang.Throwable.fillInStackTrace
   3  4.07% 33.04%     145 300336 org.apache.lucene.index.SegmentInfos.info
   4  2.50% 35.54%	89 300505
org.apache.lucene.store.RAMInputStream.readInternal
   5  2.33% 37.88%	83 300299 java.util.Vector.addElement
   6  2.16% 40.04%	77 300334 org.apache.lucene.document.Field.readerValue
   7  2.14% 42.17%	76 300272 java.net.SocketInputStream.socketRead0
   8  1.40% 43.58%	50 300598 org.apache.lucene.util.PriorityQueue.downHeap

   9  1.15% 44.73%	41 300617 org.apache.lucene.util.PriorityQueue.downHeap

  10  1.01% 45.74%	36 300581 java.io.RandomAccessFile.writeBytes
.....

And after the patch is applied it becomes:

   1  5.45%  5.45%     130 300287 java.lang.Throwable.fillInStackTrace
   2  5.20% 10.65%     124 300277 java.net.SocketInputStream.socketRead0
   3  3.86% 14.51%	92 300515
org.apache.lucene.store.RAMInputStream.readInternal
   4  3.27% 17.79%	78 300332 java.util.Vector.addElement
   5  2.35% 20.13%	56 300548 java.io.RandomAccessFile.writeBytes
   6  2.22% 22.36%	53 300305 org.apache.lucene.document.Field.readerValue
   7  1.85% 24.20%	44 300595 org.apache.lucene.util.PriorityQueue.downHeap

   8  1.72% 25.92%	41 300580 org.apache.lucene.util.PriorityQueue.downHeap

   9  1.51% 27.43%	36 300645 java.net.SocketInputStream.socketRead0
  10  1.43% 28.86%	34 300284
org.apache.lucene.store.BufferedIndexOutput.<init>
  11  1.43% 30.29%	34 300562 java.lang.Object.clone
  12  1.17% 31.46%	28 300346 java.io.StringReader.read
  13  1.01% 32.47%	24 300363
org.apache.lucene.index.DocumentWriter.writeNorms

(Note: The Socket reading element is the JDBC driver retrieving the results).

cheers,

Paul


-- 
Configure bugmail: http://issues.apache.org/bugzilla/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.

---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


Mime
View raw message