lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From yypvsxf19870706 <yypvsxf19870...@gmail.com>
Subject Re: lots of tlog.
Date Sat, 28 Dec 2013 03:05:51 GMT
Hi Mark

       Yes i have auto commit on just as other cores. All of my core are with the same configuration.the
maxtime is 60s, max number is 100000. Have not new searcher opening.
       On contrast with others , only this core is abnormal. Even it cannot relay the log,because
of the exception. 
   
org.apache.solr.update.UpdateLog  – REYPLAY_ERR: IOException reading log
>> org.apache.solr.common.SolrException: Invalid Number java.math.BigDecimal:238124404


1.Why does the log replay failed?
2.Even having the autocommit on,there are still lots of logs,I can only image that the something
wrong happened during the data import process. Are there any other suppositions about the
problem?



发自我的 iPhone

在 2013-12-28,4:09,Mark Miller <markrmiller@gmail.com> 写道:

> Do you have auto commit (not softAutoCommit) on? At what value? Are you
> ever opening a new searcher?
> 
> - Mark
> 
> On 12/27/2013 05:17 AM, YouPeng Yang wrote:
>> Hi
>>  There is  a failed core in my solrcloud cluster(solr 4.6 with hdfs 2.2)
>> when I start my solrcloud . I noticed that there are lots of tlog files [1]
>> .
>>  The start proccess was stuck ,it need to do log replay.However it
>> encountered error[2].
>>  I do think that it is abnormal that there are still a lot of tlogs.(I
>> compare it with other normal cores in my solrCloud, even there are only 1
>> tlog file in normal cores).  Which conditions wil lead to this abnormal
>> lots of  tlog files? I try many times hoping to replay the this,but i
>> failed.
>>  Please give some suggestions.
>> 
>> 
>> Regards
>> [1]-------------------------------------------
>> ......
>> -rw-r--r--   1 solr solr   23462198 2013-12-27 14:33
>> /solr/repCore/repCore/core_node20/data/tlog/tlog.0000000000000000676
>> -rw-r--r--   1 solr solr   26083634 2013-12-27 14:33
>> /solr/repCore/repCore/core_node20/data/tlog/tlog.0000000000000000677
>> -rw-r--r--   1 solr solr   25428275 2013-12-27 14:33
>> /solr/repCore/repCore/core_node20/data/tlog/tlog.0000000000000000678
>> -rw-r--r--   1 solr solr   15794489 2013-12-27 14:33
>> /solr/repCore/repCore/core_node20/data/tlog/tlog.0000000000000000679
>> -rw-r--r--   1 solr solr   23593272 2013-12-27 14:33
>> /solr/repCore/repCore/core_node20/data/tlog/tlog.0000000000000000680
>> -rw-r--r--   1 solr solr   23068981 2013-12-27 14:33
>> /solr/repCore/repCore/core_node20/data/tlog/tlog.0000000000000000681
>> -rw-r--r--   1 solr solr   21889334 2013-12-27 14:33
>> /solr/repCore/repCore/core_node20/data/tlog/tlog.0000000000000000682
>> -rw-r--r--   1 solr solr   23331127 2013-12-27 14:33
>> /solr/repCore/repCore/core_node20/data/tlog/tlog.0000000000000000683
>> -rw-r--r--   1 solr solr   22675763 2013-12-27 14:33
>> /solr/repCore/repCore/core_node20/data/tlog/tlog.0000000000000000684
>> -rw-r--r--   1 solr solr   21954870 2013-12-27 14:33
>> /solr/repCore/repCore/core_node20/data/tlog/tlog.0000000000000000685
>> -rw-r--r--   1 solr solr   21496118 2013-12-27 14:33
>> /solr/repCore/repCore/core_node20/data/tlog/tlog.0000000000000000686
>> -rw-r--r--   1 solr solr   20775222 2013-12-27 14:33
>> /solr/repCore/repCore/core_node20/data/tlog/tlog.0000000000000000687
>> -rw-r--r--   1 solr solr   24183093 2013-12-27 14:33
>> /solr/repCore/repCore/core_node20/data/tlog/tlog.0000000000000000688
>> -rw-r--r--   1 solr solr   24183090 2013-12-27 14:33
>> /solr/repCore/repCore/core_node20/data/tlog/tlog.0000000000000000689
>> -rw-r--r--   1 solr solr   24379701 2013-12-27 14:33
>> /solr/repCore/repCore/core_node20/data/tlog/tlog.0000000000000000690
>> -rw-r--r--   1 solr solr   25887033 2013-12-27 14:33
>> /solr/repCore/repCore/core_node20/data/tlog/tlog.0000000000000000691
>> -rw-r--r--   1 solr solr   25231672 2013-12-27 14:33
>> /solr/repCore/repCore/core_node20/data/tlog/tlog.0000000000000000692
>> -rw-r--r--   1 solr solr   15335737 2013-12-27 14:33
>> /solr/repCore/repCore/core_node20/data/tlog/tlog.0000000000000000693
>> -rw-r--r--   1 solr solr    8529530 2013-12-27 14:33
>> /solr/repCore/repCore/core_node20/data/tlog/tlog.0000000000000000742
>> 
>> [2]-------------------------------------------------------------
>> 133462 [recoveryExecutor-48-thread-1] WARN
>> org.apache.solr.update.UpdateLog  – Starting log replay hdfs
>> tlog{file=hdfs://lklcluster/solr/repCore/repCore/core_node2
>> 0/data/tlog/tlog.0000000000000000693 refcount=2} active=false starting pos=0
>> 133576 [recoveryExecutor-48-thread-1] WARN
>> org.apache.solr.update.UpdateLog  – REYPLAY_ERR: IOException reading log
>> org.apache.solr.common.SolrException: Invalid Number:
>> java.math.BigDecimal:238124404
>>    at
>> org.apache.solr.schema.TrieField.readableToIndexed(TrieField.java:396)
>>    at
>> org.apache.solr.update.AddUpdateCommand.getIndexedId(AddUpdateCommand.java:98)
>>    at
>> org.apache.solr.update.processor.DistributedUpdateProcessor.versionAdd(DistributedUpdateProcessor.java:582)
>>    at
>> org.apache.solr.update.processor.DistributedUpdateProcessor.processAdd(DistributedUpdateProcessor.java:435)
>>    at
>> org.apache.solr.update.processor.LogUpdateProcessor.processAdd(LogUpdateProcessorFactory.java:100)
>>    at
>> org.apache.solr.update.UpdateLog$LogReplayer.doReplay(UpdateLog.java:1313)
>>    at org.apache.solr.update.UpdateLog$LogReplayer.run(UpdateLog.java:1202)
>>    at
>> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
>>    at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
>>    at java.util.concurrent.FutureTask.run(FutureTask.java:138)
>>    at
>> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
>>    at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
>>    at java.util.concurrent.FutureTask.run(FutureTask.java:138)
>>    at
>> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
>>    at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
>>    at java.lang.Thread.run(Thread.java:662)
>> 133623 [recoveryExecutor-48-thread-1] WARN
>> org.apache.solr.update.UpdateLog  – REYPLAY_ERR: IOException reading log
>> org.apache.solr.common.SolrException: Invalid Number:
>> java.math.BigDecimal:238124405
>>    at
>> org.apache.solr.schema.TrieField.readableToIndexed(TrieField.java:396)
>>    at
>> org.apache.solr.update.AddUpdateCommand.getIndexedId(AddUpdateCommand.java:98)
>>    at
>> org.apache.solr.update.processor.DistributedUpdateProcessor.versionAdd(DistributedUpdateProcessor.java:582)
>>    at
>> org.apache.solr.update.processor.DistributedUpdateProcessor.processAdd(DistributedUpdateProcessor.java:435)
>>    at
>> org.apache.solr.update.processor.LogUpdateProcessor.processAdd(LogUpdateProcessorFactory.java:100)
>>    at
>> org.apache.solr.update.UpdateLog$LogReplayer.doReplay(UpdateLog.java:1313)
>>    at org.apache.solr.update.UpdateLog$LogReplayer.run(UpdateLog.java:1202)
>>    at
>> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
> 

Mime
View raw message