lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Erick Erickson <erickerick...@gmail.com>
Subject Re: tlogs are not deleted
Date Wed, 23 Oct 2019 12:23:28 GMT
My first guess is that your CDCR setup isn’t running. CDCR uses tlogs as a queueing mechanism.
If CDCR can’t send docs to the target collection, they’ll accumulate forever.

Best,
Erick

> On Oct 22, 2019, at 7:48 PM, Woo Choi <richkingmystory@gmail.com> wrote:
> 
> Hi,
> 
> We are using solr 7.7 cloud with CDCR(every collection has 3 replicas, 1
> shard).
> 
> In solrconfig.xml, 
> 
> tlog configuration is super simple like : <updateLog/>
> 
> There is also daily data import and commit is called after data import every
> time.
> 
> Indexing works fine, but the problem is that the number of tlogs keeps
> growing.
> 
> According to the documentation
> here(https://lucene.apache.org/solr/guide/6_6/updatehandlers-in-solrconfig.html),
> I expected tlog will remain as many as 10(default value of
> maxNumLogsToKeep=10).
> 
> However I still have a bunch of tlogs - the oldest one is Sep 6..!
> 
> I did an experiment by running data import with commit option from solr
> admin ui, but any of tlogs were not deleted.
> 
> tlog.0000000000000000002.1643995079881261056 
> tlog.0000000000000000018.1645444642733293568 
> tlog.0000000000000000034.1646803619099443200
> tlog.0000000000000000003.1644085718240198656 
> tlog.0000000000000000019.1645535304072822784 
> tlog.0000000000000000035.1646894195509559296
> tlog.0000000000000000004.1644176284537847808 
> tlog.0000000000000000020.1645625651261079552 
> tlog.0000000000000000036.1646984623121498112
> tlog.0000000000000000005.1644357373324689408 
> tlog.0000000000000000021.1645625651316654083 
> tlog.0000000000000000037.1647076244416626688
> tlog.0000000000000000006.1644447899616018432 
> tlog.0000000000000000022.1645716477747134464 
> tlog.0000000000000000038.1647165801017376768
> tlog.0000000000000000007.1644538486210953216 
> tlog.0000000000000000023.1645806853961023488 
> tlog.0000000000000000039.1647165801042542594
> tlog.0000000000000000008.1644629084296183808 
> tlog.0000000000000000024.1645897663703416832 
> tlog.0000000000000000040.1647256590865137664
> tlog.0000000000000000009.1644719895268556800 
> tlog.0000000000000000025.1645988248838733824 
> tlog.0000000000000000041.1647347172490870784
> tlog.0000000000000000010.1644810493331767296 
> tlog.0000000000000000026.1646078905702940672 
> tlog.0000000000000000042.1647437758859313152
> tlog.0000000000000000011.1644901113324896256 
> tlog.0000000000000000027.1646169478772293632 
> tlog.0000000000000000043.1647528345005457408
> tlog.0000000000000000012.1645031030684385280 
> tlog.0000000000000000028.1646259838395613184 
> tlog.0000000000000000044.1647618793025830912
> tlog.0000000000000000013.1645031030777708545 
> tlog.0000000000000000029.1646350429145006080 
> tlog.0000000000000000045.1647709579019026432
> tlog.0000000000000000014.1645082080252526592 
> tlog.0000000000000000030.1646441456502571008 
> tlog.0000000000000000046.1647890587519549440
> tlog.0000000000000000015.1645172929206419456 
> tlog.0000000000000000031.1646531802044563456 
> tlog.0000000000000000047.1647981403286011904
> tlog.0000000000000000016.1645263488829882368 
> tlog.0000000000000000032.1646622220615680000 
> tlog.0000000000000000048.1648071989042085888
> tlog.0000000000000000017.1645353861842468864 
> tlog.0000000000000000033.1646712822719053824 
> tlog.0000000000000000049.1648135546466205696
> 
> Did I miss something in the solrconfig file?
> 
> 
> 
> --
> Sent from: https://lucene.472066.n3.nabble.com/Solr-User-f472068.html


Mime
View raw message