lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "vidit.asthana" <vidit.astha...@gmail.com>
Subject Transaction logs not getting deleted
Date Sat, 07 Feb 2015 17:54:30 GMT
Dear Experts,

I have a solrcloud setup - 8 machines, 7 collections(replicationFactor=2,
numShards=8). Transaction log for one of the replica of a collection is not
getting deleted and has grown to ~4GB.

Here's the stats for this collection:

*Solr Version:* 4.10.0
*NumDocs:* 33.5 million
*Softcommit duration:* 2 minutes
*Hardcommit duration:* 30 mins
*Indexing rate:* variable(avg: 2000/sec). Indexing is paused from last 2
days.

*Size of data directory of this particular buggy replica(shard1_replica1):*
20 GB(index dir = 16GB, tlog dir = 4 GB)
*Size of data directory of second replica of this shard(shard1_replica2):*
16 GB(index dir = 16GB, tlog dir = 13 MB)

*Number of files in tlog dir of buggy replica(shard1_replica1) =* 171 (from
tlog.0000000000000000882 to tlog.0000000000000001172)

Size of most files in tlog directory is 4K. Out of 171 files, 70 are greater
than 1 MB, 10 files are larger than 100MB. Largest tlog file is 935MB.
Oldest tlog file is 42MB. Latest tlog file in 6MB.

*Number of files in tlog directory of second replica of this
shard(shard1_replica2) = * 3 (tlog.0000000000000001169,
tlog.0000000000000001171 and tlog.0000000000000001173)


Let me know how can I fix this issue and delete old transaction logs of this
particular replica. I have encountered the same issue previously with 4.8.1
as well, where tlog kept growing to 20 GB(it was a test collection, so we
just deleted it at that time).





--
View this message in context: http://lucene.472066.n3.nabble.com/Transaction-logs-not-getting-deleted-tp4184635.html
Sent from the Solr - User mailing list archive at Nabble.com.

Mime
View raw message