cassandra-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From qf zhou <zhouqf2...@gmail.com>
Subject Re: old big tombstone data file occupy much disk space
Date Fri, 01 Sep 2017 10:05:03 GMT
<html><head></head><body dir="auto" style="word-wrap: break-word; -webkit-nbsp-mode:
space; -webkit-line-break: after-white-space;"><meta http-equiv="Content-Type" content="text/html
charset=gb2312"><div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break:
after-white-space;" class=""><div class="">When I trigger the compaction with the
full path, &nbsp;I found nothing in the system.log. &nbsp;Nothing happens in the &nbsp;terminal
and it just stops there.</div><div class=""><br class=""></div><div
class="">#calling operation forceUserDefinedCompaction of mbean org.apache.cassandra.db:type=CompactionManager</div><div
class=""><br class=""></div><div class=""><br class=""></div><div
class=""><br class=""></div><br class=""><div><blockquote type="cite"
class=""><div class="">在 2017年9月1日,下午5:06,qf zhou &lt;<a href="mailto:zhouqf2013@gmail.com"
class="">zhouqf2013@gmail.com</a>&gt; 写道:</div><br class="Apple-interchange-newline"><div
class=""><meta http-equiv="Content-Type" content="text/html charset=gb2312" class=""><div
style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;"
class=""><div class=""><div class="">I &nbsp;found the &nbsp;following
log. &nbsp;What does it mean ?</div><div class=""><br class=""></div><div
class="">INFO &nbsp;[CompactionExecutor:11] 2017-09-01 16:55:47,909 NoSpamLogger.java:91
- Maximum memory usage reached (512.000MiB), cannot allocate chunk of 1.000MiB</div><div
class="">WARN &nbsp;[RMI TCP Connection(1714)-127.0.0.1] 2017-09-01 17:02:42,516 CompactionManager.java:704
- Schema does not exist for file mc-151276-big-Data.db. Skipping.</div></div><div
class=""><br class=""></div><br class=""><div class=""><blockquote
type="cite" class=""><div class="">在 2017年9月1日,下午4:54,Nicolas Guyomar
&lt;<a href="mailto:nicolas.guyomar@gmail.com" class="">nicolas.guyomar@gmail.com</a>&gt;
写道:</div><br class="Apple-interchange-newline"><div class=""><div
dir="ltr" class="">You should have a log coming from the CompactionManager (in cassandra
system.log) when you try the command, what does it says &nbsp;?</div><div class="gmail_extra"><br
class=""><div class="gmail_quote">On 1 September 2017 at 10:07, qf zhou <span
dir="ltr" class="">&lt;<a href="mailto:zhouqf2013@gmail.com" target="_blank" class="">zhouqf2013@gmail.com</a>&gt;</span>
wrote:<br class=""><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px
#ccc solid;padding-left:1ex"><div style="word-wrap:break-word" class=""><div class=""><div
class="">When I run the command, &nbsp;the following occurs and &nbsp;it returns
null.</div><div class=""><br class=""></div><div class="">Is
it normal ?</div><span class=""><div class=""><br class=""></div><div
class="">echo "run -b org.apache.cassandra.db:type=<wbr class="">CompactionManager
forceUserDefinedCompaction mc-100963-big-Data.db" | java -jar /opt/cassandra/tools/jmx/<wbr
class="">jmxterm-1.0-alpha-4-uber.jar &nbsp; -l localhost:7199</div><div class=""><br
class=""></div><div class=""><br class=""></div></span><div
class="">Welcome to JMX terminal. Type "help" for available commands.</div><div
class="">$&gt;run -b org.apache.cassandra.db:type=<wbr class="">CompactionManager
forceUserDefinedCompaction mc-100963-big-Data.db</div><div class="">#calling operation
forceUserDefinedCompaction of mbean org.apache.cassandra.db:type=<wbr class="">CompactionManager</div><div
class="">#operation returns:&nbsp;</div><div class="">null</div></div><div
class=""><div class="h5"><div class=""><br class=""></div><div
class=""><br class=""></div><div class=""><br class=""></div><br
class=""><div class=""><blockquote type="cite" class=""><div class="">在
2017年9月1日,下午3:49,Nicolas Guyomar &lt;<a href="mailto:nicolas.guyomar@gmail.com"
target="_blank" class="">nicolas.guyomar@gmail.com</a>&gt; 写道:</div><br
class="m_7619358772720384639Apple-interchange-newline"><div class=""><div dir="ltr"
class="">Hi,<div class=""><br class=""></div><div class="">Last
time I used&nbsp;<span style="font-size:12.8px" class="">forceUserDefinedCompactio<wbr
class="">n, I got myself a headache because I was trying to use a full path like you're
doing, but in fact it just need the sstable as parameter</span></div><div class=""><br
class=""></div><div class="">Can you just try :&nbsp;</div><div
class=""><br class=""></div><div class=""><span style="font-size:12.8px"
class="">echo "run -b org.apache.cassandra.db:type=</span><span style="font-size:12.8px"
class="">C<wbr class="">ompactionManager forceUserDefinedCompaction&nbsp;</span><span
style="font-size:12.8px" class="">mc-<wbr class="">100963-big-Data.db</span><span
style="font-size:12.8px" class="">" | java -jar /opt/cassandra/tools/jmx/</span><span
style="font-size:12.8px" class="">jmxte<wbr class="">rm-1.0-alpha-4-uber.jar&nbsp;
&nbsp;-l localhost:7199</span><br class=""></div><div class=""><br
class=""></div><div class=""><br class=""></div></div><div
class="gmail_extra"><br class=""><div class="gmail_quote">On 1 September 2017
at 08:29, qf zhou <span dir="ltr" class="">&lt;<a href="mailto:zhouqf2013@gmail.com"
target="_blank" class="">zhouqf2013@gmail.com</a>&gt;</span> wrote:<br
class=""><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc
solid;padding-left:1ex"><br class="">
dataPath=/hdd3/cassandra/data/<wbr class="">gps/gpsfullwithstate-073e51a0c<wbr class="">db811e68dce511be6a305f6/mc-<wbr
class="">100963-big-Data.db<br class="">
echo "run -b org.apache.cassandra.db:type=C<wbr class="">ompactionManager forceUserDefinedCompaction
$dataPath" | java -jar /opt/cassandra/tools/jmx/jmxte<wbr class="">rm-1.0-alpha-4-uber.jar&nbsp;
&nbsp;-l localhost:7199<br class="">
<br class="">
In the above, I am using a jmx method. But it seems that the file size doesn’t change. My
command is wrong ?<br class="">
<div class="m_7619358772720384639HOEnZb"><div class="m_7619358772720384639h5"><br
class="">
&gt; 在 2017年9月1日,下午2:17,Jeff Jirsa &lt;<a href="mailto:jjirsa@gmail.com"
target="_blank" class="">jjirsa@gmail.com</a>&gt; 写道:<br class="">
&gt;<br class="">
&gt; User defined compaction to do a single sstable compaction on just that sstable<br
class="">
&gt;<br class="">
&gt; It's a nodetool command in very recent versions, or a jmx method in older versions<br
class="">
&gt;<br class="">
&gt;<br class="">
&gt; --<br class="">
&gt; Jeff Jirsa<br class="">
&gt;<br class="">
&gt;<br class="">
&gt;&gt; On Aug 31, 2017, at 11:04 PM, qf zhou &lt;<a href="mailto:zhouqf2013@gmail.com"
target="_blank" class="">zhouqf2013@gmail.com</a>&gt; wrote:<br class="">
&gt;&gt;<br class="">
&gt;&gt; I am using&nbsp; a cluster with&nbsp; 3 nodes and&nbsp; the cassandra
version is 3.0.9. I have used it about 6 months. Now each node has about 1.5T data in the
disk.<br class="">
&gt;&gt; I found some sstables file are over 300G. Using the&nbsp; sstablemetadata
command,&nbsp; I found it:&nbsp; Estimated droppable tombstones: 0.9622972799707109.<br
class="">
&gt;&gt; It is obvious that too much tombstone data exists.<br class="">
&gt;&gt; The default_time_to_live = 8640000(100 days) and&nbsp; &nbsp;gc_grace_seconds
= 432000(5 days).&nbsp; Using nodetool&nbsp; compactionstats, I found the some compaction
processes exists.<br class="">
&gt;&gt; So I really&nbsp; want to know how to clear tombstone data ?&nbsp;
otherwise the disk space will cost too much.<br class="">
&gt;&gt; I really need some help, because some few people know cassandra in my company.<br
class="">
&gt;&gt; Thank you very much!<br class="">
&gt;&gt;<br class="">
&gt;&gt;<br class="">
&gt;&gt; ------------------------------<wbr class="">------------------------------<wbr
class="">---------<br class="">
&gt;&gt; To unsubscribe, e-mail: <a href="mailto:user-unsubscribe@cassandra.apache.org"
target="_blank" class="">user-unsubscribe@cassandra.apa<wbr class="">che.org</a><br
class="">
&gt;&gt; For additional commands, e-mail: <a href="mailto:user-help@cassandra.apache.org"
target="_blank" class="">user-help@cassandra.apache.org</a><br class="">
&gt;&gt;<br class="">
&gt;<br class="">
&gt; ------------------------------<wbr class="">------------------------------<wbr
class="">---------<br class="">
&gt; To unsubscribe, e-mail: <a href="mailto:user-unsubscribe@cassandra.apache.org"
target="_blank" class="">user-unsubscribe@cassandra.apa<wbr class="">che.org</a><br
class="">
&gt; For additional commands, e-mail: <a href="mailto:user-help@cassandra.apache.org"
target="_blank" class="">user-help@cassandra.apache.org</a><br class="">
&gt;<br class="">
<br class="">
<br class="">
------------------------------<wbr class="">------------------------------<wbr class="">---------<br
class="">
To unsubscribe, e-mail: <a href="mailto:user-unsubscribe@cassandra.apache.org" target="_blank"
class="">user-unsubscribe@cassandra.apa<wbr class="">che.org</a><br class="">
For additional commands, e-mail: <a href="mailto:user-help@cassandra.apache.org" target="_blank"
class="">user-help@cassandra.apache.org</a><br class="">
<br class="">
</div></div></blockquote></div><br class=""></div>
</div></blockquote></div><br class=""></div></div></div></blockquote></div><br
class=""></div>
</div></blockquote></div><br class=""></div></div></blockquote></div><br
class=""></div></body></html>
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@cassandra.apache.org
For additional commands, e-mail: user-help@cassandra.apache.org


Mime
View raw message