Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@cassandra.apache.org
Received-SPF: neutral (nike.apache.org: 209.85.215.44 is neither permitted nor
 denied by domain of tamar@tok-media.com)
MIME-Version: 1.0
In-Reply-To: 
 <CABZP+MRnTLy6t8kVQOEfLG2AauQj9CRNfJMFbM49RgYCpgaUdA@mail.gmail.com>
References: 
 <CAAam9svjUdURb_c877Gr0re-f1yMk1kKajknytryWXTEzxP8jg@mail.gmail.com>
 <CC84AF23.11A07%Dean.Hiller@nrel.gov>
 <CABZP+MR00q51AkJMix8Mi55Et8jhYeT+Qowg1YMtRSo3GJhzzA@mail.gmail.com>
 <CABZP+MSX-+M7rFLoz=TsngKoPvkQBPBG5TjWZwnOPC8YLpbC6Q@mail.gmail.com>
 <FC41D2F3-CF71-455B-A0DF-7B5848A42695@thelastpickle.com>
 <CABZP+MRnTLy6t8kVQOEfLG2AauQj9CRNfJMFbM49RgYCpgaUdA@mail.gmail.com>
From: Tamar Fraenkel <tamar@tok-media.com>
Date: Fri, 28 Sep 2012 16:38:58 +0200
Message-ID: 
 <CABZP+MTF7kspKM9pmzsS25D35w6pp2x1iSQjcwq-dcifk+Xozg@mail.gmail.com>
Subject: Re: compression
To: user@cassandra.apache.org
Content-Type: multipart/related; boundary=f46d042c6b8d7f1d5b04cac40510

--f46d042c6b8d7f1d5b04cac40510
Content-Type: multipart/alternative; boundary=f46d042c6b8d7f1d5804cac4050f

--f46d042c6b8d7f1d5804cac4050f
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

Hi!
The situation didn't resolve, does anyone has a clue?
Thanks

*Tamar Fraenkel *
Senior Software Engineer, TOK Media

[image: Inline image 1]

tamar@tok-media.com
Tel:   +972 2 6409736
Mob:  +972 54 8356490
Fax:   +972 2 5612956


On Thu, Sep 27, 2012 at 10:42 AM, Tamar Fraenkel <tamar@tok-media.com>wrote=
:

> Hi!
> First, the problem is still there, altough I checked and all node agree o=
n
> the schema.
> This is from ls -l
> Good Node
> -rw-r--r-- 1 cassandra cassandra        606 2012-09-27 08:01
> tk_usus_user-hc-269-CompressionInfo.db
> -rw-r--r-- 1 cassandra cassandra    2246431 2012-09-27 08:01
> tk_usus_user-hc-269-Data.db
> -rw-r--r-- 1 cassandra cassandra      11056 2012-09-27 08:01
> tk_usus_user-hc-269-Filter.db
> -rw-r--r-- 1 cassandra cassandra     129792 2012-09-27 08:01
> tk_usus_user-hc-269-Index.db
> -rw-r--r-- 1 cassandra cassandra       4336 2012-09-27 08:01
> tk_usus_user-hc-269-Statistics.db
>
> Node 2
> -rw-r--r-- 1 cassandra cassandra    4592393 2012-09-27 08:01
> tk_usus_user-hc-268-Data.db
> -rw-r--r-- 1 cassandra cassandra         69 2012-09-27 08:01
> tk_usus_user-hc-268-Digest.sha1
> -rw-r--r-- 1 cassandra cassandra      11056 2012-09-27 08:01
> tk_usus_user-hc-268-Filter.db
> -rw-r--r-- 1 cassandra cassandra     129792 2012-09-27 08:01
> tk_usus_user-hc-268-Index.db
> -rw-r--r-- 1 cassandra cassandra       4336 2012-09-27 08:01
> tk_usus_user-hc-268-Statistics.db
>
> Node 3
> -rw-r--r-- 1 cassandra cassandra   4592393 2012-09-27 08:01
> tk_usus_user-hc-278-Data.db
> -rw-r--r-- 1 cassandra cassandra        69 2012-09-27 08:01
> tk_usus_user-hc-278-Digest.sha1
> -rw-r--r-- 1 cassandra cassandra     11056 2012-09-27 08:01
> tk_usus_user-hc-278-Filter.db
> -rw-r--r-- 1 cassandra cassandra    129792 2012-09-27 08:01
> tk_usus_user-hc-278-Index.db
> -rw-r--r-- 1 cassandra cassandra      4336 2012-09-27 08:01
> tk_usus_user-hc-278-Statistics.db
>
> Looking at the logs, on the "good node" I can see
>
>  INFO [MigrationStage:1] 2012-09-24 10:08:16,511 Migration.java (line 119=
)
> Applying migration c22413b0-062f-11e2-0000-1bcb936807db Update column
> family to org.apache.cassandra.config.CFMetaData@1dbdcde9
> [cfId=3D1016,ksName=3Dtok,cfName=3Dtk_usus_user,cfType=3DStandard,compara=
tor=3Dorg.apache.cassandra.db.marshal.CompositeType(org.apache.cassandra.db=
.marshal.UTF8Type,org.apache.cassandra.db.marshal.UTF8Type),subcolumncompar=
ator=3D<null>,comment=3D,rowCacheSize=3D0.0,keyCacheSize=3D200000.0,readRep=
airChance=3D1.0,replicateOnWrite=3Dtrue,gcGraceSeconds=3D864000,defaultVali=
dator=3Dorg.apache.cassandra.db.marshal.UTF8Type,keyValidator=3Dorg.apache.=
cassandra.db.marshal.UUIDType,minCompactionThreshold=3D4,maxCompactionThres=
hold=3D32,rowCacheSavePeriodInSeconds=3D0,keyCacheSavePeriodInSeconds=3D144=
00,rowCacheKeysToSave=3D2147483647,rowCacheProvider=3Dorg.apache.cassandra.=
cache.SerializingCacheProvider@3505231c,mergeShardsChance=3D0.1,keyAlias=3D=
java.nio.HeapByteBuffer[pos=3D485
> lim=3D488 cap=3D653],column_metadata=3D{},compactionStrategyClass=3Dclass
> org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,compactio=
nStrategyOptions=3D{},compressionOptions=3D{sstable_compression=3Dorg.apach=
e.cassandra.io.compress.SnappyCompressor,
> chunk_length_kb=3D64},bloomFilterFpChance=3D<null>]
>
> But same can be seen in the logs of the two other nodes:
>  INFO [MigrationStage:1] 2012-09-24 10:08:16,767 Migration.java (line 119=
)
> Applying migration c22413b0-062f-11e2-0000-1bcb936807db Update column
> family to org.apache.cassandra.config.CFMetaData@24fbb95d
> [cfId=3D1016,ksName=3Dtok,cfName=3Dtk_usus_user,cfType=3DStandard,compara=
tor=3Dorg.apache.cassandra.db.marshal.CompositeType(org.apache.cassandra.db=
.marshal.UTF8Type,org.apache.cassandra.db.marshal.UTF8Type),subcolumncompar=
ator=3D<null>,comment=3D,rowCacheSize=3D0.0,keyCacheSize=3D200000.0,readRep=
airChance=3D1.0,replicateOnWrite=3Dtrue,gcGraceSeconds=3D864000,defaultVali=
dator=3Dorg.apache.cassandra.db.marshal.UTF8Type,keyValidator=3Dorg.apache.=
cassandra.db.marshal.UUIDType,minCompactionThreshold=3D4,maxCompactionThres=
hold=3D32,rowCacheSavePeriodInSeconds=3D0,keyCacheSavePeriodInSeconds=3D144=
00,rowCacheKeysToSave=3D2147483647,rowCacheProvider=3Dorg.apache.cassandra.=
cache.SerializingCacheProvider@a469ba3,mergeShardsChance=3D0.1,keyAlias=3Dj=
ava.nio.HeapByteBuffer[pos=3D0
> lim=3D3 cap=3D3],column_metadata=3D{},compactionStrategyClass=3Dclass
> org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,compactio=
nStrategyOptions=3D{},compressionOptions=3D{sstable_compression=3Dorg.apach=
e.cassandra.io.compress.SnappyCompressor,
> chunk_length_kb=3D64},bloomFilterFpChance=3D<null>]
>
>  INFO [MigrationStage:1] 2012-09-24 10:08:16,705 Migration.java (line 119=
)
> Applying migration c22413b0-062f-11e2-0000-1bcb936807db Update column
> family to org.apache.cassandra.config.CFMetaData@216b6a58
> [cfId=3D1016,ksName=3Dtok,cfName=3Dtk_usus_user,cfType=3DStandard,compara=
tor=3Dorg.apache.cassandra.db.marshal.CompositeType(org.apache.cassandra.db=
.marshal.UTF8Type,org.apache.cassandra.db.marshal.UTF8Type),subcolumncompar=
ator=3D<null>,comment=3D,rowCacheSize=3D0.0,keyCacheSize=3D200000.0,readRep=
airChance=3D1.0,replicateOnWrite=3Dtrue,gcGraceSeconds=3D864000,defaultVali=
dator=3Dorg.apache.cassandra.db.marshal.UTF8Type,keyValidator=3Dorg.apache.=
cassandra.db.marshal.UUIDType,minCompactionThreshold=3D4,maxCompactionThres=
hold=3D32,rowCacheSavePeriodInSeconds=3D0,keyCacheSavePeriodInSeconds=3D144=
00,rowCacheKeysToSave=3D2147483647,rowCacheProvider=3Dorg.apache.cassandra.=
cache.SerializingCacheProvider@1312c88c,mergeShardsChance=3D0.1,keyAlias=3D=
java.nio.HeapByteBuffer[pos=3D0
> lim=3D3 cap=3D3],column_metadata=3D{},compactionStrategyClass=3Dclass
> org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,compactio=
nStrategyOptions=3D{},compressionOptions=3D{sstable_compression=3Dorg.apach=
e.cassandra.io.compress.SnappyCompressor,
> chunk_length_kb=3D64},bloomFilterFpChance=3D<null>]
>
>
> I can also see scrub messages in logs
> Good node:
>  INFO [CompactionExecutor:1774] 2012-09-24 10:09:05,402
> CompactionManager.java (line 476) Scrubbing
> SSTableReader(path=3D'/raid0/cassandra/data/tok/tk_usus_user-hc-264-Data.=
db')
>  INFO [CompactionExecutor:1774] 2012-09-24 10:09:05,934
> CompactionManager.java (line 658) Scrub of
> SSTableReader(path=3D'/raid0/cassandra/data/tok/tk_usus_user-hc-264-Data.=
db')
> complete: 4868 rows in new sstable and 0 empty (tombstoned) rows dropped
>
> Other nodes
>
>  INFO [CompactionExecutor:1800] 2012-09-24 10:09:11,789
> CompactionManager.java (line 476) Scrubbing
> SSTableReader(path=3D'/raid0/cassandra/data/tok/tk_usus_user-hc-260-Data.=
db')
>  INFO [CompactionExecutor:1800] 2012-09-24 10:09:12,464
> CompactionManager.java (line 658) Scrub of
> SSTableReader(path=3D'/raid0/cassandra/data/tok/tk_usus_user-hc-260-Data.=
db')
> complete: 4868 rows in new sstable and 0 empty (tombstoned) rows dropped
>
>  INFO [CompactionExecutor:1687] 2012-09-24 10:09:16,235
> CompactionManager.java (line 476) Scrubbing
> SSTableReader(path=3D'/raid0/cassandra/data/tok/tk_usus_user-hc-271-Data.=
db')
>  INFO [CompactionExecutor:1687] 2012-09-24 10:09:16,898
> CompactionManager.java (line 658) Scrub of
> SSTableReader(path=3D'/raid0/cassandra/data/tok/tk_usus_user-hc-271-Data.=
db')
> compete: 4868 rows in new sstable and 0 empty (tombstoned) rows dropped
>
> Any idea?
> Thanks!!
>
> *Tamar Fraenkel *
> Senior Software Engineer, TOK Media
>
> [image: Inline image 1]
>
>
> tamar@tok-media.com
> Tel:   +972 2 6409736
> Mob:  +972 54 8356490
> Fax:   +972 2 5612956
>
>
>
>
>
> On Wed, Sep 26, 2012 at 3:40 AM, aaron morton <aaron@thelastpickle.com>wr=
ote:
>
>> Check the logs on  nodes 2 and 3 to see if the scrub started. The logs o=
n
>> 1 will be a good help with that.
>>
>> Cheers
>>
>>   -----------------
>> Aaron Morton
>> Freelance Developer
>> @aaronmorton
>> http://www.thelastpickle.com
>>
>> On 24/09/2012, at 10:31 PM, Tamar Fraenkel <tamar@tok-media.com> wrote:
>>
>> Hi!
>> I ran
>> UPDATE COLUMN FAMILY cf_name WITH
>> compression_options=3D{sstable_compression:SnappyCompressor,
>> chunk_length_kb:64};
>>
>> I then ran on all my nodes (3)
>> sudo nodetool -h localhost scrub tok cf_name
>>
>> I have replication factor 3. The size of the data on disk was cut in hal=
f
>> in the first node and in the jmx I can see that indeed the compression
>> ration is 0.46. But on nodes 2 and 3 nothing happened. In the jmx I can =
see
>> that compression ratio is 0 and the size of the files of disk stayed the
>> same.
>>
>> In cli
>>
>> ColumnFamily: cf_name
>>       Key Validation Class: org.apache.cassandra.db.marshal.UUIDType
>>       Default column value validator:
>> org.apache.cassandra.db.marshal.UTF8Type
>>       Columns sorted by:
>> org.apache.cassandra.db.marshal.CompositeType(org.apache.cassandra.db.ma=
rshal.UTF8Type,org.apache.cassandra.db.marshal.UTF8Type)
>>       Row cache size / save period in seconds / keys to save : 0.0/0/all
>>       Row Cache Provider:
>> org.apache.cassandra.cache.SerializingCacheProvider
>>       Key cache size / save period in seconds: 200000.0/14400
>>       GC grace seconds: 864000
>>       Compaction min/max thresholds: 4/32
>>       Read repair chance: 1.0
>>       Replicate on write: true
>>       Bloom Filter FP chance: default
>>       Built indexes: []
>>       Compaction Strategy:
>> org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy
>>       Compression Options:
>>         chunk_length_kb: 64
>>         sstable_compression:
>> org.apache.cassandra.io.compress.SnappyCompressor
>>
>> Can anyone help?
>> Thanks
>>
>>  *Tamar Fraenkel *
>> Senior Software Engineer, TOK Media
>>
>> <tokLogo.png>
>>
>>
>> tamar@tok-media.com
>> Tel:   +972 2 6409736
>> Mob:  +972 54 8356490
>> Fax:   +972 2 5612956
>>
>>
>>
>>
>>
>> On Mon, Sep 24, 2012 at 8:37 AM, Tamar Fraenkel <tamar@tok-media.com>wro=
te:
>>
>>> Thanks all, that helps. Will start with one - two CFs and let you know
>>> the effect
>>>
>>>
>>> *Tamar Fraenkel *
>>> Senior Software Engineer, TOK Media
>>>
>>> <tokLogo.png>
>>>
>>>
>>> tamar@tok-media.com
>>> Tel:   +972 2 6409736
>>> Mob:  +972 54 8356490
>>> Fax:   +972 2 5612956
>>>
>>>
>>>
>>>
>>>
>>> On Sun, Sep 23, 2012 at 8:21 PM, Hiller, Dean <Dean.Hiller@nrel.gov>wro=
te:
>>>
>>>> As well as your unlimited column names may all have the same prefix,
>>>> right? Like "accounts".rowkey56, "accounts".rowkey78, etc. etc.  so th=
e
>>>> "accounts gets a ton of compression then.
>>>>
>>>> Later,
>>>> Dean
>>>>
>>>> From: Tyler Hobbs <tyler@datastax.com<mailto:tyler@datastax.com>>
>>>> Reply-To: "user@cassandra.apache.org<mailto:user@cassandra.apache.org>=
"
>>>> <user@cassandra.apache.org<mailto:user@cassandra.apache.org>>
>>>> Date: Sunday, September 23, 2012 11:46 AM
>>>> To: "user@cassandra.apache.org<mailto:user@cassandra.apache.org>" <
>>>> user@cassandra.apache.org<mailto:user@cassandra.apache.org>>
>>>> Subject: Re: compression
>>>>
>>>>  column metadata, you're still likely to get a reasonable amount of
>>>> compression.  This is especially true if there is some amount of repet=
ition
>>>> in the column names, values, or TTLs in wide rows.  Compression will a=
lmost
>>>> always be beneficial unless you're already somehow CPU bound or are us=
ing
>>>> large column values that are high in entropy, such as pre-compressed o=
r
>>>> encrypted data.
>>>>
>>>
>>>
>>
>>
>

--f46d042c6b8d7f1d5804cac4050f
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Hi!<br>The situation didn&#39;t resolve, does anyone has a=
 clue?<br>Thanks<br><br clear=3D"all"><div dir=3D"ltr"><div dir=3D"ltr"><b>=
Tamar Fraenkel=A0</b><br>Senior Software Engineer, TOK Media=A0<br><br><div=
 dir=3D"ltr">

<img src=3D"cid:ii_135b91fb888fa9ff" alt=3D"Inline image 1"><br><div><br><a=
 href=3D"mailto:tamar@tok-media.com" target=3D"_blank">tamar@tok-media.com<=
/a><br>Tel:=A0=A0=A0<a value=3D"+97226409736">+972 2 6409736</a>=A0<br>Mob:=
=A0=A0<a value=3D"+972548356490">+972 54 8356490</a>=A0<br>

Fax:=A0=A0=A0<a value=3D"+97225612956">+972 2 5612956</a>=A0</div></div><br=
></div><br></div><br>
<br><br><div class=3D"gmail_quote">On Thu, Sep 27, 2012 at 10:42 AM, Tamar =
Fraenkel <span dir=3D"ltr">&lt;<a href=3D"mailto:tamar@tok-media.com" targe=
t=3D"_blank">tamar@tok-media.com</a>&gt;</span> wrote:<br><blockquote class=
=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padd=
ing-left:1ex">

<div dir=3D"ltr">Hi!<br>First, the problem is still there, altough I checke=
d and all node agree on the schema.<br>This is from ls -l<br>Good Node<br>-=
rw-r--r-- 1 cassandra cassandra=A0=A0=A0=A0=A0=A0=A0 606 2012-09-27 08:01 t=
k_usus_user-hc-269-CompressionInfo.db<br>


-rw-r--r-- 1 cassandra cassandra=A0=A0=A0 2246431 2012-09-27 08:01 tk_usus_=
user-hc-269-Data.db<br>-rw-r--r-- 1 cassandra cassandra=A0=A0=A0=A0=A0 1105=
6 2012-09-27 08:01 tk_usus_user-hc-269-Filter.db<br>-rw-r--r-- 1 cassandra =
cassandra=A0=A0=A0=A0 129792 2012-09-27 08:01 tk_usus_user-hc-269-Index.db<=
br>


-rw-r--r-- 1 cassandra cassandra=A0=A0=A0=A0=A0=A0 4336 2012-09-27 08:01 tk=
_usus_user-hc-269-Statistics.db<br><br>Node 2<br>-rw-r--r-- 1 cassandra cas=
sandra=A0=A0=A0 4592393 2012-09-27 08:01 tk_usus_user-hc-268-Data.db<br>-rw=
-r--r-- 1 cassandra cassandra=A0=A0=A0=A0=A0=A0=A0=A0 69 2012-09-27 08:01 t=
k_usus_user-hc-268-Digest.sha1<br>


-rw-r--r-- 1 cassandra cassandra=A0=A0=A0=A0=A0 11056 2012-09-27 08:01 tk_u=
sus_user-hc-268-Filter.db<br>-rw-r--r-- 1 cassandra cassandra=A0=A0=A0=A0 1=
29792 2012-09-27 08:01 tk_usus_user-hc-268-Index.db<br>-rw-r--r-- 1 cassand=
ra cassandra=A0=A0=A0=A0=A0=A0 4336 2012-09-27 08:01 tk_usus_user-hc-268-St=
atistics.db<br>


<br>Node 3<br>-rw-r--r-- 1 cassandra cassandra=A0=A0 4592393 2012-09-27 08:=
01 tk_usus_user-hc-278-Data.db<br>-rw-r--r-- 1 cassandra cassandra=A0=A0=A0=
=A0=A0=A0=A0 69 2012-09-27 08:01 tk_usus_user-hc-278-Digest.sha1<br>-rw-r--=
r-- 1 cassandra cassandra=A0=A0=A0=A0 11056 2012-09-27 08:01 tk_usus_user-h=
c-278-Filter.db<br>


-rw-r--r-- 1 cassandra cassandra=A0=A0=A0 129792 2012-09-27 08:01 tk_usus_u=
ser-hc-278-Index.db<br>-rw-r--r-- 1 cassandra cassandra=A0=A0=A0=A0=A0 4336=
 2012-09-27 08:01 tk_usus_user-hc-278-Statistics.db<br><br>Looking at the l=
ogs, on the &quot;good node&quot; I can see<br>


<br>=A0INFO [MigrationStage:1] 2012-09-24 10:08:16,511 Migration.java (line=
 119) Applying migration c22413b0-062f-11e2-0000-1bcb936807db Update column=
 family to org.apache.cassandra.config.CFMetaData@1dbdcde9[cfId=3D1016,ksNa=
me=3Dtok,cfName=3Dtk_usus_user,cfType=3DStandard,comparator=3Dorg.apache.ca=
ssandra.db.marshal.CompositeType(org.apache.cassandra.db.marshal.UTF8Type,o=
rg.apache.cassandra.db.marshal.UTF8Type),subcolumncomparator=3D&lt;null&gt;=
,comment=3D,rowCacheSize=3D0.0,keyCacheSize=3D200000.0,readRepairChance=3D1=
.0,replicateOnWrite=3Dtrue,gcGraceSeconds=3D864000,defaultValidator=3Dorg.a=
pache.cassandra.db.marshal.UTF8Type,keyValidator=3Dorg.apache.cassandra.db.=
marshal.UUIDType,minCompactionThreshold=3D4,maxCompactionThreshold=3D32,row=
CacheSavePeriodInSeconds=3D0,keyCacheSavePeriodInSeconds=3D14400,rowCacheKe=
ysToSave=3D2147483647,rowCacheProvider=3Dorg.apache.cassandra.cache.Seriali=
zingCacheProvider@3505231c,mergeShardsChance=3D0.1,keyAlias=3Djava.nio.Heap=
ByteBuffer[pos=3D485 lim=3D488 cap=3D653],column_metadata=3D{},compactionSt=
rategyClass=3Dclass org.apache.cassandra.db.compaction.SizeTieredCompaction=
Strategy,compactionStrategyOptions=3D{},compressionOptions=3D{sstable_compr=
ession=3Dorg.apache.cassandra.io.compress.SnappyCompressor, chunk_length_kb=
=3D64},bloomFilterFpChance=3D&lt;null&gt;]<br>


<br>But same can be seen in the logs of the two other nodes:<br>=A0INFO [Mi=
grationStage:1] 2012-09-24 10:08:16,767 Migration.java (line 119) Applying =
migration c22413b0-062f-11e2-0000-1bcb936807db Update column family to org.=
apache.cassandra.config.CFMetaData@24fbb95d[cfId=3D1016,ksName=3Dtok,cfName=
=3Dtk_usus_user,cfType=3DStandard,comparator=3Dorg.apache.cassandra.db.mars=
hal.CompositeType(org.apache.cassandra.db.marshal.UTF8Type,org.apache.cassa=
ndra.db.marshal.UTF8Type),subcolumncomparator=3D&lt;null&gt;,comment=3D,row=
CacheSize=3D0.0,keyCacheSize=3D200000.0,readRepairChance=3D1.0,replicateOnW=
rite=3Dtrue,gcGraceSeconds=3D864000,defaultValidator=3Dorg.apache.cassandra=
.db.marshal.UTF8Type,keyValidator=3Dorg.apache.cassandra.db.marshal.UUIDTyp=
e,minCompactionThreshold=3D4,maxCompactionThreshold=3D32,rowCacheSavePeriod=
InSeconds=3D0,keyCacheSavePeriodInSeconds=3D14400,rowCacheKeysToSave=3D2147=
483647,rowCacheProvider=3Dorg.apache.cassandra.cache.SerializingCacheProvid=
er@a469ba3,mergeShardsChance=3D0.1,keyAlias=3Djava.nio.HeapByteBuffer[pos=
=3D0 lim=3D3 cap=3D3],column_metadata=3D{},compactionStrategyClass=3Dclass =
org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,compactionS=
trategyOptions=3D{},compressionOptions=3D{sstable_compression=3Dorg.apache.=
cassandra.io.compress.SnappyCompressor, chunk_length_kb=3D64},bloomFilterFp=
Chance=3D&lt;null&gt;]<br>


<br>=A0INFO [MigrationStage:1] 2012-09-24 10:08:16,705 Migration.java (line=
 119) Applying migration c22413b0-062f-11e2-0000-1bcb936807db Update column=
 family to org.apache.cassandra.config.CFMetaData@216b6a58[cfId=3D1016,ksNa=
me=3Dtok,cfName=3Dtk_usus_user,cfType=3DStandard,comparator=3Dorg.apache.ca=
ssandra.db.marshal.CompositeType(org.apache.cassandra.db.marshal.UTF8Type,o=
rg.apache.cassandra.db.marshal.UTF8Type),subcolumncomparator=3D&lt;null&gt;=
,comment=3D,rowCacheSize=3D0.0,keyCacheSize=3D200000.0,readRepairChance=3D1=
.0,replicateOnWrite=3Dtrue,gcGraceSeconds=3D864000,defaultValidator=3Dorg.a=
pache.cassandra.db.marshal.UTF8Type,keyValidator=3Dorg.apache.cassandra.db.=
marshal.UUIDType,minCompactionThreshold=3D4,maxCompactionThreshold=3D32,row=
CacheSavePeriodInSeconds=3D0,keyCacheSavePeriodInSeconds=3D14400,rowCacheKe=
ysToSave=3D2147483647,rowCacheProvider=3Dorg.apache.cassandra.cache.Seriali=
zingCacheProvider@1312c88c,mergeShardsChance=3D0.1,keyAlias=3Djava.nio.Heap=
ByteBuffer[pos=3D0 lim=3D3 cap=3D3],column_metadata=3D{},compactionStrategy=
Class=3Dclass org.apache.cassandra.db.compaction.SizeTieredCompactionStrate=
gy,compactionStrategyOptions=3D{},compressionOptions=3D{sstable_compression=
=3Dorg.apache.cassandra.io.compress.SnappyCompressor, chunk_length_kb=3D64}=
,bloomFilterFpChance=3D&lt;null&gt;]<br>


<br><br>I can also see scrub messages in logs<br>Good node:<br>=A0INFO [Com=
pactionExecutor:1774] 2012-09-24 10:09:05,402 CompactionManager.java (line =
476) Scrubbing SSTableReader(path=3D&#39;/raid0/cassandra/data/tok/tk_usus_=
user-hc-264-Data.db&#39;)<br>


=A0INFO [CompactionExecutor:1774] 2012-09-24 10:09:05,934 CompactionManager=
.java (line 658) Scrub of SSTableReader(path=3D&#39;/raid0/cassandra/data/t=
ok/tk_usus_user-hc-264-Data.db&#39;) complete: 4868 rows in new sstable and=
 0 empty (tombstoned) rows dropped<br>


<br>Other nodes<br><br>=A0INFO [CompactionExecutor:1800] 2012-09-24 10:09:1=
1,789 CompactionManager.java (line 476) Scrubbing SSTableReader(path=3D&#39=
;/raid0/cassandra/data/tok/tk_usus_user-hc-260-Data.db&#39;)<br>=A0INFO [Co=
mpactionExecutor:1800] 2012-09-24 10:09:12,464 CompactionManager.java (line=
 658) Scrub of SSTableReader(path=3D&#39;/raid0/cassandra/data/tok/tk_usus_=
user-hc-260-Data.db&#39;) complete: 4868 rows in new sstable and 0 empty (t=
ombstoned) rows dropped<br>


<br>=A0INFO [CompactionExecutor:1687] 2012-09-24 10:09:16,235 CompactionMan=
ager.java (line 476) Scrubbing SSTableReader(path=3D&#39;/raid0/cassandra/d=
ata/tok/tk_usus_user-hc-271-Data.db&#39;)<br>=A0INFO [CompactionExecutor:16=
87] 2012-09-24 10:09:16,898 CompactionManager.java (line 658) Scrub of SSTa=
bleReader(path=3D&#39;/raid0/cassandra/data/tok/tk_usus_user-hc-271-Data.db=
&#39;) compete: 4868 rows in new sstable and 0 empty (tombstoned) rows drop=
ped<br>


<br>Any idea?<br>Thanks!!<br><br clear=3D"all"><div dir=3D"ltr"><div dir=3D=
"ltr"><div class=3D"im"><b>Tamar Fraenkel=A0</b><br>Senior Software Enginee=
r, TOK Media=A0<br><br></div><div dir=3D"ltr"><img src=3D"cid:ii_135b91fb88=
8fa9ff" alt=3D"Inline image 1"><div class=3D"im">

<br><div>
<br><a href=3D"mailto:tamar@tok-media.com" target=3D"_blank">tamar@tok-medi=
a.com</a><br>
Tel:=A0=A0=A0<a value=3D"+97226409736">+972 2 6409736</a>=A0<br>Mob:=A0=A0<=
a value=3D"+972548356490">+972 54 8356490</a>=A0<br>Fax:=A0=A0=A0<a value=
=3D"+97225612956">+972 2 5612956</a>=A0</div></div></div><br></div><br></di=
v><div><div class=3D"h5"><br>


<br><br><div class=3D"gmail_quote">On Wed, Sep 26, 2012 at 3:40 AM, aaron m=
orton <span dir=3D"ltr">&lt;<a href=3D"mailto:aaron@thelastpickle.com" targ=
et=3D"_blank">aaron@thelastpickle.com</a>&gt;</span> wrote:<br><blockquote =
class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid=
;padding-left:1ex">


<div style=3D"word-wrap:break-word">Check the logs on =A0nodes 2 and 3 to s=
ee if the scrub started. The logs on 1 will be a good help with that.=A0<di=
v><br></div><div>Cheers</div><div><br><div>
<span style=3D"text-indent:0px;letter-spacing:normal;font-variant:normal;te=
xt-align:-webkit-auto;font-style:normal;font-weight:normal;line-height:norm=
al;border-collapse:separate;text-transform:none;font-size:medium;white-spac=
e:normal;font-family:Helvetica;word-spacing:0px"><span style=3D"text-indent=
:0px;letter-spacing:normal;font-variant:normal;font-style:normal;font-weigh=
t:normal;line-height:normal;border-collapse:separate;text-transform:none;fo=
nt-size:medium;white-space:normal;font-family:Helvetica;word-spacing:0px"><=
div style=3D"word-wrap:break-word">


<span style=3D"text-indent:0px;letter-spacing:normal;font-variant:normal;fo=
nt-style:normal;font-weight:normal;line-height:normal;border-collapse:separ=
ate;text-transform:none;font-size:medium;white-space:normal;font-family:Hel=
vetica;word-spacing:0px"><div style=3D"word-wrap:break-word">


<span style=3D"text-indent:0px;letter-spacing:normal;font-variant:normal;fo=
nt-style:normal;font-weight:normal;line-height:normal;border-collapse:separ=
ate;text-transform:none;font-size:medium;white-space:normal;font-family:Hel=
vetica;word-spacing:0px"><div style=3D"word-wrap:break-word">


<div><div>-----------------</div><div>Aaron Morton</div><div>Freelance Deve=
loper</div><div>@aaronmorton</div><div><a href=3D"http://www.thelastpickle.=
com" target=3D"_blank">http://www.thelastpickle.com</a></div></div></div></=
span></div>


</span></div></span></span>
</div>

<br><div><div><div><div>On 24/09/2012, at 10:31 PM, Tamar Fraenkel &lt;<a h=
ref=3D"mailto:tamar@tok-media.com" target=3D"_blank">tamar@tok-media.com</a=
>&gt; wrote:</div><br></div></div><blockquote type=3D"cite"><div dir=3D"ltr=
">
<div><div>Hi!<br>I ran <br><span style=3D"color:rgb(0,153,0)">UPDATE COLUMN=
 FAMILY cf_name WITH compression_options=3D{sstable_compression:SnappyCompr=
essor, chunk_length_kb:64};</span><br><br>I then ran on all my nodes (3)<br=
>


<span style=3D"color:rgb(0,153,0)">sudo nodetool -h localhost scrub tok cf_=
name</span><br><br>I have replication factor 3. The size of the data on dis=
k was cut in half in the first node and in the jmx I can see that indeed th=
e compression ration is 0.46. But on nodes 2 and 3 nothing happened. In the=
 jmx I can see that compression ratio is 0 and the size of the files of dis=
k stayed the same.<br>


<br>In cli <br><br><span style=3D"color:rgb(0,153,0)">ColumnFamily: cf_name=
<br>=A0=A0=A0=A0=A0 Key Validation Class: org.apache.cassandra.db.marshal.U=
UIDType<br>=A0=A0=A0=A0=A0 Default column value validator: org.apache.cassa=
ndra.db.marshal.UTF8Type<br>


=A0=A0=A0=A0=A0 Columns sorted by: org.apache.cassandra.db.marshal.Composit=
eType(org.apache.cassandra.db.marshal.UTF8Type,org.apache.cassandra.db.mars=
hal.UTF8Type)<br>=A0=A0=A0=A0=A0 Row cache size / save period in seconds / =
keys to save : 0.0/0/all<br>


=A0=A0=A0=A0=A0 Row Cache Provider: org.apache.cassandra.cache.SerializingC=
acheProvider<br>=A0=A0=A0=A0=A0 Key cache size / save period in seconds: 20=
0000.0/14400<br>=A0=A0=A0=A0=A0 GC grace seconds: 864000<br>=A0=A0=A0=A0=A0=
 Compaction min/max thresholds: 4/32<br>


=A0=A0=A0=A0=A0 Read repair chance: 1.0<br>=A0=A0=A0=A0=A0 Replicate on wri=
te: true<br>=A0=A0=A0=A0=A0 Bloom Filter FP chance: default<br>=A0=A0=A0=A0=
=A0 Built indexes: []<br>=A0=A0=A0=A0=A0 Compaction Strategy: org.apache.ca=
ssandra.db.compaction.SizeTieredCompactionStrategy<br>


=A0=A0=A0=A0=A0 Compression Options:<br>=A0=A0=A0=A0=A0=A0=A0 chunk_length_=
kb: 64<br>=A0=A0=A0=A0=A0=A0=A0 sstable_compression: org.apache.cassandra.i=
o.compress.SnappyCompressor<br></span><br>Can anyone help?<br>Thanks<br><br=
 clear=3D"all"></div></div><div dir=3D"ltr">


<div dir=3D"ltr"><div><div>

<b>Tamar Fraenkel=A0</b><br>Senior Software Engineer, TOK Media=A0<br><br><=
/div></div><div dir=3D"ltr"><span>&lt;tokLogo.png&gt;</span><div><br><div><=
br><a href=3D"mailto:tamar@tok-media.com" target=3D"_blank">tamar@tok-media=
.com</a><br>


Tel:=A0=A0=A0<a value=3D"+97226409736">+972 2 6409736</a>=A0<br>Mob:=A0=A0<=
a value=3D"+972548356490">+972 54 8356490</a>=A0<br>Fax:=A0=A0=A0<a value=
=3D"+97225612956">+972 2 5612956</a>=A0</div></div></div><br></div><br></di=
v><br>
<br><br><div class=3D"gmail_quote"><div>On Mon, Sep 24, 2012 at 8:37 AM, Ta=
mar Fraenkel <span dir=3D"ltr">&lt;<a href=3D"mailto:tamar@tok-media.com" t=
arget=3D"_blank">tamar@tok-media.com</a>&gt;</span> wrote:<br></div>
<blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1p=
x #ccc solid;padding-left:1ex">

<div dir=3D"ltr"><div>Thanks all, that helps. Will start with one - two CFs=
 and let you know the effect</div><div><br><br clear=3D"all"><div dir=3D"lt=
r"><div dir=3D"ltr"><div><b>Tamar Fraenkel=A0</b><br>Senior Software Engine=
er, TOK Media=A0<br>


<br></div><div dir=3D"ltr">
<span>&lt;tokLogo.png&gt;</span><div><br><div><br><a href=3D"mailto:tamar@t=
ok-media.com" target=3D"_blank">tamar@tok-media.com</a><br>Tel:=A0=A0=A0<a =
value=3D"+97226409736">+972 2 6409736</a>=A0<br>Mob:=A0=A0<a value=3D"+9725=
48356490">+972 54 8356490</a>=A0<br>


Fax:=A0=A0=A0<a value=3D"+97225612956">+972 2 5612956</a>=A0</div></div></d=
iv><br></div><br></div><br>
<br><br></div><div><div><div><div class=3D"gmail_quote">On Sun, Sep 23, 201=
2 at 8:21 PM, Hiller, Dean <span dir=3D"ltr">&lt;<a href=3D"mailto:Dean.Hil=
ler@nrel.gov" target=3D"_blank">Dean.Hiller@nrel.gov</a>&gt;</span> wrote:<=
br>


<blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1p=
x #ccc solid;padding-left:1ex">
As well as your unlimited column names may all have the same prefix, right?=
 Like &quot;accounts&quot;.rowkey56, &quot;accounts&quot;.rowkey78, etc. et=
c. =A0so the &quot;accounts gets a ton of compression then.<br>
<br>
Later,<br>
Dean<br>
<br>
From: Tyler Hobbs &lt;<a href=3D"mailto:tyler@datastax.com" target=3D"_blan=
k">tyler@datastax.com</a>&lt;mailto:<a href=3D"mailto:tyler@datastax.com" t=
arget=3D"_blank">tyler@datastax.com</a>&gt;&gt;<br>
Reply-To: &quot;<a href=3D"mailto:user@cassandra.apache.org" target=3D"_bla=
nk">user@cassandra.apache.org</a>&lt;mailto:<a href=3D"mailto:user@cassandr=
a.apache.org" target=3D"_blank">user@cassandra.apache.org</a>&gt;&quot; &lt=
;<a href=3D"mailto:user@cassandra.apache.org" target=3D"_blank">user@cassan=
dra.apache.org</a>&lt;mailto:<a href=3D"mailto:user@cassandra.apache.org" t=
arget=3D"_blank">user@cassandra.apache.org</a>&gt;&gt;<br>


Date: Sunday, September 23, 2012 11:46 AM<br>
To: &quot;<a href=3D"mailto:user@cassandra.apache.org" target=3D"_blank">us=
er@cassandra.apache.org</a>&lt;mailto:<a href=3D"mailto:user@cassandra.apac=
he.org" target=3D"_blank">user@cassandra.apache.org</a>&gt;&quot; &lt;<a hr=
ef=3D"mailto:user@cassandra.apache.org" target=3D"_blank">user@cassandra.ap=
ache.org</a>&lt;mailto:<a href=3D"mailto:user@cassandra.apache.org" target=
=3D"_blank">user@cassandra.apache.org</a>&gt;&gt;<br>


Subject: Re: compression<br>
<div><br>
=A0column metadata, you&#39;re still likely to get a reasonable amount of c=
ompression. =A0This is especially true if there is some amount of repetitio=
n in the column names, values, or TTLs in wide rows. =A0Compression will al=
most always be beneficial unless you&#39;re already somehow CPU bound or ar=
e using large column values that are high in entropy, such as pre-compresse=
d or encrypted data.<br>


</div></blockquote></div><br></div></div></div></div>
</blockquote></div><br></div>
</blockquote></div><br></div></div></blockquote></div><br></div></div></div=
>
</blockquote></div><br></div>

--f46d042c6b8d7f1d5804cac4050f--

--f46d042c6b8d7f1d5b04cac40510
Content-Type: image/png; name="tokLogo.png"
Content-Transfer-Encoding: base64
Content-ID: <ii_135b91fb888fa9ff>
X-Attachment-Id: ii_135b91fb888fa9ff

iVBORw0KGgoAAAANSUhEUgAAAF0AAAAnCAYAAABtyERkAAAABGdBTUEAALGPC/xhBQAACkNpQ0NQ
SUNDIFByb2ZpbGUAAHgBnZZ3VFNZE8Dvey+90BJCkRJ6DU1KAJESepFeRSUkAUIJGBKwV0QFVxQV
aYoiiyIuuLoUWSuiWFgUFLAvyCKgrIuriIplX/QcZf/Y/b6z88ec35s7c+/cmbnnPAAovoFCUSas
AECGSCIO8/FgxsTGMfHdAAZEgAPWAHB52VlB4d4RABU/Lw4zG3WSsUygz/p1/xe4xfINYTI/m/5/
pcjLEkvQnULQkLl8QTYP5TyU03MlWTL7JMr0xDQZwxgZi9EEUVaVcfIXNv/s84XdZMzPEPFRH1nO
WfwMvow7UN6SIxWgjASinJ8jFOSifBtl/XRphhDlNyjTMwTcbAAwFJldIuCloGyFMkUcEcZBeR4A
BEryLE6cxRLBMjRPADiZWcvFwuQUCdOYZ8K0dnRkM30FuekCiYQVwuWlccV8JiczI4srWg7AlzvL
ooCSrLZMtMj21o729iwbC7T8X+VfF796/TvIevvF42Xo555BjK5vtm+x32yZ1QCwp9Da7PhmSywD
oGUTAKr3vtn0DwAgnwdA841Z92HI5iVFIslysrTMzc21EAp4FrKCfpX/6fDV859h1nkWsvO+1o7p
KUjiStMlTFlReZnpmVIxMzuLyxMwWX8bYnTr/xw4K61ZeZiHCZIEYoEIPSoKnTKhKBltt4gvlAgz
RUyh6J86/B/DZuUgwy9zjQKt5iOgL7EACjfoAPm9C2BoZIDE70dXoK99CyRGAdnLi9Ye/TL3KKPr
n/XfFFyEfsLZwmSmzMwJi2DypOIcGaNvQqawgATkAR2oAS2gB4wBC9gAB+AM3IAX8AfBIALEgsWA
B1JABhCDXLAKrAf5oBDsAHtAOagCNaAONIAToAWcBhfAZXAd3AR94D4YBCPgGZgEr8EMBEF4iArR
IDVIGzKAzCAbiA3Nh7ygQCgMioUSoGRIBEmhVdBGqBAqhsqhg1Ad9CN0CroAXYV6oLvQEDQO/Qm9
gxGYAtNhTdgQtoTZsDscAEfAi+BkeCm8As6Dt8OlcDV8DG6GL8DX4T54EH4GTyEAISMMRAdhIWyE
gwQjcUgSIkbWIAVICVKNNCBtSCdyCxlEJpC3GByGhmFiWBhnjC8mEsPDLMWswWzDlGOOYJoxHZhb
mCHMJOYjlorVwJphnbB+2BhsMjYXm48twdZim7CXsH3YEexrHA7HwBnhHHC+uFhcKm4lbhtuH64R
dx7XgxvGTeHxeDW8Gd4FH4zn4iX4fHwZ/hj+HL4XP4J/QyATtAk2BG9CHEFE2EAoIRwlnCX0EkYJ
M0QFogHRiRhM5BOXE4uINcQ24g3iCHGGpEgyIrmQIkippPWkUlID6RLpAeklmUzWJTuSQ8lC8jpy
Kfk4+Qp5iPyWokQxpXAo8RQpZTvlMOU85S7lJZVKNaS6UeOoEup2ah31IvUR9Y0cTc5Czk+OL7dW
rkKuWa5X7rk8Ud5A3l1+sfwK+RL5k/I35CcUiAqGChwFrsIahQqFUwoDClOKNEVrxWDFDMVtikcV
ryqOKeGVDJW8lPhKeUqHlC4qDdMQmh6NQ+PRNtJqaJdoI3Qc3YjuR0+lF9J/oHfTJ5WVlG2Vo5SX
KVcon1EeZCAMQ4YfI51RxDjB6Ge8U9FUcVcRqGxVaVDpVZlWnaPqpipQLVBtVO1TfafGVPNSS1Pb
qdai9lAdo26qHqqeq75f/ZL6xBz6HOc5vDkFc07MuacBa5hqhGms1Dik0aUxpaml6aOZpVmmeVFz
Qouh5aaVqrVb66zWuDZNe762UHu39jntp0xlpjsznVnK7GBO6mjo+OpIdQ7qdOvM6BrpRupu0G3U
fahH0mPrJent1mvXm9TX1g/SX6Vfr3/PgGjANkgx2GvQaTBtaGQYbbjZsMVwzEjVyM9ohVG90QNj
qrGr8VLjauPbJjgTtkmayT6Tm6awqZ1pimmF6Q0z2MzeTGi2z6zHHGvuaC4yrzYfYFFY7qwcVj1r
yIJhEWixwaLF4rmlvmWc5U7LTsuPVnZW6VY1Vvetlaz9rTdYt1n/aWNqw7OpsLk9lzrXe+7aua1z
X9ia2Qps99vesaPZBdlttmu3+2DvYC+2b7Afd9B3SHCodBhg09kh7G3sK45YRw/HtY6nHd862TtJ
nE44/eHMck5zPuo8Ns9onmBezbxhF10XrstBl8H5zPkJ8w/MH3TVceW6Vrs+dtNz47vVuo26m7in
uh9zf+5h5SH2aPKY5jhxVnPOeyKePp4Fnt1eSl6RXuVej7x1vZO9670nfex8Vvqc98X6Bvju9B3w
0/Tj+dX5Tfo7+K/27wigBIQHlAc8DjQNFAe2BcFB/kG7gh4sMFggWtASDIL9gncFPwwxClka8nMo
LjQktCL0SZh12KqwznBa+JLwo+GvIzwiiiLuRxpHSiPbo+Sj4qPqoqajPaOLowdjLGNWx1yPVY8V
xrbG4eOi4mrjphZ6LdyzcCTeLj4/vn+R0aJli64uVl+cvvjMEvkl3CUnE7AJ0QlHE95zg7nV3KlE
v8TKxEkeh7eX94zvxt/NHxe4CIoFo0kuScVJY8kuybuSx1NcU0pSJoQcYbnwRapvalXqdFpw2uG0
T+nR6Y0ZhIyEjFMiJVGaqCNTK3NZZk+WWVZ+1uBSp6V7lk6KA8S12VD2ouxWCR39meqSGks3SYdy
5udU5LzJjco9uUxxmWhZ13LT5VuXj67wXvH9SsxK3sr2VTqr1q8aWu2++uAaaE3imva1emvz1o6s
81l3ZD1pfdr6XzZYbSje8Gpj9Ma2PM28dXnDm3w21efL5YvzBzY7b67agtki3NK9de7Wsq0fC/gF
1wqtCksK32/jbbv2nfV3pd992p60vbvIvmj/DtwO0Y7+na47jxQrFq8oHt4VtKt5N3N3we5Xe5bs
uVpiW1K1l7RXunewNLC0tUy/bEfZ+/KU8r4Kj4rGSo3KrZXT+/j7eve77W+o0qwqrHp3QHjgzkGf
g83VhtUlh3CHcg49qYmq6fye/X1drXptYe2Hw6LDg0fCjnTUOdTVHdU4WlQP10vrx4/FH7v5g+cP
rQ2shoONjMbC4+C49PjTHxN+7D8RcKL9JPtkw08GP1U20ZoKmqHm5c2TLSktg62xrT2n/E+1tzm3
Nf1s8fPh0zqnK84onyk6Szqbd/bTuRXnps5nnZ+4kHxhuH1J+/2LMRdvd4R2dF8KuHTlsvfli53u
neeuuFw5fdXp6qlr7Gst1+2vN3fZdTX9YvdLU7d9d/MNhxutNx1vtvXM6znb69p74Zbnrcu3/W5f
71vQ19Mf2X9nIH5g8A7/ztjd9Lsv7uXcm7m/7gH2QcFDhYcljzQeVf9q8mvjoP3gmSHPoa7H4Y/v
D/OGn/2W/dv7kbwn1Cclo9qjdWM2Y6fHvcdvPl34dORZ1rOZifzfFX+vfG78/Kc/3P7omoyZHHkh
fvHpz20v1V4efmX7qn0qZOrR64zXM9MFb9TeHHnLftv5Lvrd6Ezue/z70g8mH9o+Bnx88Cnj06e/
AAOb8/zszueKAAAACXBIWXMAAA7DAAAOwwHHb6hkAAAHmklEQVRoBeVaa0wUVxQ+uzPLLqj1lbRW
IkKKYgNq0WpRq0mjEWJRqVaLGmoCFdpCpYhGLP6hlvpCWl+NmGATFYH+qPhqq9W0wSqgLYhPFCxI
Q2L7oyjCPthX7xkY2MedYRaGWbAnmcy959x77plvzp69c+5R2QnBICLLn7UAqg6D2aAJg8jyblPZ
7ubAatma/wVzVSVYblaB7U4l2OquAfgQGxlyodV4qQn+rAqYKZGgDp4M7MSpwASFgHr4KCIcuKRC
T3/8+G8oLi7uVyvnzZsL4eHhomvYDQYw37gBphMFYC09D6AhP0ICrkpDprGkLQB614vAF0Iudnos
aGa9DZqps0TXcxWePn0G6uvrXdkQFBQES5YsduPTGFKw5DzdaDRAeXkFTYdsvNDQUFFdpp8vgiF7
O9ibGjtARqB7SZbKIsDL5D8DdKsyuF+AFFUIeF9wMBqN8NVXX0NjY6PgckuXLsYfqHfJ2tQELR+l
gD7+Y7A/+ktWY2xN10Gfsxz0x3aD3WSQVberMgR8z57cHgGPjY31Lujm6mp4tup9sJ694PoMsvYt
l/OgbUc8WP9pklUvr4wH/PbtOzzL7Y4ejoAjceHFbYQCjParZdD23lpJK7FRq4Cd9jq3a2FCOsMU
2cFYa++A3dAGtkf3wPJ7oaguzut3xoHf5mPAvOgvOtYToaeAo26vgI4hRZ+xVfTZ2HdiQbt8BWgm
TxEcxwYGd8nspkyw1NwAc9k5Es/pL8D+rBH0BPihX54Dlda3a25fGgUFJ0Cqh/PrcKAHBgZCYWEB
z6PeGxoaYMuWTKps+/ZsQB1SCHcorWkbwV5Pj99MVBT4paYCG9wNqBS9Kq2O7FYiuMvyYAUYC3eA
rYlsM10IgTd8mw1+H37hIvG8W1RUBBcvXhKc6BhSHAcp/kdqOn8BbGV/ONrQ1dZuTocX9u/3GPAu
BZ0NduIUGJJxBNi5Sa4iro87G3N1GVUmlYmAnzp1RnC4EOA4QVHQ0cuNufuohmoz04n30UGiTuiB
iZ7vF7cJNJGbqCNNJXQ7qINdmH0BHFUpCnr7b1eoYUXzSaKsgDtipIteC0xIlCOLa+Mfq+VBtRu/
J8aVK1d77eG8bmVB/+VXfl2nu9+6BKe+nB30eN2KT6kqzbc8CzFVVVVw4MBBqi5kioUUx0mKgm45
9p3j2lwbvVw9cqQbX04GExAMav+ZbiptDbfceEIMBHzXrhwhsWTAUQG3exHUJKMAt4k00kwTz8fQ
5vSGx86MhvaTzrsZ632S35FANTU1oukBqR7OL6WYp9v1en5NpzsTON6p318dle/QXqt+8uSp6Ny2
NvqzCU1SDHQhA54HPu7V8Q9WKikGunr0aKpN1oZHVL7cTLuhVW6VTvqOHz8OmNaVQsqBPop+sGCu
rJJiZ5/HWK6dddPBhES68XrLwBCUn58PmIvpiRQDHQ3RpKxzs8e8/zDYmpvd+HIyzDfLqSkB5tXZ
Hi8zYsRwwTmYgykpKRGU8wJFQfeZ+ya/rtO9LSfXqS9nx24ygukk/etTE+a+jRRbOywslBxS5ALe
hQhTA7jbESNFQdeEvwaqoHFu9liOFoP+UJ4bv68MBFx/YCPVy9XkVIkJmCB5CQQ6PX0D6HQ6SEgQ
/5jbu3cfiO14FAVd5esLug3rqQ9qyt4DrbtzwC4hJlIVuDB5wK33f3KRdHTxGE8qBQQEdAGOc8aM
eQlSUpIFpyPgBw8Kf7kqCjpaqYtZCkz0QqrB5m8OQ0t8PFjq6qhyqcz2ikvQmhkNQoBj9hErB6TS
2LEvcx7uOH7OnNkQEfGGI8upjfEdD7pppDjoaMTQ7M+pYQZltuskEXX3LjY9ItvTZmgvJ2BnrQZj
fhLYWxqo83HH4rsyhSrzlJmUlAhif6yFhUWA5xCupFgawHFhNdk+Dis8yp2PCh1mOI7Htu1JM5jL
S7kjO67YiBzXIVkbH4DtIamNwQMLhjDw6pSh3JFUwwJAF/eZbKdGGN9TU9dDVtY2x2Wc2jt37uL+
fHEsT14BHRdn/P054Fsi3uJtod4tD+ug/YeTYP7+UM91L1QNHUzOwz/YJnsh0qRJk7hkl9CBBsb3
vLzD3MvhzfMa6GgAAi9E7RXlYDy0D2z3rnUWGwmN7JnvE5MF2vnLZPNw1xVjYmKgqqpasPwCa2lC
Qy/BggXzualeiemuRrv2jRnpoE+MA9st56yg67ie+uy0WBiy9UfQLVrTb4CjDRg60tLoOXvexvz8
I11pggEJOm9ob++ayI0c2Hj47MlevLfr4TzcRiYkxIuqwOovTBN4NbyIWihRqB4/gxxQvAJMGPnY
8Q8ENkT6VlDiEpKHYfioqKgQLMnAcjss2Rg0oKtDZoA2IZXUwZCvWp08NSuS0fRgYHJyMilV2SL4
RYppYMmg68iDCn0MoKy/iF1Eio6WkaKjsP734CBSnUsjIT5tLO7bExPXQWnpZZqY43Gl0oJSBQTN
4yZ2r4IuQEqisTTaJy0ddO+uJOen9JRw96TB15Ls6Uo8mnrmdNCuJp69cCFgnuZ5pQEBOuZidHFr
wGe2Z0X8g/WleD28WGprgZ0gPcU6WIF2tNvroDsa839pP5cfRwP95f0HN8yA0D1xOrwAAAAASUVO
RK5CYII=
--f46d042c6b8d7f1d5b04cac40510
Content-Type: image/png; name="tokLogo.png"
Content-Transfer-Encoding: base64
Content-ID: <ii_135b91fb888fa9ff>
X-Attachment-Id: ii_135b91fb888fa9ff

iVBORw0KGgoAAAANSUhEUgAAAF0AAAAnCAYAAABtyERkAAAABGdBTUEAALGPC/xhBQAACkNpQ0NQ
SUNDIFByb2ZpbGUAAHgBnZZ3VFNZE8Dvey+90BJCkRJ6DU1KAJESepFeRSUkAUIJGBKwV0QFVxQV
aYoiiyIuuLoUWSuiWFgUFLAvyCKgrIuriIplX/QcZf/Y/b6z88ec35s7c+/cmbnnPAAovoFCUSas
AECGSCIO8/FgxsTGMfHdAAZEgAPWAHB52VlB4d4RABU/Lw4zG3WSsUygz/p1/xe4xfINYTI/m/5/
pcjLEkvQnULQkLl8QTYP5TyU03MlWTL7JMr0xDQZwxgZi9EEUVaVcfIXNv/s84XdZMzPEPFRH1nO
WfwMvow7UN6SIxWgjASinJ8jFOSifBtl/XRphhDlNyjTMwTcbAAwFJldIuCloGyFMkUcEcZBeR4A
BEryLE6cxRLBMjRPADiZWcvFwuQUCdOYZ8K0dnRkM30FuekCiYQVwuWlccV8JiczI4srWg7AlzvL
ooCSrLZMtMj21o729iwbC7T8X+VfF796/TvIevvF42Xo555BjK5vtm+x32yZ1QCwp9Da7PhmSywD
oGUTAKr3vtn0DwAgnwdA841Z92HI5iVFIslysrTMzc21EAp4FrKCfpX/6fDV859h1nkWsvO+1o7p
KUjiStMlTFlReZnpmVIxMzuLyxMwWX8bYnTr/xw4K61ZeZiHCZIEYoEIPSoKnTKhKBltt4gvlAgz
RUyh6J86/B/DZuUgwy9zjQKt5iOgL7EACjfoAPm9C2BoZIDE70dXoK99CyRGAdnLi9Ye/TL3KKPr
n/XfFFyEfsLZwmSmzMwJi2DypOIcGaNvQqawgATkAR2oAS2gB4wBC9gAB+AM3IAX8AfBIALEgsWA
B1JABhCDXLAKrAf5oBDsAHtAOagCNaAONIAToAWcBhfAZXAd3AR94D4YBCPgGZgEr8EMBEF4iArR
IDVIGzKAzCAbiA3Nh7ygQCgMioUSoGRIBEmhVdBGqBAqhsqhg1Ad9CN0CroAXYV6oLvQEDQO/Qm9
gxGYAtNhTdgQtoTZsDscAEfAi+BkeCm8As6Dt8OlcDV8DG6GL8DX4T54EH4GTyEAISMMRAdhIWyE
gwQjcUgSIkbWIAVICVKNNCBtSCdyCxlEJpC3GByGhmFiWBhnjC8mEsPDLMWswWzDlGOOYJoxHZhb
mCHMJOYjlorVwJphnbB+2BhsMjYXm48twdZim7CXsH3YEexrHA7HwBnhHHC+uFhcKm4lbhtuH64R
dx7XgxvGTeHxeDW8Gd4FH4zn4iX4fHwZ/hj+HL4XP4J/QyATtAk2BG9CHEFE2EAoIRwlnCX0EkYJ
M0QFogHRiRhM5BOXE4uINcQ24g3iCHGGpEgyIrmQIkippPWkUlID6RLpAeklmUzWJTuSQ8lC8jpy
Kfk4+Qp5iPyWokQxpXAo8RQpZTvlMOU85S7lJZVKNaS6UeOoEup2ah31IvUR9Y0cTc5Czk+OL7dW
rkKuWa5X7rk8Ud5A3l1+sfwK+RL5k/I35CcUiAqGChwFrsIahQqFUwoDClOKNEVrxWDFDMVtikcV
ryqOKeGVDJW8lPhKeUqHlC4qDdMQmh6NQ+PRNtJqaJdoI3Qc3YjuR0+lF9J/oHfTJ5WVlG2Vo5SX
KVcon1EeZCAMQ4YfI51RxDjB6Ge8U9FUcVcRqGxVaVDpVZlWnaPqpipQLVBtVO1TfafGVPNSS1Pb
qdai9lAdo26qHqqeq75f/ZL6xBz6HOc5vDkFc07MuacBa5hqhGms1Dik0aUxpaml6aOZpVmmeVFz
Qouh5aaVqrVb66zWuDZNe762UHu39jntp0xlpjsznVnK7GBO6mjo+OpIdQ7qdOvM6BrpRupu0G3U
fahH0mPrJent1mvXm9TX1g/SX6Vfr3/PgGjANkgx2GvQaTBtaGQYbbjZsMVwzEjVyM9ohVG90QNj
qrGr8VLjauPbJjgTtkmayT6Tm6awqZ1pimmF6Q0z2MzeTGi2z6zHHGvuaC4yrzYfYFFY7qwcVj1r
yIJhEWixwaLF4rmlvmWc5U7LTsuPVnZW6VY1Vvetlaz9rTdYt1n/aWNqw7OpsLk9lzrXe+7aua1z
X9ia2Qps99vesaPZBdlttmu3+2DvYC+2b7Afd9B3SHCodBhg09kh7G3sK45YRw/HtY6nHd862TtJ
nE44/eHMck5zPuo8Ns9onmBezbxhF10XrstBl8H5zPkJ8w/MH3TVceW6Vrs+dtNz47vVuo26m7in
uh9zf+5h5SH2aPKY5jhxVnPOeyKePp4Fnt1eSl6RXuVej7x1vZO9670nfex8Vvqc98X6Bvju9B3w
0/Tj+dX5Tfo7+K/27wigBIQHlAc8DjQNFAe2BcFB/kG7gh4sMFggWtASDIL9gncFPwwxClka8nMo
LjQktCL0SZh12KqwznBa+JLwo+GvIzwiiiLuRxpHSiPbo+Sj4qPqoqajPaOLowdjLGNWx1yPVY8V
xrbG4eOi4mrjphZ6LdyzcCTeLj4/vn+R0aJli64uVl+cvvjMEvkl3CUnE7AJ0QlHE95zg7nV3KlE
v8TKxEkeh7eX94zvxt/NHxe4CIoFo0kuScVJY8kuybuSx1NcU0pSJoQcYbnwRapvalXqdFpw2uG0
T+nR6Y0ZhIyEjFMiJVGaqCNTK3NZZk+WWVZ+1uBSp6V7lk6KA8S12VD2ouxWCR39meqSGks3SYdy
5udU5LzJjco9uUxxmWhZ13LT5VuXj67wXvH9SsxK3sr2VTqr1q8aWu2++uAaaE3imva1emvz1o6s
81l3ZD1pfdr6XzZYbSje8Gpj9Ma2PM28dXnDm3w21efL5YvzBzY7b67agtki3NK9de7Wsq0fC/gF
1wqtCksK32/jbbv2nfV3pd992p60vbvIvmj/DtwO0Y7+na47jxQrFq8oHt4VtKt5N3N3we5Xe5bs
uVpiW1K1l7RXunewNLC0tUy/bEfZ+/KU8r4Kj4rGSo3KrZXT+/j7eve77W+o0qwqrHp3QHjgzkGf
g83VhtUlh3CHcg49qYmq6fye/X1drXptYe2Hw6LDg0fCjnTUOdTVHdU4WlQP10vrx4/FH7v5g+cP
rQ2shoONjMbC4+C49PjTHxN+7D8RcKL9JPtkw08GP1U20ZoKmqHm5c2TLSktg62xrT2n/E+1tzm3
Nf1s8fPh0zqnK84onyk6Szqbd/bTuRXnps5nnZ+4kHxhuH1J+/2LMRdvd4R2dF8KuHTlsvfli53u
neeuuFw5fdXp6qlr7Gst1+2vN3fZdTX9YvdLU7d9d/MNhxutNx1vtvXM6znb69p74Zbnrcu3/W5f
71vQ19Mf2X9nIH5g8A7/ztjd9Lsv7uXcm7m/7gH2QcFDhYcljzQeVf9q8mvjoP3gmSHPoa7H4Y/v
D/OGn/2W/dv7kbwn1Cclo9qjdWM2Y6fHvcdvPl34dORZ1rOZifzfFX+vfG78/Kc/3P7omoyZHHkh
fvHpz20v1V4efmX7qn0qZOrR64zXM9MFb9TeHHnLftv5Lvrd6Ezue/z70g8mH9o+Bnx88Cnj06e/
AAOb8/zszueKAAAACXBIWXMAAA7DAAAOwwHHb6hkAAAHmklEQVRoBeVaa0wUVxQ+uzPLLqj1lbRW
IkKKYgNq0WpRq0mjEWJRqVaLGmoCFdpCpYhGLP6hlvpCWl+NmGATFYH+qPhqq9W0wSqgLYhPFCxI
Q2L7oyjCPthX7xkY2MedYRaGWbAnmcy959x77plvzp69c+5R2QnBICLLn7UAqg6D2aAJg8jyblPZ
7ubAatma/wVzVSVYblaB7U4l2OquAfgQGxlyodV4qQn+rAqYKZGgDp4M7MSpwASFgHr4KCIcuKRC
T3/8+G8oLi7uVyvnzZsL4eHhomvYDQYw37gBphMFYC09D6AhP0ICrkpDprGkLQB614vAF0Iudnos
aGa9DZqps0TXcxWePn0G6uvrXdkQFBQES5YsduPTGFKw5DzdaDRAeXkFTYdsvNDQUFFdpp8vgiF7
O9ibGjtARqB7SZbKIsDL5D8DdKsyuF+AFFUIeF9wMBqN8NVXX0NjY6PgckuXLsYfqHfJ2tQELR+l
gD7+Y7A/+ktWY2xN10Gfsxz0x3aD3WSQVberMgR8z57cHgGPjY31Lujm6mp4tup9sJ694PoMsvYt
l/OgbUc8WP9pklUvr4wH/PbtOzzL7Y4ejoAjceHFbYQCjParZdD23lpJK7FRq4Cd9jq3a2FCOsMU
2cFYa++A3dAGtkf3wPJ7oaguzut3xoHf5mPAvOgvOtYToaeAo26vgI4hRZ+xVfTZ2HdiQbt8BWgm
TxEcxwYGd8nspkyw1NwAc9k5Es/pL8D+rBH0BPihX54Dlda3a25fGgUFJ0Cqh/PrcKAHBgZCYWEB
z6PeGxoaYMuWTKps+/ZsQB1SCHcorWkbwV5Pj99MVBT4paYCG9wNqBS9Kq2O7FYiuMvyYAUYC3eA
rYlsM10IgTd8mw1+H37hIvG8W1RUBBcvXhKc6BhSHAcp/kdqOn8BbGV/ONrQ1dZuTocX9u/3GPAu
BZ0NduIUGJJxBNi5Sa4iro87G3N1GVUmlYmAnzp1RnC4EOA4QVHQ0cuNufuohmoz04n30UGiTuiB
iZ7vF7cJNJGbqCNNJXQ7qINdmH0BHFUpCnr7b1eoYUXzSaKsgDtipIteC0xIlCOLa+Mfq+VBtRu/
J8aVK1d77eG8bmVB/+VXfl2nu9+6BKe+nB30eN2KT6kqzbc8CzFVVVVw4MBBqi5kioUUx0mKgm45
9p3j2lwbvVw9cqQbX04GExAMav+ZbiptDbfceEIMBHzXrhwhsWTAUQG3exHUJKMAt4k00kwTz8fQ
5vSGx86MhvaTzrsZ632S35FANTU1oukBqR7OL6WYp9v1en5NpzsTON6p318dle/QXqt+8uSp6Ny2
NvqzCU1SDHQhA54HPu7V8Q9WKikGunr0aKpN1oZHVL7cTLuhVW6VTvqOHz8OmNaVQsqBPop+sGCu
rJJiZ5/HWK6dddPBhES68XrLwBCUn58PmIvpiRQDHQ3RpKxzs8e8/zDYmpvd+HIyzDfLqSkB5tXZ
Hi8zYsRwwTmYgykpKRGU8wJFQfeZ+ya/rtO9LSfXqS9nx24ygukk/etTE+a+jRRbOywslBxS5ALe
hQhTA7jbESNFQdeEvwaqoHFu9liOFoP+UJ4bv68MBFx/YCPVy9XkVIkJmCB5CQQ6PX0D6HQ6SEgQ
/5jbu3cfiO14FAVd5esLug3rqQ9qyt4DrbtzwC4hJlIVuDB5wK33f3KRdHTxGE8qBQQEdAGOc8aM
eQlSUpIFpyPgBw8Kf7kqCjpaqYtZCkz0QqrB5m8OQ0t8PFjq6qhyqcz2ikvQmhkNQoBj9hErB6TS
2LEvcx7uOH7OnNkQEfGGI8upjfEdD7pppDjoaMTQ7M+pYQZltuskEXX3LjY9ItvTZmgvJ2BnrQZj
fhLYWxqo83HH4rsyhSrzlJmUlAhif6yFhUWA5xCupFgawHFhNdk+Dis8yp2PCh1mOI7Htu1JM5jL
S7kjO67YiBzXIVkbH4DtIamNwQMLhjDw6pSh3JFUwwJAF/eZbKdGGN9TU9dDVtY2x2Wc2jt37uL+
fHEsT14BHRdn/P054Fsi3uJtod4tD+ug/YeTYP7+UM91L1QNHUzOwz/YJnsh0qRJk7hkl9CBBsb3
vLzD3MvhzfMa6GgAAi9E7RXlYDy0D2z3rnUWGwmN7JnvE5MF2vnLZPNw1xVjYmKgqqpasPwCa2lC
Qy/BggXzualeiemuRrv2jRnpoE+MA9st56yg67ie+uy0WBiy9UfQLVrTb4CjDRg60tLoOXvexvz8
I11pggEJOm9ob++ayI0c2Hj47MlevLfr4TzcRiYkxIuqwOovTBN4NbyIWihRqB4/gxxQvAJMGPnY
8Q8ENkT6VlDiEpKHYfioqKgQLMnAcjss2Rg0oKtDZoA2IZXUwZCvWp08NSuS0fRgYHJyMilV2SL4
RYppYMmg68iDCn0MoKy/iF1Eio6WkaKjsP734CBSnUsjIT5tLO7bExPXQWnpZZqY43Gl0oJSBQTN
4yZ2r4IuQEqisTTaJy0ddO+uJOen9JRw96TB15Ls6Uo8mnrmdNCuJp69cCFgnuZ5pQEBOuZidHFr
wGe2Z0X8g/WleD28WGprgZ0gPcU6WIF2tNvroDsa839pP5cfRwP95f0HN8yA0D1xOrwAAAAASUVO
RK5CYII=
--f46d042c6b8d7f1d5b04cac40510--