Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 7F1A191D4 for ; Wed, 8 Feb 2012 08:51:26 +0000 (UTC) Received: (qmail 9283 invoked by uid 500); 8 Feb 2012 08:51:22 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 8864 invoked by uid 500); 8 Feb 2012 08:51:11 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 8848 invoked by uid 99); 8 Feb 2012 08:51:08 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 08 Feb 2012 08:51:08 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of shubham.k@gmail.com designates 209.85.210.172 as permitted sender) Received: from [209.85.210.172] (HELO mail-iy0-f172.google.com) (209.85.210.172) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 08 Feb 2012 08:51:03 +0000 Received: by iagf6 with SMTP id f6so668891iag.31 for ; Wed, 08 Feb 2012 00:50:43 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=oOQ+jBEswUHWQOHVltzYmhy3F/xq/hOjPq+HJZSvkzM=; b=bUMB10HwxCFUVRP7Ifx81AFLm8blamCyegQhZxJBMRKp0m9RImdgd/uUlYzm3WnA6D p5yZlOwh7Y+jQQ5aeQK6JCwd8skmQ6d4Kg/z0LqAgt1I4/hxztHbGxaiCRbtSVWw5tZG R3THSdJ35mKxphnS7Q9k5DfjqXHytkY4ASBIQ= MIME-Version: 1.0 Received: by 10.50.34.202 with SMTP id b10mr31908858igj.2.1328691042893; Wed, 08 Feb 2012 00:50:42 -0800 (PST) Received: by 10.231.84.74 with HTTP; Wed, 8 Feb 2012 00:50:42 -0800 (PST) In-Reply-To: References: <1328331236.48734.ezmlm@cassandra.apache.org> <396700C1-6066-4236-BC66-AF795B7E2EFD@thelastpickle.com> Date: Wed, 8 Feb 2012 14:20:42 +0530 Message-ID: Subject: Re: Cassandra Compaction is Killing From: shubham srivastava To: user@cassandra.apache.org Content-Type: multipart/alternative; boundary=14dae9340f9da0c0dc04b86ffd9a --14dae9340f9da0c0dc04b86ffd9a Content-Type: text/plain; charset=ISO-8859-1 did all the same 1.Disabled all row chaches 2.Heap Memory to 8Gb , young Gen reduced to 2Gb 3.in memory compaction to 2 Still the problem persists. I tried reducing the read_repair_chance from 1 to 0.1 , this helped a bit so I can run some fairly small write jobs without getting some nodes hanging, infact I tried this with a test setup on 2 nodes only so may need to test it across a bigger cluster. I also ran a write job on a node on which I disabled gossip and without much hassles It was successful although I can see mutable requests getting dropped on the other node. The problem with this is I need to repair the other node to get the same data on the write node.this should have synched in quick time. In cassandra if I need to write in a single node and when all the writes are finished on this then get the syncing done with other nodes, is this a normal scenario etc or how should I do it without because my guess is the way solr is writing data to cassandra is a problem , its actually streaming couple of data together(512 docs at a time) and then dumping it. Regards, Shubham On Wed, Feb 8, 2012 at 12:57 AM, aaron morton wrote: > Is Cassandra logging messages about the the heap been full, what are they > saying ? > > They are saying http://khaaan.com/ > > You do not have enough memory allocated to the JVM to work efficiently, > that needs to be fixed. > > First step, disable all row and key caches until you get stable. > > The size of memory is there a way to calculate the max required or I have > to hit and try. > > The best approach is to let Cassandra take care of it. See the > conf/cassandra-env.sh . The maximum useful heap size is 8GB. > > When you say memtable threshold is 0.75 do you mean > the memtable_total_space_in_mb setting in yaml ? > I am talking of : flush_largest_memtables_at: 0.75 > > That is a safety valve, the fact that is it trigger is a symptom of memory > issues. see > http://thelastpickle.com/2011/05/04/How-are-Memtables-measured/ > > Are you talking of in_memory_compaction_limit_in_mb which is by default > 1/3 of heap size. > > in_memory_compaction_limit defaults to 64MB and influences how much memory > compaction will use > see > https://github.com/apache/cassandra/blob/trunk/conf/cassandra.yaml#L334 > > Is RF:7 increasing the pressure as well. But if I reduce it to say 4 I am > effectively putting the load to only 4 servers as Solandra writes all the > docs driven by a max_docs_per_shard_size (which is 1Million) to a single > shard (single physical node:-> it uses it own partitioner) and I have total > docs as 300K. > > > I do not know that much about solandra. > > I would do this: > * disable all the caches > * allocate more memory / let cassandra take care of it (you have a high > setting for the young gen). > * consider reducing the in_memory_compaction_limit > > Cheers > > ----------------- > Aaron Morton > Freelance Developer > @aaronmorton > http://www.thelastpickle.com > > On 7/02/2012, at 2:46 PM, shubham srivastava wrote: > > Hi Aaron, > > Is Cassandra logging messages about the the heap been full, what are they > saying ? > > Most of the times but not always below logs are published by cassandra: > > WARN [ScheduledTasks:1] 2012-02-06 22:17:50,375 GCInspector.java (line > 143) Heap is 0.784281626909687 full. You may need to reduce memtable > and/or cache sizes. Cassandra will now flush up to the two largest > memtables to free up memory. Adjust flush_largest_memtables_at threshold > in cassandra.yaml if you don't want Cassandra to do this automatically > WARN [ScheduledTasks:1] 2012-02-06 22:17:50,376 StorageService.java (line > 2418) Flushing ColumnFamilyStore(table='LH', > columnFamily='SavedSearchRequest') to relieve memory pressure > INFO [ScheduledTasks:1] 2012-02-06 22:17:50,629 ColumnFamilyStore.java > (line 1128) Enqueuing flush of Memtable-SavedSearchRequest@568443115(6964940/13461931 > serialized/live bytes, 5794 ops) > WARN [ScheduledTasks:1] 2012-02-06 22:17:51,242 StorageService.java (line > 2422) Flushing ColumnFamilyStore(table='LH', columnFamily='BookedHotels') > to relieve memory pressure > INFO [ScheduledTasks:1] 2012-02-06 22:17:51,242 ColumnFamilyStore.java > (line 1128) Enqueuing flush of Memtable-BookedHotels@2031509445(1575/1968 > serialized/live bytes, 35 ops) > INFO [FlushWriter:5] 2012-02-06 22:17:51,244 Memtable.java (line 237) > Writing Memtable-SavedSearchRequest@568443115(6964940/13461931 > serialized/live bytes, 5794 ops) > INFO [ScheduledTasks:1] 2012-02-06 22:18:03,144 GCInspector.java (line > 122) GC for ConcurrentMarkSweep: 3783 ms for 2 collections, 2785603776 > used; max is 6120341504 > > When you say memtable threshold is 0.75 do you mean > the memtable_total_space_in_mb setting in yaml ? > I am talking of : flush_largest_memtables_at: 0.75 > > Wide rows, such as the TL column family in the L keyspace can increase the >> about of GC work that goes on. This can be somewhat alleviated by reducing >> the in_memory_compaction_limit_in_mb , this will increase the amount of IO >> that is needed. >> > > Are you talking of in_memory_compaction_limit_in_mb which is by default > 1/3 of heap size. > > > Heavy write traffic can also increase GC activity. Watch the tp stats >> during the load process, are you overloading the cluster ? Do you see >> pending tasks backing up ? >> > > Yes :Below are the same: > #TpStats > > Pool Name Active Pending Completed Blocked > All time blocked > ReadStage 32 922 159030 0 > 0 > RequestResponseStage 0 0 4563 0 > 0 > MutationStage 0 0 249357 0 > 0 > ReadRepairStage 0 0 3 0 > 0 > ReplicateOnWriteStage 0 0 0 0 > 0 > GossipStage 0 0 4670 0 > 0 > AntiEntropyStage 0 0 0 0 > 0 > MigrationStage 0 0 0 0 > 0 > MemtablePostFlusher 0 0 19 0 > 0 > StreamStage 0 0 0 0 > 0 > FlushWriter 0 0 19 0 > 5 > MiscStage 0 0 0 0 > 0 > FlushSorter 0 0 0 0 > 0 > InternalResponseStage 0 0 0 0 > 0 > HintedHandoff 0 0 8 0 > 0 > > Message type Dropped > RANGE_SLICE 1 > READ_REPAIR 0 > BINARY 0 > READ 147188 > MUTATION 1 > REQUEST_RESPONSE 327 > > > The size of memory is there a way to calculate the max required or I have > to hit and try. > > Is RF:7 increasing the pressure as well. But if I reduce it to say 4 I am > effectively putting the load to only 4 servers as Solandra writes all the > docs driven by a max_docs_per_shard_size (which is 1Million) to a single > shard (single physical node:-> it uses it own partitioner) and I have total > docs as 300K. > > Regards, > Shubham > > On Tue, Feb 7, 2012 at 12:51 AM, aaron morton wrote: > >> Sounds like GC is the first problem to tackle. Can you give the process >> more memory ? >> >> Look at the logs and work out what the GC is doing, the cassandra logs >> are not exactly the same as this but you get the idea >> http://blogs.oracle.com/poonam/entry/understanding_cms_gc_logs >> >> The next thing I normally do is revert all changes to the default memory >> and GC settings. >> >> When you say memtable threshold is 0.75 do you mean >> the memtable_total_space_in_mb setting in yaml ? >> Is Cassandra logging messages about the the heap been full, what are they >> saying ? >> >> Wide rows, such as the TL column family in the L keyspace can increase >> the about of GC work that goes on. This can be somewhat alleviated by >> reducing the in_memory_compaction_limit_in_mb , this will increase the >> amount of IO that is needed. >> > > Are you talking of in_memory_compaction_limit_in_mb which is by default > 1/3 of heap size. > >> >> >> Cheers >> >> ----------------- >> Aaron Morton >> Freelance Developer >> @aaronmorton >> http://www.thelastpickle.com >> >> On 4/02/2012, at 5:58 PM, Shubham Srivastava wrote: >> >> I have a cassandra setup with 7 Node Ring single DC with RF:7 and >> Read:CL:1.There is live traffic on these nodes except one -> the traffic is >> 90% read. There are also writes happening to all these nodes which >> typically are user specific data etc.These nodes aNow at times what is >> happening is there are 2-3 say nodes getting in a hanged state and >> eventually the whole ring behaves so. There state in terms of CPU Usage is >> very High 17Loads ,network incoming and outgoing requests packet were very >> high and there is continuous GC(Major and Minor) pauses happening and Read >> Messages dropped simultaneously.Also the SSTables couunt have increased >> and decreased for some families during this time. So majorly its the GC and >> SStable compaction and Memtable flush happening. We are running cassandra >> behind solr using Solandra.The max docs that we have are around 0.5Million. >> >> We keep one node as the main write node where we run sheduled job thats >> pools data into the cluster from MySql db.These jobs are run >> hourly.Recently we have increased the data to somewhere to the size of 30X >> . Before the same setup was stable and these jobs used to run in every 5 >> minutes apart from the similar problem 2-3 times. >> >> GC:Settings >> 4Gb Heap Xmx,Xms >> 2Gb Young Geneartion: Xmn >> ParNew >> CMS >> -XX:+UseParNewGC" >> -XX:+UseConcMarkSweepGC" >> -XX:+CMSParallelRemarkEnabled" >> -XX:SurvivorRatio=8" >> -XX:MaxTenuringThreshold=1" >> -XX:CMSInitiatingOccupancyFraction=75" >> -XX:+UseCMSInitiatingOccupancyOnly" >> >> Memtable Threshold is also:0.75 and rest default cassandra settings >> >> Also we dont have in place a connectionpool for thrift.We are using >> cassandra:0.8.6 with solr:3.3 >> >> Will share the Cfstats shortly or anything else needed for that >> matter.Can you guys help me kn this. >> >> >> ========================================== >> >> >> Keyspace: system >> Read Count: 19 >> Read Latency: 5.6876842105263155 ms. >> Write Count: 2375 >> Write Latency: 0.010477894736842104 ms. >> Pending Tasks: 0 >> Column Family: NodeIdInfo >> SSTable count: 0 >> Space used (live): 0 >> Space used (total): 0 >> Number of Keys (estimate): 0 >> Memtable Columns Count: 0 >> Memtable Data Size: 0 >> Memtable Switch Count: 0 >> Read Count: 0 >> Read Latency: NaN ms. >> Write Count: 0 >> Write Latency: NaN ms. >> Pending Tasks: 0 >> Key cache capacity: 1 >> Key cache size: 0 >> Key cache hit rate: NaN >> Row cache: disabled >> Compacted row minimum size: 0 >> Compacted row maximum size: 0 >> Compacted row mean size: 0 >> >> Column Family: HintsColumnFamily >> SSTable count: 2 >> Space used (live): 492064 >> Space used (total): 492064 >> Number of Keys (estimate): 256 >> Memtable Columns Count: 0 >> Memtable Data Size: 0 >> Memtable Switch Count: 3 >> Read Count: 10 >> Read Latency: 5.643 ms. >> Write Count: 2372 >> Write Latency: 0.010 ms. >> Pending Tasks: 0 >> Key cache capacity: 2 >> Key cache size: 2 >> Key cache hit rate: 0.42857142857142855 >> Row cache: disabled >> Compacted row minimum size: 219343 >> Compacted row maximum size: 263210 >> Compacted row mean size: 263210 >> >> Column Family: Schema >> SSTable count: 2 >> Space used (live): 20827 >> Space used (total): 20827 >> Number of Keys (estimate): 256 >> Memtable Columns Count: 0 >> Memtable Data Size: 0 >> Memtable Switch Count: 0 >> Read Count: 3 >> Read Latency: 4.253 ms. >> Write Count: 0 >> Write Latency: NaN ms. >> Pending Tasks: 0 >> Key cache capacity: 2 >> Key cache size: 2 >> Key cache hit rate: 0.0 >> Row cache: disabled >> Compacted row minimum size: 104 >> Compacted row maximum size: 8239 >> Compacted row mean size: 3314 >> >> Column Family: Migrations >> SSTable count: 2 >> Space used (live): 33180 >> Space used (total): 33180 >> Number of Keys (estimate): 256 >> Memtable Columns Count: 0 >> Memtable Data Size: 0 >> Memtable Switch Count: 0 >> Read Count: 0 >> Read Latency: NaN ms. >> Write Count: 0 >> Write Latency: NaN ms. >> Pending Tasks: 0 >> Key cache capacity: 2 >> Key cache size: 0 >> Key cache hit rate: NaN >> Row cache: disabled >> Compacted row minimum size: 9888 >> Compacted row maximum size: 17084 >> Compacted row mean size: 14474 >> >> Column Family: IndexInfo >> SSTable count: 0 >> Space used (live): 0 >> Space used (total): 0 >> Number of Keys (estimate): 0 >> Memtable Columns Count: 0 >> Memtable Data Size: 0 >> Memtable Switch Count: 0 >> Read Count: 0 >> Read Latency: NaN ms. >> Write Count: 0 >> Write Latency: NaN ms. >> Pending Tasks: 0 >> Key cache capacity: 1 >> Key cache size: 0 >> Key cache hit rate: NaN >> Row cache: disabled >> Compacted row minimum size: 0 >> Compacted row maximum size: 0 >> Compacted row mean size: 0 >> >> Column Family: LocationInfo >> SSTable count: 3 >> Space used (live): 15844 >> Space used (total): 15844 >> Number of Keys (estimate): 384 >> Memtable Columns Count: 0 >> Memtable Data Size: 0 >> Memtable Switch Count: 2 >> Read Count: 6 >> Read Latency: 6.479 ms. >> Write Count: 3 >> Write Latency: 0.004 ms. >> Pending Tasks: 0 >> Key cache capacity: 3 >> Key cache size: 3 >> Key cache hit rate: 0.3333333333333333 >> Row cache: disabled >> Compacted row minimum size: 73 >> Compacted row maximum size: 310 >> Compacted row mean size: 126 >> >> ---------------- >> Keyspace: L >> Read Count: 535675 >> Read Latency: 4.472875136976712 ms. >> Write Count: 282216 >> Write Latency: 0.08156946806701251 ms. >> Pending Tasks: 0 >> Column Family: FC >> SSTable count: 6 >> Space used (live): 444790202 >> Space used (total): 444790202 >> Number of Keys (estimate): 768 >> Memtable Columns Count: 93231 >> Memtable Data Size: 172790560 >> Memtable Switch Count: 1 >> Read Count: 6651 >> Read Latency: 62.041 ms. >> Write Count: 94235 >> Write Latency: 0.026 ms. >> Pending Tasks: 0 >> Key cache: disabled >> Row cache: disabled >> Compacted row minimum size: 104 >> Compacted row maximum size: 10090808 >> Compacted row mean size: 4256880 >> >> Column Family: Docs >> SSTable count: 7 >> Space used (live): 1487268134 >> Space used (total): 1487268134 >> Number of Keys (estimate): 303744 >> Memtable Columns Count: 98040 >> Memtable Data Size: 37732086 >> Memtable Switch Count: 1 >> Read Count: 125986 >> Read Latency: 1.868 ms. >> Write Count: 11900 >> Write Latency: 0.520 ms. >> Pending Tasks: 0 >> Key cache: disabled >> Row cache: disabled >> Compacted row minimum size: 36 >> Compacted row maximum size: 51012 >> Compacted row mean size: 5547 >> >> Column Family: SI >> SSTable count: 3 >> Space used (live): 136512555 >> Space used (total): 136512555 >> Number of Keys (estimate): 286848 >> Memtable Columns Count: 5344 >> Memtable Data Size: 21139811 >> Memtable Switch Count: 1 >> Read Count: 27642 >> Read Latency: 0.880 ms. >> Write Count: 5815 >> Write Latency: 0.093 ms. >> Pending Tasks: 0 >> Key cache: disabled >> Row cache: disabled >> Compacted row minimum size: 73 >> Compacted row maximum size: 30130992 >> Compacted row mean size: 5022190 >> >> Column Family: TL >> SSTable count: 4 >> Space used (live): 314821524 >> Space used (total): 314821524 >> Number of Keys (estimate): 512 >> Memtable Columns Count: 83428 >> Memtable Data Size: 16069959 >> Memtable Switch Count: 1 >> Read Count: 10867 >> Read Latency: 17.949 ms. >> Write Count: 5386 >> Write Latency: 0.578 ms. >> Pending Tasks: 0 >> Key cache: disabled >> Row cache: disabled >> Compacted row minimum size: 12108971 >> Compacted row maximum size: 186563160 >> Compacted row mean size: 90195666 >> >> Column Family: TI >> SSTable count: 6 >> Space used (live): 1451685937 >> Space used (total): 1451685937 >> Number of Keys (estimate): 3910144 >> Memtable Columns Count: 166006 >> Memtable Data Size: 184308808 >> Memtable Switch Count: 1 >> Read Count: 364529 >> Read Latency: 4.194 ms. >> Write Count: 164880 >> Write Latency: 0.065 ms. >> Pending Tasks: 0 >> Key cache: disabled >> Row cache: disabled >> Compacted row minimum size: 104 >> Compacted row maximum size: 7007506 >> Compacted row mean size: 18922 >> >> ---------------- >> Keyspace: LH >> Read Count: 61353 >> Read Latency: 0.20730264208759147 ms. >> Write Count: 56289 >> Write Latency: 0.13461228659240704 ms. >> Pending Tasks: 0 >> Column Family: UserPrefrences >> SSTable count: 4 >> Space used (live): 335309522 >> Space used (total): 335309522 >> Number of Keys (estimate): 1513600 >> Memtable Columns Count: 12807 >> Memtable Data Size: 9144714 >> Memtable Switch Count: 1 >> Read Count: 20132 >> Read Latency: 0.201 ms. >> Write Count: 27817 >> Write Latency: 0.009 ms. >> Pending Tasks: 0 >> Key cache: disabled >> Row cache: disabled >> Compacted row minimum size: 61 >> Compacted row maximum size: 215 >> Compacted row mean size: 179 >> >> Column Family: LastViewedHotels >> SSTable count: 3 >> Space used (live): 152316912 >> Space used (total): 152316912 >> Number of Keys (estimate): 767104 >> Memtable Columns Count: 3059 >> Memtable Data Size: 2906758 >> Memtable Switch Count: 1 >> Read Count: 9077 >> Read Latency: 0.180 ms. >> Write Count: 3585 >> Write Latency: 0.018 ms. >> Pending Tasks: 0 >> Key cache: disabled >> Row cache capacity: 10000 >> Row cache size: 565 >> Row cache hit rate: 0.7896882229811611 >> Compacted row minimum size: 36 >> Compacted row maximum size: 51012 >> Compacted row mean size: 144 >> >> Column Family: BookedHotels >> SSTable count: 3 >> Space used (live): 7274700 >> Space used (total): 7274700 >> Number of Keys (estimate): 39680 >> Memtable Columns Count: 7 >> Memtable Data Size: 392 >> Memtable Switch Count: 1 >> Read Count: 139 >> Read Latency: 0.027 ms. >> Write Count: 10 >> Write Latency: 0.008 ms. >> Pending Tasks: 0 >> Key cache: disabled >> Row cache capacity: 10000 >> Row cache size: 4 >> Row cache hit rate: 0.2302158273381295 >> Compacted row minimum size: 87 >> Compacted row maximum size: 35425 >> Compacted row mean size: 139 >> >> Column Family: HotelMessage >> SSTable count: 1 >> Space used (live): 349735 >> Space used (total): 349735 >> Number of Keys (estimate): 512 >> Memtable Columns Count: 19424 >> Memtable Data Size: 3408866 >> Memtable Switch Count: 1 >> Read Count: 4726 >> Read Latency: 0.059 ms. >> Write Count: 9431 >> Write Latency: 0.739 ms. >> Pending Tasks: 0 >> Key cache: disabled >> Row cache capacity: 10000 >> Row cache size: 144 >> Row cache hit rate: 0.968049090139653 >> Compacted row minimum size: 87 >> Compacted row maximum size: 24601 >> Compacted row mean size: 867 >> >> Column Family: SavedHotels >> SSTable count: 1 >> Space used (live): 650153 >> Space used (total): 650153 >> Number of Keys (estimate): 3456 >> Memtable Columns Count: 13 >> Memtable Data Size: 728 >> Memtable Switch Count: 1 >> Read Count: 4282 >> Read Latency: 0.029 ms. >> Write Count: 15 >> Write Latency: 0.014 ms. >> Pending Tasks: 0 >> Key cache: disabled >> Row cache capacity: 10000 >> Row cache size: 13 >> Row cache hit rate: 0.06819243344231668 >> Compacted row minimum size: 104 >> Compacted row maximum size: 2299 >> Compacted row mean size: 160 >> >> Column Family: SavedHotelsInverted >> SSTable count: 1 >> Space used (live): 646988 >> Space used (total): 646988 >> Number of Keys (estimate): 3456 >> Memtable Columns Count: 13 >> Memtable Data Size: 728 >> Memtable Switch Count: 1 >> Read Count: 13 >> Read Latency: 3.014 ms. >> Write Count: 15 >> Write Latency: 0.007 ms. >> Pending Tasks: 0 >> Key cache: disabled >> Row cache capacity: 10000 >> Row cache size: 2 >> Row cache hit rate: 0.15384615384615385 >> Compacted row minimum size: 104 >> Compacted row maximum size: 2299 >> Compacted row mean size: 160 >> >> Column Family: LastViewedHotelsInverted >> SSTable count: 4 >> Space used (live): 147678370 >> Space used (total): 147678370 >> Number of Keys (estimate): 770048 >> Memtable Columns Count: 2486 >> Memtable Data Size: 2524930 >> Memtable Switch Count: 1 >> Read Count: 2667 >> Read Latency: 0.622 ms. >> Write Count: 3590 >> Write Latency: 0.010 ms. >> Pending Tasks: 0 >> Key cache: disabled >> Row cache capacity: 10000 >> Row cache size: 477 >> Row cache hit rate: 0.3820772403449569 >> Compacted row minimum size: 36 >> Compacted row maximum size: 51012 >> Compacted row mean size: 160 >> >> Column Family: SavedSearchRequest >> SSTable count: 11 >> Space used (live): 4560932807 >> Space used (total): 4560932807 >> Number of Keys (estimate): 1022336 >> Memtable Columns Count: 7762 >> Memtable Data Size: 17281321 >> Memtable Switch Count: 1 >> Read Count: 20317 >> Read Latency: 0.242 ms. >> Write Count: 11827 >> Write Latency: 0.022 ms. >> Pending Tasks: 0 >> Key cache: disabled >> Row cache capacity: 10000 >> Row cache size: 619 >> Row cache hit rate: 0.7583304621745336 >> Compacted row minimum size: 925 >> Compacted row maximum size: 1955666 >> Compacted row mean size: 5014 >> >> Column Family: HotelTariffs >> SSTable count: 3 >> Space used (live): 42775204 >> Space used (total): 42775204 >> Number of Keys (estimate): 18176 >> Memtable Columns Count: 0 >> Memtable Data Size: 0 >> Memtable Switch Count: 0 >> Read Count: 0 >> Read Latency: NaN ms. >> Write Count: 0 >> Write Latency: NaN ms. >> Pending Tasks: 0 >> Key cache: disabled >> Row cache capacity: 10000 >> Row cache size: 0 >> Row cache hit rate: NaN >> Compacted row minimum size: 180 >> Compacted row maximum size: 9887 >> Compacted row mean size: 2179 >> >> I would appreciate a quick help. >> >> Regards, >> Shubham >> >> >> > > --14dae9340f9da0c0dc04b86ffd9a Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable did all the same

1.Disabled all row chaches
2.= Heap Memory to 8Gb , young Gen reduced to 2Gb
3.in memory compaction to 2=A0

Still the = problem persists.=A0

I tried reducing the read_repair_chance from 1 to 0.1 ,= this helped a bit so I can run some fairly small write jobs without gettin= g some nodes hanging, infact I tried this with a test setup on 2 nodes only= so may need to test it across a bigger cluster.

I also ran a write job on a node on which I disabled go= ssip and without much hassles It was successful although I can see mutable = requests getting dropped on the other node. The problem with =A0this is I n= eed to repair the other node to get the same data on the write node.this sh= ould have synched in quick time.

=A0In cassandra if I need to write in a single node and= when all the writes are finished on this then get the=A0syncing=A0done wit= h other nodes, is this a normal scenario etc or how should I do it without = =A0because my guess is the way solr is writing data to cassandra is a probl= em , its actually streaming couple of data together(512 docs at a time) and= then dumping it.

Regards,
Shubham


On Wed, Feb 8, 2012 at 12:57 AM, aaron mort= on <aaron@t= helastpickle.com> wrote:
Is Cassandra logging messages= about the the heap been full, what are they saying ?=A0
They are saying=A0http://khaaan.com/

You do not have enough memory allocated to the JVM to work= efficiently, that needs to be fixed.=A0

First step, disable all row and key caches until you ge= t stable.=A0

The size of memory is there a=A0way to calculate the max r= equired or I have to hit and try.
The best approach is to let C= assandra take care of it. See the conf/cassandra-env.sh . The maximum usefu= l heap size is 8GB.=A0

When you say memtable threshold is= 0.75 do you mean the=A0memtable_total_space_in_mb setting in yaml ?=A0
I am talking= of : flush_largest_memtables_at: 0.75
That is a safety valve, the fact that is it trigge= r is a symptom of memory issues. see=A0http://thelastpic= kle.com/2011/05/04/How-are-Memtables-measured/

<= div>=A0 Are you talking o= f=A0in_memory_compaction_limit_in_mb=A0which is by default 1/3 of heap size= .=A0
in_memory_compaction_limit defaults to 64MB = and influences how much memory compaction will use=A0

Is RF:7 increasing the pre= ssure as well. But if I reduce it to say 4 I am effectively putting the loa= d to only 4 servers as Solandra writes all the docs driven by a max_docs_pe= r_shard_size (which is 1Million) to a single shard (single physical node:-&= gt; it uses it own partitioner) and I have total docs as 300K.

I do not know tha= t much about solandra.=A0

I would do this:
* disable all the caches
* allocate more memory / let cassandr= a take care of it (you have a high setting for the young gen).
* consider reducing the in_memory_compaction_limit

Cheers

<= div style=3D"word-wrap:break-word">
-----------------
Aaron Morton
Freelance Deve= loper
@aaronmorton

On 7/02/2012, at 2:46 PM, shubha= m srivastava wrote:

Hi Aaron,

Is Cassandra logging messages about the the heap been full, w= hat are they saying ?=A0

Most of the times but not always below logs are published by cassandra:

=A0WARN [Scheduled= Tasks:1] 2012-02-06 22:17:50,375 GCInspector.java (line 143) Heap is 0.7842= 81626909687 full. =A0You may need to reduce memtable and/or cache sizes. = =A0Cassandra will now flush up to the two largest memtables to free up memo= ry. =A0Adjust flush_largest_memtables_at threshold in cassandra.yaml if you= don't want Cassandra to do this automatically
=A0WARN [ScheduledTa= sks:1] 2012-02-06 22:17:50,376 StorageService.java (line 2418) Flushing Col= umnFamilyStore(table=3D'LH', columnFamily=3D'SavedSearchRequest= ') to relieve memory pressure
=A0INFO [ScheduledTa= sks:1] 2012-02-06 22:17:50,629 ColumnFamilyStore.java (line 1128) Enqueuing= flush of Memtable-SavedSearchRequest@568443115(6964940/13461931 serialized= /live bytes, 5794 ops)
=A0WARN [ScheduledTa= sks:1] 2012-02-06 22:17:51,242 StorageService.java (line 2422) Flushing Col= umnFamilyStore(table=3D'LH', columnFamily=3D'BookedHotels')= to relieve memory pressure
=A0INFO [ScheduledTa= sks:1] 2012-02-06 22:17:51,242 ColumnFamilyStore.java (line 1128) Enqueuing= flush of Memtable-BookedHotels@2031509445(1575/1968 serialized/live bytes,= 35 ops)
=A0INFO [FlushWriter= :5] 2012-02-06 22:17:51,244 Memtable.java (line 237) Writing Memtable-Saved= SearchRequest@568443115(6964940/13461931 serialized/live bytes, 5794 ops)
=A0INFO [ScheduledTa= sks:1] 2012-02-06 22:18:03,144 GCInspector.java (line 122) GC for Concurren= tMarkSweep: 3783 ms for 2 collections, 2785603776 used; max is 6120341504

When you say memtable threshold is 0.75 do you mea= n the=A0memtable_total_space_in_mb setting in yaml ?=A0
I am talking of : flush_larg= est_memtables_at: 0.75

Wide rows, such as the T= L column family in the L keyspace can increase the about of GC work that go= es on. This can be somewhat alleviated by reducing the in_memory_compaction= _limit_in_mb , this will increase the amount of IO that is needed.=A0

=A0 Are you talking of=A0in_memory_compaction_lim= it_in_mb=A0which is by default 1/3 of heap size.=A0


=
Heavy write traffic can = also increase GC activity. Watch the tp stats during the load process, are = you overloading the cluster ? Do you see pending tasks backing up ?=A0

Yes :Below are the same:=
#TpStats

Pool Name =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0Active= =A0 Pending =A0 =A0 =A0Completed =A0 Blocked =A0All time blocked
ReadStage =A0 =A0 = =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A032 =A0 =A0 =A0 922 =A0 =A0 =A0 =A0 1= 59030 =A0 =A0 =A0 =A0 0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 0
= RequestResponseStage =A0 = =A0 =A0 =A0 =A0 =A0 =A00 =A0 =A0 =A0 =A0 0 =A0 =A0 =A0 =A0 =A0 4563 =A0 =A0= =A0 =A0 0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 0
MutationStage =A0 = =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 0 =A0 =A0 =A0 =A0 0 =A0 =A0 =A0 =A0 249= 357 =A0 =A0 =A0 =A0 0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 0
ReadRepairStage =A0 =A0 =A0= =A0 =A0 =A0 =A0 =A0 =A0 0 =A0 =A0 =A0 =A0 0 =A0 =A0 =A0 =A0 =A0 =A0 =A03 = =A0 =A0 =A0 =A0 0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 0
ReplicateOnWriteStag= e =A0 =A0 =A0 =A0 =A0 =A0 0 =A0 =A0 =A0 =A0 0 =A0 =A0 =A0 =A0 =A0 =A0 =A00 = =A0 =A0 =A0 =A0 0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 0
GossipStage =A0 =A0 =A0 =A0 =A0= =A0 =A0 =A0 =A0 =A0 =A0 0 =A0 =A0 =A0 =A0 0 =A0 =A0 =A0 =A0 =A0 4670 =A0 = =A0 =A0 =A0 0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 0
AntiEntropyStage =A0= =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A00 =A0 =A0 =A0 =A0 0 =A0 =A0 =A0 =A0 =A0 =A0= =A00 =A0 =A0 =A0 =A0 0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 0
= MigrationStage =A0 =A0 = =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A00 =A0 =A0 =A0 =A0 0 =A0 =A0 =A0 =A0 =A0 =A0 = =A00 =A0 =A0 =A0 =A0 0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 0
MemtablePostFlusher = =A0 =A0 =A0 =A0 =A0 =A0 =A0 0 =A0 =A0 =A0 =A0 0 =A0 =A0 =A0 =A0 =A0 =A0 19 = =A0 =A0 =A0 =A0 0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 0
StreamStage =A0 =A0 =A0 =A0 =A0= =A0 =A0 =A0 =A0 =A0 =A0 0 =A0 =A0 =A0 =A0 0 =A0 =A0 =A0 =A0 =A0 =A0 =A00 = =A0 =A0 =A0 =A0 0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 0
FlushWriter =A0 =A0 = =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 0 =A0 =A0 =A0 =A0 0 =A0 =A0 =A0 =A0 =A0= =A0 19 =A0 =A0 =A0 =A0 0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 5
MiscStage =A0 =A0 =A0 = =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 0 =A0 =A0 =A0 =A0 0 =A0 =A0 =A0 =A0 =A0= =A0 =A00 =A0 =A0 =A0 =A0 0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 0
FlushSorter =A0 =A0 = =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 0 =A0 =A0 =A0 =A0 0 =A0 =A0 =A0 =A0 =A0= =A0 =A00 =A0 =A0 =A0 =A0 0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 0
<= div>InternalResponseStage= =A0 =A0 =A0 =A0 =A0 =A0 0 =A0 =A0 =A0 =A0 0 =A0 =A0 =A0 =A0 =A0 =A0 =A00 = =A0 =A0 =A0 =A0 0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 0
HintedHandoff =A0 = =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 0 =A0 =A0 =A0 =A0 0 =A0 =A0 =A0 =A0 =A0= =A0 =A08 =A0 =A0 =A0 =A0 0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 0
<= div>
Message= type =A0 =A0 =A0 =A0 =A0 Dropped
RANGE_SLICE =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A01<= /span>
READ_REPAIR =A0 =A0 = =A0 =A0 =A0 =A0 =A0 =A0 =A00
BINARY =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 0
READ =A0 =A0 =A0 =A0= =A0 =A0 =A0 =A0 =A0 =A0147188
MUTATION =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 1
REQUEST_RESPONSE =A0= =A0 =A0 =A0 =A0 327=A0


The size of memory is there a=A0way to calculate the max required or I ha= ve to hit and try.

Is RF:7 increasing the pressure as well. But if I reduc= e it to say 4 I am effectively putting the load to only 4 servers as Soland= ra writes all the docs driven by a max_docs_per_shard_size (which is 1Milli= on) to a single shard (single physical node:-> it uses it own partitione= r) and I have total docs as 300K.

Regards,
Shubham

On Tue, Feb 7, 2012 at 12:51 AM, aaron morton <= ;aaron@thelast= pickle.com> wrote:
Sounds like GC is the first problem to = tackle. Can you give the process more memory ? =A0

Look = at the logs and work out what the GC is doing, the cassandra logs are not e= xactly the same as this but you get the idea=A0http://blo= gs.oracle.com/poonam/entry/understanding_cms_gc_logs

The next thing I normally do is revert all changes to the de= fault memory and GC settings.=A0

When you say memtab= le threshold is 0.75 do you mean the=A0memtable_total_space_in_mb setting i= n yaml ?=A0
Is Cassandra logging messages about the the heap been full, what are t= hey saying ?=A0

Wide rows, such as the TL column f= amily in the L keyspace can increase the about of GC work that goes on. Thi= s can be somewhat alleviated by reducing the in_memory_compaction_limit_in_= mb , this will increase the amount of IO that is needed.=A0

=A0 Are you talking of= =A0in_memory_compaction_limit_in_mb=A0which is by default 1/3 of heap size.= =A0


Cheers<= /div>

<= div style=3D"word-wrap:break-word">
-----------------
Aaron Morton
Freelance Deve= loper
@aaronmorton

On 4/02/2012, at 5:58 PM, Shubham Srivastava wrote:

=
I have a cassandra setup with 7 Node Ring si= ngle DC with RF:7 and Read:CL:1.There is live traffic on these nodes except= one -> the traffic is 90% read. There are also writes happening to all = these nodes which typically are user specific data etc.These nodes aNow at = times what is happening is there are 2-3 say nodes getting in a hanged stat= e and eventually the whole ring behaves so. There state in terms of CPU Usa= ge is very High 17Loads ,network incoming and outgoing requests packet were= very high and there is continuous GC(Major and Minor) pauses happening and= Read Messages dropped =A0simultaneously.Also the SSTables couunt have incr= eased and decreased for some families during this time. So majorly its the = GC and SStable compaction and Memtable flush happening. We are running cass= andra behind solr using Solandra.The max docs that we have are around 0.5Mi= llion.

We keep one node as the main write node where we run sheduled job thats= pools data into the cluster from MySql db.These jobs are run hourly.Recent= ly we have increased the data to somewhere to the size of 30X . Before the = same setup was stable and these jobs used to run in every 5 minutes apart f= rom the similar problem 2-3 times.

GC:Settings
4Gb Heap Xmx,Xms
2Gb Young Geneartion: Xmn
ParNew<= br>CMS
-XX:+UseParNewGC"
-XX:+UseConcMarkSweepGC"
-= XX:+CMSParallelRemarkEnabled"
-XX:SurvivorRatio=3D8"
-XX:MaxTenuringThreshold=3D1"
-XX:CMSInitiatingOccupancyFraction=3D75"
-XX:+UseCMSInitiatingOcc= upancyOnly"

Memtable Threshold is also:0.75 and rest default c= assandra settings

Also we dont have in place a connectionpool for t= hrift.We are using cassandra:0.8.6 with solr:3.3

Will share the Cfstats shortly or anything else needed for that matter= .Can you guys help me kn this.


=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D


Keyspace: system
=A0=A0=A0=A0=A0=A0= =A0=A0Read Count: 19
=A0=A0=A0=A0=A0=A0=A0=A0Read Latency: 5.6876842105263155 ms.
=A0=A0=A0=A0=A0=A0=A0=A0Write Count: 2375
=A0=A0=A0=A0=A0=A0=A0=A0Writ= e Latency: 0.010477894736842104 ms.
=A0=A0=A0=A0=A0=A0=A0=A0Pending Tas= ks: 0
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Column Family: No= deIdInfo
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0SSTable count:= 0
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Space used (live): 0=
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Space used (total): 0
= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Number of Keys (estimate): = 0
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Memtable Columns Coun= t: 0
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Memtable Data Size= : 0
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Memtable Switch Cou= nt: 0
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Read Count: 0
=A0=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Read Latency: NaN ms.
=A0=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Write Count: 0
=A0=A0=A0=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Write Latency: NaN ms.
=A0=A0=A0=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Pending Tasks: 0
=A0=A0=A0=A0=A0=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Key cache capacity: 1
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Key cache size: 0
=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Key cache hit rate: NaN
= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Row cache: disabled
=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Compacted row minimum size: 0<= br> =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Compacted row maximum s= ize: 0
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Compacted row mean size: 0=

=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Column Family: Hin= tsColumnFamily
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0SSTable = count: 2
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Space used (li= ve): 492064
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Space used = (total): 492064
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Number of Keys (estimate):= 256
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Memtable Columns C= ount: 0
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Memtable Data S= ize: 0
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Memtable Switch = Count: 3
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Read Count: 10=
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Read Latency: 5.643 ms= .
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Write Count: 2372
=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Write Latency: 0.010 ms.
= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Pending Tasks: 0
=A0=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Key cache capacity: 2
=A0=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Key cache size: 2
=A0=A0=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Key cache hit rate: 0.42857142857142= 855
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Row cache: disabled
= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Compacted row minimum size:= 219343
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Compacted row m= aximum size: 263210
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Com= pacted row mean size: 263210

=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0= =A0=A0=A0=A0Column Family: Schema
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0SSTable count: 2
=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Space used (live): 20827
= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Space used (total): 20827 =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Number of Keys (estimate= ): 256
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Memtable Columns= Count: 0
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Memtable Data Size: 0
= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Memtable Switch Count: 0 =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Read Count: 3
=A0=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Read Latency: 4.253 ms.
=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Write Count: 0
=A0=A0=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Write Latency: NaN ms.
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Pending Tasks: 0
=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Key cache capacity: 2
=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Key cache size: 2
=A0=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Key cache hit rate: 0.0
=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Row cache: disabled
=A0=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Compacted row minimum size: 104 =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Compacted row maximum size= : 8239
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Compacted row me= an size: 3314

=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Colum= n Family: Migrations
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0SS= Table count: 2
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Space us= ed (live): 33180
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Space used (total): 33180<= br> =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Number of Keys (estimat= e): 256
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Memtable Column= s Count: 0
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Memtable Dat= a Size: 0
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Memtable Swit= ch Count: 0
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Read Count: 0
=A0=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Read Latency: NaN ms.
=A0=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Write Count: 0
=A0=A0=A0=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Write Latency: NaN ms.
=A0=A0=A0=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Pending Tasks: 0
=A0=A0=A0=A0=A0=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Key cache capacity: 2
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Key cache size: 0
=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Key cache hit rate: NaN
= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Row cache: disabled
=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Compacted row minimum size: 98= 88
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Compacted row maximu= m size: 17084
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Compacted row mean size: 1= 4474

=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Column Family:= IndexInfo
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0SSTable coun= t: 0
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Space used (live):= 0
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Space used (total): = 0
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Number of Keys (estimate):= 0
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Memtable Columns Count: 0<= br> =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Memtable Data Size: 0 =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Memtable Switch Count: 0=
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Read Count: 0
=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Read Latency: NaN ms.
=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Write Count: 0
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Write Latency: NaN ms.
= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Pending Tasks: 0
=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Key cache capacity: 1
=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Key cache size: 0
=A0=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Key cache hit rate: NaN
=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Row cache: disabled
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Compacted row minimum size= : 0
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Compacted row maxim= um size: 0
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Compacted ro= w mean size: 0

=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Colu= mn Family: LocationInfo
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0= =A0SSTable count: 3
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Space used (live): 15844 =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Space used (total): 1584= 4
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Number of Keys (estim= ate): 384
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Memtable Colu= mns Count: 0
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Memtable D= ata Size: 0
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Memtable Switch Count: 2 =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Read Count: 6
=A0=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Read Latency: 6.479 ms.
=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Write Count: 3
=A0=A0=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Write Latency: 0.004 ms.
=A0=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Pending Tasks: 0
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Key cache capacity: 3
= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Key cache size: 3
=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Key cache hit rate: 0.33333333= 33333333
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Row cache: dis= abled
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Compacted row min= imum size: 73
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Compacted row maximum size= : 310
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Compacted row mea= n size: 126

----------------
Keyspace: L
=A0=A0=A0=A0=A0=A0= =A0=A0Read Count: 535675
=A0=A0=A0=A0=A0=A0=A0=A0Read Latency: 4.472875= 136976712 ms.
=A0=A0=A0=A0=A0=A0=A0=A0Write Count: 282216
=A0=A0=A0=A0=A0=A0=A0=A0Wr= ite Latency: 0.08156946806701251 ms.
=A0=A0=A0=A0=A0=A0=A0=A0Pending Ta= sks: 0
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Column Family: F= C
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0SSTable count: 6
= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Space used (live): 44479020= 2
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Space used (total): 444790= 202
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Number of Keys (est= imate): 768
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Memtable Co= lumns Count: 93231
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Memt= able Data Size: 172790560
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0= =A0Memtable Switch Count: 1
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Read Count: 6651
=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Read Latency: 62.041 ms.
= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Write Count: 94235
=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Write Latency: 0.026 ms.
= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Pending Tasks: 0
=A0=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Key cache: disabled
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Row cache: disabled
= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Compacted row minimum size:= 104
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Compacted row maxi= mum size: 10090808
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Comp= acted row mean size: 4256880

=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0= =A0=A0=A0=A0Column Family: Docs
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0SSTable count: 7
=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Space used (live): 1487268134<= br> =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Space used (total): 148= 7268134
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Number of Keys = (estimate): 303744
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Memt= able Columns Count: 98040
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Memtable Data Size: 377320= 86
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Memtable Switch Coun= t: 1
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Read Count: 125986=
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Read Latency: 1.868 ms= .
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Write Count: 11900 =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Write Latency: 0.520 ms.<= br> =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Pending Tasks: 0
=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Key cache: disabled
=A0=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Row cache: disabled
=A0=A0=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Compacted row minimum size: 36
= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Compacted row maximum size:= 51012
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Compacted row mean size: 5= 547

=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Column Family: = SI
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0SSTable count: 3
= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Space used (live): 1365125= 55
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Space used (total): = 136512555
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Number of Keys (estimate):= 286848
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Memtable Column= s Count: 5344
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Memtable = Data Size: 21139811
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Mem= table Switch Count: 1
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0R= ead Count: 27642
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Read Latency: 0.880 ms. =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Write Count: 5815
=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Write Latency: 0.093 ms.
= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Pending Tasks: 0
=A0=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Key cache: disabled
=A0=A0=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Row cache: disabled
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Compacted row minimum size= : 73
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Compacted row maxi= mum size: 30130992
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Comp= acted row mean size: 5022190

=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0= =A0=A0=A0=A0Column Family: TL
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0= =A0=A0=A0SSTable count: 4
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Space used (live): 3148215= 24
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Space used (total): = 314821524
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Number of Key= s (estimate): 512
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Memta= ble Columns Count: 83428
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0= =A0Memtable Data Size: 16069959
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Memtable Switch Count: 1 =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Read Count: 10867
= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Read Latency: 17.949 ms. =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Write Count: 5386
=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Write Latency: 0.578 ms.
= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Pending Tasks: 0
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Key cache: disabled
= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Row cache: disabled
=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Compacted row minimum size: 12= 108971
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Compacted row ma= ximum size: 186563160
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0C= ompacted row mean size: 90195666

=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Column Family: TI
= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0SSTable count: 6
=A0=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Space used (live): 1451685937
= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Space used (total): 145168= 5937
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Number of Keys (es= timate): 3910144
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Memtable Columns Count: 16= 6006
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Memtable Data Size= : 184308808
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Memtable Sw= itch Count: 1
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Read Coun= t: 364529
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Read Latency:= 4.194 ms.
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Write Count: 164880
= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Write Latency: 0.065 ms. =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Pending Tasks: 0
=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Key cache: disabled
=A0=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Row cache: disabled
=A0=A0=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Compacted row minimum size: 104
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Compacted row maximum size= : 7007506
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Compacted row= mean size: 18922

----------------
Keyspace: LH
=A0=A0=A0= =A0=A0=A0=A0=A0Read Count: 61353
=A0=A0=A0=A0=A0=A0=A0=A0Read Latency: = 0.20730264208759147 ms.
=A0=A0=A0=A0=A0=A0=A0=A0Write Count: 56289
=A0=A0=A0=A0=A0=A0=A0=A0Wri= te Latency: 0.13461228659240704 ms.
=A0=A0=A0=A0=A0=A0=A0=A0Pending Tas= ks: 0
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Column Family: Us= erPrefrences
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0SSTable co= unt: 4
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Space used (live= ): 335309522
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Space used (total): 335309= 522
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Number of Keys (est= imate): 1513600
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Memtabl= e Columns Count: 12807
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0= Memtable Data Size: 9144714
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0= =A0=A0Memtable Switch Count: 1
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Read Count: 20132
=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Read Latency: 0.201 ms.
= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Write Count: 27817
=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Write Latency: 0.009 ms.
= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Pending Tasks: 0
=A0=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Key cache: disabled
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Row cache: disabled
= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Compacted row minimum size:= 61
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Compacted row maxim= um size: 215
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Compacted = row mean size: 179

=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0= Column Family: LastViewedHotels
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0SSTable count: 3
=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Space used (live): 152316912 =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Space used (total): 1523= 16912
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Number of Keys (e= stimate): 767104
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Memtab= le Columns Count: 3059
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Memtable Data Size: 290675= 8
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Memtable Switch Count= : 1
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Read Count: 9077 =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Read Latency: 0.180 ms. =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Write Count: 3585
= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Write Latency: 0.018 ms. =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Pending Tasks: 0
=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Key cache: disabled
=A0=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Row cache capacity: 10000
=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Row cache size: 565
=A0=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Row cache hit rate: 0.78968822298= 11611
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Compacted row minimum size= : 36
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Compacted row maxi= mum size: 51012
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Compact= ed row mean size: 144

=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0= =A0Column Family: BookedHotels
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0= =A0=A0=A0SSTable count: 3
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Space used (live): 7274700=
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Space used (total): 72= 74700
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Number of Keys (e= stimate): 39680
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Memtabl= e Columns Count: 7
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Memt= able Data Size: 392
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Memtable Switch Count: 1 =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Read Count: 139
=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Read Latency: 0.027 ms.
= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Write Count: 10
=A0=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Write Latency: 0.008 ms.
=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Pending Tasks: 0
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Key cache: disabled
= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Row cache capacity: 10000 =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Row cache size: 4
= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Row cache hit rate: 0.23021= 58273381295
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Compacted r= ow minimum size: 87
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Compacted row maximum size= : 35425
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Compacted row m= ean size: 139

=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Colum= n Family: HotelMessage
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0= SSTable count: 1
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Space = used (live): 349735
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Space used (total): 349735=
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Number of Keys (estima= te): 512
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Memtable Colum= ns Count: 19424
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Memtabl= e Data Size: 3408866
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Me= mtable Switch Count: 1
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Read Count: 4726
=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Read Latency: 0.059 ms.
= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Write Count: 9431
=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Write Latency: 0.739 ms.
= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Pending Tasks: 0
=A0=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Key cache: disabled
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Row cache capacity: 10000<= br> =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Row cache size: 144
= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Row cache hit rate: 0.9680= 49090139653
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Compacted r= ow minimum size: 87
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Com= pacted row maximum size: 24601
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Compacted row mean size: 8= 67

=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Column Family: S= avedHotels
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0SSTable coun= t: 1
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Space used (live):= 650153
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Space used (tot= al): 650153
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Number of Keys (estimate):= 3456
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Memtable Columns = Count: 13
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Memtable Data= Size: 728
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Memtable Swi= tch Count: 1
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Read Count= : 4282
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Read Latency: 0.029 ms. =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Write Count: 15
=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Write Latency: 0.014 ms.
= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Pending Tasks: 0
=A0=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Key cache: disabled
=A0=A0=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Row cache capacity: 10000
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Row cache size: 13
=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Row cache hit rate: 0.06819243= 344231668
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Compacted row= minimum size: 104
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Comp= acted row maximum size: 2299
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0= =A0=A0Compacted row mean size: 160

=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Column Family: SavedHo= telsInverted
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0SSTable co= unt: 1
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Space used (live= ): 646988
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Space used (t= otal): 646988
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Number of= Keys (estimate): 3456
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Memtable Columns Count: 13=
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Memtable Data Size: 72= 8
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Memtable Switch Count= : 1
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Read Count: 13
= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Read Latency: 3.014 ms.
= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Write Count: 15
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Write Latency: 0.007 ms. =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Pending Tasks: 0
=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Key cache: disabled
=A0=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Row cache capacity: 10000
=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Row cache size: 2
=A0=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Row cache hit rate: 0.15384615384= 615385
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Compacted row minimum size= : 104
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Compacted row max= imum size: 2299
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Compact= ed row mean size: 160

=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0= =A0Column Family: LastViewedHotelsInverted
=A0=A0=A0=A0=A0=A0=A0=A0=A0= =A0=A0=A0=A0=A0=A0=A0SSTable count: 4
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Space used (live): 1476783= 70
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Space used (total): = 147678370
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Number of Key= s (estimate): 770048
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Me= mtable Columns Count: 2486
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0= =A0=A0Memtable Data Size: 2524930
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Memtable Switch Count: 1 =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Read Count: 2667
=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Read Latency: 0.622 ms.
= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Write Count: 3590
=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Write Latency: 0.010 ms.
= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Pending Tasks: 0
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Key cache: disabled
= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Row cache capacity: 10000 =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Row cache size: 477
= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Row cache hit rate: 0.38207= 72403449569
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Compacted r= ow minimum size: 36
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Compacted row maximum size= : 51012
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Compacted row m= ean size: 160

=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Colum= n Family: SavedSearchRequest
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0= =A0=A0SSTable count: 11
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0= =A0Space used (live): 4560932807
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Space used (total): 456093= 2807
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Number of Keys (es= timate): 1022336
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Memtab= le Columns Count: 7762
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0= Memtable Data Size: 17281321
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0= =A0=A0Memtable Switch Count: 1
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Read Count: 20317
=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Read Latency: 0.242 ms.
= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Write Count: 11827
=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Write Latency: 0.022 ms.
= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Pending Tasks: 0
=A0=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Key cache: disabled
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Row cache capacity: 10000<= br> =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Row cache size: 619
= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Row cache hit rate: 0.7583= 304621745336
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Compacted = row minimum size: 925
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0C= ompacted row maximum size: 1955666
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Compacted row mean size: 5= 014

=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Column Family: = HotelTariffs
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0SSTable co= unt: 3
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Space used (live= ): 42775204
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Space used = (total): 42775204
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Number of Keys (estimate):= 18176
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Memtable Columns= Count: 0
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Memtable Data= Size: 0
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Memtable Switc= h Count: 0
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Read Count: = 0
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Read Latency: NaN ms.
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Write Count: 0
=A0=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Write Latency: NaN ms.
=A0=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Pending Tasks: 0
=A0=A0=A0=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Key cache: disabled
=A0=A0=A0=A0=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Row cache capacity: 10000
=A0=A0=A0=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Row cache size: 0
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Row cache hit rate: NaN =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Compacted row minimum siz= e: 180
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Compacted row ma= ximum size: 9887
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0Compac= ted row mean size: 2179

I would appreciate a quick help.

Regards,
Shubham

<= /div>



--14dae9340f9da0c0dc04b86ffd9a--