Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 0FC407233 for ; Wed, 24 Aug 2011 01:53:00 +0000 (UTC) Received: (qmail 2712 invoked by uid 500); 24 Aug 2011 01:52:57 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 2575 invoked by uid 500); 24 Aug 2011 01:52:56 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 2566 invoked by uid 99); 24 Aug 2011 01:52:56 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 24 Aug 2011 01:52:56 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (athena.apache.org: local policy) Received: from [209.85.213.172] (HELO mail-yx0-f172.google.com) (209.85.213.172) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 24 Aug 2011 01:52:48 +0000 Received: by yxj17 with SMTP id 17so670561yxj.31 for ; Tue, 23 Aug 2011 18:52:27 -0700 (PDT) Received: by 10.150.170.10 with SMTP id s10mr4395536ybe.171.1314150747296; Tue, 23 Aug 2011 18:52:27 -0700 (PDT) Received: from [192.168.1.3] (21.sub-166-250-4.myvzw.com [166.250.4.21]) by mx.google.com with ESMTPS id q25sm821301yhm.62.2011.08.23.18.52.26 (version=TLSv1/SSLv3 cipher=OTHER); Tue, 23 Aug 2011 18:52:26 -0700 (PDT) From: Derek Andree Content-Type: multipart/signed; boundary="Apple-Mail=_0E959D4E-576E-42B7-8958-AAB60690A570"; protocol="application/pkcs7-signature"; micalg=sha1 Subject: Single node cassandra Date: Tue, 23 Aug 2011 18:52:23 -0700 Message-Id: To: user@cassandra.apache.org Mime-Version: 1.0 (Apple Message framework v1244.3) X-Mailer: Apple Mail (2.1244.3) --Apple-Mail=_0E959D4E-576E-42B7-8958-AAB60690A570 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii I'm looking for advice for running cassandra 8.+ on a single node. = Would love to hear stories about how much RAM you succeeded with, etc. Currently we are running with a 4GB heap size. Hardware is 4 cores and = 8GB physical memory. We're not opposed to going to 16GB of memory or = even 32GB. We have fast 6GBps SAS drives, although currently do not = have a dedicated drive for Commit Log, but we are thinking about trying = this out. Our application has time series data which means our data will get = larger over time, not in all CFs though. We have 7 "hot" CFs but they = are probably not that hot to someone running a sizable cluster. We have = 15 CFs total in our keyspace. I've already tweaked key cache and in some cases added a large enough = row cache to keep an entire CF in memory where appropriate. Basically, I'm just curious under this sort of load if we can expect = decent results with a single node as the data gets larger. I know this = isn't necessarily a binary answer, just curious about people's = experiences on a single node. Thanks, -Derek cfstats: ---------------- Keyspace: test Read Count: 2869777 Read Latency: 1.2266526890416922 ms. Write Count: 7672036 Write Latency: 0.016663120975970395 ms. Pending Tasks: 0 Column Family: DocData SSTable count: 1 Space used (live): 425090 Space used (total): 425090 Number of Keys (estimate): 128 Memtable Columns Count: 0 Memtable Data Size: 0 Memtable Switch Count: 0 Read Count: 162 Read Latency: NaN ms. Write Count: 0 Write Latency: NaN ms. Pending Tasks: 0 Key cache capacity: 1000 Key cache size: 27 Key cache hit rate: NaN Row cache: disabled Compacted row minimum size: 771 Compacted row maximum size: 315852 Compacted row mean size: 18290 Column Family: User SSTable count: 1 Space used (live): 5368 Space used (total): 5368 Number of Keys (estimate): 128 Memtable Columns Count: 0 Memtable Data Size: 0 Memtable Switch Count: 0 Read Count: 0 Read Latency: NaN ms. Write Count: 0 Write Latency: NaN ms. Pending Tasks: 0 Key cache capacity: 1000 Key cache size: 0 Key cache hit rate: NaN Row cache capacity: 1000 Row cache size: 0 Row cache hit rate: NaN Compacted row minimum size: 447 Compacted row maximum size: 535 Compacted row mean size: 535 Column Family: SMapping SSTable count: 1 Space used (live): 536900 Space used (total): 536900 Number of Keys (estimate): 768 Memtable Columns Count: 9528 Memtable Data Size: 4646940 Memtable Switch Count: 0 Read Count: 763 Read Latency: NaN ms. Write Count: 763 Write Latency: NaN ms. Pending Tasks: 0 Key cache capacity: 1000 Key cache size: 763 Key cache hit rate: NaN Row cache capacity: 1000 Row cache size: 763 Row cache hit rate: NaN Compacted row minimum size: 447 Compacted row maximum size: 73457 Compacted row mean size: 713 Column Family: LObject SSTable count: 2 Space used (live): 6945430 Space used (total): 6945430 Number of Keys (estimate): 10752 Memtable Columns Count: 729638 Memtable Data Size: 400799230 Memtable Switch Count: 2 Read Count: 316756 Read Latency: NaN ms. Write Count: 147028 Write Latency: NaN ms. Pending Tasks: 0 Key cache capacity: 20000 Key cache size: 20000 Key cache hit rate: NaN Row cache capacity: 20000 Row cache size: 5304 Row cache hit rate: NaN Compacted row minimum size: 259 Compacted row maximum size: 182785 Compacted row mean size: 661 Column Family: SMeta SSTable count: 2 Space used (live): 173059487 Space used (total): 343520951 Number of Keys (estimate): 165760 Memtable Columns Count: 442764 Memtable Data Size: 168300272 Memtable Switch Count: 53 Read Count: 2345765 Read Latency: 0.009 ms. Write Count: 2179885 Write Latency: 0.033 ms. Pending Tasks: 0 Key cache: disabled Row cache capacity: 100000 Row cache size: 82940 Row cache hit rate: 1.0 Compacted row minimum size: 925 Compacted row maximum size: 1109 Compacted row mean size: 1109 Column Family: SLookback SSTable count: 14 Space used (live): 16604796474 Space used (total): 17754314562 Number of Keys (estimate): 2515968 Memtable Columns Count: 49500 Memtable Data Size: 38927091 Memtable Switch Count: 18 Read Count: 194587 Read Latency: 13.929 ms. Write Count: 200732 Write Latency: 0.011 ms. Pending Tasks: 0 Key cache capacity: 200000 Key cache size: 200000 Key cache hit rate: 0.2599537318884695 Row cache: disabled Compacted row minimum size: 311 Compacted row maximum size: 35425 Compacted row mean size: 7338 Column Family: Event SSTable count: 2 Space used (live): 23480776 Space used (total): 23480776 Number of Keys (estimate): 33280 Memtable Columns Count: 77 Memtable Data Size: 5310 Memtable Switch Count: 1 Read Count: 12 Read Latency: NaN ms. Write Count: 12 Write Latency: NaN ms. Pending Tasks: 0 Key cache capacity: 10000 Key cache size: 0 Key cache hit rate: NaN Row cache capacity: 1000 Row cache size: 0 Row cache hit rate: NaN Compacted row minimum size: 643 Compacted row maximum size: 770 Compacted row mean size: 770 Column Family: SHourly SSTable count: 3 Space used (live): 847441284 Space used (total): 847441284 Number of Keys (estimate): 496768 Memtable Columns Count: 35256 Memtable Data Size: 67814381 Memtable Switch Count: 3 Read Count: 0 Read Latency: NaN ms. Write Count: 330520 Write Latency: NaN ms. Pending Tasks: 0 Key cache capacity: 1000 Key cache size: 0 Key cache hit rate: NaN Row cache: disabled Compacted row minimum size: 180 Compacted row maximum size: 9887 Compacted row mean size: 1835 Column Family: ConfigSettings SSTable count: 1 Space used (live): 4854 Space used (total): 4854 Number of Keys (estimate): 128 Memtable Columns Count: 0 Memtable Data Size: 0 Memtable Switch Count: 0 Read Count: 135 Read Latency: 0.007 ms. Write Count: 0 Write Latency: NaN ms. Pending Tasks: 0 Key cache capacity: 100 Key cache size: 1 Key cache hit rate: NaN Row cache capacity: 100 Row cache size: 1 Row cache hit rate: 1.0 Compacted row minimum size: 536 Compacted row maximum size: 642 Compacted row mean size: 642 Column Family: SystemMeta SSTable count: 2 Space used (live): 9258 Space used (total): 9258 Number of Keys (estimate): 256 Memtable Columns Count: 48 Memtable Data Size: 2570 Memtable Switch Count: 1 Read Count: 18 Read Latency: NaN ms. Write Count: 10 Write Latency: NaN ms. Pending Tasks: 0 Key cache capacity: 100 Key cache size: 1 Key cache hit rate: NaN Row cache capacity: 100 Row cache size: 1 Row cache hit rate: NaN Compacted row minimum size: 311 Compacted row maximum size: 372 Compacted row mean size: 372 Column Family: LConfig SSTable count: 2 Space used (live): 22198 Space used (total): 22198 Number of Keys (estimate): 256 Memtable Columns Count: 3614 Memtable Data Size: 399019 Memtable Switch Count: 1 Read Count: 261 Read Latency: NaN ms. Write Count: 261 Write Latency: NaN ms. Pending Tasks: 0 Key cache capacity: 1000 Key cache size: 9 Key cache hit rate: 0.0 Row cache capacity: 1000 Row cache size: 9 Row cache hit rate: NaN Compacted row minimum size: 643 Compacted row maximum size: 770 Compacted row mean size: 770 Column Family: S SSTable count: 6 Space used (live): 4845200284 Space used (total): 4926197540 Number of Keys (estimate): 496512 Memtable Columns Count: 61093 Memtable Data Size: 116164716 Memtable Switch Count: 26 Read Count: 11318 Read Latency: 76.083 ms. Write Count: 2215986 Write Latency: 0.008 ms. Pending Tasks: 0 Key cache capacity: 5000 Key cache size: 5000 Key cache hit rate: 0.0018995517057974318 Row cache: disabled Compacted row minimum size: 216 Compacted row maximum size: 105778 Compacted row mean size: 10079 Column Family: SLookbackLog SSTable count: 2 Space used (live): 23988670 Space used (total): 23988670 Number of Keys (estimate): 10496 Memtable Columns Count: 111401 Memtable Data Size: 50531214 Memtable Switch Count: 7 Read Count: 0 Read Latency: NaN ms. Write Count: 2431579 Write Latency: 0.007 ms. Pending Tasks: 0 Key cache capacity: 10496 Key cache size: 0 Key cache hit rate: NaN Row cache capacity: 10496 Row cache size: 0 Row cache hit rate: NaN Compacted row minimum size: 73 Compacted row maximum size: 20501 Compacted row mean size: 2484 Column Family: Tag SSTable count: 0 Space used (live): 0 Space used (total): 0 Number of Keys (estimate): 0 Memtable Columns Count: 0 Memtable Data Size: 0 Memtable Switch Count: 0 Read Count: 0 Read Latency: NaN ms. Write Count: 0 Write Latency: NaN ms. Pending Tasks: 0 Key cache capacity: 1000 Key cache size: 0 Key cache hit rate: NaN Row cache capacity: 1000 Row cache size: 0 Row cache hit rate: NaN Compacted row minimum size: 0 Compacted row maximum size: 0 Compacted row mean size: 0 Column Family: SDaily SSTable count: 1 Space used (live): 60375798 Space used (total): 60375798 Number of Keys (estimate): 166016 Memtable Columns Count: 165260 Memtable Data Size: 8056425 Memtable Switch Count: 0 Read Count: 0 Read Latency: NaN ms. Write Count: 165260 Write Latency: NaN ms. Pending Tasks: 0 Key cache capacity: 1000 Key cache size: 0 Key cache hit rate: NaN Row cache: disabled Compacted row minimum size: 150 Compacted row maximum size: 446 Compacted row mean size: 284 ---------------- --Apple-Mail=_0E959D4E-576E-42B7-8958-AAB60690A570 Content-Disposition: attachment; filename=smime.p7s Content-Type: application/pkcs7-signature; name=smime.p7s Content-Transfer-Encoding: base64 MIAGCSqGSIb3DQEHAqCAMIACAQExCzAJBgUrDgMCGgUAMIAGCSqGSIb3DQEHAQAAoIIKZTCCBN0w ggPFoAMCAQICEHGS++YZX6xNEoV0cTSiGKcwDQYJKoZIhvcNAQEFBQAwezELMAkGA1UEBhMCR0Ix GzAZBgNVBAgMEkdyZWF0ZXIgTWFuY2hlc3RlcjEQMA4GA1UEBwwHU2FsZm9yZDEaMBgGA1UECgwR Q29tb2RvIENBIExpbWl0ZWQxITAfBgNVBAMMGEFBQSBDZXJ0aWZpY2F0ZSBTZXJ2aWNlczAeFw0w NDAxMDEwMDAwMDBaFw0yODEyMzEyMzU5NTlaMIGuMQswCQYDVQQGEwJVUzELMAkGA1UECBMCVVQx FzAVBgNVBAcTDlNhbHQgTGFrZSBDaXR5MR4wHAYDVQQKExVUaGUgVVNFUlRSVVNUIE5ldHdvcmsx ITAfBgNVBAsTGGh0dHA6Ly93d3cudXNlcnRydXN0LmNvbTE2MDQGA1UEAxMtVVROLVVTRVJGaXJz dC1DbGllbnQgQXV0aGVudGljYXRpb24gYW5kIEVtYWlsMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8A MIIBCgKCAQEAsjmFpPJ9q0E7YkY3rs3BYHW8OWX5ShpHornMSMxqmNVNNRm5pELlzkniii8efNIx B8dOtINknS4p1aJkxIW9hVE1eaROaJB7HHqkkqgX8pgV8pPMyaQylbsMTzC9mKALi+VuG6JG+ni8 om+rWV6lL8/K2m2qL+usobNqqrcuZzWLeeEeaYji5kbNoKXqvgvOdjp6Dpvq/NonWz1zHyLmSGHG TPNpsaguG7bUMSAsvIKKjqQOpdeJQ/wWWq8dcdcRWdq6hw2v+vPhwvCkxWeM1tZUOt4KpLoDd7Nl yP0e03RiqhjKaJMeoYV+9Udly/hNVyh00jT/MLbu9mIwFIws6wIDAQABo4IBJzCCASMwHwYDVR0j BBgwFoAUoBEKIz6W8Qfs4q8p74Klf9AwpLQwHQYDVR0OBBYEFImCZ33EnSZwAEu0UEh83j2uBG59 MA4GA1UdDwEB/wQEAwIBBjAPBgNVHRMBAf8EBTADAQH/MB0GA1UdJQQWMBQGCCsGAQUFBwMCBggr BgEFBQcDBDARBgNVHSAECjAIMAYGBFUdIAAwewYDVR0fBHQwcjA4oDagNIYyaHR0cDovL2NybC5j b21vZG9jYS5jb20vQUFBQ2VydGlmaWNhdGVTZXJ2aWNlcy5jcmwwNqA0oDKGMGh0dHA6Ly9jcmwu Y29tb2RvLm5ldC9BQUFDZXJ0aWZpY2F0ZVNlcnZpY2VzLmNybDARBglghkgBhvhCAQEEBAMCAQYw DQYJKoZIhvcNAQEFBQADggEBAJ2Vyzy4fqUJxB6/C8LHdo45PJTGEKpPDMngq4RdiVTgZTvzbRx8 NywlVF+WIfw3hJGdFdwUT4HPVB1rbEVgxy35l1FM+WbKPKCCjKbI8OLp1Er57D9Wyd12jMOCAU9s APMeGmF0BEcDqcZAV5G8ZSLFJ2dPV9tkWtmNH7qGL/QGrpxp7en0zykX2OBKnxogL5dMUbtGB8SK N04g4wkxaMeexIud6H4RvDJoEJYRmETYKlFgTYjrdDrfQwYyyDlWjDoRUtNBpEMD9O3vMyfbOeAU TibJ2PU54om4k123KSZB6rObroP8d3XK6Mq1/uJlSmM+RMTQw16Hc6mYHK9/FX8wggWAMIIEaKAD AgECAhAHed03fGlPt2nV4Ztl4nCuMA0GCSqGSIb3DQEBBQUAMIGuMQswCQYDVQQGEwJVUzELMAkG A1UECBMCVVQxFzAVBgNVBAcTDlNhbHQgTGFrZSBDaXR5MR4wHAYDVQQKExVUaGUgVVNFUlRSVVNU IE5ldHdvcmsxITAfBgNVBAsTGGh0dHA6Ly93d3cudXNlcnRydXN0LmNvbTE2MDQGA1UEAxMtVVRO LVVTRVJGaXJzdC1DbGllbnQgQXV0aGVudGljYXRpb24gYW5kIEVtYWlsMB4XDTEwMTIyOTAwMDAw MFoXDTExMTIyOTIzNTk1OVowKjEoMCYGCSqGSIb3DQEJARYZZGFuZHJlZUBsYWN1bmFzeXN0ZW1z LmNvbTCCASIwDQYJKoZIhvcNAQEBBQADggEPADCCAQoCggEBAN8AUGZU5j3OjRr/ZHftcdrSdFHC W9Ds21da8VWWO0+C52uCWvXvM7bI2y7L4lYbuHY+qs+zG70dRk/PuXYPaxrJOPGtA9qcQ/cUULBw Ilmvv1lqSGvHXhjg025blS+u7sQlkycY5+g4cuqGoez4XCmEnwdGpzCVmgNkYzPZOFdS2rajVEwg qYyK9Eo9lWHX2a/HXMzHQmCyDqjJSGQUUiHk55Jwg+pWtykhhnQQM9BQrgvdQOJCL2dyezTJJlNf hY54lCfKD4hwd3fOVZLDUj3Fd1t00q1xg0AF+GDYLkWRpviLWuHZCWKL99R1IshQjKG6jU4q7iFr ecmrVw5o56MCAwEAAaOCAhswggIXMB8GA1UdIwQYMBaAFImCZ33EnSZwAEu0UEh83j2uBG59MB0G A1UdDgQWBBTfpxv0dUFtmuR/ZQJz2jQ2qt3aTDAOBgNVHQ8BAf8EBAMCBaAwDAYDVR0TAQH/BAIw ADAgBgNVHSUEGTAXBggrBgEFBQcDBAYLKwYBBAGyMQEDBQIwEQYJYIZIAYb4QgEBBAQDAgUgMEYG A1UdIAQ/MD0wOwYMKwYBBAGyMQECAQEBMCswKQYIKwYBBQUHAgEWHWh0dHBzOi8vc2VjdXJlLmNv bW9kby5uZXQvQ1BTMIGlBgNVHR8EgZ0wgZowTKBKoEiGRmh0dHA6Ly9jcmwuY29tb2RvY2EuY29t L1VUTi1VU0VSRmlyc3QtQ2xpZW50QXV0aGVudGljYXRpb25hbmRFbWFpbC5jcmwwSqBIoEaGRGh0 dHA6Ly9jcmwuY29tb2RvLm5ldC9VVE4tVVNFUkZpcnN0LUNsaWVudEF1dGhlbnRpY2F0aW9uYW5k RW1haWwuY3JsMGwGCCsGAQUFBwEBBGAwXjA2BggrBgEFBQcwAoYqaHR0cDovL2NydC5jb21vZG9j YS5jb20vVVROQUFBQ2xpZW50Q0EuY3J0MCQGCCsGAQUFBzABhhhodHRwOi8vb2NzcC5jb21vZG9j YS5jb20wJAYDVR0RBB0wG4EZZGFuZHJlZUBsYWN1bmFzeXN0ZW1zLmNvbTANBgkqhkiG9w0BAQUF AAOCAQEAR1HPJz0+rvkf6efQ/La72DkmYCeH/fNUaPMkLesu4ilWWHDT3ROY7HO7JtxPf5r6PNAv KihHmYdfVxpaJ/J47NTXiEmuMTuXOnhx0tbd5kqi3gDEJcOcr4FNA/AFhz0Uxcd8t4FXLXuSGsrt DmTFmswbDYJa1INeTwqoMmLZYsWj85qOOxz4GyIMQCuNFPNwTrC5TLOLw9CarLbw/3Sm6hIqYiaq 4e44jb7C4fBXhVAG0olSBI4embs2gW9I2JCuhEKgtFlbdlV8bn9IKPNCuxlm/zfWj1M5bVCW5pjJ 2Bid+CVQfiEFNqUJidt+HolYpWdEVoxl/z/zcu0BsAPp3DGCA/wwggP4AgEBMIHDMIGuMQswCQYD VQQGEwJVUzELMAkGA1UECBMCVVQxFzAVBgNVBAcTDlNhbHQgTGFrZSBDaXR5MR4wHAYDVQQKExVU aGUgVVNFUlRSVVNUIE5ldHdvcmsxITAfBgNVBAsTGGh0dHA6Ly93d3cudXNlcnRydXN0LmNvbTE2 MDQGA1UEAxMtVVROLVVTRVJGaXJzdC1DbGllbnQgQXV0aGVudGljYXRpb24gYW5kIEVtYWlsAhAH ed03fGlPt2nV4Ztl4nCuMAkGBSsOAwIaBQCgggINMBgGCSqGSIb3DQEJAzELBgkqhkiG9w0BBwEw HAYJKoZIhvcNAQkFMQ8XDTExMDgyNDAxNTIyNFowIwYJKoZIhvcNAQkEMRYEFELqJBQDCeQXOFlm khXXVPJhzNNiMIHUBgkrBgEEAYI3EAQxgcYwgcMwga4xCzAJBgNVBAYTAlVTMQswCQYDVQQIEwJV VDEXMBUGA1UEBxMOU2FsdCBMYWtlIENpdHkxHjAcBgNVBAoTFVRoZSBVU0VSVFJVU1QgTmV0d29y azEhMB8GA1UECxMYaHR0cDovL3d3dy51c2VydHJ1c3QuY29tMTYwNAYDVQQDEy1VVE4tVVNFUkZp cnN0LUNsaWVudCBBdXRoZW50aWNhdGlvbiBhbmQgRW1haWwCEAd53Td8aU+3adXhm2XicK4wgdYG CyqGSIb3DQEJEAILMYHGoIHDMIGuMQswCQYDVQQGEwJVUzELMAkGA1UECBMCVVQxFzAVBgNVBAcT DlNhbHQgTGFrZSBDaXR5MR4wHAYDVQQKExVUaGUgVVNFUlRSVVNUIE5ldHdvcmsxITAfBgNVBAsT GGh0dHA6Ly93d3cudXNlcnRydXN0LmNvbTE2MDQGA1UEAxMtVVROLVVTRVJGaXJzdC1DbGllbnQg QXV0aGVudGljYXRpb24gYW5kIEVtYWlsAhAHed03fGlPt2nV4Ztl4nCuMA0GCSqGSIb3DQEBAQUA BIIBACrOJ4JSaxQY/Il+PidYk5P+z3XTKi2rpQJVOmaasvyE9Agk3jmtdQn7ySimk7bFD4OK4UHN OJoHG58faR99t90juZ/PmPHWx5LiPDse9QqkmVvQGvQSfLYw+EoDuqHFBCoMmE7KunQS80vIO9LG BAy9UlyAmn5ufQu2TcCOE+qFeiZ7tcVapQotXnj/p6bGhSkBivlR9eKYn1SoOwRQZOnBRdA2Tmi8 Fy4iv2JbrJ9RIUsFx7NL+slUlLcDIpPRJvORUovOrGK9b4z55nl+c63S4QybZ1lxoaRHLp99oZqt 0Knjb87lJ5E2aCXGvhAmjTnM5Hp9h8opZehYY2uFaT0AAAAAAAA= --Apple-Mail=_0E959D4E-576E-42B7-8958-AAB60690A570--