Return-Path: X-Original-To: apmail-cassandra-commits-archive@www.apache.org Delivered-To: apmail-cassandra-commits-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 86E219235 for ; Wed, 7 Mar 2012 17:41:22 +0000 (UTC) Received: (qmail 76999 invoked by uid 500); 7 Mar 2012 17:41:22 -0000 Delivered-To: apmail-cassandra-commits-archive@cassandra.apache.org Received: (qmail 76760 invoked by uid 500); 7 Mar 2012 17:41:22 -0000 Mailing-List: contact commits-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@cassandra.apache.org Delivered-To: mailing list commits@cassandra.apache.org Received: (qmail 76561 invoked by uid 99); 7 Mar 2012 17:41:20 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 07 Mar 2012 17:41:20 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 07 Mar 2012 17:41:18 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id 8D2EAE988 for ; Wed, 7 Mar 2012 17:40:57 +0000 (UTC) Date: Wed, 7 Mar 2012 17:40:57 +0000 (UTC) From: "Vijay (Issue Comment Edited) (JIRA)" To: commits@cassandra.apache.org Message-ID: <280298112.34959.1331142057579.JavaMail.tomcat@hel.zones.apache.org> In-Reply-To: <689754973.20432.1330899899053.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Issue Comment Edited] (CASSANDRA-3997) Make SerializingCache Memory Pluggable MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/CASSANDRA-3997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13224533#comment-13224533 ] Vijay edited comment on CASSANDRA-3997 at 3/7/12 5:40 PM: ---------------------------------------------------------- Ohhh sorry for the confusion. JEMAlloc's case: The Malloc/Free should done by ANY one thread at a time. The test had 100 Threads doing malloc/free but only one will actually malloc/free at a time and the "Time taken" shows the raw speed. TCMalloc's case: Only one thread should be malloc and doing free. (Even after this it was crashing randomly because of illegal memory access, hence i said JEMalloc hasnt crashed). The test code does exactly the above.... The implementation should deal with it and avoid contending for malloc and free with multiple threads. Once we deal with it, it works well. was (Author: vijay2win@yahoo.com): Ohhh sorry for the confusion. JEMAlloc's case: The Malloc/Free should be one only be done by any one thread at a time. The test had 100 Threads doing malloc/free but only one will actually malloc/free at a time and the "Time taken" shows the raw speed. TCMalloc's case: One thread should be malloc and doing free. (Even making this single threaded it was crashing randomly because of illegal memory access errors, hence i said JEMalloc hasnt crashed). The test code does exactly the above.... The implementation should deal with it and avoid contending for malloc and free with multiple threads. Once we deal with it, it works well. > Make SerializingCache Memory Pluggable > -------------------------------------- > > Key: CASSANDRA-3997 > URL: https://issues.apache.org/jira/browse/CASSANDRA-3997 > Project: Cassandra > Issue Type: Improvement > Components: Core > Reporter: Vijay > Assignee: Vijay > Priority: Minor > Labels: cache > Fix For: 1.2 > > Attachments: jna.zip > > > Serializing cache uses native malloc and free by making FM pluggable, users will have a choice of gcc malloc, TCMalloc or JEMalloc as needed. > Initial tests shows less fragmentation in JEMalloc but the only issue with it is that (both TCMalloc and JEMalloc) are kind of single threaded (at-least they crash in my test otherwise). -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira