cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vijay (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (CASSANDRA-4388) Use MMap for CompressedSegmentFile with Native Checksum
Date Mon, 09 Jul 2012 04:25:33 GMT

     [ https://issues.apache.org/jira/browse/CASSANDRA-4388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Vijay updated CASSANDRA-4388:
-----------------------------

    Attachment: 0001-CASSANDRA-4388.patch

There is 2 parts to this patch:
1) We have to support MMap to get access to DirectBB
2) Use hadoop's native API to use native CRC & CRCC 

For the second part needs Native C library which is included in the alpha version of hadoop
jar. Hence we might want to wait till it is released (to avoid breaking other dependent code).

Bench Mark (First part is still better): 
http://pastebin.com/g4p3Sf6v
                
> Use MMap for CompressedSegmentFile with Native Checksum
> -------------------------------------------------------
>
>                 Key: CASSANDRA-4388
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-4388
>             Project: Cassandra
>          Issue Type: Improvement
>          Components: Core
>    Affects Versions: 1.2
>            Reporter: Vijay
>            Assignee: Vijay
>         Attachments: 0001-CASSANDRA-4388.patch
>
>
> Use MMap for CompressedSegmentFile (Something similar to CASSANDRA-3623) and use Native
Checksum (HDFS-2080) to avoid memcpy and be faster in its calculations.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message