accumulo-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Keith Turner (JIRA)" <>
Subject [jira] [Commented] (ACCUMULO-980) support pluggable codecs for RFile
Date Fri, 01 Feb 2013 22:48:13 GMT


Keith Turner commented on ACCUMULO-980:

bq.  I don't think HDFS works that way, because one can only write a file once, correct?

correct. If compactions can read and write data with different keys, then that provides a
way to rekey.  It sounds like your design may support this already?  Granted its way more
expensive than it needs to be.  I would be happy with the compaction rekeying capability at
first, because at least I have the capability.   The optimizations you mentioned for rekeying
rfile's more efficiently could be something to consider later.

> support pluggable codecs for RFile
> ----------------------------------
>                 Key: ACCUMULO-980
>                 URL:
>             Project: Accumulo
>          Issue Type: Improvement
>            Reporter: Adam Fuchs
>            Assignee: Adam Fuchs
>             Fix For: 1.6.0
>         Attachments: RFile-Changes-Proposal-V1.pdf
> As part of the encryption at rest story, RFile should support pluggable modules where
it currently has hardcoded options for compression codecs. This is a natural place to add
encryption capabilities, as the cost of encryption would likely not be significantly different
from the cost of compression, and the block-level integration should maintain the same seek
and scan performance. Given the many implementation options for both encryption and compression,
it makes sense to have a plugin structure here.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see:

View raw message