accumulo-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF subversion and git services (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (ACCUMULO-1654) Bug in encryption-at-rest causes periodic IOExceptions
Date Fri, 16 Aug 2013 16:02:48 GMT

    [ https://issues.apache.org/jira/browse/ACCUMULO-1654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13742338#comment-13742338
] 

ASF subversion and git services commented on ACCUMULO-1654:
-----------------------------------------------------------

Commit 2d36f885a117e529195ca9176dc288d85618bfc1 in branch refs/heads/master from [~mallen]
[ https://git-wip-us.apache.org/repos/asf?p=accumulo.git;h=2d36f88 ]

ACCUMULO-1654 Fixed a bug where keys and IVs from encrypted files were not always entirely
read before being used. Found this bug in longevity testing. Also adds a key management strategy
that caches keys retrieved from HDFS for better performance.

Signed-off-by: Keith Turner <kturner@apache.org>

                
> Bug in encryption-at-rest causes periodic IOExceptions
> ------------------------------------------------------
>
>                 Key: ACCUMULO-1654
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-1654
>             Project: Accumulo
>          Issue Type: Sub-task
>          Components: tserver
>            Reporter: Michael Allen
>             Fix For: 1.6.0
>
>         Attachments: 0001-Fixed-a-bug-where-keys-and-IVs-from-encrypted-files-.patch
>
>
> During longevity testing of the encryption-at-rest version of Accumulo, we would occasionally
see IOExceptions that took the form of Zlib throwing an "incorrect header check" exception.
 These exceptions occurred only after a few hours of testing, during minor and major compaction
of various RFiles.  Downloading and examining the RFiles in question showed no obvious deformities
within the RFile structure.  
> Some careful debugging later, the crux of the problem turned out to be some calls to
read() when readFully() should have been used.  
> Patch coming forthwith.  Also included in this patch is another secret key handling strategy
that caches the secret key from HDFS when first read.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message