hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Colin Patrick McCabe (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-8965) Harden edit log reading code against out of memory errors
Date Wed, 26 Aug 2015 22:48:46 GMT
Colin Patrick McCabe created HDFS-8965:
------------------------------------------

             Summary: Harden edit log reading code against out of memory errors
                 Key: HDFS-8965
                 URL: https://issues.apache.org/jira/browse/HDFS-8965
             Project: Hadoop HDFS
          Issue Type: Improvement
            Reporter: Colin Patrick McCabe
            Assignee: Colin Patrick McCabe


We should harden the edit log reading code against out of memory errors.  Now that each op
has a length prefix and a checksum, we can validate the checksum before trying to load the
Op data.  This should avoid out of memory errors when trying to load garbage data as Op data.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message