hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-9113) ErasureCodingWorker#processErasureCodingTasks should not fail to process remaining tasks due to one invalid ECTask
Date Wed, 30 Sep 2015 16:38:20 GMT

    [ https://issues.apache.org/jira/browse/HDFS-9113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14937509#comment-14937509
] 

Hudson commented on HDFS-9113:
------------------------------

FAILURE: Integrated in Hadoop-Yarn-trunk #1203 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk/1203/])
HDFS-9113. ErasureCodingWorker#processErasureCodingTasks should not fail (umamahesh: rev b762199adbd10173c588df67bd227393c5bbcce9)
* hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestRecoverStripedFile.java
* hadoop-hdfs-project/hadoop-hdfs/CHANGES-HDFS-EC-7285.txt
* hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/erasurecode/ErasureCodingWorker.java


> ErasureCodingWorker#processErasureCodingTasks should not fail to process remaining tasks
due to one invalid ECTask
> ------------------------------------------------------------------------------------------------------------------
>
>                 Key: HDFS-9113
>                 URL: https://issues.apache.org/jira/browse/HDFS-9113
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: datanode
>    Affects Versions: HDFS-7285
>            Reporter: Uma Maheswara Rao G
>            Assignee: Uma Maheswara Rao G
>            Priority: Minor
>             Fix For: HDFS-7285
>
>         Attachments: HDFS-9113-HDFS-7285-00.patch
>
>
> Currently processErasureCodingTasks method submits ecTasks to thread pool service for
processing the tasks. While submitting we initialize ReconstructAndTransferBlock with each
ecTask and submit it. There are chances ReconstructAndTransferBlock initialization can fail
due to wrong values as we had preconditions for parameter validations in Ctor. Anyway, whatever
may be the case, processErasureCodingTasks should not fail and throw exceptions out as it
could prevent processing other tasks in the list. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message