hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rakesh R (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-8899) Erasure Coding: use threadpool for EC recovery tasks
Date Tue, 15 Sep 2015 03:22:46 GMT

    [ https://issues.apache.org/jira/browse/HDFS-8899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14744757#comment-14744757

Rakesh R commented on HDFS-8899:

Thank you [~zhz], [~hitliuyi], [~walter.k.su] for the reviews. Attached another patch addressing
the comments, please take a look at it again.

bq. Maybe we can create a threadpool with corePoolSize is 2, and maximumPoolSize is 8?
bq. DN doesn't recover EC block all the time. It should be allowCoreThreadTimeOut(true). And
need a good thread name for better diagnosis .
Done. Named the thread : {{stripedBlockRecovery-%d}}

> Erasure Coding: use threadpool for EC recovery tasks
> ----------------------------------------------------
>                 Key: HDFS-8899
>                 URL: https://issues.apache.org/jira/browse/HDFS-8899
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Rakesh R
>            Assignee: Rakesh R
>         Attachments: HDFS-8899-HDFS-7285-01.patch, HDFS-8899-HDFS-7285-02.patch, HDFS-8899-HDFS-7285-merge-00.patch
> The idea is to use threadpool for processing erasure coding recovery tasks at the datanode.
> {code}
> new Daemon(new ReconstructAndTransferBlock(recoveryInfo)).start();
> {code}

This message was sent by Atlassian JIRA

View raw message