hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Inigo Goiri (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-6450) Support non-positional hedged reads in HDFS
Date Wed, 08 Mar 2017 23:16:38 GMT

    [ https://issues.apache.org/jira/browse/HDFS-6450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15902152#comment-15902152

Inigo Goiri commented on HDFS-6450:

Thanks [~andrew.wang].
Most of the hedging management is done asynchronously but we still need to copy data between
threads, so I guess his concern is still valid.
The solution is much faster than a regular read but the thread management is still there.
In any case, I think it's good practice to make it an opt-in feature.
We already rely on the config from HDFS-5776 to enable/disable it.
If we want to separate it from the regular hedged reads, we can add a separate one for non-positional

> Support non-positional hedged reads in HDFS
> -------------------------------------------
>                 Key: HDFS-6450
>                 URL: https://issues.apache.org/jira/browse/HDFS-6450
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>    Affects Versions: 2.4.0
>            Reporter: Colin P. McCabe
>            Assignee: Liang Xie
>         Attachments: HDFS-6450-like-pread.txt
> HDFS-5776 added support for hedged positional reads.  We should also support hedged non-position
reads (aka regular reads).

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org

View raw message