hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Wei-Chiu Chuang (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-13612) Short-circuit read: unknown response code ERROR
Date Wed, 23 May 2018 21:47:00 GMT
Wei-Chiu Chuang created HDFS-13612:
--------------------------------------

             Summary: Short-circuit read: unknown response code ERROR
                 Key: HDFS-13612
                 URL: https://issues.apache.org/jira/browse/HDFS-13612
             Project: Hadoop HDFS
          Issue Type: Bug
    Affects Versions: 2.6.0
         Environment: CDH5.13.3, Kerberized, HBase, hedged reader, short circuit read.
            Reporter: Wei-Chiu Chuang


Found the following warning in a HBase RS log:

2018-05-19 13:13:00,310 WARN org.apache.hadoop.hdfs.BlockReaderFactory: BlockReaderFactory(fileName=<REDACTED>,
block=BP-297993939-10.0.0.1-1402080332426:blk_1816287870_744594480): unknown response code
ERROR while attempting to set up short-circuit access. Block BP-297993939-10.0.0.1-1402080332426:blk_1816287870_744594480
is not valid

Checking the code, if the request fails because of block access token (invalid access token),
BlockReaderFactory#requestFileDescriptors expects error code ERROR_ACCESS_TOKEN. However,
on the DataNode side, DataXceiver#requestShortCircuitFds emits ERROR if an IOException is
thrown.

So ERROR is expected and BlockReaderFactory#requestFileDescriptors should handle it better.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org


Mime
View raw message