hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Benoit Perroud (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-7873) OIV webhdfs premature close channel issue
Date Tue, 03 Mar 2015 09:38:06 GMT
Benoit Perroud created HDFS-7873:
------------------------------------

             Summary: OIV webhdfs premature close channel issue
                 Key: HDFS-7873
                 URL: https://issues.apache.org/jira/browse/HDFS-7873
             Project: Hadoop HDFS
          Issue Type: Bug
          Components: tools
    Affects Versions: 2.5.2, 2.6.0
            Reporter: Benoit Perroud
            Assignee: Benoit Perroud
            Priority: Minor


The new Offline Image Viewer (OIV) supports to load the FSImage and _emulate_ a webhdfs server
to explore the image without touching the NN.

This webhdfs server is not working with folders holding a significant number of children (files
or other folders):

{quote}
$  hadoop fs -ls webhdfs://127.0.0.1:5978/a/big/folder
15/03/03 04:28:19 WARN ssl.FileBasedKeyStoresFactory: The property 'ssl.client.truststore.location'
has not been set, no TrustStore will be loaded
15/03/03 04:28:21 WARN security.UserGroupInformation: PriviledgedActionException as:bperroud
(auth:SIMPLE) cause:java.io.IOException: Response decoding failure: java.lang.IllegalStateException:
Expected one of '"}'
ls: Response decoding failure: java.lang.IllegalStateException: Expected one of '"}'
{quote}

The error comes from an inappropriate usage of Netty. {{e.getFuture().addListener(ChannelFutureListener.CLOSE)}}
is closing the channel too early because the future attached to the channel already sent the
header so the I/O operation succeeded.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message