hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-13137) Ozone: Ozonefs read fails because ChunkGroupInputStream#read does not iterate through all the blocks in the key
Date Tue, 24 Apr 2018 21:00:08 GMT

    [ https://issues.apache.org/jira/browse/HDFS-13137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16451182#comment-16451182
] 

Hudson commented on HDFS-13137:
-------------------------------

SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14057 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/14057/])
HDFS-13137. Ozone: Ozonefs read fails because ChunkGroupInputStream#read (aengineer: rev faa01f32027de4593026941f0a36cae644f6d436)
* (edit) hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/ozone/scm/pipelines/ratis/RatisManagerImpl.java
* (edit) hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/ozone/client/rpc/RpcClient.java
* (edit) hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/ozone/protocolPB/KeySpaceManagerProtocolServerSideTranslatorPB.java
* (add) hadoop-tools/hadoop-ozone/src/test/java/org/apache/hadoop/fs/ozone/TestOzoneFSInputStream.java
* (edit) hadoop-tools/hadoop-ozone/src/test/java/org/apache/hadoop/fs/ozone/TestOzoneFileInterfaces.java
* (edit) hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/ozone/ksm/KeyManagerImpl.java
* (edit) hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/ozone/client/io/ChunkGroupInputStream.java
* (edit) hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/ozone/scm/pipelines/standalone/StandaloneManagerImpl.java
* (edit) hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/ozone/client/OzoneClientFactory.java
* (edit) hadoop-tools/hadoop-ozone/src/main/java/org/apache/hadoop/fs/ozone/OzoneFSInputStream.java
* (edit) hadoop-tools/hadoop-ozone/src/main/java/org/apache/hadoop/fs/ozone/OzoneFileSystem.java
* (edit) hadoop-hdfs-project/hadoop-hdfs/src/main/resources/ozone-default.xml


> Ozone: Ozonefs read fails because ChunkGroupInputStream#read does not iterate through
all the blocks in the key
> ---------------------------------------------------------------------------------------------------------------
>
>                 Key: HDFS-13137
>                 URL: https://issues.apache.org/jira/browse/HDFS-13137
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: ozone
>    Affects Versions: HDFS-7240
>            Reporter: Mukul Kumar Singh
>            Assignee: Mukul Kumar Singh
>            Priority: Major
>             Fix For: HDFS-7240
>
>         Attachments: HDFS-13137-HDFS-7240.001.patch, HDFS-13137-HDFS-7240.002.patch,
HDFS-13137-HDFS-7240.003.patch, HDFS-13137-HDFS-7240.004.patch, HDFS-13137-HDFS-7240.005.patch
>
>
> OzoneFilesystem put is failing with the following exception. This happens because ChunkGroupInputStream#read
does not iterate through all the blocks in the key.
> {code}
> [hdfs@y129 ~]$ time /opt/hadoop/hadoop-3.1.0-SNAPSHOT/bin/hdfs dfs -put test3 /test3a
> 18/02/12 13:36:21 WARN util.NativeCodeLoader: Unable to load native-hadoop library for
your platform... using builtin-java classes where applicable
> 2018-02-12 13:36:22,211 [main] INFO       - Using org.apache.hadoop.ozone.client.rpc.RpcClient
as client protocol.
> 18/02/12 13:37:25 WARN util.ShutdownHookManager: ShutdownHook 'ClientFinalizer' timeout,
java.util.concurrent.TimeoutException
> java.util.concurrent.TimeoutException
>         at java.util.concurrent.FutureTask.get(FutureTask.java:205)
>         at org.apache.hadoop.util.ShutdownHookManager$1.run(ShutdownHookManager.java:68)
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message