hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Wei-Chiu Chuang (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (HDFS-12165) getSnapshotDiffReport throws NegativeArraySizeException for very large snapshot diff summary
Date Thu, 29 Mar 2018 20:52:00 GMT

     [ https://issues.apache.org/jira/browse/HDFS-12165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Wei-Chiu Chuang resolved HDFS-12165.
------------------------------------
    Resolution: Duplicate

> getSnapshotDiffReport throws NegativeArraySizeException for very large snapshot diff
summary
> --------------------------------------------------------------------------------------------
>
>                 Key: HDFS-12165
>                 URL: https://issues.apache.org/jira/browse/HDFS-12165
>             Project: Hadoop HDFS
>          Issue Type: Bug
>            Reporter: Wei-Chiu Chuang
>            Priority: Major
>
> For a really large snapshot diff, getSnapshotDiffReport throws NegativeArraySizeException
> {noformat}
> 2017-07-19 11:14:16,415 WARN org.apache.hadoop.ipc.Server: Error serializing call response
for call org.apache.hadoop.hdfs.protocol.ClientProtocol.getSnapshotDiffReport
>  from 10.17.211.10:58223 Call#0 Retry#0
> java.lang.NegativeArraySizeException
>         at com.google.protobuf.CodedOutputStream.newInstance(CodedOutputStream.java:105)
>         at com.google.protobuf.AbstractMessageLite.writeDelimitedTo(AbstractMessageLite.java:87)
>         at org.apache.hadoop.ipc.ProtobufRpcEngine$RpcResponseWrapper.write(ProtobufRpcEngine.java:468)
>         at org.apache.hadoop.ipc.Server.setupResponse(Server.java:2410)
>         at org.apache.hadoop.ipc.Server.access$500(Server.java:134)
>         at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2182)
> {noformat}
> This particular snapshot diff contains more than 25 million different file system objects,
and which means the serialized response can be more than 2GB, overflowing protobuf length
calculation.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message