hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Shashikant Banerjee (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-12998) SnapshotDiff - Provide an iterator-based listing API for calculating snapshotDiff
Date Tue, 09 Jan 2018 04:09:00 GMT
Shashikant Banerjee created HDFS-12998:
------------------------------------------

             Summary: SnapshotDiff - Provide an iterator-based listing API for calculating
snapshotDiff
                 Key: HDFS-12998
                 URL: https://issues.apache.org/jira/browse/HDFS-12998
             Project: Hadoop HDFS
          Issue Type: Improvement
            Reporter: Shashikant Banerjee
            Assignee: Shashikant Banerjee


Currently , SnapshotDiff computation happens over multiple rpc calls to namenode depending
on the no of snapshotDiff entries where each rpc call returns at max 1000 entries by default
. Each "getSnapshotDiffreportListing" call to namenode returns a partial snapshotDiffreportList
which are all combined and processed at the client side to generate a final snapshotDiffreport.
There can be cases where SnapshotDiffReport can be huge and in situations as such , the  rpc
calls to namnode should happen on demand at the client side.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message