hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Shashikant Banerjee (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-12998) SnapshotDiff - Provide an iterator-based listing API for calculating snapshotDiff
Date Tue, 13 Feb 2018 09:23:00 GMT

     [ https://issues.apache.org/jira/browse/HDFS-12998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Shashikant Banerjee updated HDFS-12998:
---------------------------------------
    Status: Patch Available  (was: Open)

> SnapshotDiff - Provide an iterator-based listing API for calculating snapshotDiff
> ---------------------------------------------------------------------------------
>
>                 Key: HDFS-12998
>                 URL: https://issues.apache.org/jira/browse/HDFS-12998
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>            Reporter: Shashikant Banerjee
>            Assignee: Shashikant Banerjee
>            Priority: Major
>         Attachments: HDFS-12998.001.patch
>
>
> Currently , SnapshotDiff computation happens over multiple rpc calls to namenode depending
on the no of snapshotDiff entries where each rpc call returns at max 1000 entries by default
. Each "getSnapshotDiffreportListing" call to namenode returns a partial snapshotDiffreportList
which are all combined and processed at the client side to generate a final snapshotDiffreport.
There can be cases where SnapshotDiffReport can be huge and in situations as such , the  rpc
calls to namnode should happen on demand at the client side.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message