hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yongjun Zhang (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-10314) Propose a new tool that wraps around distcp to "restore" changes on target cluster
Date Tue, 19 Apr 2016 21:57:25 GMT

     [ https://issues.apache.org/jira/browse/HDFS-10314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Yongjun Zhang updated HDFS-10314:
---------------------------------
    Description: 
HDFS-9820 proposed adding -rdiff switch to distcp, as a reversed operation of -diff switch.


Upon discussion with [~jingzhao], we will introduce a new tool that wraps around distcp to
achieve the same purpose.

I'm thinking about calling the new tool "rsync", similar to unix/linux command "rsync". The
"r" here means remote.

The syntax that simulate -rdiff behavior proposed in HDFS-9820 is
{code}
rsync <fromSnapshotName>  <toSnapshotName>  <source> <target>
{code}
This command ensure <fromSnapshotName>  is newer than <toSnapshotName>.

I think, In the future, we can add another command to have the functionality of -diff switch
of distcp.
{code}
sync <fromSnapshotName>  <toSnapshotName>  <source> <target>
{code}
that ensures <fromSnapshotName>  is older than <toSnapshotName>.

Thanks [~jingzhao].

  was:
HDFS-9820 proposed adding -rdiff switch to distcp, as a reversed operation of -diff switch.


Upon discussion with [~jingzhao], we will introduce a new tool that wraps around distcp to
achieve the same purpose.

I'm thinking about calling the new tool "rsync", similar to unix/linux command "rsync". The
"r" here means remote.

The syntax that simulate -rdiff behavior proposed in HDFS-9820 is
 {code}  
    rsync <fromSnapshotName>  <toSnapshotName>  <source> <target>
Pcode}
This command ensure <fromSnapshotName>  is newer than <toSnapshotName>.

I think, In the future, we can add another command to have the functionality of -diff switch
of distcp.
 {code}  
    sync <fromSnapshotName>  <toSnapshotName>  <source> <target>
Pcode}
where <fromSnapshotName>  must be older than <toSnapshotName>.

Thanks [~jingzhao].


> Propose a new tool that wraps around distcp to "restore" changes on target cluster
> ----------------------------------------------------------------------------------
>
>                 Key: HDFS-10314
>                 URL: https://issues.apache.org/jira/browse/HDFS-10314
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: tools
>            Reporter: Yongjun Zhang
>            Assignee: Yongjun Zhang
>
> HDFS-9820 proposed adding -rdiff switch to distcp, as a reversed operation of -diff switch.

> Upon discussion with [~jingzhao], we will introduce a new tool that wraps around distcp
to achieve the same purpose.
> I'm thinking about calling the new tool "rsync", similar to unix/linux command "rsync".
The "r" here means remote.
> The syntax that simulate -rdiff behavior proposed in HDFS-9820 is
> {code}
> rsync <fromSnapshotName>  <toSnapshotName>  <source> <target>
> {code}
> This command ensure <fromSnapshotName>  is newer than <toSnapshotName>.
> I think, In the future, we can add another command to have the functionality of -diff
switch of distcp.
> {code}
> sync <fromSnapshotName>  <toSnapshotName>  <source> <target>
> {code}
> that ensures <fromSnapshotName>  is older than <toSnapshotName>.
> Thanks [~jingzhao].



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message