hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Erik Forsberg <forsb...@opera.com>
Subject Re: discyp between different versions of Hadoop...
Date Mon, 07 Sep 2009 07:00:51 GMT
On Sun, 6 Sep 2009 22:45:28 -0700 (PDT)
C G <parallelguy@yahoo.com> wrote:

> Hi All:
> Does anybody know if it's possible to distcp between an old version
> of Hadoop (0.15.x, for example) and a modern version (0.19.2)?

Yes:

1) Run the distcp job on the newer cluster.
2) Use the hftp method in the source URI.

Example: 

hadoop distcp hftp://oldclusternamenode:50070/path/to/src \
hdfs://newclusternamenode:8020/path/to/dst

See http://hadoop.apache.org/common/docs/r0.20.0/distcp.html#cpver

Cheers,
\EF
-- 
Erik Forsberg <forsberg@opera.com>
Developer, Opera Software - http://www.opera.com/

Mime
View raw message