hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "lk_hadoop"<lk_had...@163.com>
Subject DistCp cp ftp folder to hdfs
Date Thu, 20 Oct 2016 09:46:21 GMT
hi,all:
I want to cp data files under a folder from ftp server to hdfs:
hadoop distcp ftp://youftp:youftp@192.168.0.232/biz/*.zip hdfs://dev0:9000/sourcedata/biz/
but the progress was hung :
16/10/20 17:36:45 INFO tools.DistCp: Input Options: DistCpOptions{atomicCommit=false, syncFolder=false,
deleteMissing=false, ignoreFailures=false, maxMaps=20, sslConfigurationFile='null', copyStrategy='uniformsize',
sourceFileListing=null, sourcePaths=[ftp://youftp:youftp@192.168.0.232/biz/*.zip], targetPath=hdfs://dev0:9000/sourcedata/biz/,
targetPathExists=false, preserveRawXattrs=false}
16/10/20 17:36:45 INFO client.RMProxy: Connecting to ResourceManager at dev0.youdata.com/192.168.0.130:8032

but ,if I give a specific filename ,for example :abc.zip ,it works. I don't know what to do
.


2016-10-20


lk_hadoop 
Mime
View raw message