hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "lk_hadoop"<lk_had...@163.com>
Subject DistCp cp ftp folder to hdfs
Date Thu, 20 Oct 2016 09:46:21 GMT
I want to cp data files under a folder from ftp server to hdfs:
hadoop distcp ftp://youftp:youftp@*.zip hdfs://dev0:9000/sourcedata/biz/
but the progress was hung :
16/10/20 17:36:45 INFO tools.DistCp: Input Options: DistCpOptions{atomicCommit=false, syncFolder=false,
deleteMissing=false, ignoreFailures=false, maxMaps=20, sslConfigurationFile='null', copyStrategy='uniformsize',
sourceFileListing=null, sourcePaths=[ftp://youftp:youftp@*.zip], targetPath=hdfs://dev0:9000/sourcedata/biz/,
targetPathExists=false, preserveRawXattrs=false}
16/10/20 17:36:45 INFO client.RMProxy: Connecting to ResourceManager at dev0.youdata.com/

but ,if I give a specific filename ,for example :abc.zip ,it works. I don't know what to do


View raw message