Return-Path: X-Original-To: apmail-hadoop-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 5289C17B0B for ; Tue, 3 Feb 2015 11:06:20 +0000 (UTC) Received: (qmail 97469 invoked by uid 500); 3 Feb 2015 11:06:15 -0000 Delivered-To: apmail-hadoop-user-archive@hadoop.apache.org Received: (qmail 97346 invoked by uid 500); 3 Feb 2015 11:06:15 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 97334 invoked by uid 99); 3 Feb 2015 11:06:14 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 03 Feb 2015 11:06:14 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of xeonmailinglist@gmail.com designates 74.125.82.44 as permitted sender) Received: from [74.125.82.44] (HELO mail-wg0-f44.google.com) (74.125.82.44) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 03 Feb 2015 11:05:46 +0000 Received: by mail-wg0-f44.google.com with SMTP id z12so43967732wgg.3 for ; Tue, 03 Feb 2015 03:05:45 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=message-id:date:from:user-agent:mime-version:to:subject:references :in-reply-to:content-type; bh=Fkl+PCUykxVaSDs2QkqkSth4PFXVx+NyFZt0m1Vp8pk=; b=i/AgFiaKJ0oNW4OKLNsM0L5adZMGbO3ZAOlo6EqCdwxi8Mf6fuKtemldt7tLxVsxqg Rm7NKIOSYBK3LCQW0DDfSwp2R9fZ3uP+Y7bOvwD0NqKDW52gxXFadPehm6Dny/M0atz1 IHVGdG4gtp1X6+Wc8a4TX2mw2W3i+LrYAH18+Sqq8ONAaPEGqW893KSjnBpvB0UdEd0U JibyeHEQY3LDMjhsOPYFqCSUpCQmzUAIBxkVegkQNJhck6az9f8qu4QMMQaDVqnzimp7 x+/dE1mzmh0InXaStKotMt1XUEapKHSA10MKSilwu2pMZtuonvYa+zU5OHuv+mDpijx1 NWEA== X-Received: by 10.194.60.235 with SMTP id k11mr53301619wjr.131.1422961545262; Tue, 03 Feb 2015 03:05:45 -0800 (PST) Received: from [10.101.231.86] ([194.117.18.101]) by mx.google.com with ESMTPSA id x18sm24098788wia.12.2015.02.03.03.05.43 for (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Tue, 03 Feb 2015 03:05:44 -0800 (PST) Message-ID: <54D0AB86.2020808@gmail.com> Date: Tue, 03 Feb 2015 11:05:42 +0000 From: xeonmailinglist User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: user@hadoop.apache.org Subject: Re: tools.DistCp: Invalid arguments References: <54CFD576.7020106@gmail.com> <56B55994-0CD1-4793-8A90-35D06EA0310C@gmail.com> In-Reply-To: <56B55994-0CD1-4793-8A90-35D06EA0310C@gmail.com> Content-Type: multipart/alternative; boundary="------------090903010800000207030805" X-Virus-Checked: Checked by ClamAV on apache.org This is a multi-part message in MIME format. --------------090903010800000207030805 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit Maybe this has to do with this error… I can’t do |ls| to my own machine using the command below. Can this be related to the other problem? Shouldn't I list the files with this command? |vagrant@hadoop-coc-1:~$ hdfs dfs -ls hdfs://192.168.56.100/ ls: Call From hadoop-coc-1/192.168.56.100 to hadoop-coc-1:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused | On 02-02-2015 19:59, Alexander Alten-Lorenz wrote: > Have a closer look: > >> |hdfs://hadoop-coc-2:50070/| > > No Path is given. > > >> On 02 Feb 2015, at 20:52, xeonmailinglist > > wrote: >> >> Hi, >> >> I am trying to copy data using |distcp| but I get this error. Both >> hadoop runtime are working properly. Why is this happening? >> >> | >> vagrant@hadoop-coc-1:~/Programs/hadoop$ hadoop distcphdfs://hadoop-coc-1:50070/input1 hdfs://hadoop-coc-2:50070/ >> 15/02/02 19:46:37 ERROR tools.DistCp: Invalid arguments: >> java.io.IOException: Failed on local exception: com.google.protobuf.InvalidProtocolBufferException: Protocol message end-group tag did not match expected tag.; Host Details : local host is: "hadoop-coc-1/127.0.1.1"; destination host is: "hadoop-coc-2":50070; >> at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:772) >> at org.apache.hadoop.ipc.Client.call(Client.java:1472) >> at org.apache.hadoop.ipc.Client.call(Client.java:1399) >> at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) >> at com.sun.proxy.$Proxy9.getFileInfo(Unknown Source) >> at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getFileInfo(ClientNamenodeProtocolTranslatorPB.java:752) >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) >> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >> at java.lang.reflect.Method.invoke(Method.java:606) >> at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187) >> at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102) >> at com.sun.proxy.$Proxy10.getFileInfo(Unknown Source) >> at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:1988) >> at org.apache.hadoop.hdfs.DistributedFileSystem$18.doCall(DistributedFileSystem.java:1118) >> at org.apache.hadoop.hdfs.DistributedFileSystem$18.doCall(DistributedFileSystem.java:1114) >> at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) >> at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1114) >> at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1400) >> at org.apache.hadoop.tools.DistCp.setTargetPathExists(DistCp.java:188) >> at org.apache.hadoop.tools.DistCp.run(DistCp.java:111) >> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) >> at org.apache.hadoop.tools.DistCp.main(DistCp.java:401) >> Caused by: com.google.protobuf.InvalidProtocolBufferException: Protocol message end-group tag did not match expected tag. >> at com.google.protobuf.InvalidProtocolBufferException.invalidEndTag(InvalidProtocolBufferException.java:94) >> at com.google.protobuf.CodedInputStream.checkLastTagWas(CodedInputStream.java:124) >> at com.google.protobuf.AbstractParser.parsePartialFrom(AbstractParser.java:202) >> at com.google.protobuf.AbstractParser.parsePartialDelimitedFrom(AbstractParser.java:241) >> at com.google.protobuf.AbstractParser.parseDelimitedFrom(AbstractParser.java:253) >> at com.google.protobuf.AbstractParser.parseDelimitedFrom(AbstractParser.java:259) >> at com.google.protobuf.AbstractParser.parseDelimitedFrom(AbstractParser.java:49) >> at org.apache.hadoop.ipc.protobuf.RpcHeaderProtos$RpcResponseHeaderProto.parseDelimitedFrom(RpcHeaderProtos.java:3167) >> at org.apache.hadoop.ipc.Client$Connection.receiveRpcResponse(Client.java:1072) >> at org.apache.hadoop.ipc.Client$Connection.run(Client.java:966) >> Invalid arguments: Failed on local exception: com.google.protobuf.InvalidProtocolBufferException: Protocol message end-group tag did not match expected tag.; Host Details : local host is: "hadoop-coc-1/127.0.1.1"; destination host is: "hadoop-coc-2":50070; >> usage: distcp OPTIONS [source_path...] >> | >> >> Thanks, >> >> ​ > ​ --------------090903010800000207030805 Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: 8bit

Maybe this has to do with this error… I can’t do ls to my own machine using the command below. Can this be related to the other problem? Shouldn't I list the files with this command?

vagrant@hadoop-coc-1:~$ hdfs dfs -ls hdfs://192.168.56.100/
ls: Call From hadoop-coc-1/192.168.56.100 to hadoop-coc-1:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see:  http://wiki.apache.org/hadoop/ConnectionRefused

On 02-02-2015 19:59, Alexander Alten-Lorenz wrote:

Have a closer look:

No Path is given.


On 02 Feb 2015, at 20:52, xeonmailinglist <xeonmailinglist@gmail.com> wrote:

Hi,

I am trying to copy data using distcp but I get this error. Both hadoop runtime are working properly. Why is this happening?


vagrant@hadoop-coc-1:~/Programs/hadoop$ hadoop distcp hdfs://hadoop-coc-1:50070/input1 hdfs://hadoop-coc-2:50070/
15/02/02 19:46:37 ERROR tools.DistCp: Invalid arguments: 
java.io.IOException: Failed on local exception: com.google.protobuf.InvalidProtocolBufferException: Protocol message end-group tag did not match expected tag.; Host Details : local host is: "hadoop-coc-1/127.0.1.1"; destination host is: "hadoop-coc-2":50070; 
    at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:772)
    at org.apache.hadoop.ipc.Client.call(Client.java:1472)
    at org.apache.hadoop.ipc.Client.call(Client.java:1399)
    at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232)
    at com.sun.proxy.$Proxy9.getFileInfo(Unknown Source)
    at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getFileInfo(ClientNamenodeProtocolTranslatorPB.java:752)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:606)
    at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
    at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
    at com.sun.proxy.$Proxy10.getFileInfo(Unknown Source)
    at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:1988)
    at org.apache.hadoop.hdfs.DistributedFileSystem$18.doCall(DistributedFileSystem.java:1118)
    at org.apache.hadoop.hdfs.DistributedFileSystem$18.doCall(DistributedFileSystem.java:1114)
    at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
    at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1114)
    at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1400)
    at org.apache.hadoop.tools.DistCp.setTargetPathExists(DistCp.java:188)
    at org.apache.hadoop.tools.DistCp.run(DistCp.java:111)
    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
    at org.apache.hadoop.tools.DistCp.main(DistCp.java:401)
Caused by: com.google.protobuf.InvalidProtocolBufferException: Protocol message end-group tag did not match expected tag.
    at com.google.protobuf.InvalidProtocolBufferException.invalidEndTag(InvalidProtocolBufferException.java:94)
    at com.google.protobuf.CodedInputStream.checkLastTagWas(CodedInputStream.java:124)
    at com.google.protobuf.AbstractParser.parsePartialFrom(AbstractParser.java:202)
    at com.google.protobuf.AbstractParser.parsePartialDelimitedFrom(AbstractParser.java:241)
    at com.google.protobuf.AbstractParser.parseDelimitedFrom(AbstractParser.java:253)
    at com.google.protobuf.AbstractParser.parseDelimitedFrom(AbstractParser.java:259)
    at com.google.protobuf.AbstractParser.parseDelimitedFrom(AbstractParser.java:49)
    at org.apache.hadoop.ipc.protobuf.RpcHeaderProtos$RpcResponseHeaderProto.parseDelimitedFrom(RpcHeaderProtos.java:3167)
    at org.apache.hadoop.ipc.Client$Connection.receiveRpcResponse(Client.java:1072)
    at org.apache.hadoop.ipc.Client$Connection.run(Client.java:966)
Invalid arguments: Failed on local exception: com.google.protobuf.InvalidProtocolBufferException: Protocol message end-group tag did not match expected tag.; Host Details : local host is: "hadoop-coc-1/127.0.1.1"; destination host is: "hadoop-coc-2":50070; 
usage: distcp OPTIONS [source_path...] <target_path>

Thanks,

​

​
--------------090903010800000207030805--