Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 4C0A7E104 for ; Mon, 25 Feb 2013 10:24:54 +0000 (UTC) Received: (qmail 46705 invoked by uid 500); 25 Feb 2013 10:24:49 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 46464 invoked by uid 500); 25 Feb 2013 10:24:49 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 46443 invoked by uid 99); 25 Feb 2013 10:24:48 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 25 Feb 2013 10:24:48 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,NORMAL_HTTP_TO_IP,RCVD_IN_DNSWL_LOW,SPF_PASS,T_FRT_BELOW2,WEIRD_PORT X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of samir.helpdoc@gmail.com designates 209.85.128.175 as permitted sender) Received: from [209.85.128.175] (HELO mail-ve0-f175.google.com) (209.85.128.175) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 25 Feb 2013 10:24:43 +0000 Received: by mail-ve0-f175.google.com with SMTP id cy12so2021978veb.20 for ; Mon, 25 Feb 2013 02:24:22 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:x-received:in-reply-to:references:date:message-id :subject:from:to:content-type; bh=oxYe33CL63p7rAb7o9xx4tYcnLgmm1Hf/rAVZ3k32Ww=; b=Ql0yflEXwXqpicCWqPzC4hH0549ivnLEMQKSFDiuCUQMZgQbnC2mPmO2m1gE4hc5zp zgtH4pmT9NSSRvOxJ+9wy8mz/CKfQO1Z8hMYUOAPdVO4h1Ef4gdSbaSB9c9YqBd331C2 wC/8dBVmsyJ6UpW/426ag0rj5Z3YepNEHbTihFKf3obpZWtXPQji5ovE+AtAiO3HcK5Q //moKFqS4LbJq+QVb8UUVhcprWrNmXplmoWHIMO+OFwBzsIiKLfSIrX8jZ5Y9PzfrdH+ NBssWHgn2zftTF/0hqmx/BPlCOZLdCLvr7ITlgr4fAxSa4nOhd9EeUP5OOp7gN7F0UvV DnTg== MIME-Version: 1.0 X-Received: by 10.52.92.225 with SMTP id cp1mr8446540vdb.41.1361787862403; Mon, 25 Feb 2013 02:24:22 -0800 (PST) Received: by 10.58.161.82 with HTTP; Mon, 25 Feb 2013 02:24:22 -0800 (PST) In-Reply-To: References: Date: Mon, 25 Feb 2013 15:54:22 +0530 Message-ID: Subject: Re: ISSUE IN CDH4.1.2 : transfer data between different HDFS clusters.(using distch) From: samir das mohapatra To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=20cf307f3b34cc490704d689f172 X-Virus-Checked: Checked by ClamAV on apache.org --20cf307f3b34cc490704d689f172 Content-Type: text/plain; charset=ISO-8859-1 I am using CDH4.1.2 with MRv1 not YARN. On Mon, Feb 25, 2013 at 3:47 PM, samir das mohapatra < samir.helpdoc@gmail.com> wrote: > yes > > > On Mon, Feb 25, 2013 at 3:30 PM, Nitin Pawar wrote: > >> does this match with your issue >> >> >> https://groups.google.com/a/cloudera.org/forum/#!topic/cdh-user/kIPOvrFaQE8 >> >> >> On Mon, Feb 25, 2013 at 3:20 PM, samir das mohapatra < >> samir.helpdoc@gmail.com> wrote: >> >>> >>> >>> ---------- Forwarded message ---------- >>> From: samir das mohapatra >>> Date: Mon, Feb 25, 2013 at 3:05 PM >>> Subject: ISSUE IN CDH4.1.2 : transfer data between different HDFS >>> clusters.(using distch) >>> To: cdh-user@cloudera.org >>> >>> >>> Hi All, >>> I am getting bellow error , can any one help me on the same issue, >>> >>> ERROR LOG: >>> ---------------------- >>> >>> hadoop@hadoophost2:~$ hadoop distcp hdfs:// >>> 10.192.200.170:50070/tmp/samir.txt hdfs://10.192.244.237:50070/input >>> 13/02/25 01:34:36 INFO tools.DistCp: srcPaths=[hdfs:// >>> 10.192.200.170:50070/tmp/samir.txt] >>> 13/02/25 01:34:36 INFO tools.DistCp: destPath=hdfs:// >>> 10.192.244.237:50070/input >>> With failures, global counters are inaccurate; consider running with -i >>> Copy failed: java.io.IOException: Failed on local exception: >>> com.google.protobuf.InvalidProtocolBufferException: Protocol message >>> end-group tag did not match expected tag.; Host Details : local host is: >>> "hadoophost2/10.192.244.237"; destination host is: " >>> bl1slu040.corp.adobe.com":50070; >>> at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:759) >>> at org.apache.hadoop.ipc.Client.call(Client.java:1164) >>> at >>> org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:202) >>> at $Proxy9.getFileInfo(Unknown Source) >>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >>> at >>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) >>> at >>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >>> at java.lang.reflect.Method.invoke(Method.java:616) >>> at >>> org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:164) >>> at >>> org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:83) >>> at $Proxy9.getFileInfo(Unknown Source) >>> at >>> org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getFileInfo(ClientNamenodeProtocolTranslatorPB.java:628) >>> at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:1507) >>> at >>> org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:783) >>> at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1257) >>> at org.apache.hadoop.tools.DistCp.checkSrcPath(DistCp.java:636) >>> at org.apache.hadoop.tools.DistCp.copy(DistCp.java:656) >>> at org.apache.hadoop.tools.DistCp.run(DistCp.java:881) >>> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) >>> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84) >>> at org.apache.hadoop.tools.DistCp.main(DistCp.java:908) >>> Caused by: com.google.protobuf.InvalidProtocolBufferException: Protocol >>> message end-group tag did not match expected tag. >>> at >>> com.google.protobuf.InvalidProtocolBufferException.invalidEndTag(InvalidProtocolBufferException.java:73) >>> at >>> com.google.protobuf.CodedInputStream.checkLastTagWas(CodedInputStream.java:124) >>> at >>> com.google.protobuf.AbstractMessageLite$Builder.mergeFrom(AbstractMessageLite.java:213) >>> at >>> com.google.protobuf.AbstractMessage$Builder.mergeFrom(AbstractMessage.java:746) >>> at >>> com.google.protobuf.AbstractMessage$Builder.mergeFrom(AbstractMessage.java:238) >>> at >>> com.google.protobuf.AbstractMessageLite$Builder.mergeDelimitedFrom(AbstractMessageLite.java:282) >>> at >>> com.google.protobuf.AbstractMessage$Builder.mergeDelimitedFrom(AbstractMessage.java:760) >>> at >>> com.google.protobuf.AbstractMessageLite$Builder.mergeDelimitedFrom(AbstractMessageLite.java:288) >>> at >>> com.google.protobuf.AbstractMessage$Builder.mergeDelimitedFrom(AbstractMessage.java:752) >>> at >>> org.apache.hadoop.ipc.protobuf.RpcPayloadHeaderProtos$RpcResponseHeaderProto.parseDelimitedFrom(RpcPayloadHeaderProtos.java:985) >>> at >>> org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:882) >>> at org.apache.hadoop.ipc.Client$Connection.run(Client.java:813) >>> >>> >>> >>> Regards, >>> samir >>> >>> >> >> >> -- >> Nitin Pawar >> > > --20cf307f3b34cc490704d689f172 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
I am using CDH4.1.2 with MRv1 not YARN.


On Mon, Feb 25, 2013 at 3:= 47 PM, samir das mohapatra <samir.helpdoc@gmail.com> w= rote:
yes


On Mon, Feb 25, 2013 at 3:30 PM, Nitin Pawar <nitinpawar432@gmail.c= om> wrote:


On Mon, Feb 25, 2013 at 3:20 PM, samir das mohapatra <samir= .helpdoc@gmail.com> wrote:


---------- Forwarded message ----------
From: samir das mohapatra <samir.helpdoc@gmail.com>=
Date: Mon, Feb 25, 2013 at 3:05 PM
Subject: ISSUE IN CDH4.1.2 : transfer= data between different HDFS clusters.(using distch)
To: cdh-user@cloudera.org

Hi All,
=A0 I am getting bellow error , can any one= help me on the same issue,

ERROR LOG:
--------------= --------

hadoop@hadoophost2:~$ hadoop=A0=A0 distcp hdfs://10.192.200.17= 0:50070/tmp/samir.txt hdfs://10.192.244.237:50070/input
13/02/25 01:34:36 INFO tools.DistCp: srcPaths=3D[hdfs://10.192.200.170:50070/t= mp/samir.txt]
13/02/25 01:34:36 INFO tools.DistCp: destPath=3Dhdfs:/= /10.192.244= .237:50070/input
With failures, global counters are inaccurate; consider running with -i
= Copy failed: java.io.IOException: Failed on local exception: com.google.pro= tobuf.InvalidProtocolBufferException: Protocol message end-group tag did no= t match expected tag.; Host Details : local host is: "hadoophost2/10.192.244.237"; d= estination host is: "bl1slu040.corp.adobe.com":50070;
=A0=A0=A0 at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:759= )
=A0=A0=A0 at org.apache.hadoop.ipc.Client.call(Client.java:1164)
= =A0=A0=A0 at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(Protobu= fRpcEngine.java:202)
=A0=A0=A0 at $Proxy9.getFileInfo(Unknown Source)
=A0=A0=A0 at sun.reflec= t.NativeMethodAccessorImpl.invoke0(Native Method)
=A0=A0=A0 at sun.refle= ct.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
=A0= =A0=A0 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodA= ccessorImpl.java:43)
=A0=A0=A0 at java.lang.reflect.Method.invoke(Method.java:616)
=A0=A0=A0 = at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvo= cationHandler.java:164)
=A0=A0=A0 at org.apache.hadoop.io.retry.RetryInv= ocationHandler.invoke(RetryInvocationHandler.java:83)
=A0=A0=A0 at $Proxy9.getFileInfo(Unknown Source)
=A0=A0=A0 at org.apache= .hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getFileInfo(Clie= ntNamenodeProtocolTranslatorPB.java:628)
=A0=A0=A0 at org.apache.hadoop.= hdfs.DFSClient.getFileInfo(DFSClient.java:1507)
=A0=A0=A0 at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(Dis= tributedFileSystem.java:783)
=A0=A0=A0 at org.apache.hadoop.fs.FileSyste= m.exists(FileSystem.java:1257)
=A0=A0=A0 at org.apache.hadoop.tools.Dist= Cp.checkSrcPath(DistCp.java:636)
=A0=A0=A0 at org.apache.hadoop.tools.DistCp.copy(DistCp.java:656)
=A0=A0= =A0 at org.apache.hadoop.tools.DistCp.run(DistCp.java:881)
=A0=A0=A0 at = org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
=A0=A0=A0 at o= rg.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
=A0=A0=A0 at org.apache.hadoop.tools.DistCp.main(DistCp.java:908)
Caused= by: com.google.protobuf.InvalidProtocolBufferException: Protocol message e= nd-group tag did not match expected tag.
=A0=A0=A0 at com.google.protobu= f.InvalidProtocolBufferException.invalidEndTag(InvalidProtocolBufferExcepti= on.java:73)
=A0=A0=A0 at com.google.protobuf.CodedInputStream.checkLastTagWas(CodedInpu= tStream.java:124)
=A0=A0=A0 at com.google.protobuf.AbstractMessageLite$B= uilder.mergeFrom(AbstractMessageLite.java:213)
=A0=A0=A0 at com.google.p= rotobuf.AbstractMessage$Builder.mergeFrom(AbstractMessage.java:746)
=A0=A0=A0 at com.google.protobuf.AbstractMessage$Builder.mergeFrom(Abstract= Message.java:238)
=A0=A0=A0 at com.google.protobuf.AbstractMessageLite$B= uilder.mergeDelimitedFrom(AbstractMessageLite.java:282)
=A0=A0=A0 at com= .google.protobuf.AbstractMessage$Builder.mergeDelimitedFrom(AbstractMessage= .java:760)
=A0=A0=A0 at com.google.protobuf.AbstractMessageLite$Builder.mergeDelimited= From(AbstractMessageLite.java:288)
=A0=A0=A0 at com.google.protobuf.Abst= ractMessage$Builder.mergeDelimitedFrom(AbstractMessage.java:752)
=A0=A0= =A0 at org.apache.hadoop.ipc.protobuf.RpcPayloadHeaderProtos$RpcResponseHea= derProto.parseDelimitedFrom(RpcPayloadHeaderProtos.java:985)
=A0=A0=A0 at org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client= .java:882)
=A0=A0=A0 at org.apache.hadoop.ipc.Client$Connection.run(Clie= nt.java:813)



Regards,
samir




<= font color=3D"#888888">--
Nitin Pawar


--20cf307f3b34cc490704d689f172--