hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Alexander Alten-Lorenz <wget.n...@gmail.com>
Subject Re: tools.DistCp: Invalid arguments
Date Tue, 03 Feb 2015 11:43:37 GMT
Hi,

Can you please try webhdfs instead hdfs?

- Alexander 

> On 03 Feb 2015, at 12:05, xeonmailinglist <xeonmailinglist@gmail.com> wrote:
> 
> Maybe this has to do with this error… I can’t do ls to my own machine using the command
below. Can this be related to the other problem? Shouldn't I list the files with this command?
> vagrant@hadoop-coc-1:~$ hdfs dfs -ls hdfs://192.168.56.100/
> ls: Call From hadoop-coc-1/192.168.56.100 to hadoop-coc-1:8020 failed on connection exception:
java.net.ConnectException: Connection refused; For more details see:  http://wiki.apache.org/hadoop/ConnectionRefused
<http://wiki.apache.org/hadoop/ConnectionRefused>
> On 02-02-2015 19:59, Alexander Alten-Lorenz wrote:
> 
> 
> 
>> Have a closer look:
>> 
>>> hdfs://hadoop-coc-2:50070/ <hdfs://hadoop-coc-2:50070/>
>> No Path is given.
>> 
>> 
>>> On 02 Feb 2015, at 20:52, xeonmailinglist <xeonmailinglist@gmail.com <mailto:xeonmailinglist@gmail.com>>
wrote:
>>> 
>>> Hi,
>>> 
>>> I am trying to copy data using distcp but I get this error. Both hadoop runtime
are working properly. Why is this happening?
>>> 
>>> 
>>> vagrant@hadoop-coc-1:~/Programs/hadoop$ hadoop distcp hdfs://hadoop-coc-1:50070/input1
<hdfs://hadoop-coc-1:50070/input1> hdfs://hadoop-coc-2:50070/ <hdfs://hadoop-coc-2:50070/>
>>> 15/02/02 19:46:37 ERROR tools.DistCp: Invalid arguments: 
>>> java.io.IOException: Failed on local exception: com.google.protobuf.InvalidProtocolBufferException:
Protocol message end-group tag did not match expected tag.; Host Details : local host is:
"hadoop-coc-1/127.0.1.1"; destination host is: "hadoop-coc-2":50070; 
>>>     at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:772)
>>>     at org.apache.hadoop.ipc.Client.call(Client.java:1472)
>>>     at org.apache.hadoop.ipc.Client.call(Client.java:1399)
>>>     at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232)
>>>     at com.sun.proxy.$Proxy9.getFileInfo(Unknown Source)
>>>     at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getFileInfo(ClientNamenodeProtocolTranslatorPB.java:752)
>>>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>>>     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>>     at java.lang.reflect.Method.invoke(Method.java:606)
>>>     at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
>>>     at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
>>>     at com.sun.proxy.$Proxy10.getFileInfo(Unknown Source)
>>>     at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:1988)
>>>     at org.apache.hadoop.hdfs.DistributedFileSystem$18.doCall(DistributedFileSystem.java:1118)
>>>     at org.apache.hadoop.hdfs.DistributedFileSystem$18.doCall(DistributedFileSystem.java:1114)
>>>     at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
>>>     at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1114)
>>>     at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1400)
>>>     at org.apache.hadoop.tools.DistCp.setTargetPathExists(DistCp.java:188)
>>>     at org.apache.hadoop.tools.DistCp.run(DistCp.java:111)
>>>     at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
>>>     at org.apache.hadoop.tools.DistCp.main(DistCp.java:401)
>>> Caused by: com.google.protobuf.InvalidProtocolBufferException: Protocol message
end-group tag did not match expected tag.
>>>     at com.google.protobuf.InvalidProtocolBufferException.invalidEndTag(InvalidProtocolBufferException.java:94)
>>>     at com.google.protobuf.CodedInputStream.checkLastTagWas(CodedInputStream.java:124)
>>>     at com.google.protobuf.AbstractParser.parsePartialFrom(AbstractParser.java:202)
>>>     at com.google.protobuf.AbstractParser.parsePartialDelimitedFrom(AbstractParser.java:241)
>>>     at com.google.protobuf.AbstractParser.parseDelimitedFrom(AbstractParser.java:253)
>>>     at com.google.protobuf.AbstractParser.parseDelimitedFrom(AbstractParser.java:259)
>>>     at com.google.protobuf.AbstractParser.parseDelimitedFrom(AbstractParser.java:49)
>>>     at org.apache.hadoop.ipc.protobuf.RpcHeaderProtos$RpcResponseHeaderProto.parseDelimitedFrom(RpcHeaderProtos.java:3167)
>>>     at org.apache.hadoop.ipc.Client$Connection.receiveRpcResponse(Client.java:1072)
>>>     at org.apache.hadoop.ipc.Client$Connection.run(Client.java:966)
>>> Invalid arguments: Failed on local exception: com.google.protobuf.InvalidProtocolBufferException:
Protocol message end-group tag did not match expected tag.; Host Details : local host is:
"hadoop-coc-1/127.0.1.1"; destination host is: "hadoop-coc-2":50070; 
>>> usage: distcp OPTIONS [source_path...] <target_path>
>>> Thanks,
>>> 
>> 
> 
> 


Mime
View raw message