hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From xeonmailinglist <xeonmailingl...@gmail.com>
Subject Copy data from local disc with WebHDFS?
Date Mon, 02 Mar 2015 16:57:41 GMT
Hi,

1 - I have HDFS running with WebHDFS protocol. I want to copy data from 
local disk to HDFS, but I get the error below. How I copy data from the 
local disk to HDFS?

|xubuntu@hadoop-coc-1:~/Programs/hadoop$ hdfs dfs -copyFromLocal ~/input1 webhdfs://192.168.56.101:8080/
Java HotSpot(TM) Client VM warning: You have loaded library /home/xubuntu/Programs/hadoop-2.6.0/lib/native/libhadoop.so
which might have disabled stack guard. The VM will try to fix the stack guard now.
It's highly recommended that you fix the library with 'execstack -c <libfile>', or link
it with '-z noexecstack'.
15/03/02 11:50:16 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your
platform... using builtin-java classes where applicable
copyFromLocal: Call From hadoop-coc-1/192.168.56.101 to hadoop-coc-1:9000 failed on connection
exception: java.net.ConnectException: Connection refused; For more details see:  http://wiki.apache.org/hadoop/ConnectionRefused
copyFromLocal: Call From hadoop-coc-1/192.168.56.101 to hadoop-coc-1:9000 failed on connection
exception: java.net.ConnectException: Connection refused; For more details see:  http://wiki.apache.org/hadoop/ConnectionRefused


xubuntu@hadoop-coc-1:~/Programs/hadoop$ curl -i -X PUT -T ~/input1 "http://192.168.56.101:8080/?op=CREATE"
HTTP/1.1 100 Continue

HTTP/1.1 405 HTTP method PUT is not supported by this URL
Date: Mon, 02 Mar 2015 16:50:36 GMT
Pragma: no-cache
Date: Mon, 02 Mar 2015 16:50:36 GMT
Pragma: no-cache
Content-Length: 0
Server: Jetty(6.1.26)
|

|$ netstat -plnet
tcp        0      0 192.168.56.101:8080     0.0.0.0:*               LISTEN      1000     
 587397      8229/java
tcp        0      0 0.0.0.0:4369            0.0.0.0:*               LISTEN      115      
 8049        -
tcp        0      0 127.0.0.1:53            0.0.0.0:*               LISTEN      0        
 8336        -
tcp        0      0 0.0.0.0:22              0.0.0.0:*               LISTEN      0        
 7102        -
tcp        0      0 127.0.0.1:631           0.0.0.0:*               LISTEN      0        
 104794      -
tcp        0      0 0.0.0.0:50010           0.0.0.0:*               LISTEN      1000     
 588404      8464/java
tcp        0      0 0.0.0.0:50075           0.0.0.0:*               LISTEN      1000     
 589155      8464/java
tcp        0      0 0.0.0.0:50020           0.0.0.0:*               LISTEN      1000     
 589169      8464/java
tcp        0      0 192.168.56.101:6600     0.0.0.0:*               LISTEN      1000     
 587403      8229/java
tcp6       0      0 :::22                   :::*                    LISTEN      0        
 7086        -
tcp6       0      0 ::1:631                 :::*                    LISTEN      0        
 104793      -
|

2 - How I remove the Warning that I am always having every time I launch 
a command in YARN?

|xubuntu@hadoop-coc-1:~/Programs/hadoop$ hdfs dfs -copyFromLocal ~/input1 webhdfs://192.168.56.101:8080/
Java  HotSpot(TM) Client VM warning: You have loaded library  /home/xubuntu/Programs/hadoop-2.6.0/lib/native/libhadoop.so
which might  have disabled stack guard. The VM will try to fix the stack guard now.
It's highly recommended that you fix the library with 'execstack -c <libfile>', or link
it with '-z noexecstack'.
|


‚Äč


Mime
View raw message