hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From xeon Mailinglist <xeonmailingl...@gmail.com>
Subject Re: Copy data from local disc with WebHDFS?
Date Tue, 03 Mar 2015 04:05:30 GMT
1. I am using these 2 commands below to try to copy data from local disk to
HDFS. Unfortunately these commands are not working, and I don't understand
why they are not working. I have configured HDFS to use WebHDFS
protocol. How I copy data from the local disk to HDFS using WebHDfS
protocol?

xubuntu@hadoop-coc-1:~/Programs/hadoop$ *hdfs dfs -copyFromLocal ~/input1
webhdfs://192.168.56.101:8080/ <http://192.168.56.101:8080/> *
Java HotSpot(TM) Client VM warning: You have loaded library
/home/xubuntu/Programs/hadoop-2.6.0/lib/native/libhadoop.so which might
have disabled stack guard. The VM will try to fix the stack guard now. It's
highly recommended that you fix the library with 'execstack -c <libfile>',
or link it with '-z noexecstack'.
 15/03/02 11:50:16 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
copyFromLocal: Call From hadoop-coc-1/192.168.56.101 to hadoop-coc-1:9000
failed on connection exception: java.net.ConnectException: Connection
refused; For more details see:
http://wiki.apache.org/hadoop/ConnectionRefused
copyFromLocal: Call From hadoop-coc-1/192.168.56.101 to hadoop-coc-1:9000
failed on connection exception: java.net.ConnectException: Connection
refused; For more details see:
http://wiki.apache.org/hadoop/ConnectionRefused

 xubuntu@hadoop-coc-1:~/Programs/hadoop$ *curl -i -X PUT -T ~/input1
"http://192.168.56.101:8080/?op=CREATE"
<http://192.168.56.101:8080/?op=CREATE>*
HTTP/1.1 100 Continue HTTP/1.1 405 HTTP method PUT is not supported by this
URL Date:
 Mon, 02 Mar 2015 16:50:36 GMT
Pragma: no-cache Date:
Mon, 02 Mar 2015 16:50:36 GMT
Pragma: no-cache
Content-Length: 0
Server: Jetty(6.1.26)


2. Every time I launch a command in YARN I get a java hotspot warning
(warning below). How I remove the Java HotSpotWarning?

xubuntu@hadoop-coc-1:~/Programs/hadoop$ hdfs dfs -copyFromLocal
~/input1 webhdfs://192.168.56.101:8080/
Java  HotSpot(TM) Client VM warning: You have loaded library
/home/xubuntu/Programs/hadoop-2.6.0/lib/native/libhadoop.so which
might  have disabled stack guard. The VM will try to fix the stack
guard now.
It's highly recommended that you fix the library with 'execstack -c
<libfile>', or link it with '-z noexecstack'.

Thanks,

On Monday, March 2, 2015, xeonmailinglist <xeonmailinglist@gmail.com> wrote:

>  Hi,
>
> 1 - I have HDFS running with WebHDFS protocol. I want to copy data from
> local disk to HDFS, but I get the error below. How I copy data from the
> local disk to HDFS?
>
> xubuntu@hadoop-coc-1:~/Programs/hadoop$ hdfs dfs -copyFromLocal ~/input1 webhdfs://192.168.56.101:8080/
> Java HotSpot(TM) Client VM warning: You have loaded library /home/xubuntu/Programs/hadoop-2.6.0/lib/native/libhadoop.so
which might have disabled stack guard. The VM will try to fix the stack guard now.
> It's highly recommended that you fix the library with 'execstack -c <libfile>',
or link it with '-z noexecstack'.
> 15/03/02 11:50:16 WARN util.NativeCodeLoader: Unable to load native-hadoop library for
your platform... using builtin-java classes where applicable
> copyFromLocal: Call From hadoop-coc-1/192.168.56.101 to hadoop-coc-1:9000 failed on connection
exception: java.net.ConnectException: Connection refused; For more details see:  http://wiki.apache.org/hadoop/ConnectionRefused
> copyFromLocal: Call From hadoop-coc-1/192.168.56.101 to hadoop-coc-1:9000 failed on connection
exception: java.net.ConnectException: Connection refused; For more details see:  http://wiki.apache.org/hadoop/ConnectionRefused
>
>
> xubuntu@hadoop-coc-1:~/Programs/hadoop$ curl -i -X PUT -T ~/input1 "http://192.168.56.101:8080/?op=CREATE"
<http://192.168.56.101:8080/?op=CREATE>
> HTTP/1.1 100 Continue
>
> HTTP/1.1 405 HTTP method PUT is not supported by this URL
> Date: Mon, 02 Mar 2015 16:50:36 GMT
> Pragma: no-cache
> Date: Mon, 02 Mar 2015 16:50:36 GMT
> Pragma: no-cache
> Content-Length: 0
> Server: Jetty(6.1.26)
>
> $ netstat -plnet
> tcp        0      0 192.168.56.101:8080     0.0.0.0:*               LISTEN      1000
      587397      8229/java
> tcp        0      0 0.0.0.0:4369            0.0.0.0:*               LISTEN      115 
      8049        -
> tcp        0      0 127.0.0.1:53            0.0.0.0:*               LISTEN      0   
      8336        -
> tcp        0      0 0.0.0.0:22              0.0.0.0:*               LISTEN      0   
      7102        -
> tcp        0      0 127.0.0.1:631           0.0.0.0:*               LISTEN      0   
      104794      -
> tcp        0      0 0.0.0.0:50010           0.0.0.0:*               LISTEN      1000
      588404      8464/java
> tcp        0      0 0.0.0.0:50075           0.0.0.0:*               LISTEN      1000
      589155      8464/java
> tcp        0      0 0.0.0.0:50020           0.0.0.0:*               LISTEN      1000
      589169      8464/java
> tcp        0      0 192.168.56.101:6600     0.0.0.0:*               LISTEN      1000
      587403      8229/java
> tcp6       0      0 :::22                   :::*                    LISTEN      0   
      7086        -
> tcp6       0      0 ::1:631                 :::*                    LISTEN      0   
      104793      -
>
> 2 - How I remove the Warning that I am always having every time I launch a
> command in YARN?
>
> xubuntu@hadoop-coc-1:~/Programs/hadoop$ hdfs dfs -copyFromLocal ~/input1 webhdfs://192.168.56.101:8080/
> Java  HotSpot(TM) Client VM warning: You have loaded library  /home/xubuntu/Programs/hadoop-2.6.0/lib/native/libhadoop.so
which might  have disabled stack guard. The VM will try to fix the stack guard now.
> It's highly recommended that you fix the library with 'execstack -c <libfile>',
or link it with '-z noexecstack'.
>
>
> ‚Äč
>
>

Mime
View raw message