hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <ha...@cloudera.com>
Subject Re: hftp in Hadoop 0.20.2
Date Fri, 10 Aug 2012 15:46:12 GMT
Yes the test was to figure out if there really was a listener on
50070. Can you check the hdfs-site.xml on the NN machine for what its
dfs.http.address may really be using for its port?

On Fri, Aug 10, 2012 at 7:48 PM, Jian Fang
<jian.fang.subscribe@gmail.com> wrote:
> Hi Harsh,
>
> Seems the -p requires the root privilege, which I don't have. I run
> "netstat -a | grep 50070", but did not get back anything. As I said, telnet
> did not work either.
>
> [hadoop@pnjhadoopnn01 ~]$ telnet  pnjhadoopnn01 50070
> Trying xx.xx.xx.xx...
> telnet: connect to address xx.xx.xx.xx: Connection refused
> telnet: Unable to connect to remote host: Connection refused
>
> [hadoop@pnjhadoopnn01 ~]$ telnet localhost 50070
> Trying 127.0.0.1...
> telnet: connect to address 127.0.0.1: Connection refused
> telnet: Unable to connect to remote host: Connection refused
>
> Thanks,
>
> Jian
>
> On Fri, Aug 10, 2012 at 1:50 AM, Harsh J <harsh@cloudera.com> wrote:
>>
>> Jian,
>>
>> From your NN, can you get us the output "netstat -anp | grep 50070"?
>>
>> On Fri, Aug 10, 2012 at 9:29 AM, Jian Fang
>> <jian.fang.subscribe@gmail.com> wrote:
>> > Thanks Harsh. But there is no firewall there, the two clusters are on
>> > the
>> > same networks. I cannot telnet to the port even on the same machine.
>> >
>> >
>> > On Thu, Aug 9, 2012 at 6:00 PM, Harsh J <harsh@cloudera.com> wrote:
>> >>
>> >> Hi Jian,
>> >>
>> >> HFTP is always-on by default. Can you check and make sure that the
>> >> firewall isn't the cause of the connection refused on port 50070 on
>> >> the NN and ports 50075 on the DNs here?
>> >>
>> >> On Fri, Aug 10, 2012 at 1:47 AM, Jian Fang
>> >> <jian.fang.subscribe@gmail.com> wrote:
>> >> > Hi,
>> >> >
>> >> > We have a hadoop cluster of version 0.20.2 in production. Now we have
>> >> > another new Hadoop cluster using cloudera's CDH3U4. We like to run
>> >> > distcp to
>> >> > copy files between the two clusters. Since the hadoop versions are
>> >> > different, we have to use hftp protocol to copy files based on the
>> >> > hadoop
>> >> > document here:
>> >> > http://hadoop.apache.org/common/docs/r0.20.2/distcp.html#cpver.
>> >> >
>> >> > The problem is that I cannot access files via hftp from the current
>> >> > production 0.20.2 cluster even though I can see the following setting
>> >> > from
>> >> > job tracker UI.
>> >> >
>> >> > dfs.http.address pnjhadoopnn01:50070
>> >> >
>> >> > I tried to telnet this port, but got "connection refused" error.
>> >> > Seems
>> >> > the
>> >> > hftp service is not actually running. Could someone tell me how to
>> >> > enable
>> >> > the hftp service in the 0.20.2 hadoop cluster so that I can run
>> >> > distcp?
>> >> >
>> >> > Thanks in advance,
>> >> >
>> >> > John
>> >>
>> >>
>> >>
>> >> --
>> >> Harsh J
>> >
>> >
>>
>>
>>
>> --
>> Harsh J
>
>



-- 
Harsh J

Mime
View raw message