hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jian Fang <jian.fang.subscr...@gmail.com>
Subject Re: hftp in Hadoop 0.20.2
Date Fri, 10 Aug 2012 17:10:59 GMT
Here is the property in hdfs-site.xml

   <property>
      <name>dfs.http.address</name>
      <value>pnjhadoopnn01:50070</value>
   </property>

Thanks,

Jian

On Fri, Aug 10, 2012 at 11:46 AM, Harsh J <harsh@cloudera.com> wrote:

> Yes the test was to figure out if there really was a listener on
> 50070. Can you check the hdfs-site.xml on the NN machine for what its
> dfs.http.address may really be using for its port?
>
> On Fri, Aug 10, 2012 at 7:48 PM, Jian Fang
> <jian.fang.subscribe@gmail.com> wrote:
> > Hi Harsh,
> >
> > Seems the -p requires the root privilege, which I don't have. I run
> > "netstat -a | grep 50070", but did not get back anything. As I said,
> telnet
> > did not work either.
> >
> > [hadoop@pnjhadoopnn01 ~]$ telnet  pnjhadoopnn01 50070
> > Trying xx.xx.xx.xx...
> > telnet: connect to address xx.xx.xx.xx: Connection refused
> > telnet: Unable to connect to remote host: Connection refused
> >
> > [hadoop@pnjhadoopnn01 ~]$ telnet localhost 50070
> > Trying 127.0.0.1...
> > telnet: connect to address 127.0.0.1: Connection refused
> > telnet: Unable to connect to remote host: Connection refused
> >
> > Thanks,
> >
> > Jian
> >
> > On Fri, Aug 10, 2012 at 1:50 AM, Harsh J <harsh@cloudera.com> wrote:
> >>
> >> Jian,
> >>
> >> From your NN, can you get us the output "netstat -anp | grep 50070"?
> >>
> >> On Fri, Aug 10, 2012 at 9:29 AM, Jian Fang
> >> <jian.fang.subscribe@gmail.com> wrote:
> >> > Thanks Harsh. But there is no firewall there, the two clusters are on
> >> > the
> >> > same networks. I cannot telnet to the port even on the same machine.
> >> >
> >> >
> >> > On Thu, Aug 9, 2012 at 6:00 PM, Harsh J <harsh@cloudera.com> wrote:
> >> >>
> >> >> Hi Jian,
> >> >>
> >> >> HFTP is always-on by default. Can you check and make sure that the
> >> >> firewall isn't the cause of the connection refused on port 50070 on
> >> >> the NN and ports 50075 on the DNs here?
> >> >>
> >> >> On Fri, Aug 10, 2012 at 1:47 AM, Jian Fang
> >> >> <jian.fang.subscribe@gmail.com> wrote:
> >> >> > Hi,
> >> >> >
> >> >> > We have a hadoop cluster of version 0.20.2 in production. Now
we
> have
> >> >> > another new Hadoop cluster using cloudera's CDH3U4. We like to
run
> >> >> > distcp to
> >> >> > copy files between the two clusters. Since the hadoop versions
are
> >> >> > different, we have to use hftp protocol to copy files based on
the
> >> >> > hadoop
> >> >> > document here:
> >> >> > http://hadoop.apache.org/common/docs/r0.20.2/distcp.html#cpver.
> >> >> >
> >> >> > The problem is that I cannot access files via hftp from the current
> >> >> > production 0.20.2 cluster even though I can see the following
> setting
> >> >> > from
> >> >> > job tracker UI.
> >> >> >
> >> >> > dfs.http.address pnjhadoopnn01:50070
> >> >> >
> >> >> > I tried to telnet this port, but got "connection refused" error.
> >> >> > Seems
> >> >> > the
> >> >> > hftp service is not actually running. Could someone tell me how
to
> >> >> > enable
> >> >> > the hftp service in the 0.20.2 hadoop cluster so that I can run
> >> >> > distcp?
> >> >> >
> >> >> > Thanks in advance,
> >> >> >
> >> >> > John
> >> >>
> >> >>
> >> >>
> >> >> --
> >> >> Harsh J
> >> >
> >> >
> >>
> >>
> >>
> >> --
> >> Harsh J
> >
> >
>
>
>
> --
> Harsh J
>

Mime
View raw message