hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From hadoop hive <hadooph...@gmail.com>
Subject Re: Why its take much take to live all the datanode in Jobtracker UI
Date Wed, 08 Feb 2012 06:39:57 GMT
HI Harsh,

this is job tracker logs

2012-02-08 10:55:56,638 INFO org.apache.hadoop.net.NetworkTopology: Adding
a new node: /default-rack/hadoopdata5
2012-02-08 10:55:56,639 INFO org.apache.hadoop.net.NetworkTopology: Adding
a new node: /default-rack/hadoopdata6
2012-02-08 10:55:56,639 INFO org.apache.hadoop.net.NetworkTopology: Adding
a new node: /default-rack/hadoopdata3
2012-02-08 10:55:56,640 INFO org.apache.hadoop.net.NetworkTopology: Adding
a new node: /default-rack/hadoopdata4
2012-02-08 10:55:56,640 INFO org.apache.hadoop.net.NetworkTopology: Adding
a new node: /default-rack/hadoopdata1
2012-02-08 10:55:56,641 INFO org.apache.hadoop.net.NetworkTopology: Adding
a new node: /default-rack/hadoopdata2
2012-02-08 10:55:56,641 INFO org.apache.hadoop.net.NetworkTopology: Adding
a new node: /default-rack/hadoopdata14
2012-02-08 10:55:56,641 INFO org.apache.hadoop.net.NetworkTopology: Adding
a new node: /default-rack/hadoopdata10
2012-02-08 10:55:56,642 INFO org.apache.hadoop.net.NetworkTopology: Adding
a new node: /default-rack/hadoopdata11
2012-02-08 10:55:56,642 INFO org.apache.hadoop.net.NetworkTopology: Adding
a new node: /default-rack/hadoopdata9
2012-02-08 10:55:56,643 INFO org.apache.hadoop.net.NetworkTopology: Adding
a new node: /default-rack/hadoopdata7
2012-02-08 10:55:56,643 INFO org.apache.hadoop.net.NetworkTopology: Adding
a new node: /default-rack/hadoopdata8
2012-02-08 10:55:56,858 INFO org.apache.hadoop.net.NetworkTopology: Adding
a new node: /default-rack/hadoopdata12
2012-02-08 11:02:24,727 INFO org.apache.hadoop.net.NetworkTopology: Adding
a new node: /default-rack/10.0.5.179
2012-02-08 11:02:24,727 INFO org.apache.hadoop.net.NetworkTopology: Adding
a new node: /default-rack/10.0.3.8
2012-02-08 11:14:46,643 INFO org.apache.hadoop.net.NetworkTopology: Adding
a new node: /default-rack/hadoopdata4
2012-02-08 11:14:46,644 INFO org.apache.hadoop.net.NetworkTopology: Adding
a new node: /default-rack/hadoopdata14
2012-02-08 11:14:46,644 INFO org.apache.hadoop.net.NetworkTopology: Adding
a new node: /default-rack/hadoopdata2
2012-02-08 11:14:46,644 INFO org.apache.hadoop.net.NetworkTopology: Adding
a new node: /default-rack/hadoopdata8
2012-02-08 11:14:46,645 INFO org.apache.hadoop.net.NetworkTopology: Adding
a new node: /default-rack/hadoopdata7
2012-02-08 11:14:46,645 INFO org.apache.hadoop.net.NetworkTopology: Adding
a new node: /default-rack/hadoopdata6
2012-02-08 11:14:46,646 INFO org.apache.hadoop.net.NetworkTopology: Adding
a new node: /default-rack/hadoopdata3
2012-02-08 11:14:46,647 INFO org.apache.hadoop.net.NetworkTopology: Adding
a new node: /default-rack/hadoopdata5
2012-02-08 11:14:46,649 INFO org.apache.hadoop.net.NetworkTopology: Adding
a new node: /default-rack/hadoopdata1
2012-02-08 11:14:46,650 INFO org.apache.hadoop.net.NetworkTopology: Adding
a new node: /default-rack/hadoopdata9
2012-02-08 11:14:46,651 INFO org.apache.hadoop.net.NetworkTopology: Adding
a new node: /default-rack/hadoopdata10
2012-02-08 11:14:46,652 INFO org.apache.hadoop.net.NetworkTopology: Adding
a new node: /default-rack/hadoopdata11
2012-02-08 11:14:46,882 INFO org.apache.hadoop.net.NetworkTopology: Adding
a new node: /default-rack/hadoopdata12
2012-02-08 11:19:27,571 INFO org.apache.hadoop.net.NetworkTopology: Adding
a new node: /default-rack/10.0.3.173
2012-02-08 11:19:27,571 INFO org.apache.hadoop.net.NetworkTopology: Adding
a new node: /default-rack/10.0.3.18
2012-02-08 11:19:27,572 INFO org.apache.hadoop.net.NetworkTopology: Adding
a new node: /default-rack/10.0.9.200
2012-02-08 11:19:27,573 INFO org.apache.hadoop.net.NetworkTopology: Adding
a new node: /default-rack/10.0.3.17
2012-02-08 11:20:19,455 INFO org.apache.hadoop.net.NetworkTopology: Adding
a new node: /default-rack/10.0.3.16
2012-02-08 11:20:19,456 INFO org.apache.hadoop.net.NetworkTopology: Adding
a new node: /default-rack/10.0.5.36
2012-02-08 11:20:19,456 INFO org.apache.hadoop.net.NetworkTopology: Adding
a new node: /default-rack/10.0.3.33
2012-02-08 11:32:21,588 INFO org.apache.hadoop.net.NetworkTopology: Adding
a new node: /default-rack/10.0.3.25
2012-02-08 11:32:21,588 INFO org.apache.hadoop.net.NetworkTopology: Adding
a new node: /default-rack/10.0.3.73
2012-02-08 11:32:21,589 INFO org.apache.hadoop.net.NetworkTopology: Adding
a new node: /default-rack/10.0.5.179
2012-02-08 11:43:25,745 INFO org.apache.hadoop.net.NetworkTopology: Adding
a new node: /default-rack/10.0.3.31


One thing odd actually i have only hadoopdata[1-14]  but why is also adding
by their ip's


Regards
Vikas Srivastava

On Wed, Feb 8, 2012 at 11:28 AM, Harsh J <harsh@cloudera.com> wrote:

> Hi,
>
> Can you provide your tasktracker startup log as a pastebin.com link?
> Also your JT log grepped for "Adding a new node"?
>
> On Wed, Feb 8, 2012 at 11:13 AM, hadoop hive <hadoophive@gmail.com> wrote:
> > Hi Folks,
> >
> >
> > I added a node in cluster , and restart the cluster but its taking much
> > time to come all the server live in Jobtracker UI, its only showing the
> > added server in cluster.
> > I there any specific reason for this or anything,
> >
> >
> > Thanks
> > Vikas Srivastava
>
>
>
> --
> Harsh J
> Customer Ops. Engineer
> Cloudera | http://tiny.cloudera.com/about
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message