hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ivan Tretyakov <itretya...@griddynamics.com>
Subject Re: DataNode heartbeat average time peaks
Date Mon, 25 Mar 2013 16:29:59 GMT
Thanks Harsh!

My image size is about 3.1 Gb.
Yes, I think feature from HDFS-1457 is what I need, but unfortunately it is
not available in version of hadoop we use.

What kind of risks pose by these peaks.


On Mon, Mar 25, 2013 at 7:31 PM, Harsh J <harsh@cloudera.com> wrote:

> What's your fsimage size? If its too high you would want to control
> the checkpoint transfer bandwidth to not affect the load at the NN.
> This is available via the JIRA HDFS-1457.
>
>
> On Mon, Mar 25, 2013 at 8:13 PM, Ivan Tretyakov
> <itretyakov@griddynamics.com> wrote:
> > Hi!
> >
> > We see DataNode heartbeat average time peaks in Ganglia up to 20-70
> seconds
> > while SecondaryNameNode performs checkpointing.
> > See attached screenshots please.
> >
> > I would like to clarify if it is Ok, or not. And what kind of
> consequences
> > and risks it could bring up.
> >
> > --
> > Best Regards
> > Ivan Tretyakov
>
>
>
> --
> Harsh J
>



-- 
Best Regards
Ivan Tretyakov

Mime
View raw message