hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Stanley Shi <s...@pivotal.io>
Subject Re: Replication factor affecting write performance
Date Tue, 02 Sep 2014 02:30:34 GMT
What's the network setup and topology?
Also, the size of the cluster?

On Mon, Sep 1, 2014 at 4:10 PM, Laurens Bronwasser <
Laurens.Bronwasser@imc.nl> wrote:

>  And now with the right label on the Y-axis.
>   From: Microsoft Office User <laurens.bronwasser@imc.nl>
> Date: Monday, September 1, 2014 at 9:56 AM
> To: "user@hadoop.apache.org" <user@hadoop.apache.org>
> Cc: Julien Lehuen <julien.lehuen@imc.nl>, Tyler McDougall <
> Tyler.McDougall@imc.nl>
> Subject: Replication factor affecting write performance
>   Hi,
> We have a setup with two clusters.
> On cluster shows a very strong degradation when we increase the
> replication factor.
> Another cluster shows hardly any degradation with increased replication
> factor.
>  Any idea how to find out the bottleneck in the slower cluster?
> ------------------------------
> The information in this e-mail is intended only for the person or entity
> to which it is addressed.
> It may contain confidential and /or privileged material. If someone other
> than the intended recipient should receive this e-mail, he / she shall not
> be entitled to read, disseminate, disclose or duplicate it.
> If you receive this e-mail unintentionally, please inform us immediately
> by "reply" and then delete it from your system. Although this information
> has been compiled with great care, neither IMC Financial Markets & Asset
> Management nor any of its related entities shall accept any responsibility
> for any errors, omissions or other inaccuracies in this information or for
> the consequences thereof, nor shall it be bound in any way by the contents
> of this e-mail or its attachments. In the event of incomplete or incorrect
> transmission, please return the e-mail to the sender and permanently delete
> this message and any attachments.
> Messages and attachments are scanned for all known viruses. Always scan
> attachments before opening them.

*Stanley Shi,*

View raw message