hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Henry Hung <YTHu...@winbond.com>
Subject hadoop archive impact on hbase performance
Date Thu, 18 Sep 2014 00:25:32 GMT
Dear All,

Recently I observe that whenever Hadoop archive is running, all HBase insert (put) will slow
down, from average 0.001 to 0.023, that is 23x times slower.

I wonder if there a way to slow down the archive process? Like restrict read / write buffer?

One of the restriction already implemented is to restrict only 1 map running using fair scheduler.

Best regards,

The privileged confidential information contained in this email is intended for use only by
the addressees as indicated by the original sender of this email. If you are not the addressee
indicated in this email or are not responsible for delivery of the email to such a person,
please kindly reply to the sender indicating this fact and delete all copies of it from your
computer and network server immediately. Your cooperation is highly appreciated. It is advised
that any unauthorized use of confidential information of Winbond is strictly prohibited; and
any information in this email irrelevant to the official business of Winbond shall be deemed
as neither given nor endorsed by Winbond.

View raw message