hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Bharath Vissapragada <bhara...@cloudera.com>
Subject Re: 答复: 答复: Should we set the property "hbase.local.dir" to a list of directories on different disks to spread I/O?
Date Fri, 20 Dec 2013 09:57:25 GMT
Hbase uses HDFS for data storage and region servers just use HDFS API to
write files. So you should be looking at balancing disk IO at datanode
level (dfs.datanode.data.dir as mentioned in other response). The path you
mentioned (hbase.local.dir) is just used for storing temporary files or
CP/dynamic jars etc (not data) by region server and doesn't take much space
/ cause IO.


On Fri, Dec 20, 2013 at 2:49 PM, 谢良 <xieliang@xiaomi.com> wrote:

> maybe you have a misunderstanding about "hbase.local.dir", please refer to
> HBASE-6824 for why it was introduced.
>
> Thanks,
> ________________________________________
> 发件人: Tao Xiao [xiaotao.cs.nju@gmail.com]
> 发送时间: 2013年12月20日 16:30
> 收件人: user
> 主题: Re: 答复: Should we set the property "hbase.local.dir" to a list of
> directories on different disks to spread I/O?
>
> Since "hbase.local.dir" specifes local directory, why doesn't it specify
> multiple directories on different disks to spread I/O, just as what
> "dfs.datanode.data.dir" does ?
>
>
> 2013/12/20 谢良 <xieliang@xiaomi.com>
>
> > Please take a look at "dfs.datanode.data.dir" in hdfs-site.xml.
> > P.S. "hbase.local.dir" supports one dir only, don't specify it with a
> > list:)
> >
> > Thanks,
> > ________________________________________
> > 发件人: Tao Xiao [xiaotao.cs.nju@gmail.com]
> > 发送时间: 2013年12月20日 15:11
> > 收件人: user
> > 主题: Should we set the property "hbase.local.dir" to a list of directories
> > on different disks to spread I/O?
> >
> > Hi,
> >
> >     To spread I/O on multiple disks of the HBase cluster, I set the
> > property "hbase.local.dir"  in hbase-site.xml to a comma-separated list
> of
> > directories on different disks as follows:
> >
> >      <property>
> >                 <name>hbase.local.dir</name>
> >
> >
> >
> <value>/storage/disk1/hbase.local.dir,/storage/disk2/hbase.local.dir,/storage/disk3/hbase.local.dir</value>
> >       </property>
> >
> > is it right ?
> >
>



-- 
Bharath Vissapragada
<http://www.cloudera.com>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message