hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jean-Marc Spaggiari <jean-m...@spaggiari.org>
Subject Re: 答复: 答复: Should we set the property "hbase.local.dir" to a list of directories on different disks to spread I/O?
Date Fri, 20 Dec 2013 12:52:51 GMT
Barath's respons is a good summary.

There almost nothing going into hbase.local.dir. It's like in your local
linux box. You don't specify more than one tmp directory. It's the same
thing here. There will not be really any benefit of adding that.


2013/12/20 Bharath Vissapragada <bharathv@cloudera.com>

> Hbase uses HDFS for data storage and region servers just use HDFS API to
> write files. So you should be looking at balancing disk IO at datanode
> level (dfs.datanode.data.dir as mentioned in other response). The path you
> mentioned (hbase.local.dir) is just used for storing temporary files or
> CP/dynamic jars etc (not data) by region server and doesn't take much space
> / cause IO.
>
>
> On Fri, Dec 20, 2013 at 2:49 PM, 谢良 <xieliang@xiaomi.com> wrote:
>
> > maybe you have a misunderstanding about "hbase.local.dir", please refer
> to
> > HBASE-6824 for why it was introduced.
> >
> > Thanks,
> > ________________________________________
> > 发件人: Tao Xiao [xiaotao.cs.nju@gmail.com]
> > 发送时间: 2013年12月20日 16:30
> > 收件人: user
> > 主题: Re: 答复: Should we set the property "hbase.local.dir" to a list of
> > directories on different disks to spread I/O?
> >
> > Since "hbase.local.dir" specifes local directory, why doesn't it specify
> > multiple directories on different disks to spread I/O, just as what
> > "dfs.datanode.data.dir" does ?
> >
> >
> > 2013/12/20 谢良 <xieliang@xiaomi.com>
> >
> > > Please take a look at "dfs.datanode.data.dir" in hdfs-site.xml.
> > > P.S. "hbase.local.dir" supports one dir only, don't specify it with a
> > > list:)
> > >
> > > Thanks,
> > > ________________________________________
> > > 发件人: Tao Xiao [xiaotao.cs.nju@gmail.com]
> > > 发送时间: 2013年12月20日 15:11
> > > 收件人: user
> > > 主题: Should we set the property "hbase.local.dir" to a list of
> directories
> > > on different disks to spread I/O?
> > >
> > > Hi,
> > >
> > >     To spread I/O on multiple disks of the HBase cluster, I set the
> > > property "hbase.local.dir"  in hbase-site.xml to a comma-separated list
> > of
> > > directories on different disks as follows:
> > >
> > >      <property>
> > >                 <name>hbase.local.dir</name>
> > >
> > >
> > >
> >
> <value>/storage/disk1/hbase.local.dir,/storage/disk2/hbase.local.dir,/storage/disk3/hbase.local.dir</value>
> > >       </property>
> > >
> > > is it right ?
> > >
> >
>
>
>
> --
> Bharath Vissapragada
> <http://www.cloudera.com>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message