hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From 吴限 <infinity0...@gmail.com>
Subject Re: data loss due to regionserver going down
Date Wed, 27 Jul 2011 16:35:43 GMT
Here is my hbase-site.xml:
configuration>
    <property>
        <name>hbase.cluster.distributed</name>
        <value>true</value>
    </property>
    <property>
        <name>hbase.rootdir</name>
        <value>hdfs://server3.yun.com:54310/hbase</value>
        <description>The directory shared by region servers.
        </description>
    </property>
    <property>
        <name>hbase.zookeeper.quorum</name>
        <value>server3.yun.com</value>
    </property>
    <property>
        <name>dfs.replication</name>
        <value>1</value>
    </property>


2011/7/28 Stack <stack@duboce.net>

> On Wed, Jul 27, 2011 at 8:58 AM, 吴限 <infinity0222@gmail.com> wrote:
> > Setup:
> >   -cdh3u0
> >   - Hadoop 0.20.2
>
> You are using the hadoop from cdh3u0?
>
>
> >   - dfs.replication is set to 1
> >
>
> You will lose data if a machine goes away. You have two machines but
> only one instance of each data block; think of it as half of your data
> one one node and the rest on another.  If you kill one machine, half
> your data is gone.
>
>
> >  After I restarted the regionserver which I had rebooted and checked
> again,
> >  I found that some of the missing data was got back but there still
> existed
> > some data which hadn't been found yet.
>
>
> I wonder what was going on here that we didn't see it all restored.
>
>
> >  This is problematic since we are supposed to
> > replicate at x1, so at least one other node should be able to
> > theoretically serve the *data* that the downed regionserver can't.
> >
>
> No.  The behavior you describe would come with replication of 2, not 1.
>
> St.Ack
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message