hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vladimir Rodionov (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-18843) Add DistCp support to incremental backup with bulk loading
Date Wed, 04 Oct 2017 18:56:00 GMT

    [ https://issues.apache.org/jira/browse/HBASE-18843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16191831#comment-16191831
] 

Vladimir Rodionov commented on HBASE-18843:
-------------------------------------------

What I did:

git pull
mvn clean install -DskipTests -Dhadoop.version=3.0
mvn test -Dtest=org.apache.hadoop.hbase.backup.TestIncrementalBackup -Dhadoop.profile=3.0
{code}
017-10-04 11:47:57,232 ERROR [main] zookeeper.RecoverableZooKeeper(300): ZooKeeper exists
failed after 4 attempts
2017-10-04 11:47:57,233 WARN  [main] zookeeper.ZKUtil(416): hconnection-0xa77614d0x0, quorum=localhost:21818,
baseZNode=/1 Unable to set watcher on znode (/1/hbaseid)
org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss
for /1/hbaseid
        at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
        at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
        at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1102)
        at org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper.exists(RecoverableZooKeeper.java:231)
        at org.apache.hadoop.hbase.zookeeper.ZKUtil.checkExists(ZKUtil.java:413)
        at org.apache.hadoop.hbase.zookeeper.ZKClusterId.readClusterIdZNode(ZKClusterId.java:65)
        at org.apache.hadoop.hbase.client.ZooKeeperRegistry.getClusterId(ZooKeeperRegistry.java:102)
        at org.apache.hadoop.hbase.client.ConnectionImplementation.retrieveClusterId(ConnectionImplementation.java:526)
        at org.apache.hadoop.hbase.client.ConnectionImplementation.<init>(ConnectionImplementation.java:288)
{code}

The same issue I see when run other backup tests. I do not think, this backup-related and
it should not prevent from committing this patch.

> Add DistCp support to incremental backup with bulk loading
> ----------------------------------------------------------
>
>                 Key: HBASE-18843
>                 URL: https://issues.apache.org/jira/browse/HBASE-18843
>             Project: HBase
>          Issue Type: Improvement
>            Reporter: Vladimir Rodionov
>            Assignee: Vladimir Rodionov
>             Fix For: 2.0.0-beta-1
>
>         Attachments: HBASE-18843-v1.patch, HBASE-18843-v2.patch, HBASE-18843-v4.patch,
HBASE-18843-v5.patch, HBASE-18843-v6.patch, HBASE-18843-v7.patch
>
>
> Currently, we copy bulk loaded files to backup one-by-one on a client side (where backup
create runs). This has to be replaced with DistCp copying.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message