hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "stack (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-14123) HBase Backup/Restore Phase 2
Date Thu, 23 Feb 2017 01:02:44 GMT

    [ https://issues.apache.org/jira/browse/HBASE-14123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15879631#comment-15879631
] 

stack commented on HBASE-14123:
-------------------------------

Trying the patch:

What is this format when I list out my set named 'me' w/ three tables in it:

me={x,y,z}

Is it json or something else?

I started up a job with following:

./hbase/bin/hbase --config ~/conf_hbase backup create full hdfs://ve0524.halxg.cloudera.com:8020/bkup

... it seems to have started. No progress. I killed the command. When I do progress, it found
a job:

Found ongoing session with backupId=backup_1487810721996
backup_1487810721996 progress=0%

Says... zero progress. I looked for the bkup dir but not created. Its not running a mr job
that I can tell. I do a describe and it says:

{ID=backup_1487810721996,Type=FULL,Tables={IntegrationTestBigLinkedList,x,y,z},State=RUNNING,Start
time=Wed Feb 22 16:45:22 PST 2017,Phase=REQUEST,Progress=0%}

(Is the above JSON?)

If I delete the backup, it seems to get rid of it.

Any idea what I did wrong?

The backup create usage mentions 'restore' when it should be 'backup'?

{code}
Usage: hbase backup create <type> <backup_path> [options]
  type           "full" to create a full backup image
                 "incremental" to create an incremental backup image
  backup_path     Full path to store the backup image

Options:
  -b <arg>        Bandwidth per task (MapReduce task) in MB/s
  -s <arg>        Backup set to restore, mutually exclusive with -t (table list)
  -t <arg>        Table name list, comma-separated.
  -w <arg>        Number of parallel MapReduce tasks to execute
{code}

I retried creating a backup with three empty tables in a set.... It does this:

{code}
stack@ve0524:~$ ./hbase/bin/hbase --config ~/conf_hbase backup create full hdfs://ve0524.halxg.cloudera.com:8020/bkup
-s me
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/stack/hbase-2.0.0-SNAPSHOT/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/stack/hadoop-2.7.4-SNAPSHOT/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
2017-02-22 16:59:53,327 DEBUG [main] util.ClassSize: Using Unsafe to estimate memory layout
2017-02-22 16:59:53,332 DEBUG [main] ipc.AbstractRpcClient: Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5644dc81,
compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000,
minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null
2017-02-22 16:59:53,589 DEBUG [main] ipc.RpcConnection: Use SIMPLE authentication for service
ClientService, sasl=false
2017-02-22 16:59:53,754 DEBUG [main] ipc.NettyRpcConnection: Connecting to ve0542.halxg.cloudera.com/10.17.240.29:16020
2017-02-22 16:59:53,908 DEBUG [main] ipc.RpcConnection: Use SIMPLE authentication for service
ClientService, sasl=false
2017-02-22 16:59:53,908 DEBUG [main] ipc.NettyRpcConnection: Connecting to ve0542.halxg.cloudera.com/10.17.240.29:16020
2017-02-22 16:59:53,911 DEBUG [main] ipc.RpcConnection: Use SIMPLE authentication for service
ClientService, sasl=false
2017-02-22 16:59:53,912 DEBUG [main] ipc.NettyRpcConnection: Connecting to ve0542.halxg.cloudera.com/10.17.240.29:16020
2017-02-22 16:59:53,959 DEBUG [hconnection-0x130e116b-shared-pool3-t1] ipc.RpcConnection:
Use SIMPLE authentication for service ClientService, sasl=false
2017-02-22 16:59:53,959 DEBUG [hconnection-0x130e116b-shared-pool3-t1] ipc.NettyRpcConnection:
Connecting to ve0542.halxg.cloudera.com/10.17.240.29:16020
2017-02-22 16:59:53,992 DEBUG [hconnection-0x130e116b-metaLookup-shared--pool5-t1] ipc.RpcConnection:
Use SIMPLE authentication for service ClientService, sasl=false
2017-02-22 16:59:53,993 DEBUG [hconnection-0x130e116b-metaLookup-shared--pool5-t1] ipc.NettyRpcConnection:
Connecting to ve0542.halxg.cloudera.com/10.17.240.29:16020
2017-02-22 16:59:54,002 DEBUG [main] ipc.RpcConnection: Use SIMPLE authentication for service
ClientService, sasl=false
2017-02-22 16:59:54,003 DEBUG [main] ipc.NettyRpcConnection: Connecting to ve0538.halxg.cloudera.com/10.17.240.27:16020
2017-02-22 16:59:54,029 DEBUG [main] ipc.AbstractRpcClient: Stopping rpc client
2017-02-22 16:59:54,040 DEBUG [main] ipc.AbstractRpcClient: Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2c1dc8e,
compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000,
minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null
2017-02-22 16:59:54,171 DEBUG [main] ipc.RpcConnection: Use SIMPLE authentication for service
ClientService, sasl=false
2017-02-22 16:59:54,171 DEBUG [main] ipc.NettyRpcConnection: Connecting to ve0542.halxg.cloudera.com/10.17.240.29:16020
2017-02-22 16:59:54,175 DEBUG [main] ipc.RpcConnection: Use SIMPLE authentication for service
ClientService, sasl=false
2017-02-22 16:59:54,176 DEBUG [main] ipc.NettyRpcConnection: Connecting to ve0542.halxg.cloudera.com/10.17.240.29:16020
2017-02-22 16:59:54,180 DEBUG [main] ipc.RpcConnection: Use SIMPLE authentication for service
ClientService, sasl=false
2017-02-22 16:59:54,180 DEBUG [main] ipc.NettyRpcConnection: Connecting to ve0542.halxg.cloudera.com/10.17.240.29:16020
2017-02-22 16:59:54,187 DEBUG [main] ipc.RpcConnection: Use SIMPLE authentication for service
ClientService, sasl=false
2017-02-22 16:59:54,187 DEBUG [main] ipc.NettyRpcConnection: Connecting to ve0542.halxg.cloudera.com/10.17.240.29:16020
2017-02-22 16:59:54,192 DEBUG [main] ipc.RpcConnection: Use SIMPLE authentication for service
ClientService, sasl=false
2017-02-22 16:59:54,192 DEBUG [main] ipc.NettyRpcConnection: Connecting to ve0542.halxg.cloudera.com/10.17.240.29:16020
2017-02-22 16:59:54,197 DEBUG [main] ipc.RpcConnection: Use SIMPLE authentication for service
ClientService, sasl=false
2017-02-22 16:59:54,198 DEBUG [main] ipc.NettyRpcConnection: Connecting to ve0542.halxg.cloudera.com/10.17.240.29:16020
2017-02-22 16:59:54,203 DEBUG [hconnection-0x5bb3d42d-shared-pool6-t1] ipc.RpcConnection:
Use SIMPLE authentication for service ClientService, sasl=false
2017-02-22 16:59:54,203 DEBUG [hconnection-0x5bb3d42d-shared-pool6-t1] ipc.NettyRpcConnection:
Connecting to ve0542.halxg.cloudera.com/10.17.240.29:16020
2017-02-22 16:59:54,213 INFO  [main] impl.TableBackupClient: Backup backup_1487811594048 started
at 1487811594211.
2017-02-22 16:59:54,242 DEBUG [hconnection-0x5bb3d42d-metaLookup-shared--pool7-t1] ipc.RpcConnection:
Use SIMPLE authentication for service ClientService, sasl=false
2017-02-22 16:59:54,242 DEBUG [hconnection-0x5bb3d42d-metaLookup-shared--pool7-t1] ipc.NettyRpcConnection:
Connecting to ve0542.halxg.cloudera.com/10.17.240.29:16020
2017-02-22 16:59:54,286 DEBUG [hconnection-0x5bb3d42d-shared-pool6-t2] ipc.RpcConnection:
Use SIMPLE authentication for service ClientService, sasl=false
2017-02-22 16:59:54,286 DEBUG [hconnection-0x5bb3d42d-shared-pool6-t2] ipc.NettyRpcConnection:
Connecting to ve0538.halxg.cloudera.com/10.17.240.27:16020
2017-02-22 16:59:54,313 DEBUG [main] ipc.RpcConnection: Use SIMPLE authentication for service
ClientService, sasl=false
2017-02-22 16:59:54,314 DEBUG [main] ipc.NettyRpcConnection: Connecting to ve0538.halxg.cloudera.com/10.17.240.27:16020
2017-02-22 16:59:54,322 DEBUG [hconnection-0x5bb3d42d-shared-pool6-t3] ipc.RpcConnection:
Use SIMPLE authentication for service ClientService, sasl=false
2017-02-22 16:59:54,322 DEBUG [hconnection-0x5bb3d42d-shared-pool6-t3] ipc.NettyRpcConnection:
Connecting to ve0538.halxg.cloudera.com/10.17.240.27:16020
2017-02-22 16:59:54,329 INFO  [main] impl.FullTableBackupClient: Execute roll log procedure
for full backup ...
2017-02-22 16:59:54,359 DEBUG [main] ipc.RpcConnection: Use SIMPLE authentication for service
MasterService, sasl=false
2017-02-22 16:59:54,359 DEBUG [main] ipc.NettyRpcConnection: Connecting to ve0524.halxg.cloudera.com/10.17.240.20:16000
2017-02-22 16:59:54,369 DEBUG [main] ipc.RpcConnection: Use SIMPLE authentication for service
MasterService, sasl=false
2017-02-22 16:59:54,369 DEBUG [main] ipc.NettyRpcConnection: Connecting to ve0524.halxg.cloudera.com/10.17.240.20:16000
2017-02-22 16:59:54,522 DEBUG [main] ipc.RpcConnection: Use SIMPLE authentication for service
MasterService, sasl=false
2017-02-22 16:59:54,523 DEBUG [main] ipc.NettyRpcConnection: Connecting to ve0524.halxg.cloudera.com/10.17.240.20:16000
2017-02-22 16:59:54,527 DEBUG [main] ipc.RpcConnection: Use SIMPLE authentication for service
MasterService, sasl=false
...
{code}

Seems stuck. Nothing in logs.  Nothing created in hdfs. I'm doing something wrong. Help me
out [~vrodionov] Thanks.



> HBase Backup/Restore Phase 2
> ----------------------------
>
>                 Key: HBASE-14123
>                 URL: https://issues.apache.org/jira/browse/HBASE-14123
>             Project: HBase
>          Issue Type: Umbrella
>            Reporter: Vladimir Rodionov
>            Assignee: Vladimir Rodionov
>            Priority: Blocker
>             Fix For: HBASE-7912
>
>         Attachments: 14123-master.v14.txt, 14123-master.v15.txt, 14123-master.v16.txt,
14123-master.v17.txt, 14123-master.v18.txt, 14123-master.v19.txt, 14123-master.v20.txt, 14123-master.v21.txt,
14123-master.v24.txt, 14123-master.v25.txt, 14123-master.v27.txt, 14123-master.v28.txt, 14123-master.v29.full.txt,
14123-master.v2.txt, 14123-master.v30.txt, 14123-master.v31.txt, 14123-master.v32.txt, 14123-master.v33.txt,
14123-master.v34.txt, 14123-master.v35.txt, 14123-master.v36.txt, 14123-master.v37.txt, 14123-master.v38.txt,
14123.master.v39.patch, 14123-master.v3.txt, 14123.master.v40.patch, 14123.master.v41.patch,
14123.master.v42.patch, 14123.master.v44.patch, 14123.master.v45.patch, 14123.master.v46.patch,
14123.master.v48.patch, 14123.master.v49.patch, 14123.master.v50.patch, 14123.master.v51.patch,
14123.master.v52.patch, 14123.master.v54.patch, 14123.master.v56.patch, 14123.master.v57.patch,
14123-master.v5.txt, 14123-master.v6.txt, 14123-master.v7.txt, 14123-master.v8.txt, 14123-master.v9.txt,
14123-v14.txt, Backup-restoreinHBase2.0 (1).pdf, Backup-restoreinHBase2.0.pdf, HBASE-14123-for-7912-v1.patch,
HBASE-14123-for-7912-v6.patch, HBASE-14123-v10.patch, HBASE-14123-v11.patch, HBASE-14123-v12.patch,
HBASE-14123-v13.patch, HBASE-14123-v15.patch, HBASE-14123-v16.patch, HBASE-14123-v1.patch,
HBASE-14123-v2.patch, HBASE-14123-v3.patch, HBASE-14123-v4.patch, HBASE-14123-v5.patch, HBASE-14123-v6.patch,
HBASE-14123-v7.patch, HBASE-14123-v9.patch
>
>
> Phase 2 umbrella JIRA. See HBASE-7912 for design document and description. 



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message