hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "stack (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-4298) Support to drain RS nodes through ZK
Date Thu, 03 Nov 2011 17:19:33 GMT

    [ https://issues.apache.org/jira/browse/HBASE-4298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13143331#comment-13143331
] 

stack commented on HBASE-4298:
------------------------------

I ran TestLogRolling locally and can't get it to fail.  It failed with 'Cannot lock storage
/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/7f164eb7-a297-40fb-89ff-6bd9a0e331db/dfscluster_e7b1f239-5bca-46c6-abfb-f8237c09a7ce/dfs/data/data3.
The directory is already locked.'

TestDistributedLogSplitting fails with too many open files but ulimit for files says 32k?

{code}
asf011.sp2.ygridcore.net
core file size          (blocks, -c) 0
data seg size           (kbytes, -d) unlimited
scheduling priority             (-e) 20
file size               (blocks, -f) unlimited
pending signals                 (-i) 16382
max locked memory       (kbytes, -l) 64
max memory size         (kbytes, -m) unlimited
open files                      (-n) 32768
pipe size            (512 bytes, -p) 8
POSIX message queues     (bytes, -q) 819200
real-time priority              (-r) 0
stack size              (kbytes, -s) 8192
cpu time               (seconds, -t) unlimited
max user processes              (-u) 2048
virtual memory          (kbytes, -v) unlimited
file locks                      (-x) unlimited
32768
Running in Jenkins mode
{code}

This is good to go I'd say.

                
> Support to drain RS nodes through ZK
> ------------------------------------
>
>                 Key: HBASE-4298
>                 URL: https://issues.apache.org/jira/browse/HBASE-4298
>             Project: HBase
>          Issue Type: Improvement
>          Components: master
>    Affects Versions: 0.90.4
>         Environment: all
>            Reporter: Aravind Gottipati
>            Priority: Critical
>              Labels: patch
>             Fix For: 0.92.0, 0.90.5
>
>         Attachments: 4298-trunk-v2.txt, 4298-trunk-v3.txt, 90_hbase.patch, drainingservertest-v2.txt,
drainingservertest.txt, trunk_hbase.patch
>
>
> HDFS currently has a way to exclude certain datanodes and prevent them from getting new
blocks.  HDFS goes one step further and even drains these nodes for you.  This enhancement
is a step in that direction.
> The idea is that we mark nodes in zookeeper as draining nodes.  This means that they
don't get any more new regions.  These draining nodes look exactly the same as the corresponding
nodes in /rs, except they live under /draining.
> Eventually, support for draining them can be added.  I am submitting two patches for
review - one for the 0.90 branch and one for trunk (in git).
> Here are the two patches
> 0.90 - https://github.com/aravind/hbase/commit/181041e72e7ffe6a4da6d82b431ef7f8c99e62d2
> trunk - https://github.com/aravind/hbase/commit/e127b25ae3b4034103b185d8380f3b7267bc67d5
> I have tested both these patches and they work as advertised.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message