hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "nkeywal (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-5064) use surefire tests parallelization
Date Mon, 19 Dec 2011 17:27:31 GMT

    [ https://issues.apache.org/jira/browse/HBASE-5064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13172420#comment-13172420
] 

nkeywal commented on HBASE-5064:
--------------------------------

There are two issues:

1) open files (-n) 1024
This limit is per process
This is the cause for "too many open file"
This occurs when a test, for a reason or another, goes beyond this limit (some of the tests
are very close)

2) max user processes (-u) 2048
This limit is per user/machine, not per process!
This is the cause for "unable to create new native thread"
This occurs when the machine runs multiple tests in parallel, and  when all tests happen to
use a lot of threads.

Both must be changed. As we should limit the number of file descriptor used, it makes sense
to set open files to something reasonable (like 2048 or 4096), but the number of max user
processes could be set to unlimited without any issue, as when it fails it's because there
are other processes using threads as well, and we don't control them.



                
> use surefire tests parallelization
> ----------------------------------
>
>                 Key: HBASE-5064
>                 URL: https://issues.apache.org/jira/browse/HBASE-5064
>             Project: HBase
>          Issue Type: Improvement
>          Components: test
>    Affects Versions: 0.94.0
>            Reporter: nkeywal
>            Assignee: nkeywal
>            Priority: Minor
>         Attachments: 5064.patch, 5064.patch, 5064.v2.patch, 5064.v3.patch, 5064.v4.patch,
5064.v5.patch, 5064.v6.patch, 5064.v7.patch
>
>
> To be tried multiple times on hadoop-qa before committing.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message