accumulo-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (ACCUMULO-408) Large bulk imports timing out
Date Wed, 19 Dec 2012 22:51:14 GMT

    [ https://issues.apache.org/jira/browse/ACCUMULO-408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13536518#comment-13536518
] 

Hudson commented on ACCUMULO-408:
---------------------------------

Integrated in Accumulo-Trunk #586 (See [https://builds.apache.org/job/Accumulo-Trunk/586/])
    ACCUMULO-408 get the bulk functional tests working (Revision 1424060)
ACCUMULO-408 use sync to make sure we do not read old data from zookeeper (Revision 1424050)
ACCUMULO-408 use sync to make sure we do not read old data from zookeeper (Revision 1424036)
ACCUMULO-408 track threads which are assigning files to tservers, make connection timeout
configurable for bulk requests (Revision 1423994)

     Result = ABORTED
ecn : 
Files : 
* /accumulo/trunk/fate/src/main/java/org/apache/accumulo/fate/zookeeper/ZooReader.java
* /accumulo/trunk/server/src/main/java/org/apache/accumulo/server/test/functional/BulkSplitOptimizationTest.java
* /accumulo/trunk/test/system/auto/TestUtils.py

ecn : 
Files : 
* /accumulo/trunk/fate/src/main/java/org/apache/accumulo/fate/zookeeper/ZooReader.java

ecn : 
Files : 
* /accumulo/trunk/core/src/main/java/org/apache/accumulo/core/client/impl/ServerClient.java
* /accumulo/trunk/fate/src/main/java/org/apache/accumulo/fate/zookeeper/IZooReader.java
* /accumulo/trunk/fate/src/main/java/org/apache/accumulo/fate/zookeeper/ZooReader.java
* /accumulo/trunk/fate/src/main/java/org/apache/accumulo/fate/zookeeper/ZooReaderWriter.java
* /accumulo/trunk/server/src/main/java/org/apache/accumulo/server/client/BulkImporter.java
* /accumulo/trunk/server/src/main/java/org/apache/accumulo/server/tabletserver/TabletServer.java
* /accumulo/trunk/server/src/main/java/org/apache/accumulo/server/zookeeper/TransactionWatcher.java

ecn : 
Files : 
* /accumulo/trunk/core/src/main/java/org/apache/accumulo/core/client/impl/ServerClient.java
* /accumulo/trunk/core/src/main/java/org/apache/accumulo/core/conf/Property.java
* /accumulo/trunk/server/src/main/java/org/apache/accumulo/server/client/BulkImporter.java
* /accumulo/trunk/server/src/main/java/org/apache/accumulo/server/client/ClientServiceHandler.java
* /accumulo/trunk/server/src/main/java/org/apache/accumulo/server/master/tableOps/BulkImport.java
* /accumulo/trunk/server/src/main/java/org/apache/accumulo/server/tabletserver/TabletServer.java

                
> Large bulk imports timing out
> -----------------------------
>
>                 Key: ACCUMULO-408
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-408
>             Project: Accumulo
>          Issue Type: Bug
>          Components: master, tserver
>    Affects Versions: 1.4.0
>            Reporter: Keith Turner
>            Assignee: Eric Newton
>            Priority: Critical
>             Fix For: 1.5.0
>
>
> Large bulk imports that take more than 2 minutes to process are failing.  The master
ask a tablet sever to bulk import the files and times out after 2 minutes.  It retries, but
the retry will take over 2 minutes.  Eventually it gives up and starts copying all of the
data to the fail dir which takes forever.  This copy is all through the master and for large
data basically never completes.  The bulk import threads on the tablet server probably complete
eventually, so the data is still there.
> The master should not time these request out.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message