accumulo-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (ACCUMULO-408) Large bulk imports timing out
Date Wed, 19 Dec 2012 23:01:26 GMT

    [ https://issues.apache.org/jira/browse/ACCUMULO-408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13536538#comment-13536538
] 

Hudson commented on ACCUMULO-408:
---------------------------------

Integrated in Accumulo-1.4.x #256 (See [https://builds.apache.org/job/Accumulo-1.4.x/256/])
    ACCUMULO-408 merge from trunk (Revision 1424065)
ACCUMULO-408 use sync to make sure we do not read old data from zookeeper (Revision 1424053)

     Result = SUCCESS
ecn : 
Files : 
* /accumulo/branches/1.4
* /accumulo/branches/1.4/src
* /accumulo/branches/1.4/src/core
* /accumulo/branches/1.4/src/core/src/main/java/org/apache/accumulo/core/zookeeper/ZooReader.java
* /accumulo/branches/1.4/src/server

ecn : 
Files : 
* /accumulo/branches/1.4
* /accumulo/branches/1.4/src
* /accumulo/branches/1.4/src/core
* /accumulo/branches/1.4/src/core/src/main/java/org/apache/accumulo/core/client/impl/ServerClient.java
* /accumulo/branches/1.4/src/core/src/main/java/org/apache/accumulo/core/conf/Property.java
* /accumulo/branches/1.4/src/core/src/main/java/org/apache/accumulo/core/util/ThriftUtil.java
* /accumulo/branches/1.4/src/core/src/main/java/org/apache/accumulo/core/zookeeper/IZooReader.java
* /accumulo/branches/1.4/src/core/src/main/java/org/apache/accumulo/core/zookeeper/ZooReader.java
* /accumulo/branches/1.4/src/server
* /accumulo/branches/1.4/src/server/src/main/java/org/apache/accumulo/server/client/BulkImporter.java
* /accumulo/branches/1.4/src/server/src/main/java/org/apache/accumulo/server/master/tableOps/BulkImport.java
* /accumulo/branches/1.4/src/server/src/main/java/org/apache/accumulo/server/tabletserver/TabletServer.java
* /accumulo/branches/1.4/src/server/src/main/java/org/apache/accumulo/server/zookeeper/TransactionWatcher.java

                
> Large bulk imports timing out
> -----------------------------
>
>                 Key: ACCUMULO-408
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-408
>             Project: Accumulo
>          Issue Type: Bug
>          Components: master, tserver
>    Affects Versions: 1.4.0
>            Reporter: Keith Turner
>            Assignee: Eric Newton
>            Priority: Critical
>             Fix For: 1.5.0
>
>
> Large bulk imports that take more than 2 minutes to process are failing.  The master
ask a tablet sever to bulk import the files and times out after 2 minutes.  It retries, but
the retry will take over 2 minutes.  Eventually it gives up and starts copying all of the
data to the fail dir which takes forever.  This copy is all through the master and for large
data basically never completes.  The bulk import threads on the tablet server probably complete
eventually, so the data is still there.
> The master should not time these request out.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message