accumulo-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eric Newton (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (ACCUMULO-408) Large bulk imports timing out
Date Wed, 12 Dec 2012 15:31:22 GMT

    [ https://issues.apache.org/jira/browse/ACCUMULO-408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13530030#comment-13530030
] 

Eric Newton commented on ACCUMULO-408:
--------------------------------------

On large clusters, I'm seeing bulk imports fail, so the master moves the files, and yet there
are entries in the METADATA table for those files.  Later, tservers complain that the files
do not exist.

                
> Large bulk imports timing out
> -----------------------------
>
>                 Key: ACCUMULO-408
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-408
>             Project: Accumulo
>          Issue Type: Bug
>          Components: master, tserver
>    Affects Versions: 1.4.0
>            Reporter: Keith Turner
>            Assignee: Eric Newton
>            Priority: Critical
>             Fix For: 1.5.0
>
>
> Large bulk imports that take more than 2 minutes to process are failing.  The master
ask a tablet sever to bulk import the files and times out after 2 minutes.  It retries, but
the retry will take over 2 minutes.  Eventually it gives up and starts coping all of the data
to the fail dir which takes forever.  This copy is all through the master and for large data
basically never completes.  The bulk import threads on the tablet server probably complete
eventually, so the data is still there.
> The master should not time these request out.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message