hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Aaron Fabbri (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-14971) Merge S3A committers into trunk
Date Thu, 02 Nov 2017 02:54:00 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-14971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16235099#comment-16235099
] 

Aaron Fabbri commented on HADOOP-14971:
---------------------------------------

Think I found the cause of the job not finishing for that test case.  
{noformat}
2017-11-01 19:34:57,380 [JUnit] ERROR nodemanager.LocalDirsHandlerService (LocalDirsHandlerService.java:updateDirsAfterTest(462))
- Most of the disks failed.
4/4 local-dirs usable space is below configured utilization percentage/no more usable space
[ /Users/fabbri/Code/hadoop/hadoop-tools/hadoop-aws/target/ITCommitMRJob/ITCommitMRJob-localDir-nm-0_0
: used space above threshold of 90.0% 
...
{noformat}

I still had multiple GB of space left but apparently NM won't run above the threshold.  Cleaned
up gigs of old intellij downloads and now the test passes.  Hah.  Here I was reading YARN/MR
code.

> Merge S3A committers into trunk
> -------------------------------
>
>                 Key: HADOOP-14971
>                 URL: https://issues.apache.org/jira/browse/HADOOP-14971
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: fs/s3
>    Affects Versions: 3.0.0
>            Reporter: Steve Loughran
>            Assignee: Steve Loughran
>            Priority: Major
>         Attachments: HADOOP-13786-040.patch, HADOOP-13786-041.patch
>
>
> Merge the HADOOP-13786 committer into trunk. This branch is being set up as a github
PR for review there & to keep it out the mailboxes of the watchers on the main JIRA



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message