falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Pallavi Rao (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FALCON-1555) succeeded-post-processing action fails in Oozie uber mode
Date Mon, 26 Oct 2015 04:50:27 GMT

    [ https://issues.apache.org/jira/browse/FALCON-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14973721#comment-14973721
] 

Pallavi Rao commented on FALCON-1555:
-------------------------------------

The below excerpt of stack in the log shows that FS was closed when a job commit was attempted:
{code}
2015-10-23 06:02:04,115 ERROR [CommitterEvent Processor #1] org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler:
could not create failure file.
java.io.IOException: Filesystem closed
	at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:795)
{code}

fs.close() in HiveDRTool had nothing to do with this particular bug. As mentioned by me and
[~sriksun] in other comments using fs.close() is not recommended. Hence, we removed it from
all the places where it was used.

> succeeded-post-processing action fails in Oozie uber mode
> ---------------------------------------------------------
>
>                 Key: FALCON-1555
>                 URL: https://issues.apache.org/jira/browse/FALCON-1555
>             Project: Falcon
>          Issue Type: Bug
>    Affects Versions: 0.8
>         Environment: QA
>            Reporter: Pragya Mittal
>            Assignee: Pragya Mittal
>             Fix For: 0.8
>
>         Attachments: FALCON-1555-v1.patch, FALCON-1555.patch, post-processing.log
>
>
> Falcon succeeded-post-processing action fails with uber mode enable in oozie. This is
happening because filesystem is closed in post processing action in WorkflowExecutionContext.
> Attaching yarn logs for the same.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message