falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Pallavi Rao (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FALCON-1555) succeeded-post-processing action fails in Oozie uber mode
Date Fri, 23 Oct 2015 11:27:27 GMT

    [ https://issues.apache.org/jira/browse/FALCON-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14970849#comment-14970849
] 

Pallavi Rao commented on FALCON-1555:
-------------------------------------

Oozie uber mode leverages Hadoop 2's uber mode for Launcher jobs. For Java actions, the Java
program is run within the launcher itself. In such cases, the FileSystem instance is shared
(from cache), an fs.close() results in errors during JOB_COMMIT. The general recommendation
is to not use fs.close() in user programs. Alternately, you can disable caching in the Hadoop
configuration, which might not be a good idea.

> succeeded-post-processing action fails in Oozie uber mode
> ---------------------------------------------------------
>
>                 Key: FALCON-1555
>                 URL: https://issues.apache.org/jira/browse/FALCON-1555
>             Project: Falcon
>          Issue Type: Bug
>    Affects Versions: 0.8
>         Environment: QA
>            Reporter: Pragya Mittal
>            Assignee: Pragya Mittal
>             Fix For: 0.8
>
>         Attachments: FALCON-1555-v1.patch, FALCON-1555.patch, post-processing.log
>
>
> Falcon succeeded-post-processing action fails with uber mode enable in oozie. This is
happening because filesystem is closed in post processing action in WorkflowExecutionContext.
> Attaching yarn logs for the same.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message