falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Venkatesh Seetharam (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FALCON-220) Post processing should propagate user information in messages for offline processing
Date Thu, 16 Jan 2014 18:13:23 GMT

    [ https://issues.apache.org/jira/browse/FALCON-220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13873689#comment-13873689
] 

Venkatesh Seetharam commented on FALCON-220:
--------------------------------------------

Another good question [~shaik.idris].

bq. Also, should we use FileSystem fs = HadoopClientFactory.get().createProxiedFileSystem(workflowUser,
conf); across all services.
Nope. You only proxy when a service (login user with credentials) is executing on behalf of
the end user (authenticated user with out credentials on server). 

bq. 1. FeedEvictor
This is executed as the user by oozie - oozie launches a map task as the end user

bq. 3. LogMover
This is executed as the user by oozie as oart of FalconPostProcessing - oozie launches a map
task as the end user

bq. 2. LogCleanupService
I think I have missed this one. Good catch. This is fine since Falcon owns these dirs and
is responsible for cleaning up. I'd still like to change this to use the HadoopClientFactory.
This will be a rev to FALCON-15.


> Post processing should propagate user information in messages for offline processing
> ------------------------------------------------------------------------------------
>
>                 Key: FALCON-220
>                 URL: https://issues.apache.org/jira/browse/FALCON-220
>             Project: Falcon
>          Issue Type: Sub-task
>          Components: messaging
>    Affects Versions: 0.4, 0.3
>            Reporter: Venkatesh Seetharam
>            Assignee: Venkatesh Seetharam
>              Labels: security
>         Attachments: FALCON-220.patch
>
>
> Late data handling, retries need to execute the jobs as the user who submitted it requiring
propagation of user information.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

Mime
View raw message