hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Miklos Szegedi (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-7712) Add ability to ignore timestamps in localized files
Date Sat, 13 Jan 2018 02:19:00 GMT

    [ https://issues.apache.org/jira/browse/YARN-7712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16324906#comment-16324906
] 

Miklos Szegedi commented on YARN-7712:
--------------------------------------

Thank you, [~chris.douglas] for the reply.
Here are my requirements:
1. I would like to run my own YARN AM in an unmodified cluster, so I believe I cannot use
FilterFileSystem
2. The option to ignore the timestamp should be application specific (no global config, etc.)
3. I have no client code in Java, so only REST APIs can be used
Given the above requirements I need to use webhdfs to get the timestamp and set for each localized
file every time I launch something. This is cumbersome and not necessary in case of my app.
This is why it would be nice to have a special value (-1) to ignore the timestamp per request.
The default remains the same, no other applications are affected.

> Add ability to ignore timestamps in localized files
> ---------------------------------------------------
>
>                 Key: YARN-7712
>                 URL: https://issues.apache.org/jira/browse/YARN-7712
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: nodemanager
>            Reporter: Miklos Szegedi
>            Assignee: Miklos Szegedi
>
> YARN currently requires and checks the timestamp of localized files and fails, if the
file on HDFS does not match to the one requested. This jira adds the ability to ignore the
timestamp based on the request of the client.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message