hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gaurangi Saxena (Jira)" <j...@apache.org>
Subject [jira] [Created] (MAPREDUCE-7295) Add support to read history files from the done directory
Date Tue, 08 Sep 2020 16:54:00 GMT
Gaurangi Saxena created MAPREDUCE-7295:

             Summary: Add support to read history files from the done directory
                 Key: MAPREDUCE-7295
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-7295
             Project: Hadoop Map/Reduce
          Issue Type: Wish
          Components: jobhistoryserver
    Affects Versions: 3.2.1, 2.9.2
            Reporter: Gaurangi Saxena

We would like to add a configuration option that enables a history-server to read files directly
from done directory, instead of moving them from intermediate to done directory.

Current setup of mapreduce code, displays files that our moved by a history server from intermediate
to done. We cannot have two servers (job cluster and static history server) doing this as
it could lead to race conditions. 

Our service wants to configure a static history server that displays jobs run on multiple
clusters. We would like this server to only read from log directories.



This message was sent by Atlassian Jira

To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org

View raw message