kylin-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "zheng zhifeng (JIRA)" <j...@apache.org>
Subject [jira] [Created] (KYLIN-2366) multi FactDistinctColumnsReducer task write the same output file
Date Sun, 08 Jan 2017 07:01:58 GMT
zheng zhifeng created KYLIN-2366:
------------------------------------

             Summary: multi FactDistinctColumnsReducer task write the same output file
                 Key: KYLIN-2366
                 URL: https://issues.apache.org/jira/browse/KYLIN-2366
             Project: Kylin
          Issue Type: Bug
          Components: streaming
    Affects Versions: v1.6.0
            Reporter: zheng zhifeng
             Fix For: Future


  Multi FactDistinctColumnsReducer task will write the 
distinct columns to the same output file if the mapreduce
property mapreduce.reduce.speculative is true. This will
make the mapreduce job failed or the output file is redundancy.
  I think it shoud set mapreduce.reduce.speculative to false on
Extract Fact Table Distinct Columns step.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message