kylin-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Liu Shaohui (JIRA)" <j...@apache.org>
Subject [jira] [Created] (KYLIN-4026) Avoid too many file append operation in HiveProducer of hive metrics reporter
Date Fri, 31 May 2019 11:30:00 GMT
Liu Shaohui created KYLIN-4026:
----------------------------------

             Summary: Avoid too many file append operation in HiveProducer of hive metrics
reporter
                 Key: KYLIN-4026
                 URL: https://issues.apache.org/jira/browse/KYLIN-4026
             Project: Kylin
          Issue Type: Improvement
            Reporter: Liu Shaohui


Currently  for each write in HiveProducer, there will be a hdfs append operation, which is
heavy for HDFS. 

A improvement is to keep a FSDataOutputStream in  HiveProducer and write data to it continuously


 

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message