kylin-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Xiaoxiang Yu <xiaoxiang...@kyligence.io>
Subject Re: GlobalDict backup
Date Mon, 17 Jun 2019 07:46:14 GMT
Hi,
  Not only GlobalDict file, but also every piece of metadata which pushed down to HDFS will
not be backup. Maybe you should take a look at "$KYLIN_WORKING_DIR/$METADATA" in your HDFS.

----------------
Best wishes,
Xiaoxiang Yu 

在 2019/6/17 15:33,“Jason Tang”<jason.tang@striking.ly> 写入:

    
    
    > Thanks for the reply.
    > 
    > One thing to confirm:  “pushdown resource will not be backup in execute command
‘metadata.sh backup’”. Is it? Or only GlobalDict will not be backup?
    > 
    >> On Jun 14, 2019, at 2:40 PM, Xiaoxiang Yu <xiaoxiang.yu@kyligence.io> wrote:
    >> 
    >> Hi,
    >> Sorry for the late reply. You are right, the pushdown resource file(maybe big
dictionary) will be not be backup in execute command "metadata.sh backup". So you should backup
the hdfs dir(should be $WORKING_DIR/$METADATA/resoureces) manually.
    >> 
    >> ----------------
    >> Best wishes,
    >> Xiaoxiang Yu 
    >> 
    >> 
    >> 在 2019/6/12 18:09,“Jason Tang”<jason.tang@striking.ly> 写入:
    >> 
    >>   全局字典文件用于精确去重,咨询一下,这个文件有什么备份措施吗?
    >> 
    >>   查看了metadata backup的部分代码,应该是备份HBase上的数据,遇到列中没有数据的,判定是push
down到HDFS上了,然后到HDFS上读取。但没有找到相关的对全局字典进行备份的逻辑。在构建全局字典任务结束后,也没有看到存放到HBase中这部分代码(好像元数据中确实没有)。
    >> 
    >>   是暂时没有这个功能还是我遗漏掉了某部分代码逻辑?感谢指导!
    >> 
    > 
    
    

Mime
View raw message