kylin-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From 冯广彬 <ibm5...@gmail.com>
Subject Re: 你好,我在构建cube的时候清理h ive垃圾出现问题,在追踪源码后发现问题。
Date Tue, 08 Jan 2019 01:42:14 GMT
你好史少峰,我所做的具体步骤是这样的。
1:下载一份kylin2.5.2的源代码。
2:将KYLIN_HOME/tool 文件夹下的jar包复制一份出来。
3:找到报错的类并在其中打上log,编译并替换源文件。
4:重启kylin并再次执行构建。
5:查看log日志,但是我发现一个奇怪的事情,我的KYLIN_CONF即便是配置了。他仍然读不到,我是在kylin.sh中
使用-DKYLIN_CONF来配置的,但是日志打印出来的结果却是另一个路径,所以我现在想确认,这个KYLIN_CONF的作用是?我应该在哪里配置,并且好像我的conf文件夹下的配置文件都被程序读不到。如果需要日志,我可以重现并发送日志。

ShaoFeng Shi <shaofengshi@apache.org> 于2019年1月8日周二 上午9:34写道:

> Hello Guangbin,
>
> Do you have a further update on this issue? Thanks.
>
> Best regards,
>
> Shaofeng Shi 史少锋
> Apache Kylin PMC
> Work email: shaofeng.shi@kyligence.io
> Kyligence Inc: https://kyligence.io/
>
> Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
> Join Kylin user mail group: user-subscribe@kylin.apache.org
> Join Kylin dev mail group: dev-subscribe@kylin.apache.org
>
>
>
>
> ShaoFeng Shi <shaofengshi@apache.org> 于2019年1月4日周五 上午9:03写道:
>
> > hi, thanks for the reporting; It is very interesting (never heard of it
> > before); Did you observe this problem occasionally, or it can be
> reproduced
> > consistently? (the file exists, but Kylin reports not existing).
> >
> > Can you try to add some log there and then check whether it is really
> > misreporting? Thank you!
> >
> > Best regards,
> >
> > Shaofeng Shi 史少锋
> > Apache Kylin PMC
> > Work email: shaofeng.shi@kyligence.io
> > Kyligence Inc: https://kyligence.io/
> >
> > Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
> > Join Kylin user mail group: user-subscribe@kylin.apache.org
> > Join Kylin dev mail group: dev-subscribe@kylin.apache.org
> >
> >
> >
> >
> > 冯广彬 <ibm5016@gmail.com> 于2019年1月3日周四 下午3:58写道:
> >
> >> 具体的描述是这样的,
> >> 我的报错堆栈信息:
> >> org.apache.kylin.job.exception  .ExecuteException:
> >> org.apache.kylin.job.exception  .ExecuteException:
> >> java.lang.RuntimeException: Failed to read kylin_hive_conf.xml
> >>         at org.apache.kylin.job.execution
> >> .AbstractExecutable.execute(  AbstractExecutable.java:179)
> >>
> >>         at org.apache.kylin.job.impl.thre
> >> adpool.DefaultScheduler$JobRun  ner.run(DefaultScheduler.java:
> >>  113)
> >>         at java. util.concurrent.ThreadPoo
> >> lExecutor.runWorker(ThreadPool  Executor.java:1149)
> >>
> >>         at java.util.concurrent.ThreadPoo
> >> lExecutor$Worker.run(ThreadPoo  lExecutor.java:624)
> >>
> >>         at java.lang.Thread.run(Thread.java:748)
> >> Caused by: org.apache.kylin.job.exception  .ExecuteException:
> >> java.lang.RuntimeException: Failed to read kylin_hive_conf.xml
> >>         at org.apache.kylin.job.execution
> >> .AbstractExecutable.execute(  AbstractExecutable.java:
> >> 179)
> >>         at org.apache.kylin.job.execution
> >> .DefaultChainedExecutable.doWo  rk(DefaultChainedExecutable.
> >>  java:70)
> >>         at org.apache.kylin.job.execution
> >> .AbstractExecutable.execute(  AbstractExecutable.java:164)
> >>
> >>         ... 4 more
> >> Caused by: java.lang.RuntimeException: Failed to read
> kylin_hive_conf.xml
> >>         at org.apache.kylin.common.util.S
> ourceConfigurationUtil.loadXml
> >> Configuration(SourceConfigurat ionUtil.java:83)
> >>         at org.apache.kylin.common.util.S
> >> ourceConfigurationUtil.loadHiv  eConfiguration(SourceConfigura
> >>  tionUtil.java:57)
> >>         at org.apache.kylin.common.util.H  iveCmdBuilder.<init>
> >> (HiveCmdBu  ilder
> >> .java:46)
> >>         at org.apache.kylin.source.hive.G
> >> arbageCollectionStep.cleanUpIn  termediateFlatTable(GarbageCol
> >>  lectionStep.java:61)
> >>         at org.apache.kylin.source.hive.G
> >> arbageCollectionStep.doWork(Ga  rbageCollectionStep
> >> .java: 48)
> >>         at org.apache.kylin.job.execution
> >> .AbstractExecutable.execute(  AbstractExecutable.java:164)
> >>
> >>
> >>
> >> *我下载了源码,查看了这个类*org.apache.kylin.common.util.S ourceConfigurationUtil;
> >> 我发现他在加载配置文件的时候会做这一步判断
> >>  if (!confFile.exists()) {
> >>             if (checkExist)
> >>                 throw new RuntimeException("Failed to read " +
> >> xmlFileName);
> >>             else
> >>                 return confProps;
> >>         }
> >>
> >> 后来经过查阅   https://bugs.java.com/bu  gdatabase/view_bug.do?bug_id=
> 5003595
> >> <https://bugs.java.com/bugdatabase/view_bug.do?bug_id=5003595>
> >>
> >>
> 发现在linux系统上使用此方法可能会出现及时文件存在,依然返回值为false的结果,我想请你审阅下是否存在问题,如果存在问题的话,我可以怎样解决呢?
> >> 谢谢!
> >>
> >
>
Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message