kylin-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hong Wei" <hwei2...@qq.com>
Subject 回复: Fail to extract disctinct columns from fact tables
Date Fri, 21 Apr 2017 06:19:50 GMT
I do confirm kylin has got the right hive-site.xml on classpath.
Additionally, when I add 
--hiveconf hive.security.authorization.sqlstd.confwhitelist.append='mapred.job.*|dfs.*' 
into beeline params which is configured in conf/kylin.properties, a error is reported while
starting kylin:


Error: Fail to open new session: org.apache.hive.service.cli.HiveSQLException: java.lan.IllegalArgumentException:
Cannot modify hive.security.authorization.sqlstd.confwhitelist.append at runtime. It is not
in list of params that are allowed to be modified at runtime (state=, code=0)




------------------ 原始邮件 ------------------
发件人: "Li Yang";<liyang@apache.org>;
发送时间: 2017年4月21日(星期五) 中午1:02
收件人: "dev"<dev@kylin.apache.org>; 

主题: Re: Fail to extract disctinct columns from fact tables



I recall checking if Kylin has got the right hive-site.xml on classpath may
fix this problem.

On Thu, Apr 20, 2017 at 8:13 PM, Hong Wei <hwei2007@qq.com> wrote:

> Dear Kylin:
>     I try to run Kylin (v1.6.0) on HuaWei FusionInsight with Kerberos
> authorization (Hadoop v2.7.0, Hive v1.3.0, HBase v1.0.2). I use Beeline
> mode to visit hive with config like:
>     kylin.hive.beeline.params=-n [username] -u 'jdbc:hive2://ip:port;
> principal=[principal];auth=KERBEROS;sasl.qop=auto-conf'
>
>     When I tried to build the sample cube, a mistake token place in the
> 3rd step: 'extract the distinct columns from fact tables'. The Part of
> error log like this:
>     WARN hive.metastore:574 : set_ugi() not suuccessful, Likely cause: new
> client talking to old server. Continuing without it.
> org.apache.thrift.transport.TTransportException
>        at org.apache.thrift.transport.TIOStreamTransport.read(
> TIOStreamTransport.java:132)
>        at org.apache.thrift.transport.TTransport.readAll(TTransport.
> java:86)
>        ............
>        at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.
> recv_set_ugi(ThriftHiveMetastore.java:3794)
>        at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.
> set_ugi(ThriftHiveMetastore.java:3780)
>        at  org.apache.hadoop.hive.metastore.HiveMetaStoreClient.
> open(HiveMetaStoreClient:566)
>        at  org.apache.hadoop.hive.metastore.HiveMetaStoreClient.
> reconnect(HiveMetaStoreClient:342)
>       ...............
>        at  org.apache.hive.hcatalog.common.HCatUtil.getTable(
> HCatUtil.java:180)
>       ...............
>        at  org.apache.kylin.source.hive.HiveMRInputFormat.
> configureJob(HiveMRInput.java:105)
>        at  org.apache.kylin.engine.mr.steps.FactDistinctColumnsJob.
> setupMapper(FactDistinctColumnsJob.java:119)
>        at  org.apache.kylin.engine.mr.steps.FactDistinctColumnsJob.
> run(FactDistinctColumnsJob.java:103)
>        ..............
>    INFO        hive.metastore:602 :Connect to metastore.
>    INFO        common.AbstractHadoopJob:506 : tempMetaFileString is : null
>    ERROR     common.MapReduceExecutable:127 : error execute
> MapReduceExecutable{id=......,name=Extract Fact Table Distinct Columns,
> state=RUNNING}
>
>
>     Unfortunatly, I have no idea to solve this problem, I need some help.
> Thanks.
>
>
>
>                                                Sincerely yours
Mime
  • Unnamed multipart/alternative (inline, 8-Bit, 0 bytes)
View raw message