kylin-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF subversion and git services (JIRA)" <>
Subject [jira] [Commented] (KYLIN-3137) Update hive-site.xml locating logic for CDH distro
Date Thu, 31 May 2018 13:37:00 GMT


ASF subversion and git services commented on KYLIN-3137:

Commit f11aec308119426222a4bc9d9d6a28f551a16111 in kylin's branch refs/heads/KYLIN-3137 from
[;h=f11aec3 ]

KYLIN-3137 Spark cubing refine

> Update hive-site.xml locating logic for CDH distro
> --------------------------------------------------
>                 Key: KYLIN-3137
>                 URL:
>             Project: Kylin
>          Issue Type: Improvement
>          Components: Job Engine, Others, Spark Engine
>    Affects Versions: v2.2.0
>            Reporter: Ruslan Dautkhanov
>            Assignee: Shaofeng SHI
>            Priority: Major
>              Labels: cdh, cloudera, configuration, hive
> Getting following exception while trying to build a cube
> {noformat}
> java.lang.RuntimeException: Cannot find hive-site.xml in kylin_hadoop_conf_dir: /etc/hadoop/conf.
In order to enable spark cubing, you must set kylin.env.hadoop-conf-dir to a dir which contains
at least core-site.xml, hdfs-site.xml, hive-site.xml, mapred-site.xml, yarn-site.xml
> 	at org.apache.kylin.engine.spark.SparkExecutable.doWork(
> 	at org.apache.kylin.job.execution.AbstractExecutable.execute(
> 	at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(
> 	at org.apache.kylin.job.execution.AbstractExecutable.execute(
> 	at org.apache.kylin.job.impl.threadpool.DefaultScheduler$
> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(
> 	at java.util.concurrent.ThreadPoolExecutor$
> 	at
> {noformat}
> I am using Kylin binaries for CDH downloaded from
> Yes, indeed hive-site.xml is not in /etc/hadoop/conf in Cloudera's distribution for Hadoop.
> hive-site.xml is in /etc/hive/conf, not in /etc/hadoop/conf
> The other four files:
> core-site.xml, hdfs-site.xml, mapred-site.xml, yarn-site.xml
> can be found in /etc/hadoop/conf but, again, not hive-site.xml which is in /etc/hive/conf
> Would be great to have this adjusted for CDH.

This message was sent by Atlassian JIRA

View raw message