kylin-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Billy Liu <billy...@apache.org>
Subject Re: Is kylin support kerberos while using cube connecting to HBASE?
Date Wed, 21 Jun 2017 13:50:11 GMT
My friend told me, put the hdfs-site.xml into HADOOP_CONF_DIR will resolve
the HBase Kerberos issue. Have a try.

2017-06-20 0:23 GMT+08:00 ShaoFeng Shi <shaofengshi@apache.org>:

> I think the root cause error is "Caused by: java.lang.IllegalAccessError:
> tried to access class
> org.apache.hadoop.hbase.client.AsyncProcess from class
> org.apache.hadoop.hbase.client.ConnectionManager$
> HConnectionImplementation"
>
> For what this error means, you can check:
> https://stackoverflow.com/questions/7076414/java-lang-
> illegalaccesserror-tried-to-access-method
>
> So there might be version unmatched hbase jars in Kylin's classpath.
>
>
> 2017-06-19 13:51 GMT+08:00 ran gabriele <ran.gabriele@live.com>:
>
> > Thank you for telling me that.
> >
> > After some struggle, I succeed in making spark yarn work for HBASE token
> > distribution.
> >
> > However I got this error instead:
> >
> > 17/06/19 09:50:10 ERROR ResourceStore: Create new store instance failed
> > java.lang.reflect.InvocationTargetException
> >         at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> > Method)
> >         at
> > sun.reflect.NativeConstructorAccessorImpl.newInstance(
> > NativeConstructorAccessorImpl.java:62)
> >         at
> > sun.reflect.DelegatingConstructorAccessorImpl.newInstance(
> > DelegatingConstructorAccessorImpl.java:45)
> >         at java.lang.reflect.Constructor.newInstance(Constructor.java:
> 423)
> >         at
> > org.apache.kylin.common.persistence.ResourceStore.createResourceStore(
> > ResourceStore.java:91)
> >         at
> > org.apache.kylin.common.persistence.ResourceStore.
> > getStore(ResourceStore.java:110)
> >         at org.apache.kylin.cube.CubeManager.getStore(
> > CubeManager.java:812)
> >         at
> > org.apache.kylin.cube.CubeManager.loadAllCubeInstance(
> > CubeManager.java:732)
> >         at org.apache.kylin.cube.CubeManager.<init>(
> CubeManager.java:143)
> >         at org.apache.kylin.cube.CubeManager.getInstance(
> > CubeManager.java:107)
> >         at
> > org.apache.kylin.engine.spark.SparkCubingByLayer.execute(
> > SparkCubingByLayer.java:160)
> >         at
> > org.apache.kylin.common.util.AbstractApplication.execute(
> > AbstractApplication.java:37)
> >         at org.apache.kylin.common.util.SparkEntry.main(SparkEntry.
> > java:44)
> >         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >         at
> > sun.reflect.NativeMethodAccessorImpl.invoke(
> NativeMethodAccessorImpl.java:
> > 62)
> >         at
> > sun.reflect.DelegatingMethodAccessorImpl.invoke(
> > DelegatingMethodAccessorImpl.java:43)
> >         at java.lang.reflect.Method.invoke(Method.java:498)
> >         at
> > org.apache.spark.deploy.SparkSubmit$.org$apache$spark$
> > deploy$SparkSubmit$$runMain(SparkSubmit.scala:731)
> >         at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(
> > SparkSubmit.scala:181)
> >         at org.apache.spark.deploy.SparkSubmit$.submit(
> > SparkSubmit.scala:206)
> >         at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.
> > scala:121)
> >         at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
> > Caused by: org.apache.kylin.common.persistence.StorageException: Error
> > when
> > open connection hbase
> >         at
> > org.apache.kylin.storage.hbase.HBaseConnection.get(
> > HBaseConnection.java:242)
> >         at
> > org.apache.kylin.storage.hbase.HBaseResourceStore.getConnection(
> > HBaseResourceStore.java:73)
> >         at
> > org.apache.kylin.storage.hbase.HBaseResourceStore.createHTableIfNeeded(
> > HBaseResourceStore.java:90)
> >         at
> > org.apache.kylin.storage.hbase.HBaseResourceStore.<
> > init>(HBaseResourceStore.java:86)
> >         ... 22 more
> > Caused by: java.io.IOException: java.lang.reflect.
> > InvocationTargetException
> >         at
> > org.apache.hadoop.hbase.client.ConnectionFactory.createConnection(
> > ConnectionFactory.java:240)
> >         at
> > org.apache.hadoop.hbase.client.ConnectionFactory.createConnection(
> > ConnectionFactory.java:218)
> >         at
> > org.apache.hadoop.hbase.client.ConnectionFactory.createConnection(
> > ConnectionFactory.java:119)
> >         at
> > org.apache.kylin.storage.hbase.HBaseConnection.get(
> > HBaseConnection.java:229)
> >         ... 25 more
> > Caused by: java.lang.reflect.InvocationTargetException
> >         at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> > Method)
> >         at
> > sun.reflect.NativeConstructorAccessorImpl.newInstance(
> > NativeConstructorAccessorImpl.java:62)
> >         at
> > sun.reflect.DelegatingConstructorAccessorImpl.newInstance(
> > DelegatingConstructorAccessorImpl.java:45)
> >         at java.lang.reflect.Constructor.newInstance(Constructor.java:
> 423)
> >         at
> > org.apache.hadoop.hbase.client.ConnectionFactory.createConnection(
> > ConnectionFactory.java:238)
> >         ... 28 more
> > Caused by: java.lang.IllegalAccessError: tried to access class
> > org.apache.hadoop.hbase.client.AsyncProcess from class
> > org.apache.hadoop.hbase.client.ConnectionManager$
> HConnectionImplementation
> >         at
> > org.apache.hadoop.hbase.client.ConnectionManager$
> > HConnectionImplementation.createAsyncProcess(
> ConnectionManager.java:2433)
> >         at
> > org.apache.hadoop.hbase.client.ConnectionManager$
> > HConnectionImplementation.<init>(ConnectionManager.java:712)
> >         at
> > org.apache.hadoop.hbase.client.ConnectionManager$
> > HConnectionImplementation.<init>(ConnectionManager.java:652)
> >         ... 33 more
> >
> >
> > Do you have any idea about that?
> >
> > --
> > View this message in context: http://apache-kylin.74782.x6.
> > nabble.com/Is-kylin-support-kerberos-while-using-cube-
> connecting-to-HBASE-
> > tp8028p8268.html
> > Sent from the Apache Kylin mailing list archive at Nabble.com.
> >
>
>
>
> --
> Best regards,
>
> Shaofeng Shi 史少锋
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message