hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yi Liang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-17989) hbase-spark silent compilation failures
Date Wed, 03 May 2017 17:20:04 GMT

    [ https://issues.apache.org/jira/browse/HBASE-17989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15995240#comment-15995240
] 

Yi Liang commented on HBASE-17989:
----------------------------------

Hi Mike,
   HBase-spark is scala & java mixed module,  there is no good way to generate javadoc
for scala code. The javadoc errors may be caused by above class(all those class are java class)
want to read javadoc of some scala class. 


> hbase-spark silent compilation failures
> ---------------------------------------
>
>                 Key: HBASE-17989
>                 URL: https://issues.apache.org/jira/browse/HBASE-17989
>             Project: HBase
>          Issue Type: Bug
>          Components: build, spark
>         Environment: Apache Maven 3.5.0 (ff8f5e7444045639af65f6095c62210b5713f426; 2017-04-03T14:39:06-05:00)
> Maven home: /opt/apache-maven-3.5.0
> Java version: 1.8.0_131, vendor: Oracle Corporation
> Java home: /usr/lib/jvm/java-8-oracle/jre
> Default locale: en_US, platform encoding: UTF-8
> OS name: "linux", version: "3.13.0-116-generic", arch: "amd64", family: "unix"
>            Reporter: Mike Drob
>            Priority: Blocker
>             Fix For: 2.0.0
>
>
> This is very possibly an issue with my local environment, but it seems strange enough
that I'm not sure.
> There are tons of compilation problems in the hbase-spark module. I first noticed them
because eclipse was complaining very loudly, but was very confused when {{mvn package}} seemed
to succeed. In trying to investigate, I took a look at the generated class file and saw what
looks like javac error output:
> {noformat}
> $ less hbase-spark/target/classes/org/apache/hadoop/hbase/spark/SparkSQLPushDownFilter.class
> <CA><FE><BA><BE>^@^@^@4^@R^G^@^B^A^@4org/apache/hadoop/hbase/spark/SparkSQLPushDownFilter^G^@^D^A^@)org/apache/hadoop/hbase/filter/FilterBase^A^@^Clog^A^@
Lorg/apache/commons/logging/Log;^A^@^VdynamicLogicExpression^A^@^XLDynamicLogicExpression;^A^@^SvalueFromQueryArray^A^@^C[[B^A^@ESCcurrentCellToColumnIndexMap^A^@^SLjava/util/HashMap;^A^@
 Signature^A^@fLjava/util/HashMap<LByteArrayComparable;Ljava/util/HashMap<LByteArrayComparable;Ljava/lang/String;>;>;^A^@^ZcolumnToCurrentRowValueMap^A^@<Ljava/util/HashMap<Ljava/lang/String;LByteArrayComparable;>;^A^@^LrowKeyFamily^A^@^B[B^A^@^OrowKeyQualifier^A^@^PencoderClassName^A^@^RLjava/lang/String;^A^@^F<init>^A^@C(LDynamicLogicExpression;[[BLjava/util/HashMap;Ljava/lang/String;)V^A^@<96>(LDynamicLogicExpression;[[BLjava/util/HashMap<LByteArrayComparable;Ljava/util/HashMap<LByteArrayComparable;Ljava/lang/String;>;>;Ljava/lang/String;)V^A^@^DCode^G^@ESC^A^@^Ojava/lang/Erro^@^]^A^M"Unresolved
compilation problems: 
>         The import org.apache.hadoop.hbase.spark.datasources.BytesEncoder cannot be resolved
>         The import org.apache.hadoop.hbase.spark.datasources.JavaBytesEncoder cannot
be resolved
>         The import org.apache.spark.sql.datasources.hbase.Field cannot be resolved
>         DynamicLogicExpression cannot be resolved to a type
>         ByteArrayComparable cannot be resolved to a type
>         ByteArrayComparable cannot be resolved to a type
>         ByteArrayComparable cannot be resolved to a type
>         DynamicLogicExpression cannot be resolved to a type
> <snip>
> {noformat}
> This problem is present in several classes.
> {noformat}
> $ grep -lrF 'Unresolved compilation problem' **/*.class
> hbase-spark/target/classes/org/apache/hadoop/hbase/spark/example/hbasecontext/JavaHBaseBulkDeleteExample.class
> hbase-spark/target/classes/org/apache/hadoop/hbase/spark/example/hbasecontext/JavaHBaseBulkGetExample.class
> hbase-spark/target/classes/org/apache/hadoop/hbase/spark/example/hbasecontext/JavaHBaseBulkLoadExample$BulkLoadFunction.class
> hbase-spark/target/classes/org/apache/hadoop/hbase/spark/example/hbasecontext/JavaHBaseBulkLoadExample.class
> hbase-spark/target/classes/org/apache/hadoop/hbase/spark/example/hbasecontext/JavaHBaseBulkPutExample.class
> hbase-spark/target/classes/org/apache/hadoop/hbase/spark/example/hbasecontext/JavaHBaseDistributedScan.class
> hbase-spark/target/classes/org/apache/hadoop/hbase/spark/example/hbasecontext/JavaHBaseMapGetPutExample.class
> hbase-spark/target/classes/org/apache/hadoop/hbase/spark/example/hbasecontext/JavaHBaseStreamingBulkPutExample.class
> hbase-spark/target/classes/org/apache/hadoop/hbase/spark/SparkSQLPushDownFilter.class
> hbase-spark/target/test-classes/org/apache/hadoop/hbase/spark/TestJavaHBaseContext$BulkLoadFunction.class
> hbase-spark/target/test-classes/org/apache/hadoop/hbase/spark/TestJavaHBaseContext$BulkLoadThinRowsFunction.class
> hbase-spark/target/test-classes/org/apache/hadoop/hbase/spark/TestJavaHBaseContext.class
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message