Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Date: Wed, 3 May 2017 18:56:04 +0000 (UTC)
From: "Sean Busbey (JIRA)" <jira@apache.org>
To: issues@hbase.apache.org
Message-ID: <JIRA.13068830.1493829145000.118631.1493837764213@Atlassian.JIRA>
In-Reply-To: <JIRA.13068830.1493829145000@Atlassian.JIRA>
References: <JIRA.13068830.1493829145000@Atlassian.JIRA> <JIRA.13068830.1493829145606@jira-lw-us.apache.org>
Subject: [jira] [Commented] (HBASE-17989) hbase-spark silent compilation
 failures
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
archived-at: Wed, 03 May 2017 18:56:09 -0000


    [ https://issues.apache.org/jira/browse/HBASE-17989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15995433#comment-15995433 ] 

Sean Busbey commented on HBASE-17989:
-------------------------------------

{code}
Busbey-MBA:hbase busbey$ find hbase-spark/target/classes -type f | wc -l
     512
Busbey-MBA:hbase busbey$ grep -lrF 'Unresolved compilation problem' hbase-spark/target/classes/
Busbey-MBA:hbase busbey$  mvn -version
Apache Maven 3.3.9 (bb52d8502b132ec0a5a3f4c09453c07478323dc5; 2015-11-10T10:41:47-06:00)
Maven home: /usr/local/Cellar/maven/3.3.9/libexec
Java version: 1.8.0_74, vendor: Oracle Corporation
Java home: /Library/Java/JavaVirtualMachines/jdk1.8.0_74.jdk/Contents/Home/jre
Default locale: en_US, platform encoding: UTF-8
OS name: "mac os x", version: "10.11.6", arch: "x86_64", family: "mac"
{code}

Can you try an earlier maven?

> hbase-spark silent compilation failures
> ---------------------------------------
>
>                 Key: HBASE-17989
>                 URL: https://issues.apache.org/jira/browse/HBASE-17989
>             Project: HBase
>          Issue Type: Bug
>          Components: build, spark
>         Environment: Apache Maven 3.5.0 (ff8f5e7444045639af65f6095c62210b5713f426; 2017-04-03T14:39:06-05:00)
> Maven home: /opt/apache-maven-3.5.0
> Java version: 1.8.0_131, vendor: Oracle Corporation
> Java home: /usr/lib/jvm/java-8-oracle/jre
> Default locale: en_US, platform encoding: UTF-8
> OS name: "linux", version: "3.13.0-116-generic", arch: "amd64", family: "unix"
>            Reporter: Mike Drob
>            Priority: Blocker
>             Fix For: 2.0.0
>
>
> This is very possibly an issue with my local environment, but it seems strange enough that I'm not sure.
> There are tons of compilation problems in the hbase-spark module. I first noticed them because eclipse was complaining very loudly, but was very confused when {{mvn package}} seemed to succeed. In trying to investigate, I took a look at the generated class file and saw what looks like javac error output:
> {noformat}
> $ less hbase-spark/target/classes/org/apache/hadoop/hbase/spark/SparkSQLPushDownFilter.class
> <CA><FE><BA><BE>^@^@^@4^@R^G^@^B^A^@4org/apache/hadoop/hbase/spark/SparkSQLPushDownFilter^G^@^D^A^@)org/apache/hadoop/hbase/filter/FilterBase^A^@^Clog^A^@ Lorg/apache/commons/logging/Log;^A^@^VdynamicLogicExpression^A^@^XLDynamicLogicExpression;^A^@^SvalueFromQueryArray^A^@^C[[B^A^@ESCcurrentCellToColumnIndexMap^A^@^SLjava/util/HashMap;^A^@  Signature^A^@fLjava/util/HashMap<LByteArrayComparable;Ljava/util/HashMap<LByteArrayComparable;Ljava/lang/String;>;>;^A^@^ZcolumnToCurrentRowValueMap^A^@<Ljava/util/HashMap<Ljava/lang/String;LByteArrayComparable;>;^A^@^LrowKeyFamily^A^@^B[B^A^@^OrowKeyQualifier^A^@^PencoderClassName^A^@^RLjava/lang/String;^A^@^F<init>^A^@C(LDynamicLogicExpression;[[BLjava/util/HashMap;Ljava/lang/String;)V^A^@<96>(LDynamicLogicExpression;[[BLjava/util/HashMap<LByteArrayComparable;Ljava/util/HashMap<LByteArrayComparable;Ljava/lang/String;>;>;Ljava/lang/String;)V^A^@^DCode^G^@ESC^A^@^Ojava/lang/Erro^@^]^A^M"Unresolved compilation problems: 
>         The import org.apache.hadoop.hbase.spark.datasources.BytesEncoder cannot be resolved
>         The import org.apache.hadoop.hbase.spark.datasources.JavaBytesEncoder cannot be resolved
>         The import org.apache.spark.sql.datasources.hbase.Field cannot be resolved
>         DynamicLogicExpression cannot be resolved to a type
>         ByteArrayComparable cannot be resolved to a type
>         ByteArrayComparable cannot be resolved to a type
>         ByteArrayComparable cannot be resolved to a type
>         DynamicLogicExpression cannot be resolved to a type
> <snip>
> {noformat}
> This problem is present in several classes.
> {noformat}
> $ grep -lrF 'Unresolved compilation problem' **/*.class
> hbase-spark/target/classes/org/apache/hadoop/hbase/spark/example/hbasecontext/JavaHBaseBulkDeleteExample.class
> hbase-spark/target/classes/org/apache/hadoop/hbase/spark/example/hbasecontext/JavaHBaseBulkGetExample.class
> hbase-spark/target/classes/org/apache/hadoop/hbase/spark/example/hbasecontext/JavaHBaseBulkLoadExample$BulkLoadFunction.class
> hbase-spark/target/classes/org/apache/hadoop/hbase/spark/example/hbasecontext/JavaHBaseBulkLoadExample.class
> hbase-spark/target/classes/org/apache/hadoop/hbase/spark/example/hbasecontext/JavaHBaseBulkPutExample.class
> hbase-spark/target/classes/org/apache/hadoop/hbase/spark/example/hbasecontext/JavaHBaseDistributedScan.class
> hbase-spark/target/classes/org/apache/hadoop/hbase/spark/example/hbasecontext/JavaHBaseMapGetPutExample.class
> hbase-spark/target/classes/org/apache/hadoop/hbase/spark/example/hbasecontext/JavaHBaseStreamingBulkPutExample.class
> hbase-spark/target/classes/org/apache/hadoop/hbase/spark/SparkSQLPushDownFilter.class
> hbase-spark/target/test-classes/org/apache/hadoop/hbase/spark/TestJavaHBaseContext$BulkLoadFunction.class
> hbase-spark/target/test-classes/org/apache/hadoop/hbase/spark/TestJavaHBaseContext$BulkLoadThinRowsFunction.class
> hbase-spark/target/test-classes/org/apache/hadoop/hbase/spark/TestJavaHBaseContext.class
> {noformat}


--
This message was sent by Atlassian JIRA
(v6.3.15#6346)