hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sean Busbey (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-16179) Fix compilation errors when building hbase-spark against Spark 2.0
Date Fri, 31 Mar 2017 16:42:41 GMT

    [ https://issues.apache.org/jira/browse/HBASE-16179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15951249#comment-15951249

Sean Busbey commented on HBASE-16179:

bq. How can we move this forward ?

I've been waiting on the dev@ discussion. You could start it.

bq. just properly kept out of the classpath for general HBase uses
Any suggestion on how the above can be achieved ?

We currently build a classpath for our services and utilities. Just make sure that however
those classpaths are formed we don't include the various sparkXscala specific jars.

bq. Without support for Spark 2.x, it makes little sense to include hbase-spark module for

I don't agree with this statement; there are plenty of Spark 1.6 users still. I do agree that
I'd like Spark 2 support for HBase 2.0.0.

If [~jerryhe] is also game, I'd be up for us changing gears a bit here. We could focus here
just on what _has_ to be done for correctness and do things that would be nice in follow-ons.

> Fix compilation errors when building hbase-spark against Spark 2.0
> ------------------------------------------------------------------
>                 Key: HBASE-16179
>                 URL: https://issues.apache.org/jira/browse/HBASE-16179
>             Project: HBase
>          Issue Type: Bug
>          Components: spark
>            Reporter: Ted Yu
>            Assignee: Ted Yu
>            Priority: Critical
>             Fix For: 2.0.0
>         Attachments: 16179.v0.txt, 16179.v10.txt, 16179.v11.txt, 16179.v12.txt, 16179.v12.txt,
16179.v12.txt, 16179.v13.txt, 16179.v15.txt, 16179.v16.txt, 16179.v18.txt, 16179.v19.txt,
16179.v19.txt, 16179.v1.txt, 16179.v1.txt, 16179.v20.txt, 16179.v22.txt, 16179.v23.txt, 16179.v24.txt,
16179.v25.txt, 16179.v26.txt, 16179.v4.txt, 16179.v5.txt, 16179.v7.txt, 16179.v8.txt, 16179.v9.txt
> I tried building hbase-spark module against Spark-2.0 snapshot and got the following
compilation errors:
> http://pastebin.com/bg3w247a
> Some Spark classes such as DataTypeParser and Logging are no longer accessible to downstream
> hbase-spark module should not depend on such classes.

This message was sent by Atlassian JIRA

View raw message