hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jonathan Hsieh (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-14795) Enhance the spark-hbase scan operations
Date Tue, 15 Dec 2015 21:51:46 GMT

    [ https://issues.apache.org/jira/browse/HBASE-14795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15058902#comment-15058902
] 

Jonathan Hsieh commented on HBASE-14795:
----------------------------------------

If you look at the test path script, the new warnings from javadoc and javac are likely from
these scala warnings:

{code}
[INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ hbase-spark ---
[INFO] /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/hbase/hbase-spark/src/main/java:-1:
info: compiling
[INFO] /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/hbase/hbase-spark/src/main/scala:-1:
info: compiling
[INFO] Compiling 38 source files to /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/hbase/hbase-spark/target/classes
at 1449855286283
[WARNING] warning: there were 3 feature warning(s); re-run with -feature for details
[WARNING] one warning found
[INFO] prepare-compile in 0 s
[INFO] compile in 23 s
[INFO] 
[INFO] --- maven-compiler-plugin:3.2:compile (default-compile) @ hbase-spark ---
[INFO] Compiling 8 source files to /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/hbase/hbase-spark/target/classes
[INFO] 
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ hbase-spark
---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 2 resources
[INFO] Copying 3 resources
[INFO] 
[INFO] --- scala-maven-plugin:3.2.0:testCompile (scala-test-compile) @ hbase-spark ---
[INFO] /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/hbase/hbase-spark/src/test/java:-1:
info: compiling
[INFO] /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/hbase/hbase-spark/src/test/scala:-1:
info: compiling
[INFO] Compiling 7 source files to /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/hbase/hbase-spark/target/test-classes
at 1449855310486
[WARNING] warning: Class org.apache.hadoop.mapred.MiniMRCluster not found - continuing with
a stub.
[WARNING] one warning found
[INFO] prepare-compile in 0 s
[INFO] compile in 20 s
{code}

The a previous build didn't have the warning in the scala sections. [2] 

{code}
[INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ hbase-spark ---
[INFO] /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/hbase/hbase-spark/src/main/java:-1:
info: compiling
[INFO] /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/hbase/hbase-spark/src/main/scala:-1:
info: compiling
[INFO] Compiling 33 source files to /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/hbase/hbase-spark/target/classes
at 1449897694709
[INFO] prepare-compile in 0 s
[INFO] compile in 19 s
[INFO] 
[INFO] --- maven-compiler-plugin:3.2:compile (default-compile) @ hbase-spark ---
[INFO] Compiling 8 source files to /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/hbase/hbase-spark/target/classes
[INFO] 
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ hbase-spark
---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 2 resources
[INFO] Copying 3 resources
[INFO] 
[INFO] --- scala-maven-plugin:3.2.0:testCompile (scala-test-compile) @ hbase-spar
{code}


Can one of you guys follow up or addendum to clean up these newly introduced warnings?  Maybe
enable the -feature options suggested by the build?

[2] https://builds.apache.org/job/PreCommit-HBASE-Build/16839//console

> Enhance the spark-hbase scan operations
> ---------------------------------------
>
>                 Key: HBASE-14795
>                 URL: https://issues.apache.org/jira/browse/HBASE-14795
>             Project: HBase
>          Issue Type: Improvement
>            Reporter: Ted Malaska
>            Assignee: Zhan Zhang
>            Priority: Minor
>             Fix For: 2.0.0
>
>         Attachments: 0001-HBASE-14795-Enhance-the-spark-hbase-scan-operations.patch,
HBASE-14795-1.patch, HBASE-14795-2.patch, HBASE-14795-3.patch, HBASE-14795-4.patch
>
>
> This is a sub-jira of HBASE-14789.  This jira is to focus on the replacement of TableInputFormat
for a more custom scan implementation that will make the following use case more effective.
> Use case:
> In the case you have multiple scan ranges on a single table with in a single query. 
TableInputFormat will scan the the outer range of the scan start and end range where this
implementation can be more pointed.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message