Return-Path: X-Original-To: apmail-hbase-issues-archive@www.apache.org Delivered-To: apmail-hbase-issues-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 05A95186C1 for ; Tue, 15 Dec 2015 21:51:52 +0000 (UTC) Received: (qmail 79758 invoked by uid 500); 15 Dec 2015 21:51:46 -0000 Delivered-To: apmail-hbase-issues-archive@hbase.apache.org Received: (qmail 79708 invoked by uid 500); 15 Dec 2015 21:51:46 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 79677 invoked by uid 99); 15 Dec 2015 21:51:46 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 15 Dec 2015 21:51:46 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id 9DFCA2C1F56 for ; Tue, 15 Dec 2015 21:51:46 +0000 (UTC) Date: Tue, 15 Dec 2015 21:51:46 +0000 (UTC) From: "Jonathan Hsieh (JIRA)" To: issues@hbase.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HBASE-14795) Enhance the spark-hbase scan operations MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HBASE-14795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15058902#comment-15058902 ] Jonathan Hsieh commented on HBASE-14795: ---------------------------------------- If you look at the test path script, the new warnings from javadoc and javac are likely from these scala warnings: {code} [INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ hbase-spark --- [INFO] /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/hbase/hbase-spark/src/main/java:-1: info: compiling [INFO] /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/hbase/hbase-spark/src/main/scala:-1: info: compiling [INFO] Compiling 38 source files to /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/hbase/hbase-spark/target/classes at 1449855286283 [WARNING] warning: there were 3 feature warning(s); re-run with -feature for details [WARNING] one warning found [INFO] prepare-compile in 0 s [INFO] compile in 23 s [INFO] [INFO] --- maven-compiler-plugin:3.2:compile (default-compile) @ hbase-spark --- [INFO] Compiling 8 source files to /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/hbase/hbase-spark/target/classes [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ hbase-spark --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 2 resources [INFO] Copying 3 resources [INFO] [INFO] --- scala-maven-plugin:3.2.0:testCompile (scala-test-compile) @ hbase-spark --- [INFO] /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/hbase/hbase-spark/src/test/java:-1: info: compiling [INFO] /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/hbase/hbase-spark/src/test/scala:-1: info: compiling [INFO] Compiling 7 source files to /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/hbase/hbase-spark/target/test-classes at 1449855310486 [WARNING] warning: Class org.apache.hadoop.mapred.MiniMRCluster not found - continuing with a stub. [WARNING] one warning found [INFO] prepare-compile in 0 s [INFO] compile in 20 s {code} The a previous build didn't have the warning in the scala sections. [2] {code} [INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ hbase-spark --- [INFO] /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/hbase/hbase-spark/src/main/java:-1: info: compiling [INFO] /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/hbase/hbase-spark/src/main/scala:-1: info: compiling [INFO] Compiling 33 source files to /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/hbase/hbase-spark/target/classes at 1449897694709 [INFO] prepare-compile in 0 s [INFO] compile in 19 s [INFO] [INFO] --- maven-compiler-plugin:3.2:compile (default-compile) @ hbase-spark --- [INFO] Compiling 8 source files to /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/hbase/hbase-spark/target/classes [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ hbase-spark --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 2 resources [INFO] Copying 3 resources [INFO] [INFO] --- scala-maven-plugin:3.2.0:testCompile (scala-test-compile) @ hbase-spar {code} Can one of you guys follow up or addendum to clean up these newly introduced warnings? Maybe enable the -feature options suggested by the build? [2] https://builds.apache.org/job/PreCommit-HBASE-Build/16839//console > Enhance the spark-hbase scan operations > --------------------------------------- > > Key: HBASE-14795 > URL: https://issues.apache.org/jira/browse/HBASE-14795 > Project: HBase > Issue Type: Improvement > Reporter: Ted Malaska > Assignee: Zhan Zhang > Priority: Minor > Fix For: 2.0.0 > > Attachments: 0001-HBASE-14795-Enhance-the-spark-hbase-scan-operations.patch, HBASE-14795-1.patch, HBASE-14795-2.patch, HBASE-14795-3.patch, HBASE-14795-4.patch > > > This is a sub-jira of HBASE-14789. This jira is to focus on the replacement of TableInputFormat for a more custom scan implementation that will make the following use case more effective. > Use case: > In the case you have multiple scan ranges on a single table with in a single query. TableInputFormat will scan the the outer range of the scan start and end range where this implementation can be more pointed. -- This message was sent by Atlassian JIRA (v6.3.4#6332)