Return-Path: 
 <dev-return-112754-apmail-hive-dev-archive=hive.apache.org@hive.apache.org>
X-Original-To: apmail-hive-dev-archive@www.apache.org
Delivered-To: apmail-hive-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id 800FE17B36
	for <apmail-hive-dev-archive@www.apache.org>;
 Thu,  6 Nov 2014 14:06:34 +0000 (UTC)
Received: (qmail 53192 invoked by uid 500); 6 Nov 2014 14:06:34 -0000
Delivered-To: apmail-hive-dev-archive@hive.apache.org
Received: (qmail 53097 invoked by uid 500); 6 Nov 2014 14:06:34 -0000
Mailing-List: contact dev-help@hive.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:dev-help@hive.apache.org>
List-Unsubscribe: <mailto:dev-unsubscribe@hive.apache.org>
List-Post: <mailto:dev@hive.apache.org>
List-Id: <dev.hive.apache.org>
Reply-To: dev@hive.apache.org
Delivered-To: mailing list dev@hive.apache.org
Received: (qmail 53084 invoked by uid 500); 6 Nov 2014 14:06:34 -0000
Delivered-To: apmail-hadoop-hive-dev@hadoop.apache.org
Received: (qmail 53078 invoked by uid 99); 6 Nov 2014 14:06:34 -0000
Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28)
    by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 06 Nov 2014 14:06:34 +0000
Date: Thu, 6 Nov 2014 14:06:33 +0000 (UTC)
From: "Xuefu Zhang (JIRA)" <jira@apache.org>
To: hive-dev@hadoop.apache.org
Message-ID: <JIRA.12753403.1415282629000.433869.1415282793938@Atlassian.JIRA>
In-Reply-To: <JIRA.12753403.1415282629000@Atlassian.JIRA>
References: <JIRA.12753403.1415282629000@Atlassian.JIRA>
 <JIRA.12753403.1415282629879@arcas>
Subject: [jira] [Commented] (HIVE-8758) Fix hadoop-1 build [Spark Branch]
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394


    [ https://issues.apache.org/jira/browse/HIVE-8758?page=3Dcom.atlassian.=
jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=3D14200=
185#comment-14200185 ]=20

Xuefu Zhang commented on HIVE-8758:
-----------------------------------

[~jxiang], since problem #3 seemed related to your recent change, I assigne=
d the JIRA to you for investigation/fix. Thanks.

> Fix hadoop-1 build [Spark Branch]
> ---------------------------------
>
>                 Key: HIVE-8758
>                 URL: https://issues.apache.org/jira/browse/HIVE-8758
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Spark
>            Reporter: Xuefu Zhang
>            Assignee: Jimmy Xiang
>
> This may mean merging patches from trunk and fixing whatever problem spec=
ific to Spark branch. Here are user reported problems:
> Problem 1:
> {code}
> Hive Serde ......................................... FAILURE [  2.357 s]
> [ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-pl=
ugin:3.1:compile (default-compile) on project hive-serde: Compilation failu=
re: Compilation failure:
> [ERROR] /data/hive-spark/serde/src/java/org/apache/hadoop/hive/serde2/Abs=
tractSerDe.java:[27,24] cannot find symbol
> [ERROR] symbol:   class Nullable
> [ERROR] location: package javax.annotation
> [ERROR] /data/hive-spark/serde/src/java/org/apache/hadoop/hive/serde2/Abs=
tractSerDe.java:[67,36] cannot find symbol
> [ERROR] symbol:   class Nullable
> [ERROR] location: class org.apache.hadoop.hive.serde2.AbstractSerDe
> {code}
> My understanding: Looks the Nullable annotation was recently added in the=
 recent branch. Added the below dependency in the project hive-serde
> {code}
> <dependency>
>     <groupId>com.google.code.findbugs</groupId>
>     <artifactId>jsr305</artifactId>
>     <version>3.0.0</version>
> </dependency>
> {code}
> Problem 2:
> After adding the dependency for hive-serde, got the below compilation err=
or
> {code}
> [INFO] Hive Query Language ................................ FAILURE [01:3=
5 min]
> /data/hive-spark/ql/src/java/org/apache/hadoop/hive/ql/exec/spark/counter=
/SparkCounters.java:[35,39] error: package org.apache.hadoop.mapreduce.util=
 does not exist
> {code}
> In the dependency jar for hadoop-1 (hadoop-core-1.2.1.jar) - We do not ha=
ve the package =E2=80=9Corg.apache.hadoop.mapreduce.util=E2=80=9D to circum=
vent it added the below dependency where we had the package (not sure, it i=
s right =E2=80=93 I badly wanted to make the build successful L)
> {code}
> <dependency>
>                 <groupId>org.apache.hadoop</groupId>
>                         <artifactId>hadoop-mapreduce-client-core</artifac=
tId>
>                                 <version>0.23.11</version>
>                                 </dependency>
>       </dependencies>
> {code}
> Problem 3:
> After making the above change, again failed in the same project @ file /d=
ata/hive-spark/ql/src/java/org/apache/hadoop/hive/ql/exec/persistence/MapJo=
inTableContainerSerDe.java. In the snippet below taken from the file, we ca=
n see the =E2=80=9CfileStatus.isFile()=E2=80=9D is called which is not avai=
lable in the =E2=80=9Corg.apache.hadoop.fs.FileStatus=E2=80=9D hadoop1 api.
> {code}
>  for (FileStatus fileStatus: fs.listStatus(folder)) {
>        Path filePath =3D fileStatus.getPath();
>         if (!fileStatus.isFile()) {
>           throw new HiveException("Error, not a file: " + filePath);
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)