spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Yu <yuzhih...@gmail.com>
Subject Re: The latest master branch didn't compile with -Phive?
Date Thu, 09 Jul 2015 15:48:46 GMT
I guess the compilation issue didn't surface in QA run because sbt was used:

[info] Building Spark (w/Hive 0.13.1) using SBT with these arguments:
-Pyarn -Phadoop-2.3 -Dhadoop.version=2.3.0 -Pkinesis-asl
-Phive-thriftserver -Phive package assembly/assembly
streaming-kafka-assembly/assembly streaming-flume-assembly/assembly


Cheers


On Thu, Jul 9, 2015 at 7:58 AM, Ted Yu <yuzhihong@gmail.com> wrote:

> From
> https://amplab.cs.berkeley.edu/jenkins/job/Spark-Master-Maven-with-YARN/HADOOP_PROFILE=hadoop-2.4,label=centos/2875/consoleFull
> :
>
> + build/mvn -DzincPort=3439 -DskipTests -Phadoop-2.4 -Pyarn -Phive -Phive-thriftserver
-Pkinesis-asl clean package
>
>
> FYI
>
>
> On Thu, Jul 9, 2015 at 7:51 AM, Sean Owen <sowen@cloudera.com> wrote:
>
>> This is an error from scalac and not Spark. I find it happens
>> frequently for me but goes away on a clean build. *shrug*
>>
>>
>> On Thu, Jul 9, 2015 at 3:45 PM, Ted Yu <yuzhihong@gmail.com> wrote:
>> > Looking at
>> >
>> https://amplab.cs.berkeley.edu/jenkins/job/Spark-Master-Maven-with-YARN/HADOOP_PROFILE=hadoop-2.4,label=centos/2875/consoleFull
>> > :
>> >
>> > [error]
>> > [error]      while compiling:
>> >
>> /home/jenkins/workspace/Spark-Master-Maven-with-YARN/HADOOP_PROFILE/hadoop-2.4/label/centos/sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveMetastoreCatalog.scala
>> > [error]         during phase: typer
>> > [error]      library version: version 2.10.4
>> > [error]     compiler version: version 2.10.4
>> >
>> >
>> > I traced back to build #2869 and the error was there - didn't go back
>> > further.
>> >
>> >
>> > FYI
>> >
>> >
>> > On Thu, Jul 9, 2015 at 7:24 AM, Yijie Shen <henry.yijieshen@gmail.com>
>> > wrote:
>> >>
>> >> Hi,
>> >>
>> >> I use the clean version just clone from the master branch, build with:
>> >>
>> >> build/mvn -Phive -Phadoop-2.4 -DskipTests package
>> >>
>> >> And BUILD FAILURE at last, due to:
>> >>
>> >> [error]      while compiling:
>> >>
>> /Users/yijie/spark/sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveMetastoreCatalog.scala
>> >> [error]         during phase: typer
>> >> [error]      library version: version 2.10.4
>> >> [error]     compiler version: version 2.10.4
>> >> ...
>> >> [error]
>> >> [error]   last tree to typer: Ident(Warehouse)
>> >> [error]               symbol: <none> (flags: )
>> >> [error]    symbol definition: <none>
>> >> [error]        symbol owners:
>> >> [error]       context owners: lazy value hiveWarehouse -> class
>> >> HiveMetastoreCatalog -> package hive
>> >> [error]
>> >> [error] == Enclosing template or block ==
>> >> [error]
>> >> [error] Template( // val <local HiveMetastoreCatalog>: <notype>
in
>> class
>> >> HiveMetastoreCatalog
>> >> [error]   "Catalog", "Logging" // parents
>> >> [error]   ValDef(
>> >> [error]     private
>> >> [error]     "_"
>> >> [error]     <tpt>
>> >> [error]     <empty>
>> >> [error]   )
>> >> [error]   // 24 statements
>> >> [error]   ValDef( // private[this] val client:
>> >> org.apache.spark.sql.hive.client.ClientInterface in class
>> >> HiveMetastoreCatalog
>> >> [error]     private <local> <paramaccessor>
>> >> [error]     "client"
>> >> [error]     "ClientInterface"
>> >> [error]     <empty>
>> >> …
>> >>
>> >>
>> https://gist.github.com/yijieshen/e0925e2227a312ae4c64#file-build_failure
>> >>
>> >> Did I make a silly mistake?
>> >>
>> >> Thanks, Yijie
>> >
>> >
>>
>
>

Mime
View raw message