spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Stephen Boesch <java...@gmail.com>
Subject Re: Required file not found in building
Date Tue, 02 Dec 2014 04:00:31 GMT
Anyone maybe can assist on how to run zinc with the latest maven build?

I am starting zinc as follows:

/shared/zinc-0.3.5.3/dist/target/zinc-0.3.5.3/bin/zinc -scala-home
$SCALA_HOME -nailed -start

The pertinent env vars are:


19:58:11/lib $echo $SCALA_HOME
/shared/scala
19:58:14/lib $which scala
/shared/scala/bin/scala
19:58:16/lib $scala -version
Scala code runner version 2.10.4 -- Copyright 2002-2013, LAMP/EPFL


When I do *not *start zinc then the maven build works .. but v slowly since
no incremental compiler available.

When zinc is started as shown above then the error occurs on all of the
modules except parent:


[INFO] Using zinc server for incremental compilation
[INFO] compiler plugin:
BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[error] Required file not found: scala-compiler-2.10.4.jar
[error] See zinc -help for information about locating necessary files

2014-12-01 19:02 GMT-08:00 Stephen Boesch <javadba@gmail.com>:

> Mac as well.  Just found the problem:  I had created an alias to zinc a
> couple of months back. Apparently that is not happy with the build anymore.
> No problem now that the issue has been isolated - just need to fix my zinc
> alias.
>
> 2014-12-01 18:55 GMT-08:00 Ted Yu <yuzhihong@gmail.com>:
>
> I tried the same command on MacBook and didn't experience the same error.
>>
>> Which OS are you using ?
>>
>> Cheers
>>
>> On Mon, Dec 1, 2014 at 6:42 PM, Stephen Boesch <javadba@gmail.com> wrote:
>>
>>> It seems there were some additional settings required to build spark now
>>> .
>>> This should be a snap for most of you ot there about what I am missing.
>>> Here is the command line I have traditionally used:
>>>
>>>    mvn -Pyarn -Phadoop-2.3 -Phive install compile package -DskipTests
>>>
>>> That command line is however failing with the lastest from HEAD:
>>>
>>> INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @
>>> spark-network-common_2.10 ---
>>> [INFO] Using zinc server for incremental compilation
>>> [INFO] compiler plugin:
>>> BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
>>>
>>> *[error] Required file not found: scala-compiler-2.10.4.jar*
>>>
>>> *[error] See zinc -help for information about locating necessary files*
>>>
>>> [INFO]
>>> ------------------------------------------------------------------------
>>> [INFO] Reactor Summary:
>>> [INFO]
>>> [INFO] Spark Project Parent POM .......................... SUCCESS
>>> [4.077s]
>>> [INFO] Spark Project Networking .......................... FAILURE
>>> [0.445s]
>>>
>>>
>>> OK let's try "zinc -help":
>>>
>>> 18:38:00/spark2 $*zinc -help*
>>> Nailgun server running with 1 cached compiler
>>>
>>> Version = 0.3.5.1
>>>
>>> Zinc compiler cache limit = 5
>>> Resident scalac cache limit = 0
>>> Analysis cache limit = 5
>>>
>>> Compiler(Scala 2.10.4) [74ff364f]
>>> Setup = {
>>> *   scala compiler =
>>>
>>> /Users/steve/.m2/repository/org/scala-lang/scala-compiler/2.10.4/scala-compiler-2.10.4.jar*
>>>    scala library =
>>>
>>> /Users/steve/.m2/repository/org/scala-lang/scala-library/2.10.4/scala-library-2.10.4.jar
>>>    scala extra = {
>>>
>>>
>>> /Users/steve/.m2/repository/org/scala-lang/scala-reflect/2.10.4/scala-reflect-2.10.4.jar
>>>       /shared/zinc-0.3.5.1/lib/scala-reflect.jar
>>>    }
>>>    sbt interface = /shared/zinc-0.3.5.1/lib/sbt-interface.jar
>>>    compiler interface sources =
>>> /shared/zinc-0.3.5.1/lib/compiler-interface-sources.jar
>>>    java home =
>>>    fork java = false
>>>    cache directory = /Users/steve/.zinc/0.3.5.1
>>> }
>>>
>>> Does that compiler jar exist?  Yes!
>>>
>>> 18:39:34/spark2 $ll
>>>
>>> /Users/steve/.m2/repository/org/scala-lang/scala-compiler/2.10.4/scala-compiler-2.10.4.jar
>>> -rw-r--r--  1 steve  staff  14445780 Apr  9  2014
>>>
>>> /Users/steve/.m2/repository/org/scala-lang/scala-compiler/2.10.4/scala-compiler-2.10.4.jar
>>>
>>
>>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message