Mailing-List: contact issues-help@spark.apache.org; run by ezmlm
Precedence: bulk
Date: Tue, 31 May 2016 12:13:12 +0000 (UTC)
From: "Lior Chaga (JIRA)" <jira@apache.org>
To: issues@spark.apache.org
Message-ID: <JIRA.12962638.1461686046000.336779.1464696792902@Atlassian.JIRA>
In-Reply-To: <JIRA.12962638.1461686046000@Atlassian.JIRA>
References: <JIRA.12962638.1461686046000@Atlassian.JIRA> <JIRA.12962638.1461686046197@arcas>
Subject: [jira] [Commented] (SPARK-14919) Spark Cannot be used with software
 that requires jackson-databind 2.6+: RDDOperationScope
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
archived-at: Tue, 31 May 2016 12:13:15 -0000


    [ https://issues.apache.org/jira/browse/SPARK-14919?page=3Dcom.atlassia=
n.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=3D153=
07631#comment-15307631 ]=20

Lior Chaga commented on SPARK-14919:
------------------------------------

Well, my experience with user classpath first is not so good. I can't recal=
l the exact issue I had.
BTW, is there any point on fixing this in 1.x branch? Are there any planned=
 releases?

> Spark Cannot be used with software that requires jackson-databind 2.6+: R=
DDOperationScope
> -------------------------------------------------------------------------=
----------------
>
>                 Key: SPARK-14919
>                 URL: https://issues.apache.org/jira/browse/SPARK-14919
>             Project: Spark
>          Issue Type: Bug
>          Components: Input/Output
>    Affects Versions: 1.6.1
>         Environment: Linux, OSX
>            Reporter: John Ferguson
>
> When using Spark 1.4.x or Spark 1.6.1 in an application that has a front =
end requiring jackson-databind 2.6+, we see the follow exceptions:
> Subset of stack trace:
> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
> com.fasterxml.jackson.databind.JsonMappingException: Could not find creat=
or property with name 'id' (in class org.apache.spark.rdd.RDDOperationScope=
)
>  at [Source: {"id":"0","name":"textFile"}; line: 1, column: 1]
> =E2=80=82=E2=80=82at com.fasterxml.jackson.databind.JsonMappingException.=
from(JsonMappingException.java:148)
> =E2=80=82=E2=80=82at com.fasterxml.jackson.databind.DeserializationContex=
t.mappingException(DeserializationContext.java:843)
> =E2=80=82=E2=80=82at com.fasterxml.jackson.databind.deser.BeanDeserialize=
rFactory.addBeanProps(BeanDeserializerFactory.java:533)
> =E2=80=82=E2=80=82at com.fasterxml.jackson.databind.deser.BeanDeserialize=
rFactory.buildBeanDeserializer(BeanDeserializerFactory.java:220)
> =E2=80=82=E2=80=82at com.fasterxml.jackson.databind.deser.BeanDeserialize=
rFactory.createBeanDeserializer(BeanDeserializerFactory.java:143)
> =E2=80=82=E2=80=82at com.fasterxml.jackson.databind.deser.DeserializerCac=
he._createDeserializer2(DeserializerCache.java:405)
> =E2=80=82=E2=80=82at com.fasterxml.jackson.databind.deser.DeserializerCac=
he._createDeserializer(DeserializerCache.java:354)
> =E2=80=82=E2=80=82at com.fasterxml.jackson.databind.deser.DeserializerCac=
he._createAndCache2(DeserializerCache.java:262)
> =E2=80=82=E2=80=82at com.fasterxml.jackson.databind.deser.DeserializerCac=
he._createAndCacheValueDeserializer(DeserializerCache.java:242)
> =E2=80=82=E2=80=82at com.fasterxml.jackson.databind.deser.DeserializerCac=
he.findValueDeserializer(DeserializerCache.java:143)
> =E2=80=82=E2=80=82at com.fasterxml.jackson.databind.DeserializationContex=
t.findRootValueDeserializer(DeserializationContext.java:439)
> =E2=80=82=E2=80=82at com.fasterxml.jackson.databind.ObjectMapper._findRoo=
tDeserializer(ObjectMapper.java:3664)
> =E2=80=82=E2=80=82at com.fasterxml.jackson.databind.ObjectMapper._readMap=
AndClose(ObjectMapper.java:3556)
> =E2=80=82=E2=80=82at com.fasterxml.jackson.databind.ObjectMapper.readValu=
e(ObjectMapper.java:2576)
> =E2=80=82=E2=80=82at org.apache.spark.rdd.RDDOperationScope$.fromJson(RDD=
OperationScope.scala:85)
> =E2=80=82=E2=80=82at org.apache.spark.rdd.RDDOperationScope$$anonfun$5.ap=
ply(RDDOperationScope.scala:136)
> =E2=80=82=E2=80=82at org.apache.spark.rdd.RDDOperationScope$$anonfun$5.ap=
ply(RDDOperationScope.scala:136)
> =E2=80=82=E2=80=82at scala.Option.map(Option.scala:145)
> =E2=80=82=E2=80=82at org.apache.spark.rdd.RDDOperationScope$.withScope(RD=
DOperationScope.scala:136)
> =E2=80=82=E2=80=82at org.apache.spark.rdd.RDDOperationScope$.withScope(RD=
DOperationScope.scala:111)
> =E2=80=82=E2=80=82at org.apache.spark.SparkContext.withScope(SparkContext=
.scala:714)
> =E2=80=82=E2=80=82at org.apache.spark.SparkContext.hadoopFile(SparkContex=
t.scala:1011)
> =E2=80=82=E2=80=82at org.apache.spark.SparkContext$$anonfun$textFile$1.ap=
ply(SparkContext.scala:832)
> =E2=80=82=E2=80=82at org.apache.spark.SparkContext$$anonfun$textFile$1.ap=
ply(SparkContext.scala:830)
> =E2=80=82=E2=80=82at org.apache.spark.rdd.RDDOperationScope$.withScope(RD=
DOperationScope.scala:150)
> =E2=80=82=E2=80=82at org.apache.spark.rdd.RDDOperationScope$.withScope(RD=
DOperationScope.scala:111)
> =E2=80=82=E2=80=82at org.apache.spark.SparkContext.withScope(SparkContext=
.scala:714)
> =E2=80=82=E2=80=82at org.apache.spark.SparkContext.textFile(SparkContext.=
scala:830)


--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org