flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Zach Cox <zcox...@gmail.com>
Subject Re: asm IllegalArgumentException with 1.0.0
Date Thu, 10 Mar 2016 21:20:48 GMT
After some poking around I noticed
that flink-connector-elasticsearch_2.10-1.0.0.jar contains shaded asm
classes. If I remove that dependency from my project then I do not get the
IllegalArgumentException.


On Thu, Mar 10, 2016 at 11:51 AM Zach Cox <zcox522@gmail.com> wrote:

> Here are the jars on the classpath when I try to run our Flink job in a
> local environment (via `sbt run`):
>
>
> https://gist.githubusercontent.com/zcox/0992aba1c517b51dc879/raw/7136ec034c2beef04bd65de9f125ce3796db511f/gistfile1.txt
>
> There are many transitive dependencies pulled in from internal library
> projects that probably need to be cleaned out. Maybe we are including
> something that conflicts? Or maybe something important is being excluded?
>
> Are the asm classes included in Flink jars in some shaded form?
>
> Thanks,
> Zach
>
>
> On Thu, Mar 10, 2016 at 5:06 AM Stephan Ewen <sewen@apache.org> wrote:
>
>> Dependency shading changed a bit between RC4 and RC5 - maybe a different
>> minor ASM version is now included in the "test" scope.
>>
>> Can you share the dependencies of the problematic project?
>>
>> On Thu, Mar 10, 2016 at 12:26 AM, Zach Cox <zcox522@gmail.com> wrote:
>>
>>> I also noticed when I try to run this application in a local
>>> environment, I get the same IllegalArgumentException.
>>>
>>> When I assemble this application into a fat jar and run it on a Flink
>>> cluster using the CLI tools, it seems to run fine.
>>>
>>> Maybe my local classpath is missing something that is provided on the
>>> Flink task managers?
>>>
>>> -Zach
>>>
>>>
>>> On Wed, Mar 9, 2016 at 5:16 PM Zach Cox <zcox522@gmail.com> wrote:
>>>
>>>> Hi - after upgrading to 1.0.0, I'm getting this exception now in a unit
>>>> test:
>>>>
>>>>    IllegalArgumentException:   (null:-1)
>>>> org.apache.flink.shaded.org.objectweb.asm.ClassVisitor.<init>(Unknown
>>>> Source)
>>>> org.apache.flink.shaded.org.objectweb.asm.ClassVisitor.<init>(Unknown
>>>> Source)
>>>>
>>>> org.apache.flink.api.scala.InnerClosureFinder.<init>(ClosureCleaner.scala:279)
>>>>
>>>> org.apache.flink.api.scala.ClosureCleaner$.getInnerClasses(ClosureCleaner.scala:95)
>>>>
>>>> org.apache.flink.api.scala.ClosureCleaner$.clean(ClosureCleaner.scala:115)
>>>>
>>>> org.apache.flink.streaming.api.scala.StreamExecutionEnvironment.scalaClean(StreamExecutionEnvironment.scala:568)
>>>>
>>>> org.apache.flink.streaming.api.scala.StreamExecutionEnvironment.addSource(StreamExecutionEnvironment.scala:498)
>>>>
>>>> The line that causes that exception is just adding
>>>> a FlinkKafkaConsumer08 source.
>>>>
>>>> ClassVisitor [1] seems to throw that IllegalArgumentException when it
>>>> is not given a valid api version number, but InnerClosureFinder [2] looks
>>>> fine to me.
>>>>
>>>> Any idea what might be causing this? This unit test worked fine with
>>>> 1.0.0-rc0 jars.
>>>>
>>>> Thanks,
>>>> Zach
>>>>
>>>> [1]
>>>> http://websvn.ow2.org/filedetails.php?repname=asm&path=%2Ftrunk%2Fasm%2Fsrc%2Forg%2Fobjectweb%2Fasm%2FClassVisitor.java
>>>> [2]
>>>> https://github.com/apache/flink/blob/master/flink-scala/src/main/scala/org/apache/flink/api/scala/ClosureCleaner.scala#L279
>>>>
>>>>
>>>>
>>

Mime
View raw message