Return-Path: X-Original-To: apmail-flink-user-archive@minotaur.apache.org Delivered-To: apmail-flink-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 40F0418FA6 for ; Mon, 26 Oct 2015 08:09:24 +0000 (UTC) Received: (qmail 39489 invoked by uid 500); 26 Oct 2015 08:09:19 -0000 Delivered-To: apmail-flink-user-archive@flink.apache.org Received: (qmail 39409 invoked by uid 500); 26 Oct 2015 08:09:19 -0000 Mailing-List: contact user-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@flink.apache.org Delivered-To: mailing list user@flink.apache.org Received: (qmail 39399 invoked by uid 99); 26 Oct 2015 08:09:19 -0000 Received: from Unknown (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 26 Oct 2015 08:09:19 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 8EF741A09F1 for ; Mon, 26 Oct 2015 08:09:18 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 4.002 X-Spam-Level: **** X-Spam-Status: No, score=4.002 tagged_above=-999 required=6.31 tests=[HTML_MESSAGE=3, KAM_LAZY_DOMAIN_SECURITY=1, URIBL_BLOCKED=0.001, WEIRD_PORT=0.001] autolearn=disabled Received: from mx1-us-west.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id tSgH2OGv9myl for ; Mon, 26 Oct 2015 08:09:06 +0000 (UTC) Received: from mail-yk0-f178.google.com (mail-yk0-f178.google.com [209.85.160.178]) by mx1-us-west.apache.org (ASF Mail Server at mx1-us-west.apache.org) with ESMTPS id EB84D20562 for ; Mon, 26 Oct 2015 08:09:05 +0000 (UTC) Received: by ykdr3 with SMTP id r3so175831400ykd.1 for ; Mon, 26 Oct 2015 01:09:05 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:content-type; bh=TYjp2y5DhwWQ+zF92Md3uIdzmrf+8CJZYRy+NgzNuC0=; b=O/2Nzeiu112hyuT48W4cJc11GbyaDt2TsG7dVD2J0SVNIVVCcOHjJ79+8E41eIriJ9 20JZtbSEIcdiA65ulFpXwqRxTvp6GtzDX3wvUWVZqEFPstsTN2if2qhdMvz/dd8zeNl9 1JlhVLDJ5mv59S50KTZ0C8dpn4TCQ4xli4ovYLKH2Kap/tJo3ryUpSjX2GK+/FHiIhXy WDqNc+rNCSxgE4PLlWilF0YfUX1uSL01O2rhrpp1BIRDzxY9boBi6R4YhB0Ov+tEPLrS je0MHrKQnDdV01Rrsx7NyQWTnv1b29NkyvonxxDG9ZwQ/e/TttEf/b/uoucVu+5G7ami aGFg== X-Gm-Message-State: ALoCoQmPOWjjhJkoOamDS50A8RdfvaY8LwxqWpsApDDpKYbqCe3ZHFAQjZ9AvRbjFATqtEpxQh9Y X-Received: by 10.13.251.2 with SMTP id l2mr6804079ywf.44.1445846944818; Mon, 26 Oct 2015 01:09:04 -0700 (PDT) MIME-Version: 1.0 Received: by 10.129.84.6 with HTTP; Mon, 26 Oct 2015 01:08:45 -0700 (PDT) X-Originating-IP: [213.203.177.29] In-Reply-To: References: From: Flavio Pompermaier Date: Mon, 26 Oct 2015 09:08:45 +0100 Message-ID: Subject: Re: Error running an hadoop job from web interface To: user Content-Type: multipart/alternative; boundary=94eb2c07e9e28bdac60522fd7910 --94eb2c07e9e28bdac60522fd7910 Content-Type: text/plain; charset=UTF-8 Running from the shell everything works..is it a problem of classloaders hierarchy in the webapp? On Fri, Oct 23, 2015 at 5:53 PM, Maximilian Michels wrote: > ./bin/flink run /path/to/jar arguments > > or > > ./bin/flink run -c MainClass /path/to/jar arguments > > On Fri, Oct 23, 2015 at 5:50 PM, Stefano Bortoli > wrote: > >> What I normally do is to >> >> java -cp MYUBERJAR.jar my.package.mainclass >> >> does it make sense? >> >> 2015-10-23 17:22 GMT+02:00 Flavio Pompermaier : >> >>> could you write ne the command please?I'm not in the office right now.. >>> On 23 Oct 2015 17:10, "Maximilian Michels" wrote: >>> >>>> Could you try submitting the job from the command-line and see if it >>>> works? >>>> >>>> Thanks, >>>> Max >>>> >>>> On Fri, Oct 23, 2015 at 4:42 PM, Flavio Pompermaier < >>>> pompermaier@okkam.it> wrote: >>>> >>>>> 0.10-snapshot >>>>> On 23 Oct 2015 16:09, "Maximilian Michels" wrote: >>>>> >>>>>> Hi Flavio, >>>>>> >>>>>> Which version of Flink are you using? >>>>>> >>>>>> Cheers, >>>>>> Max >>>>>> >>>>>> On Fri, Oct 23, 2015 at 2:45 PM, Flavio Pompermaier < >>>>>> pompermaier@okkam.it> wrote: >>>>>> >>>>>>> Hi to all, >>>>>>> I'm trying to run a job from the web interface but I get this error: >>>>>>> >>>>>>> java.lang.RuntimeException: java.io.FileNotFoundException: JAR entry core-site.xml not found in /tmp/webclient-jobs/EntitonsJsonizer.jar >>>>>>> at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2334) >>>>>>> at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2187) >>>>>>> at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2104) >>>>>>> at org.apache.hadoop.conf.Configuration.get(Configuration.java:853) >>>>>>> at org.apache.hadoop.mapred.JobConf.checkAndWarnDeprecation(JobConf.java:2088) >>>>>>> at org.apache.hadoop.mapred.JobConf.(JobConf.java:446) >>>>>>> at org.apache.hadoop.mapreduce.Job.getInstance(Job.java:175) >>>>>>> at org.apache.hadoop.mapreduce.Job.getInstance(Job.java:156) >>>>>>> at it.okkam.flink.entitons.io.utils.ParquetThriftEntitons.readEntitons(ParquetThriftEntitons.java:42) >>>>>>> at it.okkam.flink.entitons.io.utils.ParquetThriftEntitons.readEntitonsWithId(ParquetThriftEntitons.java:73) >>>>>>> at org.okkam.entitons.EntitonsJsonizer.readAtomQuads(EntitonsJsonizer.java:235) >>>>>>> at org.okkam.entitons.EntitonsJsonizer.main(EntitonsJsonizer.java:119) >>>>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >>>>>>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) >>>>>>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >>>>>>> at java.lang.reflect.Method.invoke(Method.java:606) >>>>>>> at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:497) >>>>>>> at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:395) >>>>>>> at org.apache.flink.client.program.OptimizerPlanEnvironment.getOptimizedPlan(OptimizerPlanEnvironment.java:80) >>>>>>> at org.apache.flink.client.program.Client.getOptimizedPlan(Client.java:220) >>>>>>> at org.apache.flink.client.CliFrontend.info(CliFrontend.java:412) >>>>>>> at org.apache.flink.client.CliFrontend.parseParameters(CliFrontend.java:977) >>>>>>> at org.apache.flink.client.web.JobSubmissionServlet.doGet(JobSubmissionServlet.java:171) >>>>>>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:734) >>>>>>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:847) >>>>>>> at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:532) >>>>>>> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:453) >>>>>>> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:227) >>>>>>> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:965) >>>>>>> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:388) >>>>>>> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:187) >>>>>>> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:901) >>>>>>> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:117) >>>>>>> at org.eclipse.jetty.server.handler.HandlerList.handle(HandlerList.java:47) >>>>>>> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:113) >>>>>>> at org.eclipse.jetty.server.Server.handle(Server.java:352) >>>>>>> at org.eclipse.jetty.server.HttpConnection.handleRequest(HttpConnection.java:596) >>>>>>> at org.eclipse.jetty.server.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:1048) >>>>>>> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:549) >>>>>>> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:211) >>>>>>> at org.eclipse.jetty.server.HttpConnection.handle(HttpConnection.java:425) >>>>>>> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:489) >>>>>>> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:436) >>>>>>> at java.lang.Thread.run(Thread.java:745) >>>>>>> Caused by: java.io.FileNotFoundException: JAR entry core-site.xml not found in /tmp/webclient-jobs/EntitonsJsonizer.jar >>>>>>> at sun.net.www.protocol.jar.JarURLConnection.connect(JarURLConnection.java:140) >>>>>>> at sun.net.www.protocol.jar.JarURLConnection.getInputStream(JarURLConnection.java:150) >>>>>>> at java.net.URL.openStream(URL.java:1037) >>>>>>> at org.apache.hadoop.conf.Configuration.parse(Configuration.java:2163) >>>>>>> at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2234) >>>>>>> >>>>>>> >>>>>>> >>>>>>> I checked the jar and it contains the core-site.xml file..Am I >>>>>>> forced to configure the hadoop classpath in my Flink cluster config files? >>>>>>> >>>>>>> Best, >>>>>>> Flavio >>>>>>> >>>>>> >>>>>> >>>> >> > --94eb2c07e9e28bdac60522fd7910 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Running from the shell everything works..is it a problem o= f classloaders hierarchy in the webapp?

On Fri, Oct 23, 2015 at 5:53 PM, Maximilian Michels <= span dir=3D"ltr"><mx= m@apache.org> wrote:
./bin/flink run /path/to/jar arguments

or
=
./bin/flink run -c MainClass /path/to/jar arguments

On Fri, Oct 23, 2015 at 5:50 PM, Stefano Bortoli <s.bortoli= @gmail.com> wrote:
What I normally do is to

java -cp MYUBERJAR.jar my.pa= ckage.mainclass

does it make sense?

2015-10-23 17:22 GMT+02:= 00 Flavio Pompermaier <pompermaier@okkam.it>:

could you write ne the command please= ?I'm not in the office right now..

On 23 Oct 2015 17:10, "Maximilian Michels&q= uot; <mxm@apache.org= > wrote:
Could you try submitting the job from the command-li= ne and see if it works?

Thanks,
Max

On Fri, Oct 23, 2015 at 4= :42 PM, Flavio Pompermaier <pompermaier@okkam.it> wrote:<= br>

0.10-snapshot

On 23 Oct 2015 16:09, "Maximilian Michels&q= uot; <mxm@apache.org= > wrote:
Hi Flavio,

Which version of Flink = are you using?

Cheers,
Max

On Fri, Oct 23, 2015 at 2:45 PM, Flavio = Pompermaier <pompermaier@okkam.it> wrote:
Hi to all,
I'm trying to run a = job from the web interface but I get this error:

<= pre style=3D"padding:0px;margin-top:0px;margin-bottom:0px;color:rgb(0,0,0);= text-align:center">java.lang.RuntimeException: java.io.FileNotFoundExceptio= n: JAR entry core-site.xml not found in /tmp/webclient-jobs/EntitonsJsonize= r.jar at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:23= 34) at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2= 187) at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2104) at org.apache.hadoop.conf.Configuration.get(Configuration.java:853) at org.apache.hadoop.mapred.JobConf.checkAndWarnDeprecation(JobConf.java:2= 088) at org.apache.hadoop.mapred.JobConf.<init>(JobConf.java:446) at org.apache.hadoop.mapreduce.Job.getInstance(Job.java:175) at org.apache.hadoop.mapreduce.Job.getInstance(Job.java:156) at it.okkam.flink.entitons.io.utils.ParquetThriftEntitons.readEntitons(Par= quetThriftEntitons.java:42) at it.okkam.flink.entitons.io.utils.ParquetThriftEntitons.readEntitonsWith= Id(ParquetThriftEntitons.java:73) at org.okkam.entitons.EntitonsJsonizer.readAtomQuads(EntitonsJsonizer.java= :235) at org.okkam.entitons.EntitonsJsonizer.main(EntitonsJsonizer.java:119) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.ja= va:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccesso= rImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.flink.client.program.PackagedProgram.callMainMethod(Packaged= Program.java:497) at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeFo= rExecution(PackagedProgram.java:395) at org.apache.flink.client.program.OptimizerPlanEnvironment.getOptimizedPl= an(OptimizerPlanEnvironment.java:80) at org.apache.flink.client.program.Client.getOptimizedPlan(Client.java:220= ) at org.apache.flink.client.CliFrontend.info(CliFrontend.java:412) at org.apache.flink.client.CliFrontend.parseParameters(CliFrontend.java:97= 7) at org.apache.flink.client.web.JobSubmissionServlet.doGet(JobSubmissionSer= vlet.java:171) at javax.servlet.http.HttpServlet.service(HttpServlet.java:734) at javax.servlet.http.HttpServlet.service(HttpServlet.java:847) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:532) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:4= 53) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler= .java:227) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler= .java:965) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:38= 8) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.= java:187) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.= java:901) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.jav= a:117) at org.eclipse.jetty.server.handler.HandlerList.handle(HandlerList.java:47= ) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.j= ava:113) at org.eclipse.jetty.server.Server.handle(Server.java:352) at org.eclipse.jetty.server.HttpConnection.handleRequest(HttpConnection.ja= va:596) at org.eclipse.jetty.server.HttpConnection$RequestHandler.headerComplete(H= ttpConnection.java:1048) at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:549) at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:211) at org.eclipse.jetty.server.HttpConnection.handle(HttpConnection.java:425) at org.eclipse.jetty.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoin= t.java:489) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.j= ava:436) at java.lang.Thread.run(Thread.java:745) Caused by: java.io.FileNotFoundException: JAR entry core-site.xml not found= in /tmp/webclient-jobs/EntitonsJsonizer.jar at sun.net.www.protocol.jar.JarURLConnection.connect(JarURLConnection.java= :140) at sun.net.www.protocol.jar.JarURLConnection.getInputStream(JarURLConnecti= on.java:150) at java.net.URL.openStream(URL.java:1037) at org.apache.hadoop.conf.Configuration.parse(Configuration.java:2163) at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:22= 34)

I checked the jar and it contains the core-site= .xml file..Am I forced to configure the hadoop classpath in my Flink cluste= r config files?

Best,
Flavio





--94eb2c07e9e28bdac60522fd7910--