Return-Path: X-Original-To: apmail-flink-user-archive@minotaur.apache.org Delivered-To: apmail-flink-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id A601418A12 for ; Fri, 23 Oct 2015 14:09:12 +0000 (UTC) Received: (qmail 15978 invoked by uid 500); 23 Oct 2015 14:09:12 -0000 Delivered-To: apmail-flink-user-archive@flink.apache.org Received: (qmail 15904 invoked by uid 500); 23 Oct 2015 14:09:12 -0000 Mailing-List: contact user-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@flink.apache.org Delivered-To: mailing list user@flink.apache.org Received: (qmail 15895 invoked by uid 99); 23 Oct 2015 14:09:12 -0000 Received: from mail-relay.apache.org (HELO mail-relay.apache.org) (140.211.11.15) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 23 Oct 2015 14:09:12 +0000 Received: from mail-vk0-f47.google.com (mail-vk0-f47.google.com [209.85.213.47]) by mail-relay.apache.org (ASF Mail Server at mail-relay.apache.org) with ESMTPSA id 065DA1A022C for ; Fri, 23 Oct 2015 14:09:12 +0000 (UTC) Received: by vkgs66 with SMTP id s66so4501236vkg.1 for ; Fri, 23 Oct 2015 07:09:11 -0700 (PDT) X-Gm-Message-State: ALoCoQmqj2hK+n9bmGPD+8XUvM0DNVdLwZ/yEz+UiiSQK+11mR1VGZ8juz22IYWo+jWhkMd8hrCf X-Received: by 10.31.162.81 with SMTP id l78mr13286409vke.13.1445609351372; Fri, 23 Oct 2015 07:09:11 -0700 (PDT) MIME-Version: 1.0 Received: by 10.31.61.133 with HTTP; Fri, 23 Oct 2015 07:08:51 -0700 (PDT) In-Reply-To: References: From: Maximilian Michels Date: Fri, 23 Oct 2015 16:08:51 +0200 Message-ID: Subject: Re: Error running an hadoop job from web interface To: "user@flink.apache.org" Content-Type: multipart/alternative; boundary=001a11438a8edf79e80522c62716 --001a11438a8edf79e80522c62716 Content-Type: text/plain; charset=UTF-8 Hi Flavio, Which version of Flink are you using? Cheers, Max On Fri, Oct 23, 2015 at 2:45 PM, Flavio Pompermaier wrote: > Hi to all, > I'm trying to run a job from the web interface but I get this error: > > java.lang.RuntimeException: java.io.FileNotFoundException: JAR entry core-site.xml not found in /tmp/webclient-jobs/EntitonsJsonizer.jar > at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2334) > at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2187) > at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2104) > at org.apache.hadoop.conf.Configuration.get(Configuration.java:853) > at org.apache.hadoop.mapred.JobConf.checkAndWarnDeprecation(JobConf.java:2088) > at org.apache.hadoop.mapred.JobConf.(JobConf.java:446) > at org.apache.hadoop.mapreduce.Job.getInstance(Job.java:175) > at org.apache.hadoop.mapreduce.Job.getInstance(Job.java:156) > at it.okkam.flink.entitons.io.utils.ParquetThriftEntitons.readEntitons(ParquetThriftEntitons.java:42) > at it.okkam.flink.entitons.io.utils.ParquetThriftEntitons.readEntitonsWithId(ParquetThriftEntitons.java:73) > at org.okkam.entitons.EntitonsJsonizer.readAtomQuads(EntitonsJsonizer.java:235) > at org.okkam.entitons.EntitonsJsonizer.main(EntitonsJsonizer.java:119) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:497) > at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:395) > at org.apache.flink.client.program.OptimizerPlanEnvironment.getOptimizedPlan(OptimizerPlanEnvironment.java:80) > at org.apache.flink.client.program.Client.getOptimizedPlan(Client.java:220) > at org.apache.flink.client.CliFrontend.info(CliFrontend.java:412) > at org.apache.flink.client.CliFrontend.parseParameters(CliFrontend.java:977) > at org.apache.flink.client.web.JobSubmissionServlet.doGet(JobSubmissionServlet.java:171) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:734) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:847) > at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:532) > at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:453) > at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:227) > at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:965) > at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:388) > at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:187) > at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:901) > at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:117) > at org.eclipse.jetty.server.handler.HandlerList.handle(HandlerList.java:47) > at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:113) > at org.eclipse.jetty.server.Server.handle(Server.java:352) > at org.eclipse.jetty.server.HttpConnection.handleRequest(HttpConnection.java:596) > at org.eclipse.jetty.server.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:1048) > at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:549) > at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:211) > at org.eclipse.jetty.server.HttpConnection.handle(HttpConnection.java:425) > at org.eclipse.jetty.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:489) > at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:436) > at java.lang.Thread.run(Thread.java:745) > Caused by: java.io.FileNotFoundException: JAR entry core-site.xml not found in /tmp/webclient-jobs/EntitonsJsonizer.jar > at sun.net.www.protocol.jar.JarURLConnection.connect(JarURLConnection.java:140) > at sun.net.www.protocol.jar.JarURLConnection.getInputStream(JarURLConnection.java:150) > at java.net.URL.openStream(URL.java:1037) > at org.apache.hadoop.conf.Configuration.parse(Configuration.java:2163) > at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2234) > > > > I checked the jar and it contains the core-site.xml file..Am I forced to > configure the hadoop classpath in my Flink cluster config files? > > Best, > Flavio > --001a11438a8edf79e80522c62716 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Hi Flavio,

Which version of Fl= ink are you using?

Cheers,
Max

On Fri, Oct 23, 2015 at 2:45 PM, Fla= vio Pompermaier <pompermaier@okkam.it> wrote:
Hi to all,
I'm trying to ru= n a job from the web interface but I get this error:

java.lang.RuntimeException: java.io.FileNotFoundExce=
ption: JAR entry core-site.xml not found in /tmp/webclient-jobs/EntitonsJso=
nizer.jar
	at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:23=
34)
	at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2=
187)
	at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2104)
	at org.apache.hadoop.conf.Configuration.get(Configuration.java:853)
	at org.apache.hadoop.mapred.JobConf.checkAndWarnDeprecation(JobConf.java:2=
088)
	at org.apache.hadoop.mapred.JobConf.<init>(JobConf.java:446)
	at org.apache.hadoop.mapreduce.Job.getInstance(Job.java:175)
	at org.apache.hadoop.mapreduce.Job.getInstance(Job.java:156)
	at it.okkam.flink.entitons.io.utils.ParquetThriftEntitons.readEntitons(Par=
quetThriftEntitons.java:42)
	at it.okkam.flink.entitons.io.utils.ParquetThriftEntitons.readEntitonsWith=
Id(ParquetThriftEntitons.java:73)
	at org.okkam.entitons.EntitonsJsonizer.readAtomQuads(EntitonsJsonizer.java=
:235)
	at org.okkam.entitons.EntitonsJsonizer.main(EntitonsJsonizer.java:119)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.ja=
va:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccesso=
rImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.apache.flink.client.program.PackagedProgram.callMainMethod(Packaged=
Program.java:497)
	at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeFo=
rExecution(PackagedProgram.java:395)
	at org.apache.flink.client.program.OptimizerPlanEnvironment.getOptimizedPl=
an(OptimizerPlanEnvironment.java:80)
	at org.apache.flink.client.program.Client.getOptimizedPlan(Client.java:220=
)
	at org.apache.flink.client.CliFrontend.info(CliFrontend.java:412)
	at org.apache.flink.client.CliFrontend.parseParameters(CliFrontend.java:97=
7)
	at org.apache.flink.client.web.JobSubmissionServlet.doGet(JobSubmissionSer=
vlet.java:171)
	at javax.servlet.http.HttpServlet.service(HttpServlet.java:734)
	at javax.servlet.http.HttpServlet.service(HttpServlet.java:847)
	at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:532)
	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:4=
53)
	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler=
.java:227)
	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler=
.java:965)
	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:38=
8)
	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.=
java:187)
	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.=
java:901)
	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.jav=
a:117)
	at org.eclipse.jetty.server.handler.HandlerList.handle(HandlerList.java:47=
)
	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.j=
ava:113)
	at org.eclipse.jetty.server.Server.handle(Server.java:352)
	at org.eclipse.jetty.server.HttpConnection.handleRequest(HttpConnection.ja=
va:596)
	at org.eclipse.jetty.server.HttpConnection$RequestHandler.headerComplete(H=
ttpConnection.java:1048)
	at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:549)
	at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:211)
	at org.eclipse.jetty.server.HttpConnection.handle(HttpConnection.java:425)
	at org.eclipse.jetty.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoin=
t.java:489)
	at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.j=
ava:436)
	at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.FileNotFoundException: JAR entry core-site.xml not found=
 in /tmp/webclient-jobs/EntitonsJsonizer.jar
	at sun.net.www.protocol.jar.JarURLConnection.connect(JarURLConnection.java=
:140)
	at sun.net.www.protocol.jar.JarURLConnection.getInputStream(JarURLConnecti=
on.java:150)
	at java.net.URL.openStream(URL.java:1037)
	at org.apache.hadoop.conf.Configuration.parse(Configuration.java:2163)
	at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:22=
34)


I checked the jar and it contains the core-site= .xml file..Am I forced to configure the hadoop classpath in my Flink cluste= r config files?

Best,
Flavio

--001a11438a8edf79e80522c62716--