falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Samarth Gupta <samarthgupta...@gmail.com>
Subject Re: Falcon CLi Cluster submit Error with Hadoop 2.x
Date Wed, 09 Apr 2014 11:16:30 GMT
@shwetha , does it mean we can not submit any entity to current falcon
trunk in distributed mode , till the bug FALCON-229 is resolved ?


On Wed, Apr 9, 2014 at 4:15 PM, Shwetha GS <shwetha.gs@inmobi.com> wrote:

> Hi Sunil,
>
> Looks like you have set-up falcon in distributed mode. This requires a fix
> tracked in FALCON-229. Please try out with an embedded set-up of falcon
>
> Regards,
> Shwetha
>
> On Wed, Apr 9, 2014 at 2:57 PM, Sunil N Kumar <suniln.kumar@impetus.co.in
> >wrote:
>
> > Hi,
> >
> > I have configured latest code of the Falcon and build it for Hadoop 2.x.
> I
> > am getting error while submitting cluster entity definition to the Falcon
> > Server. Is there changes in the API of the latest trunk??
> >
> > Console Error:
> >
> > bin/falcon entity -submit -type cluster -file
> > examples/entity/standalone-cluster.xml
> >
> > SLF4J: Class path contains multiple SLF4J bindings.
> >
> > SLF4J: Found binding in
> >
> [jar:file:/usr/share/hadoop/falcon-distributed-0.5-incubating-SNAPSHOT/client/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> >
> > SLF4J: Found binding in
> >
> [jar:file:/usr/share/hadoop/falcon-distributed-0.5-incubating-SNAPSHOT/hadooplibs/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> >
> > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
> > explanation.
> >
> > Error:
> >
> local/org.apache.falcon.FalconException::org.apache.falcon.FalconException:
> > <html>
> >
> > <head>
> >
> > <meta http-equiv="Content-Type" content="text/html; charset=ISO-8859-1"/>
> >
> > <title>Error 404 NOT_FOUND</title>
> >
> > </head>
> >
> > <body><h2>HTTP ERROR 404</h2>
> >
> > <p>Problem accessing //secure/sync/submit/cluster. Reason:
> >
> > <pre>    NOT_FOUND</pre></p><hr /><i><small>Powered
by
> > Jetty://</small></i><br/>
> >
> > <br/>
> >
> > <br/>
> >
> > <br/>
> >
> > <br/>
> >
> > <br/>
> >
> > <br/>
> >
> > <br/>
> >
> > <br/>
> >
> > <br/>
> >
> > <br/>
> >
> > <br/>
> >
> > <br/>
> >
> > <br/>
> >
> > <br/>
> >
> > <br/>
> >
> > <br/>
> >
> > <br/>
> >
> > <br/>
> >
> > <br/>
> >
> >
> >
> > </body>
> >
> > </html>
> >
> >
> >
> > Log Error logs/prism.application.log:
> >
> > 2014-04-09 14:50:04,932 ERROR - [292007154@qtp-1352618001-10
> :root:POST//entities/submit/cluster
> > d20c3323-4c16-4c68-ab7d-4c5fa712a29e] ~ Request failed (HTTPChannel:110)
> >
> > org.apache.falcon.FalconException: <html>
> >
> > <head>
> >
> > <meta http-equiv="Content-Type" content="text/html; charset=ISO-8859-1"/>
> >
> > <title>Error 404 NOT_FOUND</title>
> >
> > </head>
> >
> > <body><h2>HTTP ERROR 404</h2>
> >
> > <p>Problem accessing //secure/sync/submit/cluster. Reason:
> >
> > <pre>    NOT_FOUND</pre></p><hr /><i><small>Powered
by
> > Jetty://</small></i><br/>
> >
> > <br/>
> >
> > <br/>
> >
> > <br/>
> >
> > <br/>
> >
> > <br/>
> >
> > <br/>
> >
> > <br/>
> >
> > <br/>
> >
> > <br/>
> >
> > <br/>
> >
> > <br/>
> >
> > <br/>
> >
> > <br/>
> >
> > <br/>
> >
> > <br/>
> >
> > <br/>
> >
> > <br/>
> >
> > <br/>
> >
> > <br/>
> >
> >
> >
> > </body>
> >
> > </html>
> >
> >
> >
> >         at
> >
> org.apache.falcon.resource.channel.HTTPChannel.invoke(HTTPChannel.java:107)
> >
> >         at
> >
> org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy$1.doExecute(SchedulableEntityManagerProxy.java:118)
> >
> >         at
> >
> org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy$EntityProxy.execute(SchedulableEntityManagerProxy.java:410)
> >
> >         at
> >
> org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy.submit_aroundBody0(SchedulableEntityManagerProxy.java:120)
> >
> >         at
> >
> org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy$AjcClosure1.run(SchedulableEntityManagerProxy.java:1)
> >
> >         at
> > org.aspectj.runtime.reflect.JoinPointImpl.proceed(JoinPointImpl.java:149)
> >
> >         at
> >
> org.apache.falcon.aspect.AbstractFalconAspect.logAround(AbstractFalconAspect.java:50)
> >
> >         at
> >
> org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy.submit(SchedulableEntityManagerProxy.java:107)
> >
> >         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >
> >         at
> >
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> >
> >         at
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> >
> >         at java.lang.reflect.Method.invoke(Method.java:597)
> >
> >         at
> >
> com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60)
> >
> >         at
> >
> com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$TypeOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:185)
> >
> >         at
> >
> com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75)
> >
> >         at
> >
> com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:288)
> >
> >         at
> >
> com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
> >
> >         at
> >
> com.sun.jersey.server.impl.uri.rules.ResourceClassRule.accept(ResourceClassRule.java:108)
> >
> >         at
> >
> com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
> >
> >         at
> >
> com.sun.jersey.server.impl.uri.rules.RootResourceClassesRule.accept(RootResourceClassesRule.java:84)
> >
> >         at
> >
> com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1469)
> >
> >         at
> >
> com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1400)
> >
> >         at
> >
> com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1349)
> >
> >         at
> >
> com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1339)
> >
> >         at
> >
> com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:416)
> >
> >         at
> >
> com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:537)
> >
> >         at
> >
> com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:699)
> >
> >         at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
> >
> >         at
> > org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511)
> >
> >         at
> >
> org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1221)
> >
> >         at
> >
> org.apache.falcon.security.BasicAuthFilter$2.doFilter(BasicAuthFilter.java:156)
> >
> >         at
> >
> org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:384)
> >
> >         at
> >
> org.apache.falcon.security.BasicAuthFilter.doFilter(BasicAuthFilter.java:194)
> >
> >         at
> >
> org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
> >
> >         at
> > org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)
> >
> >         at
> >
> org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
> >
> >         at
> > org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
> >
> >         at
> > org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
> >
> >         at
> > org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
> >
> >         at
> > org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
> >
> >         at org.mortbay.jetty.Server.handle(Server.java:326)
> >
> >         at
> > org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
> >
> >         at
> >
> org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:945)
> >
> >         at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:756)
> >
> >         at
> org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218)
> >
> >         at
> org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
> >
> >         at
> >
> org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
> >
> >         at
> >
> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
> >
> > 2014-04-09 14:50:04,933 ERROR - [292007154@qtp-1352618001-10
> :root:POST//entities/submit/cluster
> > d20c3323-4c16-4c68-ab7d-4c5fa712a29e] ~ Action failed: Bad Request
> >
> >
> Error:local/org.apache.falcon.FalconException::org.apache.falcon.FalconException:
> > <html>
> >
> > <head>
> >
> > <meta http-equiv="Content-Type" content="text/html; charset=ISO-8859-1"/>
> >
> > <title>Error 404 NOT_FOUND</title>
> >
> > </head>
> >
> > <body><h2>HTTP ERROR 404</h2>
> >
> > <p>Problem accessing //secure/sync/submit/cluster. Reason:
> >
> > <pre>    NOT_FOUND</pre></p><hr /><i><small>Powered
by
> > Jetty://</small></i><br/>
> >
> > <br/>
> >
> > <br/>
> >
> > <br/>
> >
> > <br/>
> >
> > <br/>
> >
> > <br/>
> >
> > <br/>
> >
> > <br/>
> >
> > <br/>
> >
> > <br/>
> >
> > <br/>
> >
> > <br/>
> >
> > <br/>
> >
> > <br/>
> >
> > <br/>
> >
> > <br/>
> >
> > <br/>
> >
> > <br/>
> >
> > <br/>
> >
> >
> >
> > </body>
> >
> > </html>
> >
> >
> >
> >
> >
> > Cluster Definition:
> >
> > <cluster colo="local" description="Standalone cluster" name="democls"
> > xmlns="uri:falcon:cluster:0.1">
> >
> >     <interfaces>
> >
> >         <interface type="readonly" endpoint="hftp://localhost:50070"
> > version="2.2.0"/>
> >
> >
> >
> >         <interface type="write" endpoint="hdfs://localhost:9000"
> > version="2.2.0"/>
> >
> >
> >
> >         <interface type="execute" endpoint="localhost " version="2.2.0"/>
> >
> >
> >
> >         <interface type="workflow" endpoint="
> http://localhost:11000/oozie/"
> > version="4.0.0"/>
> >
> >
> >
> >         <interface type="messaging"
> > endpoint="tcp://localhost:61616?daemon=true"  version="5.4.3"/>
> >
> >     </interfaces>
> >
> >     <locations>
> >
> >         <location name="staging" path="/falcon/staging"/>
> >
> >         <location name="temp" path="/falcon/temp"/>
> >
> >         <location name="working" path="/falcon/working"/>
> >
> >     </locations>
> >
> >     <properties>
> >
> >     </properties>
> >
> > </cluster>
> >
> >
> >
> > Thanks and Regards.
> >
> > Sunil Kumar
> >
> > ________________________________
> >
> >
> >
> >
> >
> >
> > NOTE: This message may contain information that is confidential,
> > proprietary, privileged or otherwise protected by law. The message is
> > intended solely for the named addressee. If received in error, please
> > destroy and notify the sender. Any use of this email is prohibited when
> > received in error. Impetus does not represent, warrant and/or guarantee,
> > that the integrity of this communication has been maintained nor that the
> > communication is free of errors, virus, interception or interference.
> >
>
> --
> _____________________________________________________________
> The information contained in this communication is intended solely for the
> use of the individual or entity to whom it is addressed and others
> authorized to receive it. It may contain confidential or legally privileged
> information. If you are not the intended recipient you are hereby notified
> that any disclosure, copying, distribution or taking any action in reliance
> on the contents of this information is strictly prohibited and may be
> unlawful. If you have received this communication in error, please notify
> us immediately by responding to this email and then delete it from your
> system. The firm is neither liable for the proper and complete transmission
> of the information contained in this communication nor for any delay in its
> receipt.
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message