incubator-oozie-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mohammad Islam <>
Subject Re: using oozie with datastax brisk
Date Sat, 22 Oct 2011 20:11:58 GMT
Hi Jeremy,
The patch review is pending.

We plan to aplly it into trunk sometime next week.


From: Jeremy Hanna <>
Sent: Saturday, October 22, 2011 7:26 AM
Subject: Re: using oozie with datastax brisk

Thanks for the response Mayank.  Is there a particular fix on trunk or something you're talking

The full exception in the logs from the error I mentioned is:
2011-10-21 21:03:55,627  INFO BaseJobServlet:536 - USER[?] GROUP[users] TOKEN[-] APP[-] JOB[-]
ACTION[-] AuthorizationException
org.apache.oozie.service.AuthorizationException: E0902: Exception occured: [
No FileSystem for scheme: cfs]
        at org.apache.oozie.service.AuthorizationService.authorizeForApp(
        at org.apache.oozie.servlet.BaseJobServlet.checkAuthorizationForApp(
        at org.apache.oozie.servlet.BaseJobsServlet.doPost(
        at javax.servlet.http.HttpServlet.service(
        at org.apache.oozie.servlet.JsonRestServlet.service(
        at javax.servlet.http.HttpServlet.service(
        at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
        at org.apache.catalina.core.ApplicationFilterChain.doFilter(
        at org.apache.catalina.core.StandardWrapperValve.invoke(
        at org.apache.catalina.core.StandardContextValve.invoke(
        at org.apache.catalina.core.StandardHostValve.invoke(
        at org.apache.catalina.valves.ErrorReportValve.invoke(
        at org.apache.catalina.core.StandardEngineValve.invoke(
        at org.apache.catalina.connector.CoyoteAdapter.service(
        at org.apache.coyote.http11.Http11Processor.process(
        at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(
Caused by: org.apache.oozie.service.HadoopAccessorException: E0902: Exception occured: [
No FileSystem for scheme: cfs]
        at org.apache.oozie.service.KerberosHadoopAccessorService.createFileSystem(
        at org.apache.oozie.service.AuthorizationService.authorizeForApp(
        ... 17 more
Caused by: No FileSystem for scheme: cfs
        at org.apache.hadoop.fs.FileSystem.createFileSystem(
        at org.apache.hadoop.fs.FileSystem.access$100(
        at org.apache.hadoop.fs.FileSystem$Cache.get(
        at org.apache.hadoop.fs.FileSystem.get(
        at org.apache.oozie.service.KerberosHadoopAccessorService$
        at org.apache.oozie.service.KerberosHadoopAccessorService$
        at Method)
        at org.apache.oozie.service.KerberosHadoopAccessorService.createFileSystem(
        ... 18 more

I seem to have gotten past that part, though I've needed to get some of the Cassandra libs
in there that cfs is dependent on.  But I may not be seeing all the errors yet.  Is there
a release planned with the fix that you're talking about or a revision or ticket or patch
I can apply?



On Oct 22, 2011, at 12:32 AM, Mayank Bansal wrote:

> I am not sure whether you will be able to run any other file system except
> hdfs. I do not think we have put the configurable file systems fix in 3.0.2.
> Send the Oozie log for more details.
> Thanks,
> Mayank
> On Fri, Oct 21, 2011 at 7:37 PM, Jeremy Hanna <>wrote:
>> Looks like I need to put that core-site.xml and the jar that contains
>> CassandraFileSystem into the oozie/oozie-server/lib directory.  Still trying
>> to track down a 500 error now, but at least I've gotten past that initial
>> issue.
>> On Oct 21, 2011, at 4:20 PM, Jeremy Hanna wrote:
>>> I've been trying to setup oozie with datastax's brisk product.  I am
>> using oozie 3.0.2 and set it up by using:
>>> bin/ -hadoop 0.20.200 /opt/brisk/resources/hadoop -extjs
>> ./
>>> Technically brisk uses hadoop 0.20.203 but oozie didn't like that.
>>> So in the brisk core-site.xml it defines:
>>> <property>
>>>   <name>fs.cfs.impl</name>
>>>   <value>com.datastax.bdp.hadoop.cfs.CassandraFileSystem</value>
>>> </property>
>>> and then I use that in my
>>> <property>
>>>   <name></name>
>>>   <value>cfs://</value>
>>> </property>
>>> however when I try to run one of the examples such as this (with nameNode
>> set to cfs://
>>> oozie job -oozie http://localhost:11000/oozie -config
>> examples/apps/map-reduce/ -run
>>> it gives the error:
>>> Error: E0902 : E0902: Exception occured: [ No
>> FileSystem for scheme: cfs]
>>> Shouldn't oozie have picked up the core-site.xml from the hadoop that it
>> picked up when running and therefore been able to pick up the
>> fs.cfs.impl property?
>>> Thanks!
>>> Jeremy
> -- 
> Thanks and Regards,
> Mayank
> Cell: 408-718-9370
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message