camel-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Claus Ibsen <claus.ib...@gmail.com>
Subject Re: Question on camel-hdfs
Date Mon, 22 Mar 2010 18:07:52 GMT
On Mon, Mar 22, 2010 at 7:00 PM, Vinicius Carvalho
<java.vinicius@gmail.com> wrote:
> Thanks Claus. I was just hoping someone from the camel-hadoop would be
> around this list :)
>
> The HDFSProducer do extend DefaultProducer, but I was debugging the
> code, and the doStart is not invoked. Any reason for this?
>

No it ought to call start on the producer when its created.

I think its David Grecko who created the Hadoop component.
He may be around to help out.


> Regards
>
> On Mon, Mar 22, 2010 at 2:40 PM, Claus Ibsen <claus.ibsen@gmail.com> wrote:
>> Hi
>>
>> Camel Hadoop is hosted outside Apache and thus not officially
>> supported by Apache etc.
>> I think you gotta dig into it yourself to see the issue.
>>
>> Normally doStart should be invoked on a Producer/Consumer if it
>> extends the DefaultProducer/DefaultConsumer etc.
>>
>> And I am sure patches etc is welcome on the Camel Hadop project.
>>
>>
>> On Mon, Mar 22, 2010 at 5:57 PM, Vinicius Carvalho
>> <java.vinicius@gmail.com> wrote:
>>> Hello there! I'm trying the Camel Hadoop integration (using
>>> camel-2.3-Snapshot), and using this producer:
>>>
>>> @Produce(uri="hdfs://localhost/temp/tweets?splitStrategy=BYTES:200000")
>>>        protected TweeterProducer producer;
>>>
>>> The problem is that I get a NPE:
>>>
>>> Exception in thread "Twitter Stream Handling Thread[receiving stream]"
>>> org.apache.camel.RuntimeCamelException: java.lang.NullPointerException
>>>        at org.apache.camel.component.hdfs.HdfsProducer.process(HdfsProducer.java:176)
>>>        at org.apache.camel.component.bean.CamelInvocationHandler.invoke(CamelInvocationHandler.java:64)
>>>        at $Proxy32.broadcast(Unknown Source)
>>>        at com.acme.tweet.TwitterBroadcaster.onStatus(TwitterBroadcaster.java:39)
>>>        at twitter4j.StatusStream.next(StatusStream.java:78)
>>>        at twitter4j.TwitterStream$StreamHandlingThread.run(TwitterStream.java:357)
>>>
>>> Checking the HdfsProducer code, I can verify that it seems that when
>>> process is called, the variable
>>>
>>> HdfsOutputStream ostream is not set. I do not know the internals of
>>> camel, but it seems that this component does not get the doStart()
>>> called prior to the process method. And it seems thats how it should
>>> happen.
>>>
>>> Any ideas?
>>>
>>> Regards
>>>
>>
>>
>>
>> --
>> Claus Ibsen
>> Apache Camel Committer
>>
>> Author of Camel in Action: http://www.manning.com/ibsen/
>> Open Source Integration: http://fusesource.com
>> Blog: http://davsclaus.blogspot.com/
>> Twitter: http://twitter.com/davsclaus
>>
>



-- 
Claus Ibsen
Apache Camel Committer

Author of Camel in Action: http://www.manning.com/ibsen/
Open Source Integration: http://fusesource.com
Blog: http://davsclaus.blogspot.com/
Twitter: http://twitter.com/davsclaus

Mime
View raw message