apex-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Akshay Gore <goreaks...@gmail.com>
Subject Re: Concrete classes in Malhar
Date Wed, 13 Jan 2016 05:10:53 GMT
Thanks all for your feedback.

I will create a JIRA and update here.

--Akshay
On 13-Jan-2016 10:27, "Yogi Devendra" <devendra@datatorrent.com> wrote:

> Akshay,
>
> Can you please create a JIRA for this?
> Also add Permalink
> <https://mail-archives.apache.org/mod_mbox/incubator-apex-users/201601.mbox/%3CCAJxXgwMG721Gu7MN5QShPYVYadtTgQesm%2BeHfR%2BD%2B0Yt%2ByXrEw%40mail.gmail.com%3E>
for
> the email thread in the JIRA description.
> and paste the JIRA link on this thread.
>
> ~ Yogi
>
> On Wed, Jan 13, 2016 at 3:50 AM, Pramod Immaneni <pramod@datatorrent.com>
> wrote:
>
>> Agreed. We have created trivial implementations for other operators like
>> kafka string, line by line file input so on. This may be a candidate for
>> that.
>>
>> On Tue, Jan 12, 2016 at 3:30 AM, Akshay Gore <goreakshay@gmail.com>
>> wrote:
>>
>>> Thanks Yogi. I am able to perform file write operation on HDFS.
>>>
>>> One suggestion here, Malhar library should have some concrete classes
>>> like hdfs file input/output operations so that it would be easy for a new
>>> Apex user to quickly start with.
>>>
>>> -Akshay
>>>
>>> On Tue, Jan 12, 2016 at 3:26 PM, Yogi Devendra <devendra@datatorrent.com
>>> > wrote:
>>>
>>>> Here is the Javadoc:
>>>>
>>>>
>>>> https://www.datatorrent.com/docs/apidocs/com/datatorrent/lib/io/fs/AbstractFileOutputOperator.html
>>>>
>>>> Here is the user guide:
>>>>
>>>> http://docs.datatorrent.com/operators/file_output/
>>>>
>>>> You will need to provide implementation for couple of methods:
>>>>
>>>> 1.  protected abstract String getFileName(INPUT tuple)
>>>>  You could simply return "output.txt"
>>>>
>>>> 2. protected abstract byte[] getBytesForTuple(INPUT tuple)
>>>>
>>>> You need to provide some way to serialize input tuple.
>>>> It could be as simple as return tuple.toString().getBytes()
>>>>
>>>> It would be great if you use some IDE like eclipse or intellij; it
>>>> should give you suggestions, auto-complete template for methods to be
>>>> overridden.
>>>>
>>>> ~ Yogi
>>>>
>>>> On Tue, Jan 12, 2016 at 2:58 PM, Akshay Gore <goreakshay@gmail.com>
>>>> wrote:
>>>>
>>>>> Hi,
>>>>>
>>>>> I am developing the sample Apex application to explore Malhar
>>>>> operators. In my case, I need to write the processed data to HDFS. I
did
>>>>> not find concrete class for file writing, instead I got AbstractFileOutput
>>>>> operator class which will have to implement it. Can I have references/
>>>>> examples to how to implement the abstract classes in Malhar ?  If not,
it
>>>>> would be nice to have such classes in Malhar.
>>>>>
>>>>> --
>>>>> Thanks,
>>>>> Akshay
>>>>>
>>>>
>>>>
>>>
>>>
>>> --
>>> Thanks,
>>> Akshay
>>>
>>
>>
>

Mime
View raw message