falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Shwetha G S (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FALCON-259) Design Transformation Interface
Date Tue, 28 Jan 2014 12:09:37 GMT

    [ https://issues.apache.org/jira/browse/FALCON-259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13884053#comment-13884053
] 

Shwetha G S commented on FALCON-259:
------------------------------------

1. Primitive.validate() returns null if there are no errors. But CompilationException(Iterable<Message>)
doesn't handle null
2. CompilationException should probably expose all messages as is instead of forming detailedMessage.
Its easier for clients to work with Message directly
3. Does Primitive.doOptimize() and doCompile() require Conf param? Primitive contains conf
already. doOptimize() can probably return another optimised Primitive if required
4. Update comment as Partition Transform can create multiple outputs
+     * Each Transform by default requires one or more input data sets
+     * and produces a single output data set.

> Design Transformation Interface
> -------------------------------
>
>                 Key: FALCON-259
>                 URL: https://issues.apache.org/jira/browse/FALCON-259
>             Project: Falcon
>          Issue Type: Sub-task
>          Components: designer
>    Affects Versions: 0.5
>            Reporter: Srikanth Sundarrajan
>            Assignee: Srikanth Sundarrajan
>         Attachments: FALCON-259-v2.patch, FALCON-259.patch
>
>
> The foundation block in the pipeline designer is the transformation. All primitives of
the process are either defined as a transformation or an action. Transformation is a data
flow primitive while action could either be a general purpose processing primitive or a control
flow. 



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

Mime
View raw message