crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Christian Tzolov (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (CRUNCH-425) Implement the Converter#applyPTypeTransforms() logic for the crunch-spark execution model
Date Mon, 23 Jun 2014 17:27:25 GMT

     [ https://issues.apache.org/jira/browse/CRUNCH-425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Christian Tzolov updated CRUNCH-425:
------------------------------------

    Attachment: CRUNCH-425.patch

Attaching a patch that handles the applyPTypeTransforms() in the InputCollection, InputTable
(for the input sources) and SparkRuntime for the output targets.

Not sure if we should  handle the logic in the org.apache.crunch.impl.spark.collect.PGroupedTableImpl?




> Implement the Converter#applyPTypeTransforms() logic for the crunch-spark execution model
> -----------------------------------------------------------------------------------------
>
>                 Key: CRUNCH-425
>                 URL: https://issues.apache.org/jira/browse/CRUNCH-425
>             Project: Crunch
>          Issue Type: Bug
>            Reporter: Christian Tzolov
>         Attachments: CRUNCH-425.patch
>
>
> Converter#applyPTypeTransforms()  controls whether the PType's input/output map functions
are applied. 
> If set to true, convert the inputs or outputs from this Converter instance before (for
outputs) or after (for inputs) using the associated PType#getInputMapFn and PType#getOutputMapFn
calls.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message