apex-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (APEXMALHAR-2077) SingleFileOutputOperator should append partitionId to file name
Date Tue, 17 May 2016 13:30:13 GMT

    [ https://issues.apache.org/jira/browse/APEXMALHAR-2077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15286613#comment-15286613
] 

ASF GitHub Bot commented on APEXMALHAR-2077:
--------------------------------------------

GitHub user yogidevendra reopened a pull request:

    https://github.com/apache/incubator-apex-malhar/pull/273

    APEXMALHAR-2077 AbstractSingleFileOutputOperator appending partitionID

    1. Renamed HDFSOutputOperator to BytesFileOutputOperator
    2. Moved partitionID related logic into AbstractSingleFileOutputOperator
    3. BytesFileOutputOperator extends AbstractSingleFileOutputOperator
    4. renamed currentPartName to partitionedFileName
    5. update partitionedFileName from field setters

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/yogidevendra/incubator-apex-malhar APEXMALHAR-2077-AbstractSingleFileOutputOperator-partitionId

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/incubator-apex-malhar/pull/273.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #273
    
----
commit 67ad24edd6dc1629501e86168d2594606c52e291
Author: yogidevendra <devendra@datatorrent.com>
Date:   2016-05-13T06:03:53Z

    APEXMALHAR-2077 AbstractSingleFileOutputOperator appending partitionID
    
    1. Renamed HDFSOutputOperator to BytesFileOutputOperator
    2. Moved partitionID related logic into AbstractSingleFileOutputOperator
    3. BytesFileOutputOperator extends AbstractSingleFileOutputOperator
    
    4. renamed currentPartName to partitionedFileName
    
    5. update partitionedFileName from field setters
    
    6. Fixing unit tests
    
    7. Incorporating review comments.
    
    8. Fixing checkstyle violation

----


> SingleFileOutputOperator should append partitionId to file name
> ---------------------------------------------------------------
>
>                 Key: APEXMALHAR-2077
>                 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2077
>             Project: Apache Apex Malhar
>          Issue Type: Improvement
>            Reporter: Yogi Devendra
>            Assignee: Yogi Devendra
>            Priority: Minor
>             Fix For: 3.4.0
>
>
> If SingleFileOutputOperator is partitioned into more than one physical instances then
it  should append partitionId to file name. So that, each partition can independently write
to separate file.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message