apex-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (APEXMALHAR-2102) Add A Clone Partitioner Which Sends The Same Data To Each Partition
Date Wed, 08 Jun 2016 19:25:21 GMT

    [ https://issues.apache.org/jira/browse/APEXMALHAR-2102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15321292#comment-15321292
] 

ASF GitHub Bot commented on APEXMALHAR-2102:
--------------------------------------------

Github user gauravgopi123 commented on a diff in the pull request:

    https://github.com/apache/apex-malhar/pull/315#discussion_r66322272
  
    --- Diff: library/src/test/java/com/datatorrent/lib/partitioner/ClonePartitionerTest.java
---
    @@ -0,0 +1,314 @@
    +/**
    + * Licensed to the Apache Software Foundation (ASF) under one
    + * or more contributor license agreements.  See the NOTICE file
    + * distributed with this work for additional information
    + * regarding copyright ownership.  The ASF licenses this file
    + * to you under the Apache License, Version 2.0 (the
    + * "License"); you may not use this file except in compliance
    + * with the License.  You may obtain a copy of the License at
    + *
    + *   http://www.apache.org/licenses/LICENSE-2.0
    + *
    + * Unless required by applicable law or agreed to in writing,
    + * software distributed under the License is distributed on an
    + * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
    + * KIND, either express or implied.  See the License for the
    + * specific language governing permissions and limitations
    + * under the License.
    + */
    +package com.datatorrent.lib.partitioner;
    +
    +import java.io.IOException;
    +import java.util.ArrayList;
    +import java.util.Collection;
    +import java.util.List;
    +
    +import javax.validation.ConstraintViolationException;
    +
    +import org.junit.Assert;
    +import org.junit.Test;
    +import org.slf4j.Logger;
    +import org.slf4j.LoggerFactory;
    +
    +import org.apache.hadoop.conf.Configuration;
    +
    +import com.google.common.collect.Lists;
    +
    +import com.datatorrent.api.Context;
    +import com.datatorrent.api.Context.OperatorContext;
    +import com.datatorrent.api.DAG;
    +import com.datatorrent.api.DefaultInputPort;
    +import com.datatorrent.api.DefaultOutputPort;
    +import com.datatorrent.api.DefaultPartition;
    +import com.datatorrent.api.InputOperator;
    +import com.datatorrent.api.LocalMode;
    +import com.datatorrent.api.Operator;
    +import com.datatorrent.api.Operator.InputPort;
    +import com.datatorrent.api.Partitioner;
    +import com.datatorrent.api.Partitioner.Partition;
    +import com.datatorrent.api.StreamingApplication;
    +import com.datatorrent.api.StringCodec.Object2String;
    +
    +import static junit.framework.TestCase.assertFalse;
    +import static org.junit.Assert.assertEquals;
    +
    +public class ClonePartitionerTest
    +{
    +  private static Logger LOG = LoggerFactory.getLogger(ClonePartitionerTest.class);
    +
    +  private static int numPartitions = 20;
    +  private static Integer countPerWindow = 100;
    +  private static Integer totalReceived = 0;
    +  private static Integer totalSent = 0;
    +
    +  private static boolean matchFailed = false;
    +
    +  public static class FixedEmitter implements InputOperator
    --- End diff --
    
    may be you want to extend BaseOperator to avoid writing boiler plate code like setup/endWindow


> Add A Clone Partitioner Which Sends The Same Data To Each Partition
> -------------------------------------------------------------------
>
>                 Key: APEXMALHAR-2102
>                 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2102
>             Project: Apache Apex Malhar
>          Issue Type: New Feature
>            Reporter: Timothy Farkas
>            Assignee: Ilya Ganelin
>
> This should go into com.datatorrent.common.partitioner and would be very similar to the
StatelessPartitioner



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message