apex-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From vrozov <...@git.apache.org>
Subject [GitHub] apex-malhar pull request #319: APEXMALHAR-2085: REVIEW ONLY: Operator suppor...
Date Tue, 05 Jul 2016 23:38:42 GMT
Github user vrozov commented on a diff in the pull request:

    https://github.com/apache/apex-malhar/pull/319#discussion_r69656309
  
    --- Diff: library/src/main/java/org/apache/apex/malhar/lib/window/Accumulation.java ---
    @@ -0,0 +1,76 @@
    +/**
    + * Licensed to the Apache Software Foundation (ASF) under one
    + * or more contributor license agreements.  See the NOTICE file
    + * distributed with this work for additional information
    + * regarding copyright ownership.  The ASF licenses this file
    + * to you under the Apache License, Version 2.0 (the
    + * "License"); you may not use this file except in compliance
    + * with the License.  You may obtain a copy of the License at
    + *
    + *   http://www.apache.org/licenses/LICENSE-2.0
    + *
    + * Unless required by applicable law or agreed to in writing,
    + * software distributed under the License is distributed on an
    + * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
    + * KIND, either express or implied.  See the License for the
    + * specific language governing permissions and limitations
    + * under the License.
    + */
    +package org.apache.apex.malhar.lib.window;
    +
    +import org.apache.hadoop.classification.InterfaceStability;
    +
    +/**
    + * This interface is for the processing part of the WindowedOperator.
    + * We can assume that all stateful processing of the WindowedOperator is a form of accumulation.
    + *
    + * In most cases, AccumT is the same as OutputT. But in some cases, the accumulated type
and the output type may be
    + * different. For example, if we are doing the AVERAGE of doubles, InputT will be double,
and we need the SUM and the
    + * COUNT stored as type AccumT, and AccumT will be a pair of double and long, in which
double is the sum of the inputs,
    + * and long is the number of inputs. OutputT will be double, because it represents the
average of the inputs.
    + */
    +@InterfaceStability.Evolving
    +public interface Accumulation<InputT, AccumT, OutputT>
    +{
    +  /**
    +   * Returns the default accumulated value when nothing has been accumulated
    +   *
    +   * @return
    +   */
    +  AccumT defaultAccumulatedValue();
    +
    +  /**
    +   * Accumulates the input to the accumulated value
    +   *
    +   * @param accumulatedValue
    +   * @param input
    +   * @return
    +   */
    +  AccumT accumulate(AccumT accumulatedValue, InputT input);
    --- End diff --
    
    My suggestion is to delegate to a class that implements Accumulation interface handling
of accumulation and change interface to 
    ```
    void accumulate(InputT input);
    void merge(Accumulation accumulatedValue);
    OutputT getOutput();
    ```
    The implementation class will need to define how it handles accumulation and how AccumT
is defined. The implementation may use Collection for AccumT or may use primitive types such
as int, long or double to accumulate values.



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

Mime
View raw message