apex-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (APEXMALHAR-2070) Create In Memory Implementation of ArrayList Multimap
Date Sun, 01 May 2016 06:44:13 GMT

    [ https://issues.apache.org/jira/browse/APEXMALHAR-2070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15265638#comment-15265638
] 

ASF GitHub Bot commented on APEXMALHAR-2070:
--------------------------------------------

Github user tweise commented on a diff in the pull request:

    https://github.com/apache/incubator-apex-malhar/pull/262#discussion_r61682196
  
    --- Diff: library/src/main/java/org/apache/apex/malhar/lib/state/spillable/SpillableComplexComponent.java
---
    @@ -105,6 +105,26 @@
           Serde<V, byte[]> serdeValue);
     
       /**
    +   * This is a method for creating a {@link SpillableByteMultiset}. This method
    +   * auto-generates an identifier for the data structure.
    +   * @param <T> The type of the elements.
    +   * @param bucket The bucket that this {@link SpillableByteMultiset} will be spilled
too.
    +   * @param serde The Serializer/Deserializer to use for data stored in the {@link SpillableByteMultiset}.
    +   * @return A {@link SpillableByteMultiset}.
    +   */
    +  <T> SpillableByteMultiset<T> newSpillableMultiset(long bucket, Serde<T,
byte[]> serde);
    +
    +  /**
    +   * This is a method for creating a {@link SpillableByteMultiset}.
    +   * @param <T> The type of the elements.
    +   * @param identifier The identifier for this {@link SpillableByteMultiset}.
    +   * @param bucket The bucket that this {@link SpillableByteMultiset} will be spilled
too.
    +   * @param serde The Serializer/Deserializer to use for data stored in the {@link SpillableByteMultiset}.
    +   * @return A {@link SpillableByteMultiset}.
    +   */
    +  <T> SpillableByteMultiset<T> newSpillableMultiset(byte[] identifier, long
bucket, Serde<T, byte[]> serde);
    --- End diff --
    
    How will this work with ManagedState? Will the data be distributed over multiple data
files, partitioned by time?


> Create In Memory Implementation of ArrayList Multimap
> -----------------------------------------------------
>
>                 Key: APEXMALHAR-2070
>                 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2070
>             Project: Apache Apex Malhar
>          Issue Type: Sub-task
>            Reporter: Timothy Farkas
>            Assignee: Timothy Farkas
>
>  - Create an in memory implementation of ArrayListMultimap
>  - Add Spillable Multisets



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message