pirk-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (PIRK-25) Serialization and storage changes to Querier, Query, and Response
Date Sun, 24 Jul 2016 13:20:20 GMT

    [ https://issues.apache.org/jira/browse/PIRK-25?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15391061#comment-15391061
] 

ASF GitHub Bot commented on PIRK-25:
------------------------------------

GitHub user tellison opened a pull request:

    https://github.com/apache/incubator-pirk/pull/25

    [PIRK-25] Additional comments and tidy-up.

    Enhancement to merged commit for PIRK-25, adding some comments and using try-with-resources.

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/tellison/incubator-pirk serialization

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/incubator-pirk/pull/25.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #25
    
----
commit aef6aea88896f808c578e3660785a9b8483e375d
Author: Tim Ellison <t.p.ellison@gmail.com>
Date:   2016-07-22T14:40:12Z

    Serialization and storage changes to Querier, Query, and Response.
    
     - Introduce serialization services that can flatten objects into a
    variety of different formats.  Currently just reusing the Java
    serialization code until the project is ready to adopt other
    serializers.
     
     - Introduce storage services that can store objects and retrieve them.
    Currently just reusing the local file system and HDFS.  The storage
    service uses one of the serialization services to flatten the objects.
     
     - Remove code from Querier, Query, and Response that was serializing
    and storing each of them; and update the callers to use the storage
    services.

commit 77baa948ea2092cf1ce9de8e8be380aef2331d31
Author: Tim Ellison <t.p.ellison@gmail.com>
Date:   2016-07-23T21:02:19Z

    Merge branch 'master' of https://github.com/apache/incubator-pirk into
    serialization
    
    Conflicts:
    	src/main/java/org/apache/pirk/querier/wideskies/Querier.java
    	src/main/java/org/apache/pirk/querier/wideskies/QuerierDriver.java
    	src/main/java/org/apache/pirk/query/wideskies/Query.java
    	src/main/java/org/apache/pirk/responder/wideskies/mapreduce/ExpTableMapper.java
    	src/main/java/org/apache/pirk/responder/wideskies/mapreduce/FinalResponseReducer.java
    	src/main/java/org/apache/pirk/responder/wideskies/mapreduce/HashSelectorsAndPartitionDataMapper.java
    	src/main/java/org/apache/pirk/responder/wideskies/spark/ComputeExpLookupTable.java
    	src/main/java/org/apache/pirk/responder/wideskies/spark/ComputeResponse.java
    	src/main/java/org/apache/pirk/response/wideskies/Response.java
    	src/main/java/org/apache/pirk/test/utils/StandaloneQuery.java

commit dd13367ea62c214b7fb6c11ee415bb8ccbe2a53c
Author: Tim Ellison <t.p.ellison@gmail.com>
Date:   2016-07-23T21:37:26Z

    Add comments and use try-with-resources.
    
     - remove placeholder for JSON serializer.  Will be reintroduced when a
    JSON serializer is available in Pirk.

commit ed2c51f83cd509da7f78552503cc920d66577fc5
Author: Tim Ellison <t.p.ellison@gmail.com>
Date:   2016-07-24T13:15:39Z

    Merge branch 'master' of https://github.com/apache/incubator-pirk into
    serialization
    
    Conflicts:
    	src/main/java/org/apache/pirk/responder/wideskies/standalone/Responder.java
    	src/main/java/org/apache/pirk/serialization/HadoopFileSystemStore.java
    	src/main/java/org/apache/pirk/serialization/JavaSerializer.java
    	src/main/java/org/apache/pirk/serialization/LocalFileSystemStore.java
    	src/main/java/org/apache/pirk/serialization/Storable.java
    	src/main/java/org/apache/pirk/serialization/StorageService.java

----


> Serialization and storage changes to Querier, Query, and Response
> -----------------------------------------------------------------
>
>                 Key: PIRK-25
>                 URL: https://issues.apache.org/jira/browse/PIRK-25
>             Project: PIRK
>          Issue Type: Improvement
>          Components: Querier, Responder
>            Reporter: Tim Ellison
>            Assignee: Tim Ellison
>
> Introduce serialization services that can flatten objects into a
> variety of different formats. Currently just reusing the Java
> serialization code until the project is ready to adopt other
> serializers.
> Introduce storage services that can store objects and retrieve them.
> Currently just reusing the local file system and HDFS. The storage
> service uses one of the serialization services to flatten the objects.
> Remove code from Querier, Query, and Response that was serializing
> and storing each of them; and update the callers to use the storage
> services.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message