accumulo-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Josh Elser (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (ACCUMULO-1854) Accumulo{Input,Output}Format can't handle multiple configurations
Date Tue, 05 Nov 2013 19:28:19 GMT

    [ https://issues.apache.org/jira/browse/ACCUMULO-1854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13814167#comment-13814167
] 

Josh Elser commented on ACCUMULO-1854:
--------------------------------------

My initial approach is to introduce the notion of a "sequence id" to the Input/Output Formats.
Adding new methods to each class allows us to preserve the old functionality (of one "configuration"
per Configuration), yet also gives clients the hooks to store multiple configurations.

My only concern was the contract on the getSplits() method. I believe we can increment through
each sequence id that we "gave" clients and attempt to set each of them. Initial tests seem
to show that this approach will work out.

> Accumulo{Input,Output}Format can't handle multiple configurations
> -----------------------------------------------------------------
>
>                 Key: ACCUMULO-1854
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-1854
>             Project: Accumulo
>          Issue Type: Bug
>    Affects Versions: 1.4.4, 1.5.0
>            Reporter: Josh Elser
>            Assignee: Josh Elser
>
> I noticed that I was unable to properly use MultipleInputs (or any code which uses a
similar approach) with the AccumuloInputFormat class because of the way it builds up information
in the Configuration object.
> It would be useful to be able to have multiple instances of AIF (and AOF) configured
within one Job (Configuration).



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message