accumulo-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Josh Elser (JIRA)" <>
Subject [jira] [Commented] (ACCUMULO-1854) Accumulo{Input,Output}Format can't handle multiple configurations
Date Sat, 09 Nov 2013 03:16:19 GMT


Josh Elser commented on ACCUMULO-1854:

First off, thanks to [~ctubbsii] and [~bills] because they were both helpful in talking this

Came to the conclusion that I don't need to rework the Configuration object, but instead could
leverage all of the necessary information inside of the RangeInputSplit class (instead of
just the location and Range as it currently contains). This allows us to let multiple invocations
of the AccumuloInputFormat create RangeInputSplits without requiring all of the connection
information contained in the Configuration.

This creates a *much* cleaner changeset as well as backwards compatibility with the current
implementation which falls back to using the information in the Configuration when the information
is not present (null) in the RangeInputSplit.

> Accumulo{Input,Output}Format can't handle multiple configurations
> -----------------------------------------------------------------
>                 Key: ACCUMULO-1854
>                 URL:
>             Project: Accumulo
>          Issue Type: Bug
>    Affects Versions: 1.4.4, 1.5.0
>            Reporter: Josh Elser
>            Assignee: Josh Elser
>             Fix For: 1.4.5, 1.5.1, 1.6.1
> I noticed that I was unable to properly use MultipleInputs (or any code which uses a
similar approach) with the AccumuloInputFormat class because of the way it builds up information
in the Configuration object.
> It would be useful to be able to have multiple instances of AIF (and AOF) configured
within one Job (Configuration).

This message was sent by Atlassian JIRA

View raw message