hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jane Wayne <jane.wayne2...@gmail.com>
Subject Re: Partition classes, how to pass in background information
Date Wed, 14 Mar 2012 23:42:56 GMT
Thanks Chris! That worked!

On Wed, Mar 14, 2012 at 6:06 AM, Chris White <chriswhite199@gmail.com>wrote:

> If your class implements the configurable interface, hadoop will call the
> setConf method after creating the instance. Look in the source code for
> ReflectionUtils.newInstance for more info
> On Mar 14, 2012 2:31 AM, "Jane Wayne" <jane.wayne2978@gmail.com> wrote:
>
> > i am using the new org.apache.hadoop.mapreduce.Partitioner class.
> however,
> > i need to pass it some background information. how can i do this?
> >
> > in the old, org.apache.hadoop.mapred.Partitioner class (now deprecated),
> > this class extends JobConfigurable, and it seems the "hook" to pass in
> any
> > background data is with the JobConfigurable.configure(JobConf job)
> method.
> >
> > i thought that if i sub-classed org.apache.hadoop.mapreduce.Partitioner,
> i
> > could pass in the background information, however, in the
> > org.apache.hadoop.mapreduce.Job class, it only has a
> > setPartitionerClass(Class<? extends Partitioner>) method.
> >
> > all my development has been the new mapreduce package, and i would
> > definitely desire to stick with the new API/package. any help is
> > appreciated.
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message