Mailing-List: contact common-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: common-user@hadoop.apache.org
Received-SPF: pass (athena.apache.org: domain of matt.tanquary@gmail.com
 designates 209.85.160.176 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:date:message-id:subject:from:to:content-type;
        b=ULHA/0FdPiOrA07/16TNyksZWYPTSYeddgp0uJZLL8b/ySFruX3TZIdmPent77LHKg
         kUo4cqfs+IgQXrv0zWMNYKElugqVA9PBmToVbxSdS8/ZWzLOBt8j1zvt1wHBXOxYW/P6
         pOFsNnwk+RSdLjWeybqVWkrIDN2WdADs+nbk8=
MIME-Version: 1.0
Date: Mon, 22 Nov 2010 09:43:02 -0700
Message-ID: <AANLkTi=Sj5Lsd=j8yPbitYG0GrasGrRnkJbGAR_ZOZST@mail.gmail.com>
Subject: Cannot find MultipleOutputs files
From: Matt Tanquary <matt.tanquary@gmail.com>
To: common-user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=0016e6d27bd91a5fdb0495a6f326

--0016e6d27bd91a5fdb0495a6f326
Content-Type: text/plain; charset=ISO-8859-1

I am trying to implement MultipleOutputs (the new API). I have done the
following:

Added the following to my Tool run() method:

MultipleOutputs.addNamedOutput(sortJob, "l1n1", TextOutputFormat.class,
NullWritable.class, Text.class);
MultipleOutputs.addNamedOutput(sortJob, "l1n2", TextOutputFormat.class,
NullWritable.class, Text.class);


Here's my reducer:

static class FinalSortReducer extends Reducer<TextTriplet, IntWritable,
NullWritable, Text>
    {
        private MultipleOutputs<NullWritable, Text> mos;

        public void setup(Context context) {
          mos = new MultipleOutputs<NullWritable, Text>(context);
       }
        public void reduce(TextTriplet key, Iterable<IntWritable> values,
                Context context) throws IOException, InterruptedException {

            Text out = new Text();

            for (IntWritable val : values) {
                context.getCounter(TotalCounter.ITEM).increment(1);
                out.set(key.getThird() + "\t" + key.getSecond());
                if (key.getFirst().toString().equals("l1n1"))
                {
                    //mos.write(NullWritable.get(), out,
key.getFirst().toString());
                    mos.write("l1n1", NullWritable.get(), key.getThird() +
"\t" + key.getSecond());
                    //logger.info("Wrote: " + key.toString());
                }else if (key.getFirst().toString().equals("l1n2"))
                {
                    //mos.write(NullWritable.get(), out,
key.getFirst().toString());
                    mos.write("l1n2", NullWritable.get(), key.getThird() +
"\t" + key.getSecond());
                    //logger.info("Wrote: " + key.toString());
                } else
                {
                    context.write(NullWritable.get(), out);
                }
            }
        }

        public void cleanup(Context context) throws IOException,
InterruptedException {
            mos.close();
        }
    }

Once the job is finished, I end up with nothing in my output path although
statistics show that my reducer output 83 records.
The only thing found in my output path is '_logs' folder.

I have searched up and down the folder tree to see if maybe the outputs are
somewhere else, but have not been able to find the output.

Any idea about what I might be doing wrong?

Thanks!
-M@

-- 
Have you thanked a teacher today? ---> http://www.liftateacher.org

--0016e6d27bd91a5fdb0495a6f326--