Mailing-List: contact mapreduce-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: mapreduce-user@hadoop.apache.org
Received-SPF: neutral (nike.apache.org: local policy)
Message-ID: <4BEB25EF.8030502@squareplanet.de>
Date: Thu, 13 May 2010 00:04:31 +0200
From: Alan Miller <somebody@squareplanet.de>
User-Agent: Mozilla/5.0 (X11; U; Linux x86_64; en-US;
 rv:1.9.1.9) Gecko/20100330 Fedora/3.0.4-1.fc12 Lightning/1.0b2pre
 Thunderbird/3.0.4
MIME-Version: 1.0
To: mapreduce-user@hadoop.apache.org
Subject: Re: tab-delimited output
References: <4BEB188A.6050202@squareplanet.de>
 <AANLkTil7c9npMtjXsXAqmGScPQBEVsqXx7mpxmRelUyy@mail.gmail.com>
In-Reply-To: <AANLkTil7c9npMtjXsXAqmGScPQBEVsqXx7mpxmRelUyy@mail.gmail.com>
Content-Type: multipart/alternative;
 boundary="------------070703010901050508040607"

This is a multi-part message in MIME format.
--------------070703010901050508040607
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit

Hi Alex,

The tab isn't the issue (yet). I guess it's really 2 questions I have.
Using the reducer inputs already mentioned.

1. How do I generate multiple output files named YYYY-MM-DD.txt
2. Each file should contain
      a. one line per host
      b. each line with host avg1 avg2 avg3 ....

Alan

On 05/12/2010 11:50 PM, Alex Kozlov wrote:
> Hi Alan,
>
> Is the problem that you want your 'value' vals to be tab separated?   
> This is entirely under control of your reducer.
>
> Alex K
>
> On Wed, May 12, 2010 at 2:07 PM, Alan Miller <somebody@squareplanet.de 
> <mailto:somebody@squareplanet.de>> wrote:
>
>     Hi all,
>
>     How can I write tab-delimited output files from my reducer?
>
>     My reducer gets Text/Text key/vals like:
>
>     hostX_2010-05-01 varA=valA1,varB=valB1,varC=valC1
>     hostX_2010-05-01 varA=valA2,varB=valB2,varC=valC2
>     hostX_2010-05-01 varA=valA3,varB=valB3,varC=valC3
>     ...
>     hostY_2010-05-01 varA=valA1,varB=valB1,varC=valC1
>     hostY_2010-05-01 varA=valA2,varB=valB2,varC=valC2
>     hostY_2010-05-01 varA=valA3,varB=valB3,varC=valC3
>     ...
>
>     After my reducer calcs the daily averages of varA,B,C
>     I  want to write a tab-delimited file with lines like:
>
>     hostX    varA-Avg    varB-Avg    varC-Avg    ....
>     hostY    varA-Avg    varB-Avg    varC-Avg    ....
>
>
>     Thanks,
>     Alan
>
>


--------------070703010901050508040607
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit

<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
<html>
<head>
  <meta content="text/html; charset=ISO-8859-1"
 http-equiv="Content-Type">
</head>
<body bgcolor="#ffff99" text="#000099">
Hi Alex,<br>
<br>
The tab isn't the issue (yet). I guess it's really 2 questions I have.<br>
Using the reducer inputs already mentioned.<br>
<br>
1. How do I generate multiple output files named YYYY-MM-DD.txt<br>
2. Each file should contain<br>
&nbsp;&nbsp;&nbsp;&nbsp; a. one line per host<br>
&nbsp;&nbsp;&nbsp;&nbsp; b. each line with host avg1 avg2 avg3 ....<br>
<br>
Alan<br>
<br>
On 05/12/2010 11:50 PM, Alex Kozlov wrote:
<blockquote
 cite="mid:AANLkTil7c9npMtjXsXAqmGScPQBEVsqXx7mpxmRelUyy@mail.gmail.com"
 type="cite">Hi Alan,<br>
  <br>
Is the problem that you want your 'value' vals to be tab separated?&nbsp;&nbsp;
This is entirely under control of your reducer.<br>
  <br>
Alex K<br>
  <br>
  <div class="gmail_quote">On Wed, May 12, 2010 at 2:07 PM, Alan Miller
  <span dir="ltr">&lt;<a moz-do-not-send="true"
 href="mailto:somebody@squareplanet.de">somebody@squareplanet.de</a>&gt;</span>
wrote:<br>
  <blockquote class="gmail_quote"
 style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">Hi
all,<br>
    <br>
How can I write tab-delimited output files from my reducer?<br>
    <br>
My reducer gets Text/Text key/vals like:<br>
    <br>
hostX_2010-05-01 varA=valA1,varB=valB1,varC=valC1<br>
hostX_2010-05-01 varA=valA2,varB=valB2,varC=valC2<br>
hostX_2010-05-01 varA=valA3,varB=valB3,varC=valC3<br>
...<br>
hostY_2010-05-01 varA=valA1,varB=valB1,varC=valC1<br>
hostY_2010-05-01 varA=valA2,varB=valB2,varC=valC2<br>
hostY_2010-05-01 varA=valA3,varB=valB3,varC=valC3<br>
...<br>
    <br>
After my reducer calcs the daily averages of varA,B,C<br>
I &nbsp;want to write a tab-delimited file with lines like:<br>
    <br>
hostX &nbsp; &nbsp;varA-Avg &nbsp; &nbsp;varB-Avg &nbsp; &nbsp;varC-Avg &nbsp; &nbsp;....<br>
hostY &nbsp; &nbsp;varA-Avg &nbsp; &nbsp;varB-Avg &nbsp; &nbsp;varC-Avg &nbsp; &nbsp;....<br>
    <br>
    <br>
Thanks,<br>
    <font color="#888888">Alan<br>
    </font></blockquote>
  </div>
  <br>
</blockquote>
<br>
</body>
</html>

--------------070703010901050508040607--