Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hadoop.apache.org
Received-SPF: pass (athena.apache.org: domain of dechouxb@gmail.com designates
 209.85.216.176 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAEAKFL-Rp6MQP8Xp5m6kPEiRuQ1xo4LewvjxoA+EwVmfWonwSw@mail.gmail.com>
References: 
 <CAO6W-2dyTrZOWb-cS0bW7oDhwkZ+khhLYn6mRBB6zm54qJrsWA@mail.gmail.com>
	<CAEAKFL-Rp6MQP8Xp5m6kPEiRuQ1xo4LewvjxoA+EwVmfWonwSw@mail.gmail.com>
Date: Fri, 14 Sep 2012 07:38:54 +0200
Message-ID: 
 <CAO6W-2dzfM+YFEFjYs9abnpzn4B8jymkJiR8NR3KHmg7oPgqWQ@mail.gmail.com>
Subject: Re: Configuration of hadoop.job.history.user.location on a user basis
From: Bertrand Dechoux <dechouxb@gmail.com>
To: user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=00248c6a66c2e803fd04c9a2d6bd

--00248c6a66c2e803fd04c9a2d6bd
Content-Type: text/plain; charset=ISO-8859-1

Hi Hemanth,

I thought of that but I didn't test it because I need the same for the job
id. Of course, I could generate my own id but I don't like that solution. I
will look at hadoop.tmp.dir to see if it can solve my issue differently.

Regards

Bertrand

On Fri, Sep 14, 2012 at 5:54 AM, Hemanth Yamijala <yhemanth@thoughtworks.com
> wrote:

> Hi Bretrand,
>
> Could you try using user.name as a property in the value of the config
> item ? Something like /user/${user.name}/history ?
>
> Thanks
> hemanth
>
>
> On Thu, Sep 13, 2012 at 5:46 PM, Bertrand Dechoux <dechouxb@gmail.com>wrote:
>
>> Hi,
>>
>> I would like to be able to fully isolate the quota of each user.
>> That is, I would like to put everything related to a user into her/his
>> home directory /user/<user>.
>>
>> Among other points of configuration, I would like to be able to configure
>> hadoop.job.history.user.location.
>> But I can't see how it could be done.
>>
>> How can I have a different path for each user?
>> How do I make sure that each job will still have its own directory? (Even
>> when no output dir is defined for the job.)
>>
>> Other question, slightly related. If I deactivate those logs using the
>> "none" configuration, it should only impact the copy of the user, should it
>> not?
>> The user should still be able to browse the logs using the version
>> provided through the jobtracker web interface, should it not?
>>
>> Regards
>>
>> Bertrand
>>
>
>


-- 
Bertrand Dechoux

--00248c6a66c2e803fd04c9a2d6bd
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

<div>Hi=A0Hemanth,</div><div><br></div>I thought of that but I didn&#39;t t=
est it because I need the same for the job id. Of course, I could generate =
my own id but I don&#39;t like that solution. I will look at hadoop.tmp.dir=
 to see if it can solve my issue differently.<div>
<br></div><div>Regards</div><div><br></div><div>Bertrand<br><br><div class=
=3D"gmail_quote">On Fri, Sep 14, 2012 at 5:54 AM, Hemanth Yamijala <span di=
r=3D"ltr">&lt;<a href=3D"mailto:yhemanth@thoughtworks.com" target=3D"_blank=
">yhemanth@thoughtworks.com</a>&gt;</span> wrote:<br>
<blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1p=
x #ccc solid;padding-left:1ex">Hi Bretrand,<div><br></div><div>Could you tr=
y using <a href=3D"http://user.name" target=3D"_blank">user.name</a> as a p=
roperty in the value of the config item ? Something like /user/${<a href=3D=
"http://user.name" target=3D"_blank">user.name</a>}/history ?</div>
<div>
<br></div><div>Thanks</div><div><span class=3D"HOEnZb"><font color=3D"#8888=
88">hemanth</font></span><div><div class=3D"h5"><br><br><div class=3D"gmail=
_quote">On Thu, Sep 13, 2012 at 5:46 PM, Bertrand Dechoux <span dir=3D"ltr"=
>&lt;<a href=3D"mailto:dechouxb@gmail.com" target=3D"_blank">dechouxb@gmail=
.com</a>&gt;</span> wrote:<br>

<blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1p=
x #ccc solid;padding-left:1ex">Hi,<br><br>I would like to be able to fully =
isolate the quota of each user.<br>That is, I would like to put everything =
related to a user into her/his home directory /user/&lt;user&gt;.<br>

<br>Among other points of configuration, I would like to be able to configu=
re hadoop.job.history.user.location.<br>
But I can&#39;t see how it could be done.<br><br>How can I have a different=
 path for each user?<br>How do I make sure that each job will still have it=
s own directory? (Even when no output dir is defined for the job.)<br>

<br>
Other question, slightly related. If I deactivate those logs using the &quo=
t;none&quot; configuration, it should only impact the copy of the user, sho=
uld it not?<br>The user should still be able to browse the logs using the v=
ersion provided through the jobtracker web interface, should it not?<br>


<br>Regards<span><font color=3D"#888888"><br><br>Bertrand<br>
</font></span></blockquote></div><br></div></div></div>
</blockquote></div><br><br clear=3D"all"><div><br></div>-- <br>Bertrand Dec=
houx<br>
</div>

--00248c6a66c2e803fd04c9a2d6bd--