hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Devaraj Das (JIRA)" <j...@apache.org>
Subject [jira] Issue Comment Edited: (HADOOP-3743) -libjars, -files and -archives options do not work with 0.18
Date Sun, 13 Jul 2008 05:37:31 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-3743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12613152#action_12613152
] 

devaraj edited comment on HADOOP-3743 at 7/12/08 10:36 PM:
---------------------------------------------------------------

I think we should have users move to the style of the hadoop examples programs (e.g. o.a.h.e.RandomWriter)
which implements Tool and all that. I can't see any other way other than hacking a solution
to work around this constraint and HADOOP-3417 had actually removed that hack. I think long
term it makes sense to have the users migrate to implement apps using Tool, etc. That includes
the framework client classes o.a.h.s.StreamJob and o.a.h.m.p.Submitter as Amareshwari pointed
out.

I understand that we have broken 0.17 java apps that use -files, -achives, and -libjars arguments
and don't implement Tool, but unless we revert HADOOP-3417, I can't see how we can provide
this functionality.

Till the time user apps are moved to implementing Tool, with 0.18 and beyond, users could
set the values for the options tmpfiles, tmparchives and tmpjars in the configuration they
use to submit jobs (that's what the three arguments, -files, -archives and -jars, do).

Thoughts?


      was (Author: devaraj):
    I think we should have users move to the style of the hadoop examples programs (e.g. o.a.h.e.RandomWriter)
which implements Tool and all that. I can't see any other way other than hacking a solution
to work around this constraint and that was the reason why HADOOP-3417 was done. I think long
term it makes sense to have the users migrate to implement apps using Tool, etc. That includes
the framework client classes o.a.h.s.StreamJob and o.a.h.m.p.Submitter as Amareshwari pointed
out.

I understand that we have broken 0.17 apps that use -files, -achives, and -libjars arguments
but unless we revert HADOOP-3417, I can't see how we can achieve this. 

Till the time user apps are moved to implementing Tool, with 0.18, users could set the values
for the options tmpfiles, tmparchives and tmpjars in the configuration they use to submit
jobs (that's what the three arguments, -files, -archives and -jars, do).

Thoughts?

  
> -libjars, -files and -archives options do not work with 0.18
> ------------------------------------------------------------
>
>                 Key: HADOOP-3743
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3743
>             Project: Hadoop Core
>          Issue Type: Bug
>    Affects Versions: 0.17.0
>            Reporter: Mahadev konar
>            Assignee: Amareshwari Sriramadasu
>            Priority: Blocker
>             Fix For: 0.18.0
>
>         Attachments: patch-3743.txt
>
>
> I am not sure how to get -libjars and -files working with 0.18. I tried all the options
but cannot get it runnning. I am filing this as a blocker until we find out that its not broken.
-- in that case we need to update the docs with an example to say how it works. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message