hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "lohit vijayarenu (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-1952) Streaming does not handle invalid -inputformat (typo by users for example)
Date Fri, 26 Oct 2007 05:36:50 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-1952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12537838
] 

lohit vijayarenu commented on HADOOP-1952:
------------------------------------------

Ok, I should have mentioned that StreamUtil.goodClassOrNull actually is used to check if the
map command passed is a class or an executable. So, -mapper could have either a class or just
an executable. So, if that is not a valid class, a null (as the method name indicates) is
returned and StreamJob treats it as a map executable. How about logging at info level inside
the goodClassOrNull class and instead of throwing an exception we fail at appropriate places,
when we do not allow null? If so, I will modify that and submit a patch.

> Streaming does not handle invalid -inputformat  (typo by users for example)
> ---------------------------------------------------------------------------
>
>                 Key: HADOOP-1952
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1952
>             Project: Hadoop
>          Issue Type: Bug
>          Components: contrib/streaming
>    Affects Versions: 0.14.1
>            Reporter: lohit vijayarenu
>            Assignee: lohit vijayarenu
>            Priority: Minor
>             Fix For: 0.16.0
>
>         Attachments: CatchInvalidInputFormat.patch
>
>
> Hadoop Streaming does not handle invalid inputformat class. For example -inputformat
INVALID class would not be thrown as an error. Instead it defaults to StreamInputFormat. If
an invalid inputformat is specified, it is good to fail. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message