incubator-blur-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Aaron McCurry (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (BLUR-107) Create checkOutputSpecs check in the BlurOutputFormat
Date Sat, 25 May 2013 18:07:20 GMT

    [ https://issues.apache.org/jira/browse/BLUR-107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13667146#comment-13667146
] 

Aaron McCurry commented on BLUR-107:
------------------------------------

The validation for the reducers should be, if it's 0 then it's not running any reducers so
don't check.  If the reducers are greater than 0 then they need to be equal to the number
of shards time the reducer multipler which you can read from BlurOutputFormat.getReducerMultiplier(conf);

I just added the getReducerMultiplier method.

All the other validation logic looks good.

Aaron
                
> Create checkOutputSpecs check in the BlurOutputFormat
> -----------------------------------------------------
>
>                 Key: BLUR-107
>                 URL: https://issues.apache.org/jira/browse/BLUR-107
>             Project: Apache Blur
>          Issue Type: Bug
>    Affects Versions: 0.1.5
>            Reporter: Aaron McCurry
>             Fix For: 0.1.5
>
>
> Using the checkOutputSpecs method on the BlurOutputFormat validate that the number of
reducers is valid number.  Also check that the Blur table exists and that the number of shards
in the FS match the table descriptor.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message