crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Matthias Friedrich (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CRUNCH-206) Upgrade to Hadoop 1.1.2
Date Tue, 14 May 2013 06:39:16 GMT

    [ https://issues.apache.org/jira/browse/CRUNCH-206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13656855#comment-13656855
] 

Matthias Friedrich commented on CRUNCH-206:
-------------------------------------------

Amazing! The whole test suite takes 5:30 on 1.1.2 on my developer workstation :)

I have verified that there have been no relevant dependency changes in Hadoop and that the
HBase dependency situation has improved (Avro versions still diverge though). HBase even downgraded
their slf4j for Hadoop compatibility, nice. So, +1
                
> Upgrade to Hadoop 1.1.2
> -----------------------
>
>                 Key: CRUNCH-206
>                 URL: https://issues.apache.org/jira/browse/CRUNCH-206
>             Project: Crunch
>          Issue Type: Bug
>          Components: Core
>    Affects Versions: 0.7.0
>            Reporter: Josh Wills
>            Assignee: Josh Wills
>             Fix For: 0.7.0
>
>         Attachments: CRUNCH-206.patch
>
>
> Hadoop 1.1.x has a fix that makes the LocalJobRunner run much faster, which dramatically
improves the performance of running Crunch's integration tests in local mode.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message