www-infrastructure-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Doug Cutting (JIRA)" <j...@apache.org>
Subject [jira] Commented: (INFRA-1844) Request new Hadoop build machine
Date Tue, 06 Jan 2009 19:44:44 GMT

    [ https://issues.apache.org/jira/browse/INFRA-1844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12661274#action_12661274

Doug Cutting commented on INFRA-1844:

There are two parts to this:

1. A request: Can we get one or more of the newly donated boxes allocated as Hudson executors?

2. A proposal: Once (1) is complete, a Hudson admin (Nigel) would like to dedicate one executor
to Hadoop, since its builds currently consume the majority of resources and are the least
reliable.  Isolating Hadoop will make things more reliable and performant for other projects,
decreasing the volume of complaints.  If we use round-robin scheduling of builds accross all
executors that will not help the current situation where Hadoop builds frequently hang things
for everyone else.

The second issue is a Hudson configuration issue that can be revisited over time.  The new
executor should not be specially configured for Hadoop.

> Request new Hadoop build machine
> --------------------------------
>                 Key: INFRA-1844
>                 URL: https://issues.apache.org/jira/browse/INFRA-1844
>             Project: Infrastructure
>          Issue Type: Wish
>      Security Level: public(Regular issues) 
>          Components: Hudson, Zones
>            Reporter: Nigel Daley
> Now that Yahoo! has donated some hardware to ASF, would it be possible to get a dedicated
build machine for the Hadoop project?  We would make this machine a dedicated build slave
of the hudson.zones.apache.org (ala lucene.zones.apache.org).
> Rationale is as follows:
> - volume of sub-project builds:
>    - Hadoop Core
>    - Hadoop MapReduce
>    - Hadoop DFS
>    - Pig
>    - Hive
>    - ZooKeeper
>    - HBase
> - volume of patch builds (patches are built and tested before commit)
> - isolation from other builds and build environments
> - support for Hadoop's official build platform (Linux)
> Thanks,
> Nigel Daley
> Hadoop PMC

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message