Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: common-dev@hadoop.apache.org
Received-SPF: pass (nike.apache.org: domain of cnauroth@hortonworks.com
 designates 209.85.216.176 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CANJr2=GWD5C1vxNJNrYErH3WLFebKneWRGbYCyOAZWaqF9rrqw@mail.gmail.com>
References: 
 <CANJr2=FuA2HSCYaLnCKOm-+AD2t5GFHA4nqTf46mkO2V-m8_xw@mail.gmail.com>
	<CANJr2=H8VSTJHtCigb9Hb7Vi-RRNW=kDedX6g=AerFwmrMBe3w@mail.gmail.com>
	<CABCYYb_ukycQWqNcDcSAoAuunkH4qHp9on1dpJjdkQV6kFxNTA@mail.gmail.com>
	<CANJr2=GWD5C1vxNJNrYErH3WLFebKneWRGbYCyOAZWaqF9rrqw@mail.gmail.com>
Date: Thu, 10 Jul 2014 09:53:48 -0700
Message-ID: 
 <CABCYYb8S86ftOqR-4NYxxJOhsY8J5vrr9tkyBPdZt9FLBCRPrA@mail.gmail.com>
Subject: Re: Jenkins Build Slaves
From: Chris Nauroth <cnauroth@hortonworks.com>
To: Giridharan Kesavan <gkesavan@hortonworks.com>
Cc: "mapreduce-dev@hadoop.apache.org" <mapreduce-dev@hadoop.apache.org>,
	"hdfs-dev@hadoop.apache.org" <hdfs-dev@hadoop.apache.org>,
	"yarn-dev@hadoop.apache.org" <yarn-dev@hadoop.apache.org>,
 HBase Dev List <DEV@hbase.apache.org>,
	dev@zookeeper.apache.org, dev@pig.apache.org,
 dev@falcon.incubator.apache.org,
	dev@oozie.apache.org, dev@tez.incubator.apache.org,
	"common-dev@hadoop.apache.org" <common-dev@hadoop.apache.org>
Content-Type: multipart/alternative; boundary=001a11c2d6002d420504fdd9abd3

--001a11c2d6002d420504fdd9abd3
Content-Type: text/plain; charset=UTF-8

Thanks, Giri, for taking care of pkgconfig.

It looks like most (all?) pre-commit builds have some new failing tests:

https://builds.apache.org/job/PreCommit-HADOOP-Build/4247/testReport/

On the symlink tests, is there any chance that the new hosts have a
different version/different behavior for the ln command?

The TestIPC failure is in a stress test that checks behavior after spamming
a lot of connections at an RPC server.  Maybe the new hosts have something
different in the TCP stack, such as TCP backlog?

I likely won't get a chance to investigate any more today, but I wanted to
raise the issue in case someone else gets an opportunity to look.

Chris Nauroth
Hortonworks
http://hortonworks.com/


On Wed, Jul 9, 2014 at 10:33 AM, Giridharan Kesavan <
gkesavan@hortonworks.com> wrote:

> I dont think so, let me fix that. Thanks Chris for pointing that out.
>
>
> -giri
>
>
> On Wed, Jul 9, 2014 at 9:50 AM, Chris Nauroth <cnauroth@hortonworks.com>
> wrote:
>
>> Hi Giri,
>>
>> Is pkgconfig deployed on the new Jenkins slaves?  I noticed this build
>> failed:
>>
>> https://builds.apache.org/job/PreCommit-HADOOP-Build/4237/
>>
>> Looking in the console output, it appears the HDFS native code failed to
>> build due to missing pkgconfig.
>>
>>      [exec] CMake Error at
>> /usr/share/cmake-2.8/Modules/FindPackageHandleStandardArgs.cmake:108
>> (message):
>>      [exec]   Could NOT find PkgConfig (missing: PKG_CONFIG_EXECUTABLE)
>>
>> Chris Nauroth
>> Hortonworks
>> http://hortonworks.com/
>>
>>
>>
>> On Wed, Jul 9, 2014 at 7:08 AM, Giridharan Kesavan <
>> gkesavan@hortonworks.com> wrote:
>>
>>> Build jobs are now configured to run on the newer set of slaves.
>>>
>>>
>>>
>>> -giri
>>>
>>>
>>> On Mon, Jul 7, 2014 at 4:12 PM, Giridharan Kesavan <
>>> gkesavan@hortonworks.com
>>> > wrote:
>>>
>>> > All
>>> >
>>> > Yahoo is in the process of retiring all the hadoop jenkins build
>>> slaves,
>>> > *hadoop[1-9]* and
>>>
>>> > replace them with a newer set of beefier hosts. These new machines are
>>> > configured
>>> > with *ubuntu-14.04*.
>>>
>>> >
>>> > Over the next couple of days I will be configuring the build jobs to
>>> run
>>> > on these newly
>>> > configured build slaves.  To automate the installation of tools and
>>> build
>>> > libraries I have
>>> > put together ansible scripts and here is the link to the toolchain
>>> repo.
>>> >
>>> >
>>> > *https://github.com/apache/toolchain <
>>> https://github.com/apache/toolchain>
>>>
>>> > *
>>> >
>>> > During the transition, the old build slave will be accessible, and
>>> > expected to be shutdown by 07/15.
>>> >
>>> > I will send out an update later this week when this transition is
>>> > complete.
>>> >
>>> > *Mean while, I would like to request the project owners to
>>> remove/cleanup
>>> > any stale *
>>> > *jenkins job for their respective project and help with any builds
>>> issue
>>> > to make this *
>>> > *transition seamless. *
>>> >
>>> > Thanks
>>> >
>>> > -
>>> > Giri
>>> >
>>>
>>> --
>>> CONFIDENTIALITY NOTICE
>>> NOTICE: This message is intended for the use of the individual or entity
>>> to
>>> which it is addressed and may contain information that is confidential,
>>> privileged and exempt from disclosure under applicable law. If the reader
>>> of this message is not the intended recipient, you are hereby notified
>>> that
>>> any printing, copying, dissemination, distribution, disclosure or
>>> forwarding of this communication is strictly prohibited. If you have
>>> received this communication in error, please contact the sender
>>> immediately
>>> and delete it from your system. Thank You.
>>>
>>
>>
>

-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.

--001a11c2d6002d420504fdd9abd3--