Return-Path: X-Original-To: apmail-hbase-dev-archive@www.apache.org Delivered-To: apmail-hbase-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id C21EF11094 for ; Thu, 10 Jul 2014 18:47:36 +0000 (UTC) Received: (qmail 12190 invoked by uid 500); 10 Jul 2014 18:47:35 -0000 Delivered-To: apmail-hbase-dev-archive@hbase.apache.org Received: (qmail 12111 invoked by uid 500); 10 Jul 2014 18:47:35 -0000 Mailing-List: contact dev-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hbase.apache.org Delivered-To: mailing list dev@hbase.apache.org Received: (qmail 12000 invoked by uid 99); 10 Jul 2014 18:47:35 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 10 Jul 2014 18:47:35 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of gkesavan@hortonworks.com designates 209.85.220.169 as permitted sender) Received: from [209.85.220.169] (HELO mail-vc0-f169.google.com) (209.85.220.169) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 10 Jul 2014 18:47:33 +0000 Received: by mail-vc0-f169.google.com with SMTP id la4so11434154vcb.14 for ; Thu, 10 Jul 2014 11:47:08 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to:cc:content-type; bh=fB7APrBSuD3L2K0yqPlmSfFGJ7/RHywvzx0wIu+nC3Y=; b=A8OEUayyVzqvZEUFOsX9Q2cUmaPR256NYpc8MvG5tvOSjcWxT0WwEph+oWNscEHR1L zZH55lsyUKENXyF9JuU8DgTtRv07RZbPShNBT/ImHZZZvZ3OVQighky5efQz1ggO7Q8B wRzlOuJYOeK0aU8U9Nfxx9fcOMGzKCR5QJp5Kf6jCEQfb5Pbhgj5RYFE3YrkFkbRp/4U OEmd3UIpH2ciBwE5V1w2TxogYyuUqQyl0EEIj6ZY8j0yecwL5VjQ0JrP0OY4is6Qx0kJ ruRHxOGFaglB7FEVy9lZSyEvCFxUUm3DlIqTFCBMR0ZkukW//Rj2OdZQ3wkamwNsEyvm cb6Q== X-Gm-Message-State: ALoCoQmW7CJh0y0tSekb90fe9LCLqG19f4t2i1fomDG3zxUmXCcHk9isscHPvgz0+kgeZpxheZQHdZgF+/G0FWUxCzydeAbnBWT5UqpPBhnes3ErLP+VSoQ= MIME-Version: 1.0 X-Received: by 10.52.253.140 with SMTP id aa12mr17340728vdd.11.1405018028324; Thu, 10 Jul 2014 11:47:08 -0700 (PDT) Received: by 10.58.196.50 with HTTP; Thu, 10 Jul 2014 11:47:08 -0700 (PDT) In-Reply-To: References: Date: Thu, 10 Jul 2014 11:47:08 -0700 Message-ID: Subject: Re: Jenkins Build Slaves From: Giridharan Kesavan To: Chris Nauroth Cc: "mapreduce-dev@hadoop.apache.org" , "hdfs-dev@hadoop.apache.org" , "yarn-dev@hadoop.apache.org" , HBase Dev List , dev@zookeeper.apache.org, dev@pig.apache.org, dev@falcon.incubator.apache.org, dev@oozie.apache.org, dev@tez.incubator.apache.org, "common-dev@hadoop.apache.org" Content-Type: multipart/alternative; boundary=001a1135edda7b4fdd04fddb402a X-Virus-Checked: Checked by ClamAV on apache.org --001a1135edda7b4fdd04fddb402a Content-Type: text/plain; charset=UTF-8 Chris, Newer hosts are on ubuntu-14.04 and I'm not aware of any ln related change there. Please let me know if you need any help with debugging the hosts. -giri On Thu, Jul 10, 2014 at 9:53 AM, Chris Nauroth wrote: > Thanks, Giri, for taking care of pkgconfig. > > It looks like most (all?) pre-commit builds have some new failing tests: > > https://builds.apache.org/job/PreCommit-HADOOP-Build/4247/testReport/ > > On the symlink tests, is there any chance that the new hosts have a > different version/different behavior for the ln command? > > The TestIPC failure is in a stress test that checks behavior after > spamming a lot of connections at an RPC server. Maybe the new hosts have > something different in the TCP stack, such as TCP backlog? > > I likely won't get a chance to investigate any more today, but I wanted to > raise the issue in case someone else gets an opportunity to look. > > Chris Nauroth > Hortonworks > http://hortonworks.com/ > > > > On Wed, Jul 9, 2014 at 10:33 AM, Giridharan Kesavan < > gkesavan@hortonworks.com> wrote: > >> I dont think so, let me fix that. Thanks Chris for pointing that out. >> >> >> -giri >> >> >> On Wed, Jul 9, 2014 at 9:50 AM, Chris Nauroth >> wrote: >> >>> Hi Giri, >>> >>> Is pkgconfig deployed on the new Jenkins slaves? I noticed this build >>> failed: >>> >>> https://builds.apache.org/job/PreCommit-HADOOP-Build/4237/ >>> >>> Looking in the console output, it appears the HDFS native code failed to >>> build due to missing pkgconfig. >>> >>> [exec] CMake Error at >>> /usr/share/cmake-2.8/Modules/FindPackageHandleStandardArgs.cmake:108 >>> (message): >>> [exec] Could NOT find PkgConfig (missing: PKG_CONFIG_EXECUTABLE) >>> >>> Chris Nauroth >>> Hortonworks >>> http://hortonworks.com/ >>> >>> >>> >>> On Wed, Jul 9, 2014 at 7:08 AM, Giridharan Kesavan < >>> gkesavan@hortonworks.com> wrote: >>> >>>> Build jobs are now configured to run on the newer set of slaves. >>>> >>>> >>>> >>>> -giri >>>> >>>> >>>> On Mon, Jul 7, 2014 at 4:12 PM, Giridharan Kesavan < >>>> gkesavan@hortonworks.com >>>> > wrote: >>>> >>>> > All >>>> > >>>> > Yahoo is in the process of retiring all the hadoop jenkins build >>>> slaves, >>>> > *hadoop[1-9]* and >>>> >>>> > replace them with a newer set of beefier hosts. These new machines are >>>> > configured >>>> > with *ubuntu-14.04*. >>>> >>>> > >>>> > Over the next couple of days I will be configuring the build jobs to >>>> run >>>> > on these newly >>>> > configured build slaves. To automate the installation of tools and >>>> build >>>> > libraries I have >>>> > put together ansible scripts and here is the link to the toolchain >>>> repo. >>>> > >>>> > >>>> > *https://github.com/apache/toolchain < >>>> https://github.com/apache/toolchain> >>>> >>>> > * >>>> > >>>> > During the transition, the old build slave will be accessible, and >>>> > expected to be shutdown by 07/15. >>>> > >>>> > I will send out an update later this week when this transition is >>>> > complete. >>>> > >>>> > *Mean while, I would like to request the project owners to >>>> remove/cleanup >>>> > any stale * >>>> > *jenkins job for their respective project and help with any builds >>>> issue >>>> > to make this * >>>> > *transition seamless. * >>>> > >>>> > Thanks >>>> > >>>> > - >>>> > Giri >>>> > >>>> >>>> -- >>>> CONFIDENTIALITY NOTICE >>>> NOTICE: This message is intended for the use of the individual or >>>> entity to >>>> which it is addressed and may contain information that is confidential, >>>> privileged and exempt from disclosure under applicable law. If the >>>> reader >>>> of this message is not the intended recipient, you are hereby notified >>>> that >>>> any printing, copying, dissemination, distribution, disclosure or >>>> forwarding of this communication is strictly prohibited. If you have >>>> received this communication in error, please contact the sender >>>> immediately >>>> and delete it from your system. Thank You. >>>> >>> >>> >> > -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You. --001a1135edda7b4fdd04fddb402a--