hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andrew Wang <andrew.w...@cloudera.com>
Subject Re: Local repo sharing for maven builds
Date Mon, 28 Sep 2015 06:50:17 GMT
I think the right route is to file an INFRA JIRA with this request. Not
entirely sure since at one point the Hadoop build infra was separately
managed by Yahoo, but I think as of late it's under Apache administration.

Best,
Andrew

On Fri, Sep 25, 2015 at 9:43 PM, Vinayakumar B <vinayakumarb@apache.org>
wrote:

> Thanks Andrew,
>
> May be we can try making it to 1 exec, and try for sometime. i think also
> need to check what other jobs, hadoop ecosystem jobs, run in Hadoop nodes.
> As HADOOP-11984 and HDFS-9139 are on the way to reduce build time
> dramatically by enabling parallel tests, HDFS and COMMON precommit builds
> will not block other builds for much time.
>
> To check, I dont have access to jenkins configuration. If I can get the
> access I can reduce it myself and verify.
>
>
> -Vinay
>
> On Sat, Sep 26, 2015 at 7:49 AM, Andrew Wang <andrew.wang@cloudera.com>
> wrote:
>
> > Thanks for checking Vinay. As a temporary workaround, could we reduce
> the #
> > of execs per node to 1? Our build queues are pretty short right now, so I
> > don't think it would be too bad.
> >
> > Best,
> > Andrew
> >
> > On Wed, Sep 23, 2015 at 12:18 PM, Vinayakumar B <vinayakumarb@apache.org
> >
> > wrote:
> >
> > > In case if we are going to have separate repo for each executor,
> > >
> > > I have checked, each jenkins node is allocated 2 executors. so we only
> > need
> > > to create one more replica.
> > >
> > > Regards,
> > > Vinay
> > >
> > > On Wed, Sep 23, 2015 at 7:33 PM, Steve Loughran <
> stevel@hortonworks.com>
> > > wrote:
> > >
> > > >
> > > > > On 22 Sep 2015, at 16:39, Colin P. McCabe <cmccabe@apache.org>
> > wrote:
> > > > >
> > > > >> ANNOUNCEMENT: new patches which contain hard-coded ports in test
> > runs
> > > > will henceforth be reverted. Jenkins matters more than the 30s of
> your
> > > time
> > > > it takes to use the free port finder methods. Same for any hard code
> > > paths
> > > > in filesystems.
> > > > >
> > > > > +1.  Can you add this to HowToContribute on the wiki?  Or should
we
> > > > > vote on it first?
> > > >
> > > > I don't think we need to vote on it: hard code ports should be
> > something
> > > > we veto on patches anyway.
> > > >
> > > > In https://issues.apache.org/jira/browse/HADOOP-12143 I propose
> > having a
> > > > better style guide in the docs.
> > > >
> > > >
> > > >
> > >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message