incubator-blur-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Aaron McCurry <amccu...@gmail.com>
Subject Re: CDH5 MR1
Date Mon, 30 Jun 2014 19:38:23 GMT
Sure we can do that.  I will let you know what I find.

Aaron


On Mon, Jun 30, 2014 at 3:36 PM, Sak, Steve <ssak@integrity-apps.com> wrote:

>
> The testing would be enormously helpful if you had CHD5 configured to use
> MR1 as opposed to YARN, less so against straight CDH5.
>
> -- Steve
>
> ________________________________________
> From: Aaron McCurry [amccurry@gmail.com]
> Sent: Monday, June 30, 2014 3:27 PM
> To: blur-dev@incubator.apache.org
> Subject: Re: CDH5 MR1
>
> On Mon, Jun 30, 2014 at 3:24 PM, Sak, Steve <ssak@integrity-apps.com>
> wrote:
>
> >
> > Aaron,
> >
> > It's not CDH5 per se that is raising the risk profile but rather
> > Cloudera's implementation of Map Reduce 1 with CDH5.  They have custom
> libs
> > built for hadoop-core, hadoop-minicluster, hadoop-client, and hadoop-test
> > all versioned as 2.3.0-mr1-cdh5.0.2 as well as all the MR1 daemons (NN,
> TT,
> > JT) using the hadoop2 filesystem.
> >
>
> I don't mind testing Blur against CDH5 if you would like...  Would that
> help?  Or no?
>
> Aaron
>
>
>
> >
> > -- Steve
> >
> > ________________________________________
> > From: Aaron McCurry [amccurry@gmail.com]
> > Sent: Monday, June 30, 2014 3:10 PM
> > To: blur-dev@incubator.apache.org
> > Subject: Re: CDH5 MR1
> >
> > On Mon, Jun 30, 2014 at 2:33 PM, Sak, Steve <ssak@integrity-apps.com>
> > wrote:
> >
> > >
> > > Has anyone gotten Blur built against Cloudera CDH5 using the MR1
> > libraries
> > > and done any testing?  How likely is it to work?  I'm close to passing
> > the
> > > unit tests but the poms are a hodgepodge and our project is quickly
> > > approaching a decision point as to what direction to take.  We were
> > > thinking that CDH5 MR1 would provide a medium risk option on the road
> to
> > > Hadoop 2 and Yarn but perhaps were too low in our risk assessment.
> > >
> >
> > We currently run hadoop2 builds CI on Apache's servers.  The build run's
> > against hadoop 2.2.0 and I have successfully run Blur on HDP 2.1 (based
> on
> > hadoop 2.4.0).  I don't mind running the tests and minicluster against
> CDH5
> > if this will help in your decision making process.
> >
> > https://builds.apache.org/job/Blur-master-jdk7-hadoop2/
> >
> > Thanks!
> >
> > Aaron
> >
> >
> > >
> > > Thanks,
> > >
> > > Steve
> > >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message