incubator-blur-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Aaron McCurry <amccu...@gmail.com>
Subject Re: CDH5 MR1
Date Thu, 03 Jul 2014 13:41:38 GMT
That's great.  Let us know if you have any issues.

Aaron


On Thu, Jul 3, 2014 at 9:17 AM, Sak, Steve <ssak@integrity-apps.com> wrote:

>
> Aaron,
>
> I was able to checkout and build the latest version on my machine at home
> successfully.  No worries about maven.
>
> -- Steve
>
> ________________________________________
> From: Aaron McCurry [amccurry@gmail.com]
> Sent: Wednesday, July 02, 2014 3:35 PM
> To: blur-dev@incubator.apache.org
> Subject: Re: CDH5 MR1
>
> Steve,
>
> After a few small code changes and some pom updates Blur now works with
> cdh5-mr1.
>
> https://builds.apache.org/job/Blur-master-jdk7-hadoop2-mr1/7/
>
>
> https://builds.apache.org/job/Blur-master-jdk7-hadoop2-mr1/7/org.apache.blur$apache-blur/
>
> Aaron
>
>
> On Mon, Jun 30, 2014 at 3:38 PM, Aaron McCurry <amccurry@gmail.com> wrote:
>
> > Sure we can do that.  I will let you know what I find.
> >
> > Aaron
> >
> >
> > On Mon, Jun 30, 2014 at 3:36 PM, Sak, Steve <ssak@integrity-apps.com>
> > wrote:
> >
> >>
> >> The testing would be enormously helpful if you had CHD5 configured to
> use
> >> MR1 as opposed to YARN, less so against straight CDH5.
> >>
> >> -- Steve
> >>
> >> ________________________________________
> >> From: Aaron McCurry [amccurry@gmail.com]
> >> Sent: Monday, June 30, 2014 3:27 PM
> >> To: blur-dev@incubator.apache.org
> >> Subject: Re: CDH5 MR1
> >>
> >> On Mon, Jun 30, 2014 at 3:24 PM, Sak, Steve <ssak@integrity-apps.com>
> >> wrote:
> >>
> >> >
> >> > Aaron,
> >> >
> >> > It's not CDH5 per se that is raising the risk profile but rather
> >> > Cloudera's implementation of Map Reduce 1 with CDH5.  They have custom
> >> libs
> >> > built for hadoop-core, hadoop-minicluster, hadoop-client, and
> >> hadoop-test
> >> > all versioned as 2.3.0-mr1-cdh5.0.2 as well as all the MR1 daemons
> (NN,
> >> TT,
> >> > JT) using the hadoop2 filesystem.
> >> >
> >>
> >> I don't mind testing Blur against CDH5 if you would like...  Would that
> >> help?  Or no?
> >>
> >> Aaron
> >>
> >>
> >>
> >> >
> >> > -- Steve
> >> >
> >> > ________________________________________
> >> > From: Aaron McCurry [amccurry@gmail.com]
> >> > Sent: Monday, June 30, 2014 3:10 PM
> >> > To: blur-dev@incubator.apache.org
> >> > Subject: Re: CDH5 MR1
> >> >
> >> > On Mon, Jun 30, 2014 at 2:33 PM, Sak, Steve <ssak@integrity-apps.com>
> >> > wrote:
> >> >
> >> > >
> >> > > Has anyone gotten Blur built against Cloudera CDH5 using the MR1
> >> > libraries
> >> > > and done any testing?  How likely is it to work?  I'm close to
> passing
> >> > the
> >> > > unit tests but the poms are a hodgepodge and our project is quickly
> >> > > approaching a decision point as to what direction to take.  We were
> >> > > thinking that CDH5 MR1 would provide a medium risk option on the
> road
> >> to
> >> > > Hadoop 2 and Yarn but perhaps were too low in our risk assessment.
> >> > >
> >> >
> >> > We currently run hadoop2 builds CI on Apache's servers.  The build
> run's
> >> > against hadoop 2.2.0 and I have successfully run Blur on HDP 2.1
> (based
> >> on
> >> > hadoop 2.4.0).  I don't mind running the tests and minicluster against
> >> CDH5
> >> > if this will help in your decision making process.
> >> >
> >> > https://builds.apache.org/job/Blur-master-jdk7-hadoop2/
> >> >
> >> > Thanks!
> >> >
> >> > Aaron
> >> >
> >> >
> >> > >
> >> > > Thanks,
> >> > >
> >> > > Steve
> >> > >
> >> >
> >>
> >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message