incubator-blur-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Aaron McCurry <amccu...@gmail.com>
Subject Re: CDH5 MR1
Date Wed, 02 Jul 2014 19:35:35 GMT
Steve,

After a few small code changes and some pom updates Blur now works with
cdh5-mr1.

https://builds.apache.org/job/Blur-master-jdk7-hadoop2-mr1/7/

https://builds.apache.org/job/Blur-master-jdk7-hadoop2-mr1/7/org.apache.blur$apache-blur/

Aaron


On Mon, Jun 30, 2014 at 3:38 PM, Aaron McCurry <amccurry@gmail.com> wrote:

> Sure we can do that.  I will let you know what I find.
>
> Aaron
>
>
> On Mon, Jun 30, 2014 at 3:36 PM, Sak, Steve <ssak@integrity-apps.com>
> wrote:
>
>>
>> The testing would be enormously helpful if you had CHD5 configured to use
>> MR1 as opposed to YARN, less so against straight CDH5.
>>
>> -- Steve
>>
>> ________________________________________
>> From: Aaron McCurry [amccurry@gmail.com]
>> Sent: Monday, June 30, 2014 3:27 PM
>> To: blur-dev@incubator.apache.org
>> Subject: Re: CDH5 MR1
>>
>> On Mon, Jun 30, 2014 at 3:24 PM, Sak, Steve <ssak@integrity-apps.com>
>> wrote:
>>
>> >
>> > Aaron,
>> >
>> > It's not CDH5 per se that is raising the risk profile but rather
>> > Cloudera's implementation of Map Reduce 1 with CDH5.  They have custom
>> libs
>> > built for hadoop-core, hadoop-minicluster, hadoop-client, and
>> hadoop-test
>> > all versioned as 2.3.0-mr1-cdh5.0.2 as well as all the MR1 daemons (NN,
>> TT,
>> > JT) using the hadoop2 filesystem.
>> >
>>
>> I don't mind testing Blur against CDH5 if you would like...  Would that
>> help?  Or no?
>>
>> Aaron
>>
>>
>>
>> >
>> > -- Steve
>> >
>> > ________________________________________
>> > From: Aaron McCurry [amccurry@gmail.com]
>> > Sent: Monday, June 30, 2014 3:10 PM
>> > To: blur-dev@incubator.apache.org
>> > Subject: Re: CDH5 MR1
>> >
>> > On Mon, Jun 30, 2014 at 2:33 PM, Sak, Steve <ssak@integrity-apps.com>
>> > wrote:
>> >
>> > >
>> > > Has anyone gotten Blur built against Cloudera CDH5 using the MR1
>> > libraries
>> > > and done any testing?  How likely is it to work?  I'm close to passing
>> > the
>> > > unit tests but the poms are a hodgepodge and our project is quickly
>> > > approaching a decision point as to what direction to take.  We were
>> > > thinking that CDH5 MR1 would provide a medium risk option on the road
>> to
>> > > Hadoop 2 and Yarn but perhaps were too low in our risk assessment.
>> > >
>> >
>> > We currently run hadoop2 builds CI on Apache's servers.  The build run's
>> > against hadoop 2.2.0 and I have successfully run Blur on HDP 2.1 (based
>> on
>> > hadoop 2.4.0).  I don't mind running the tests and minicluster against
>> CDH5
>> > if this will help in your decision making process.
>> >
>> > https://builds.apache.org/job/Blur-master-jdk7-hadoop2/
>> >
>> > Thanks!
>> >
>> > Aaron
>> >
>> >
>> > >
>> > > Thanks,
>> > >
>> > > Steve
>> > >
>> >
>>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message