tajo-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Hyunsik Choi <hyunsik.c...@gmail.com>
Subject Re: [FYI] Apache Slider app package for Tajo
Date Wed, 19 Nov 2014 10:10:46 GMT
Hi folks,

I updated the branch. I tested this Slider application for Tajo on Slider
0.60 and Hadoop 2.6.0 which will be released soon.

I'm going to briefly explain how to test my Slider work.

First of all, you need to prepare Tajo compatible with Hadoop 2.6.0. Hadoop
2.6.0 has some trivial API break change. As a result, we need to make
Tajo 0.9.1 compatible with Hadoop 2.6.0. Now, I recommend you to use some
Tajo branch made by Jaehwa. You can get the source code as follows:

git clone -b TAJO-1166 https://github.com/blrunner/tajo.git

Then, you can build Tajo and make a Tajo tarball through maven as follows:

$ cd tajo-0.9.1-SNAPSHOT
$ mvn clean package -DskipTests -Dhadoop.version=2.6.0-SNAPSHOT -Pdist -Dtar
$ ls -l tajo-dist/target/tajo-0.9.1-SNAPSHOT.tar.gz

Next, you can download my Slider work as follows:
git clone -b tajo-slider https://github.com/hyunsik/incubator-slider

You can also make the Slider application package for Tajo in my working
source as follows:

$ cd incubator-slider
$ mvn package -DskipTests -Ptajo-app-package
-Dtajo-version=0.9.1-SNAPSHOT -Dpkg.version=0.9.1-SNAPSHOT

This Slider application just uses Tajo tarball distribution generated by

Then, you can install the tajo app to Slider as follows:
bin/slider install-package --replacepkg --name tajo
--package ../incubator-slider/app-packages/tajo/target/slider-tajo-app-package-0.9.1-SNAPSHOT.zip

Finally, you can start a Tajo cluster named 'tajo1' as follows:
bin/slider create tajo1 --template tajoConfig.json --resources

You can also get tajoConfig.json and resource.json that I used from
the below links:
* tajoConfig.json: https://gist.github.com/hyunsik/8f4ef0e097f7e9053065
* resource.json file: https://gist.github.com/hyunsik/7783318cdcf4d1eac89e

Warm regards,

On Tue, Nov 18, 2014 at 1:14 AM, Jihoon Son <jihoonson@apache.org> wrote:

> Awesome!
> Thanks for your effort!
> Sincerely,
> Jihoon
> 2014-11-18 18:13 GMT+09:00 Hyunsik Choi <hyunsik@apache.org>:
> > Hi folks,
> >
> > I'm working on Slider application package for Tajo. Slider is a YARN
> > application to deploy existing distributed applications on YARN. With
> > Slider, you can easily deploy Tajo on your Yarn cluster.
> >
> > https://github.com/hyunsik/incubator-slider/tree/tajo
> >
> > It's still an on-going work, and so it is still buggy. After I finish
> > it, I'll submit the patch to Slider community. I'll share some
> > documentation soon with you guys.
> >
> > Best regards,
> > Hyunsik
> >

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message