reef-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Douglas Service <dsop...@gmail.com>
Subject Re: Interested in contributing to reef--newbie
Date Thu, 09 Feb 2017 20:44:15 GMT
Do you have update-alternatives installed? Have you run update-alternatives
--config java?

Sorry I made a mistake in may last email, I actually have JAVA_HOME set to
/usr as listed on the webpage which figured out from Sergiy. However, I do
not need to set the other ones. It is important that our contributing to
REEF wiki be general and not specific to a single setup.

Here is my environment for building REEF on Ubuntu 16.04.

dougse@reefdevlx:/code/reef [master ↑]$$ env
MATE_DESKTOP_SESSION_ID=this-is-deprecated
XDG_SESSION_ID=c2
SHELL=/bin/bash
TERM=xterm
WINDOWID=44144243
USER=dougse
LS_COLORS=rs=0:di=01;34:ln=01;36:mh=00:pi=40;33:so=01;35:do=01;35:bd=40;33;01:cd=40;33;01:or=40;31;01:mi=00:su=37;41:sg=30;43:ca=30;41:tw=30;42:ow=34;42:st=37;44:ex=01;32:*.tar=01;31:*.tgz=01;31:*.arc=01;31:*.arj=01;31:*.taz=01;31:*.lha=01;31:*.lz4=01;31:*.lzh=01;31:*.lzma=01;31:*.tlz=01;31:*.txz=01;31:*.tzo=01;31:*.t7z=01;31:*.zip=01;31:*.z=01;31:*.Z=01;31:*.dz=01;31:*.gz=01;31:*.lrz=01;31:*.lz=01;31:*.lzo=01;31:*.xz=01;31:*.bz2=01;31:*.bz=01;31:*.tbz=01;31:*.tbz2=01;31:*.tz=01;31:*.deb=01;31:*.rpm=01;31:*.jar=01;31:*.war=01;31:*.ear=01;31:*.sar=01;31:*.rar=01;31:*.alz=01;31:*.ace=01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.cab=01;31:*.jpg=01;35:*.jpeg=01;35:*.gif=01;35:*.bmp=01;35:*.pbm=01;35:*.pgm=01;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:*.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=01;35:*.svgz=01;35:*.mng=01;35:*.pcx=01;35:*.mov=01;35:*.mpg=01;35:*.mpeg=01;35:*.m2v=01;35:*.mkv=01;35:*.webm=01;35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.vob=01;35:*.qt=01;35:*.nuv=01;35:*.wmv=01;35:*.asf=01;35:*.rm=01;35:*.rmvb=01;35:*.flc=01;35:*.avi=01;35:*.fli=01;35:*.flv=01;35:*.gl=01;35:*.dl=01;35:*.xcf=01;35:*.xwd=01;35:*.yuv=01;35:*.cgm=01;35:*.emf=01;35:*.ogv=01;35:*.ogx=01;35:*.aac=00;36:*.au=00;36:*.flac=00;36:*.m4a=00;36:*.mid=00;36:*.midi=00;36:*.mka=00;36:*.mp3=00;36:*.mpc=00;36:*.ogg=00;36:*.ra=00;36:*.wav=00;36:*.oga=00;36:*.opus=00;36:*.spx=00;36:*.xspf=00;36:
SSH_AUTH_SOCK=/run/user/1000/keyring/ssh
SESSION_MANAGER=local/reefdevlx:@
/tmp/.ICE-unix/3866,unix/reefdevlx:/tmp/.ICE-unix/3866
PATH=/home/dougse/bin:/bin:/usr/bin:/usr/X11R6/bin:/usr/local/bin
PWD=/code/reef
JAVA_HOME=/usr
LANG=en_US.UTF-8
REEF_HOME=/code/reef
SHLVL=1
HOME=/home/dougse
GTK_OVERLAY_SCROLLING=0
DBUS_SESSION_BUS_ADDRESS=unix:abstract=/tmp/dbus-l06bsMWGy0,guid=ae74bbce18102091c11c7bd458939d1c
UID=1000
LESSOPEN=| /bin/lesspipe %s
XDG_RUNTIME_DIR=/run/user/1000
DISPLAY=:10.0
XDG_CURRENT_DESKTOP=MATE
LESSCLOSE=/bin/lesspipe %s %s
COLORTERM=mate-terminal
_=/usr/bin/env


On Thu, Feb 9, 2017 at 7:41 PM, Saikat Kanjilal <sxk1969@gmail.com> wrote:

> Weird, yes I did read that pageand yes I had to do those exact steps that I
> described, I haven't run the tests yet but fully suspect that I'll need to
> increase the ulimit to enable that.  If you do a plain maven build after
> checking out the reef code in ubuntu it complains that JAVA_HOME is not
> set, also its a good idea to set the maven oriented environment variables
> because I highly suspect that in the future we may need to adjust heap
> space settings, finally the LD_LIBRARY_PATH is needed I suspect because the
> java code is invoking the protoc compiler at some point and in order to do
> so it much load some .so files that live in LD_LIBRARY_PATH.  Net Net we
> should definitely figure out the differences between your and Sergei's
> setup and mine, I believe IIRC I used ubuntu 16.10 but I'm not convinced
> that the version matters if the major version is the same.
> Cheers
>
> On Thu, Feb 9, 2017 at 11:28 AM, Douglas Service <dsopsrc@gmail.com>
> wrote:
>
> > Hello Saikat,
> >
> > Did you read the documentation on this page
> > https://cwiki.apache.org/confluence/display/REEF/Linux on the REEF wiki
> > concerning Java on Ubuntu? I added this page after setting up a Linux
> 16.04
> > to build REEF and  trading emails with Sergiy on the dev list. Note that
> I
> > do NOT set JAVA_HOME, M2_HOME, LD_LIBRARY_PATH. However, you do need to
> > change the default for ulimit -n in bash to get the tests to run which is
> > also described.
> >
> > Doug
> >
> >
> >
> > On Wed, Feb 8, 2017 at 5:29 PM, Saikat Kanjilal <sxk1969@gmail.com>
> wrote:
> >
> > > A battle well fought and won, got reef to build successfully on ubuntu
> > > linux vm after hours of hacking, fyi here's what I had to do:
> > > 1) installed the necessary tools (jdk 1.7/maven 3.3.9/protoc version
> 2.5)
> > > 2) added JAVA_HOME and M2_HOME
> > > 3) here's the kicker that's not in the documentation :) (
> > > https://github.com/apache/reef/blob/master/lang/java/BUILD.md), had to
> > add
> > > LD_LIBRARY_PATH environment variable and have it point to
> /usr/local/lib
> > > where the shared library for protobuf is installed
> > > 4) had to add JAVA_HOME and M2_HOME to path (also not in the
> > documentation
> > > :) )
> > >
> > >
> > > [INFO]
> > > ------------------------------------------------------------
> ------------
> > > [INFO] Reactor Summary:
> > > [INFO]
> > > [INFO] REEF ............................................... SUCCESS [
> > >  4.167 s]
> > > [INFO] REEF Dot Net ....................................... SUCCESS [
> > >  1.628 s]
> > > [INFO] REEF Annotations ................................... SUCCESS [
> > >  5.509 s]
> > > [INFO] REEF Utils ......................................... SUCCESS [
> > >  5.747 s]
> > > [INFO] REEF Tang Project .................................. SUCCESS [
> > >  0.492 s]
> > > [INFO] Tang Test Jar A .................................... SUCCESS [
> > >  4.276 s]
> > > [INFO] Tang Test Jar B .................................... SUCCESS [
> > >  4.186 s]
> > > [INFO] Tang Test Jar AB ................................... SUCCESS [
> > >  4.376 s]
> > > [INFO] Tang Test Jar B conflict A ......................... SUCCESS [
> > >  0.440 s]
> > > [INFO] REEF Tang .......................................... SUCCESS [
> > > 24.779 s]
> > > [INFO] REEF Wake Project .................................. SUCCESS [
> > >  0.487 s]
> > > [INFO] REEF Wake .......................................... SUCCESS [
> > > 15.587 s]
> > > [INFO] REEF Common ........................................ SUCCESS [
> > > 23.343 s]
> > > [INFO] REEF Runtime Local ................................. SUCCESS [
> > >  8.375 s]
> > > [INFO] REEF Applications .................................. SUCCESS [
> > >  0.416 s]
> > > [INFO] REEF Vortex ........................................ SUCCESS [
> > > 11.263 s]
> > > [INFO] REEF HTTP Server ................................... SUCCESS [
> > >  9.772 s]
> > > [INFO] REEF Utils for Hadoop .............................. SUCCESS [
> > >  5.881 s]
> > > [INFO] REEF Runtime for YARN .............................. SUCCESS [
> > > 11.041 s]
> > > [INFO] REEF Runtime for HDInsight ......................... SUCCESS [
> > >  9.719 s]
> > > [INFO] REEF IO ............................................ SUCCESS [
> > > 23.729 s]
> > > [INFO] REEF Checkpoint .................................... SUCCESS [
> > >  5.771 s]
> > > [INFO] REEF Bridge Java ................................... SUCCESS [
> > > 11.981 s]
> > > [INFO] REEF Runtime for multiple runtime scenarios ........ SUCCESS [
> > >  7.898 s]
> > > [INFO] REEF Bridge (Client) ............................... SUCCESS [
> > > 12.242 s]
> > > [INFO] REEF Runtime Standalone ............................ SUCCESS [
> > >  7.779 s]
> > > [INFO] REEF Runtime for Mesos ............................. SUCCESS [
> > > 11.103 s]
> > > [INFO] REEF Poison ........................................ SUCCESS [
> > >  5.384 s]
> > > [INFO] REEF Examples ...................................... SUCCESS [
> > > 14.313 s]
> > > [INFO] REEF Examples CLR .................................. SUCCESS [
> > >  7.532 s]
> > > [INFO] REEF Examples on HDInsight ......................... SUCCESS [
> > >  9.213 s]
> > > [INFO] REEF Tang Tint ..................................... SUCCESS [
> > >  8.546 s]
> > > [INFO] REEF Tests ......................................... SUCCESS [
> > > 15.696 s]
> > > [INFO] REEF Website ....................................... SUCCESS [
> > >  1.033 s]
> > > [INFO]
> > > ------------------------------------------------------------
> ------------
> > > [INFO] BUILD SUCCESS
> > > [INFO]
> > > ------------------------------------------------------------
> ------------
> > > [INFO] Total time: 04:54 min
> > > [INFO] Finished at: 2017-02-09T01:21:17+00:00
> > > [INFO] Final Memory: 125M/1238M
> > > [INFO]
> > > ------------------------------------------------------------
> ------------
> > >
> > >
> > > On to bigger and better things :), we should probably update the docs
> to
> > > reflect the current build process subtleties.  Will try windows next.
> > >
> > >
> > > On Wed, Feb 8, 2017 at 11:44 AM, Byung-Gon Chun <bgchun@gmail.com>
> > wrote:
> > >
> > > > Welcome, Saikat!
> > > >
> > > >
> > > >
> > > >
> > > > On Thu, Feb 9, 2017 at 4:41 AM, Markus Weimer <markus@weimo.de>
> wrote:
> > > >
> > > > > On 2017-02-08 11:19, Saikat Kanjilal wrote:
> > > > >
> > > > >> I am a newbie to Apache Reef and am interested in contributing
to
> > the
> > > > reef
> > > > >> dev efforts
> > > > >>
> > > > >
> > > > > Welcome!
> > > > >
> > > > > my JIRA id is kanjilal
> > > > >>
> > > > >
> > > > > I have added you to the contributor's list on JIRA. This basically
> > > means
> > > > > that you can self-assign issues to yourself now :)
> > > > >
> > > > > Markus
> > > > >
> > > >
> > > >
> > > >
> > > > --
> > > > Byung-Gon Chun
> > > >
> > >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message