reef-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Saikat Kanjilal <sxk1...@gmail.com>
Subject Re: Interested in contributing to reef--newbie
Date Thu, 09 Feb 2017 20:52:01 GMT
I think part of the difference is the way both of us installed java, my
setup is using the oracle java as opposed to the open-jdk java provided by
update-alternatives, I agree with your instructions assessment.


On another note I have a question, how did folks install protoc on windows,
in looking at the wiki it points you to the protoc site where it seems to
need a whole bunch of supporting tools (cmake/mingw etc), I am using
gitbash on windows and was wondering if there's an easy way to download the
protoc binaries and set the path, please forgive me if this is in the
documentation somewhere, still learning my way around.

On Thu, Feb 9, 2017 at 12:48 PM, Douglas Service <dsopsrc@gmail.com> wrote:

> What I mean is that we should provide instructions to setup the least
> complicated build environment that works, not one that is more complicated
> but also works.
>
> On Thu, Feb 9, 2017 at 12:44 PM, Douglas Service <dsopsrc@gmail.com>
> wrote:
>
> > Do you have update-alternatives installed? Have you run
> > update-alternatives --config java?
> >
> > Sorry I made a mistake in may last email, I actually have JAVA_HOME set
> to
> > /usr as listed on the webpage which figured out from Sergiy. However, I
> do
> > not need to set the other ones. It is important that our contributing to
> > REEF wiki be general and not specific to a single setup.
> >
> > Here is my environment for building REEF on Ubuntu 16.04.
> >
> > dougse@reefdevlx:/code/reef [master ↑]$$ env
> > MATE_DESKTOP_SESSION_ID=this-is-deprecated
> > XDG_SESSION_ID=c2
> > SHELL=/bin/bash
> > TERM=xterm
> > WINDOWID=44144243
> > USER=dougse
> > LS_COLORS=rs=0:di=01;34:ln=01;36:mh=00:pi=40;33:so=01;35:do=
> > 01;35:bd=40;33;01:cd=40;33;01:or=40;31;01:mi=00:su=37;41:sg=
> > 30;43:ca=30;41:tw=30;42:ow=34;42:st=37;44:ex=01;32:*.tar=01;
> > 31:*.tgz=01;31:*.arc=01;31:*.arj=01;31:*.taz=01;31:*.lha=
> > 01;31:*.lz4=01;31:*.lzh=01;31:*.lzma=01;31:*.tlz=01;31:*.
> > txz=01;31:*.tzo=01;31:*.t7z=01;31:*.zip=01;31:*.z=01;31:*.
> > Z=01;31:*.dz=01;31:*.gz=01;31:*.lrz=01;31:*.lz=01;31:*.lzo=
> > 01;31:*.xz=01;31:*.bz2=01;31:*.bz=01;31:*.tbz=01;31:*.tbz2=
> > 01;31:*.tz=01;31:*.deb=01;31:*.rpm=01;31:*.jar=01;31:*.war=
> > 01;31:*.ear=01;31:*.sar=01;31:*.rar=01;31:*.alz=01;31:*.ace=
> > 01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.
> > cab=01;31:*.jpg=01;35:*.jpeg=01;35:*.gif=01;35:*.bmp=01;35:
> > *.pbm=01;35:*.pgm=01;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:
> > *.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=
> > 01;35:*.svgz=01;35:*.mng=01;35:*.pcx=01;35:*.mov=01;35:*.
> > mpg=01;35:*.mpeg=01;35:*.m2v=01;35:*.mkv=01;35:*.webm=01;
> > 35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.vob=
> > 01;35:*.qt=01;35:*.nuv=01;35:*.wmv=01;35:*.asf=01;35:*.rm=
> > 01;35:*.rmvb=01;35:*.flc=01;35:*.avi=01;35:*.fli=01;35:*.
> > flv=01;35:*.gl=01;35:*.dl=01;35:*.xcf=01;35:*.xwd=01;35:*.
> > yuv=01;35:*.cgm=01;35:*.emf=01;35:*.ogv=01;35:*.ogx=01;35:
> > *.aac=00;36:*.au=00;36:*.flac=00;36:*.m4a=00;36:*.mid=00;36:
> > *.midi=00;36:*.mka=00;36:*.mp3=00;36:*.mpc=00;36:*.ogg=
> > 00;36:*.ra=00;36:*.wav=00;36:*.oga=00;36:*.opus=00;36:*.spx=
> > 00;36:*.xspf=00;36:
> > SSH_AUTH_SOCK=/run/user/1000/keyring/ssh
> > SESSION_MANAGER=local/reefdevlx:@/tmp/.ICE-unix/
> > 3866,unix/reefdevlx:/tmp/.ICE-unix/3866
> > PATH=/home/dougse/bin:/bin:/usr/bin:/usr/X11R6/bin:/usr/local/bin
> > PWD=/code/reef
> > JAVA_HOME=/usr
> > LANG=en_US.UTF-8
> > REEF_HOME=/code/reef
> > SHLVL=1
> > HOME=/home/dougse
> > GTK_OVERLAY_SCROLLING=0
> > DBUS_SESSION_BUS_ADDRESS=unix:abstract=/tmp/dbus-l06bsMWGy0,guid=
> > ae74bbce18102091c11c7bd458939d1c
> > UID=1000
> > LESSOPEN=| /bin/lesspipe %s
> > XDG_RUNTIME_DIR=/run/user/1000
> > DISPLAY=:10.0
> > XDG_CURRENT_DESKTOP=MATE
> > LESSCLOSE=/bin/lesspipe %s %s
> > COLORTERM=mate-terminal
> > _=/usr/bin/env
> >
> >
> > On Thu, Feb 9, 2017 at 7:41 PM, Saikat Kanjilal <sxk1969@gmail.com>
> wrote:
> >
> >> Weird, yes I did read that pageand yes I had to do those exact steps
> that
> >> I
> >> described, I haven't run the tests yet but fully suspect that I'll need
> to
> >> increase the ulimit to enable that.  If you do a plain maven build after
> >> checking out the reef code in ubuntu it complains that JAVA_HOME is not
> >> set, also its a good idea to set the maven oriented environment
> variables
> >> because I highly suspect that in the future we may need to adjust heap
> >> space settings, finally the LD_LIBRARY_PATH is needed I suspect because
> >> the
> >> java code is invoking the protoc compiler at some point and in order to
> do
> >> so it much load some .so files that live in LD_LIBRARY_PATH.  Net Net we
> >> should definitely figure out the differences between your and Sergei's
> >> setup and mine, I believe IIRC I used ubuntu 16.10 but I'm not convinced
> >> that the version matters if the major version is the same.
> >> Cheers
> >>
> >> On Thu, Feb 9, 2017 at 11:28 AM, Douglas Service <dsopsrc@gmail.com>
> >> wrote:
> >>
> >> > Hello Saikat,
> >> >
> >> > Did you read the documentation on this page
> >> > https://cwiki.apache.org/confluence/display/REEF/Linux on the REEF
> wiki
> >> > concerning Java on Ubuntu? I added this page after setting up a Linux
> >> 16.04
> >> > to build REEF and  trading emails with Sergiy on the dev list. Note
> >> that I
> >> > do NOT set JAVA_HOME, M2_HOME, LD_LIBRARY_PATH. However, you do need
> to
> >> > change the default for ulimit -n in bash to get the tests to run which
> >> is
> >> > also described.
> >> >
> >> > Doug
> >> >
> >> >
> >> >
> >> > On Wed, Feb 8, 2017 at 5:29 PM, Saikat Kanjilal <sxk1969@gmail.com>
> >> wrote:
> >> >
> >> > > A battle well fought and won, got reef to build successfully on
> ubuntu
> >> > > linux vm after hours of hacking, fyi here's what I had to do:
> >> > > 1) installed the necessary tools (jdk 1.7/maven 3.3.9/protoc version
> >> 2.5)
> >> > > 2) added JAVA_HOME and M2_HOME
> >> > > 3) here's the kicker that's not in the documentation :) (
> >> > > https://github.com/apache/reef/blob/master/lang/java/BUILD.md), had
> >> to
> >> > add
> >> > > LD_LIBRARY_PATH environment variable and have it point to
> >> /usr/local/lib
> >> > > where the shared library for protobuf is installed
> >> > > 4) had to add JAVA_HOME and M2_HOME to path (also not in the
> >> > documentation
> >> > > :) )
> >> > >
> >> > >
> >> > > [INFO]
> >> > > ------------------------------------------------------------
> >> ------------
> >> > > [INFO] Reactor Summary:
> >> > > [INFO]
> >> > > [INFO] REEF ...............................................
> SUCCESS [
> >> > >  4.167 s]
> >> > > [INFO] REEF Dot Net .......................................
> SUCCESS [
> >> > >  1.628 s]
> >> > > [INFO] REEF Annotations ...................................
> SUCCESS [
> >> > >  5.509 s]
> >> > > [INFO] REEF Utils .........................................
> SUCCESS [
> >> > >  5.747 s]
> >> > > [INFO] REEF Tang Project ..................................
> SUCCESS [
> >> > >  0.492 s]
> >> > > [INFO] Tang Test Jar A ....................................
> SUCCESS [
> >> > >  4.276 s]
> >> > > [INFO] Tang Test Jar B ....................................
> SUCCESS [
> >> > >  4.186 s]
> >> > > [INFO] Tang Test Jar AB ...................................
> SUCCESS [
> >> > >  4.376 s]
> >> > > [INFO] Tang Test Jar B conflict A ......................... SUCCESS
> [
> >> > >  0.440 s]
> >> > > [INFO] REEF Tang ..........................................
> SUCCESS [
> >> > > 24.779 s]
> >> > > [INFO] REEF Wake Project ..................................
> SUCCESS [
> >> > >  0.487 s]
> >> > > [INFO] REEF Wake ..........................................
> SUCCESS [
> >> > > 15.587 s]
> >> > > [INFO] REEF Common ........................................
> SUCCESS [
> >> > > 23.343 s]
> >> > > [INFO] REEF Runtime Local .................................
> SUCCESS [
> >> > >  8.375 s]
> >> > > [INFO] REEF Applications ..................................
> SUCCESS [
> >> > >  0.416 s]
> >> > > [INFO] REEF Vortex ........................................
> SUCCESS [
> >> > > 11.263 s]
> >> > > [INFO] REEF HTTP Server ...................................
> SUCCESS [
> >> > >  9.772 s]
> >> > > [INFO] REEF Utils for Hadoop .............................. SUCCESS
> [
> >> > >  5.881 s]
> >> > > [INFO] REEF Runtime for YARN .............................. SUCCESS
> [
> >> > > 11.041 s]
> >> > > [INFO] REEF Runtime for HDInsight ......................... SUCCESS
> [
> >> > >  9.719 s]
> >> > > [INFO] REEF IO ............................................
> SUCCESS [
> >> > > 23.729 s]
> >> > > [INFO] REEF Checkpoint ....................................
> SUCCESS [
> >> > >  5.771 s]
> >> > > [INFO] REEF Bridge Java ...................................
> SUCCESS [
> >> > > 11.981 s]
> >> > > [INFO] REEF Runtime for multiple runtime scenarios ........ SUCCESS
> [
> >> > >  7.898 s]
> >> > > [INFO] REEF Bridge (Client) ...............................
> SUCCESS [
> >> > > 12.242 s]
> >> > > [INFO] REEF Runtime Standalone ............................ SUCCESS
> [
> >> > >  7.779 s]
> >> > > [INFO] REEF Runtime for Mesos ............................. SUCCESS
> [
> >> > > 11.103 s]
> >> > > [INFO] REEF Poison ........................................
> SUCCESS [
> >> > >  5.384 s]
> >> > > [INFO] REEF Examples ......................................
> SUCCESS [
> >> > > 14.313 s]
> >> > > [INFO] REEF Examples CLR ..................................
> SUCCESS [
> >> > >  7.532 s]
> >> > > [INFO] REEF Examples on HDInsight ......................... SUCCESS
> [
> >> > >  9.213 s]
> >> > > [INFO] REEF Tang Tint .....................................
> SUCCESS [
> >> > >  8.546 s]
> >> > > [INFO] REEF Tests .........................................
> SUCCESS [
> >> > > 15.696 s]
> >> > > [INFO] REEF Website .......................................
> SUCCESS [
> >> > >  1.033 s]
> >> > > [INFO]
> >> > > ------------------------------------------------------------
> >> ------------
> >> > > [INFO] BUILD SUCCESS
> >> > > [INFO]
> >> > > ------------------------------------------------------------
> >> ------------
> >> > > [INFO] Total time: 04:54 min
> >> > > [INFO] Finished at: 2017-02-09T01:21:17+00:00
> >> > > [INFO] Final Memory: 125M/1238M
> >> > > [INFO]
> >> > > ------------------------------------------------------------
> >> ------------
> >> > >
> >> > >
> >> > > On to bigger and better things :), we should probably update the
> docs
> >> to
> >> > > reflect the current build process subtleties.  Will try windows
> next.
> >> > >
> >> > >
> >> > > On Wed, Feb 8, 2017 at 11:44 AM, Byung-Gon Chun <bgchun@gmail.com>
> >> > wrote:
> >> > >
> >> > > > Welcome, Saikat!
> >> > > >
> >> > > >
> >> > > >
> >> > > >
> >> > > > On Thu, Feb 9, 2017 at 4:41 AM, Markus Weimer <markus@weimo.de>
> >> wrote:
> >> > > >
> >> > > > > On 2017-02-08 11:19, Saikat Kanjilal wrote:
> >> > > > >
> >> > > > >> I am a newbie to Apache Reef and am interested in contributing
> to
> >> > the
> >> > > > reef
> >> > > > >> dev efforts
> >> > > > >>
> >> > > > >
> >> > > > > Welcome!
> >> > > > >
> >> > > > > my JIRA id is kanjilal
> >> > > > >>
> >> > > > >
> >> > > > > I have added you to the contributor's list on JIRA. This
> basically
> >> > > means
> >> > > > > that you can self-assign issues to yourself now :)
> >> > > > >
> >> > > > > Markus
> >> > > > >
> >> > > >
> >> > > >
> >> > > >
> >> > > > --
> >> > > > Byung-Gon Chun
> >> > > >
> >> > >
> >> >
> >>
> >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message