giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Amani Alonazi <amani.alon...@kaust.edu.sa>
Subject Re: what is the recommended way to develop Giraph code with Eclipse or other IDEs
Date Tue, 23 Oct 2012 09:33:03 GMT
 Sorry for late response.

Once you checkout the repository, you don't have to change anything. The
following is the source dirs:
- giraph/src/main/java


On Mon, Oct 22, 2012 at 4:22 PM, Doron Cohen <cdoronc@gmail.com> wrote:

> Hi Amani,
> Thanks for your help!
>
> NetBeans seems a nice IDE.
> Does it solve the munging issue?
> I mean, which of these two setups do you have for its source dirs:
>
> (1) the ones under src:
>   - giraph/src/main/java
>   - giraph/src/test/java
>
> (2) the ones under target:
>   - giraph/target/munged/main
>   - giraph/target/munged/test
>
> Thanks,
> Doron
>
> On Mon, Oct 22, 2012 at 12:10 PM, Amani Alonazi
> <amani.alonazi@kaust.edu.sa>wrote:
>
> > Hey,
> >
> > I used NetBeans IDE. It's easy to write code and compile. I used the
> > command line (Terminal) to run the code.
> >
> > I hope this help.
> > In case you'll work on NetBeans, let me know if you need any help.
> >
> > Best,
> >
> > On Mon, Oct 22, 2012 at 12:22 PM, Doron Cohen <cdoronc@gmail.com> wrote:
> >
> > > Hi, I am new to Giraph.
> > >
> > > Looking at GIRAPH-42 I used Eclipse (on Windows 7) to modify the code.
> > >
> > > The process I went through was quite cumbersome, so I wonder if there
> is
> > a
> > > more efficient way...
> > >
> > > Here is what I did.
> > > Checked out giraph-trunk and ran this command:
> > >    mvn -Dhadoop=non_secure clean eclipse:eclipse
> > >
> > > This created:
> > > - the giraph/target dir with munged code suitable for unsecured env
> > > - Eclipse definition files .project and .classpath for two
> sub-projects:
> > > giraph and giraph-formats-contrib.
> > >
> > > I concentrated in the giraph sub project which has the sent messages
> > > counters code (and all of giraph core I assume).
> > >
> > > It turns out that the Eclipse project has - as source folders - the
> > target
> > > source, result of munging (pre-processing).
> > > (Never used munge before, just read about it now trying to figure out
> > what
> > > was going on):
> > > - target/munged/test
> > > - target/munged/main
> > >
> > > The Eclipse project compiles with no errors.
> > >
> > > Tests are running ok from command line, like this: mvn
> > -Dhadoop=non_secure
> > > test
> > > (Giraph Formats build fails but ignoring this now)
> > > The output summary is:
> > >    [INFO] Apache Giraph Parent .............................. SUCCESS
> > > [0.008s]
> > >    [INFO] Apache Giraph ..................................... SUCCESS
> > > [3:17.460s]
> > >    [INFO] Apache Giraph Formats ............................. FAILURE
> > > [2.805s]
> > > (many exception stack traces printed, but ignoring this for now).
> > >
> > > Running the tests from Eclipse fails: 16 out of 120 tests are failing,
> > most
> > > or all of them with this exception:
> > > java.lang.IllegalArgumentException: Can not create a Path from an empty
> > > string
> > >     at org.apache.hadoop.fs.Path.checkPathArg(Path.java:82)
> > >     at org.apache.hadoop.fs.Path.<init>(Path.java:90)
> > >     at
> > >
> > >
> >
> org.apache.hadoop.mapred.JobClient.configureCommandLineOptions(JobClient.java:657)
> > >     at
> > >
> org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:761)
> > >     at org.apache.hadoop.mapreduce.Job.submit(Job.java:432)
> > >     at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:447)
> > >     at org.apache.giraph.graph.GiraphJob.run(GiraphJob.java:261)
> > >     at
> > >
> >
> org.apache.giraph.TestMutateGraph.testMutateGraph(TestMutateGraph.java:56)
> > >
> > > This makes it hard to fix tests, or run them through a debugger.
> > > Also, each execution of the mvn command line wipes out the the target
> dir
> > > and the Eclipse project must be refreshed.
> > > It will also undo any code changes that were done within Eclipse, as
> the
> > > sources under target are rewritten.
> > >
> > > Last, the source files under target are not in SVN, so it is not
> possible
> > > to use svn stat/diff etc. to see what has changed or to create a patch.
> > > To workaround this, I opened the source files (as resources) in Eclipse
> > and
> > > edited, then ran the mvn target and refreshed Eclipse.
> > > This is quite inconvenient and might lead to errors.
> > >
> > > This is also mentioned in
> > https://issues.apache.org/jira/browse/GIRAPH-207
> > > ,
> > > which is also where I learned about the eclipse:eclipse target.
> > >
> > > How do others develop Giraph code then?
> > > Using Eclipse or other IDEs perhaps? (how?)
> > > Plain VI or EMACS editor with command line mvn commands?
> > >
> > > Thanks,
> > > Doron
> > >
> >
> >
> >
> > --
> > Amani AlOnazi
> > MSc Computer Science
> > King Abdullah University of Science and Technology
> > Kingdom of Saudi Arabia
> > amani.alonazi@kaust.edu.sa |
> >
> > --
> >
> > ------------------------------
> > This message and its contents, including attachments are intended solely
> > for the original recipient. If you are not the intended recipient or have
> > received this message in error, please notify me immediately and delete
> > this message from your computer system. Any unauthorized use or
> > distribution is prohibited. Please consider the environment before
> printing
> > this email.
> >
>



-- 
Amani AlOnazi
MSc Computer Science
King Abdullah University of Science and Technology
Kingdom of Saudi Arabia
amani.alonazi@kaust.edu.sa | +966 (0) 555 191 795

-- 

------------------------------
This message and its contents, including attachments are intended solely 
for the original recipient. If you are not the intended recipient or have 
received this message in error, please notify me immediately and delete 
this message from your computer system. Any unauthorized use or 
distribution is prohibited. Please consider the environment before printing 
this email.

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message