hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mahadev Konar <maha...@hortonworks.com>
Subject Re: MPI Java bindings now available
Date Wed, 22 Feb 2012 22:10:13 GMT
Great to see this Ralph. Looking forward to the Hamster patch!

mahadev
On Feb 22, 2012, at 2:06 PM, Ralph Castain wrote:

> Many thanks to Noah for his off-list help in diagnosing the problem. There was an undiagnosed
VPATH build issue in OMPI that surfaced with the Java bindings. This has been fixed - the
tarball generated tonight will include the patch.
> 
> Thanks again, Noah.
> Ralph
> 
> On Feb 22, 2012, at 12:51 PM, Noah Watkins wrote:
> 
>> I have LD_LIBRARY_PATH pointing to the full OpenMPI installation, which seems to
include the MPI libraries. Is that what you meant by OMPI libraries?
>> 
>> nwatkins@kyoto:~/projects/openmpi_java/openmpi-1.7a1r25994/examples$ echo $LD_LIBRARY_PATH

>> /home/nwatkins/projects/openmpi_java/install/lib:
>> 
>> nwatkins@kyoto:~/projects/openmpi_java/openmpi-1.7a1r25994/examples$ ls -l /home/nwatkins/projects/openmpi_java/install/lib
>> total 19372
>> -rwxr-xr-x 1 nwatkins nwatkins     1027 2012-02-22 09:49 libmca_common_sm.la
>> lrwxrwxrwx 1 nwatkins nwatkins       25 2012-02-22 09:49 libmca_common_sm.so ->
libmca_common_sm.so.0.0.0
>> lrwxrwxrwx 1 nwatkins nwatkins       25 2012-02-22 09:49 libmca_common_sm.so.0 ->
libmca_common_sm.so.0.0.0
>> -rwxr-xr-x 1 nwatkins nwatkins    77835 2012-02-22 09:49 libmca_common_sm.so.0.0.0
>> -rwxr-xr-x 1 nwatkins nwatkins     1140 2012-02-22 09:49 libmpi_java.la
>> lrwxrwxrwx 1 nwatkins nwatkins       20 2012-02-22 09:49 libmpi_java.so -> libmpi_java.so.0.0.0
>> lrwxrwxrwx 1 nwatkins nwatkins       20 2012-02-22 09:49 libmpi_java.so.0 -> libmpi_java.so.0.0.0
>> -rwxr-xr-x 1 nwatkins nwatkins   393888 2012-02-22 09:49 libmpi_java.so.0.0.0
>> -rwxr-xr-x 1 nwatkins nwatkins     1051 2012-02-22 09:49 libmpi.la
>> lrwxrwxrwx 1 nwatkins nwatkins       15 2012-02-22 09:49 libmpi.so -> libmpi.so.0.0.0
>> lrwxrwxrwx 1 nwatkins nwatkins       15 2012-02-22 09:49 libmpi.so.0 -> libmpi.so.0.0.0
>> -rwxr-xr-x 1 nwatkins nwatkins 12002747 2012-02-22 09:49 libmpi.so.0.0.0
>> -rwxr-xr-x 1 nwatkins nwatkins     1003 2012-02-22 09:49 libompitrace.la
>> lrwxrwxrwx 1 nwatkins nwatkins       21 2012-02-22 09:49 libompitrace.so -> libompitrace.so.0.0.0
>> lrwxrwxrwx 1 nwatkins nwatkins       21 2012-02-22 09:49 libompitrace.so.0 ->
libompitrace.so.0.0.0
>> -rwxr-xr-x 1 nwatkins nwatkins    86113 2012-02-22 09:49 libompitrace.so.0.0.0
>> -rwxr-xr-x 1 nwatkins nwatkins     1081 2012-02-22 09:49 libopen-pal.la
>> lrwxrwxrwx 1 nwatkins nwatkins       20 2012-02-22 09:49 libopen-pal.so -> libopen-pal.so.0.0.0
>> lrwxrwxrwx 1 nwatkins nwatkins       20 2012-02-22 09:49 libopen-pal.so.0 -> libopen-pal.so.0.0.0
>> -rwxr-xr-x 1 nwatkins nwatkins  2493981 2012-02-22 09:49 libopen-pal.so.0.0.0
>> -rwxr-xr-x 1 nwatkins nwatkins     1081 2012-02-22 09:49 libopen-rte.la
>> lrwxrwxrwx 1 nwatkins nwatkins       20 2012-02-22 09:49 libopen-rte.so -> libopen-rte.so.0.0.0
>> lrwxrwxrwx 1 nwatkins nwatkins       20 2012-02-22 09:49 libopen-rte.so.0 -> libopen-rte.so.0.0.0
>> -rwxr-xr-x 1 nwatkins nwatkins  4695012 2012-02-22 09:49 libopen-rte.so.0.0.0
>> -rw-r--r-- 1 nwatkins nwatkins    27260 2012-02-22 09:49 mpi.jar
>> drwxrwxr-x 2 nwatkins nwatkins    12288 2012-02-22 09:49 openmpi
>> drwxrwxr-x 2 nwatkins nwatkins     4096 2012-02-22 09:49 pkgconfig
>> 
>> On Feb 22, 2012, at 10:25 AM, Ralph Castain wrote:
>> 
>>> Hi Noah
>>> 
>>> Your LD_LIBRARY_PATH has to include the path to the OMPI libraries so we can
find libmpi. Did you include your $prefix/lib[64] in it?
>>> 
>>> On Feb 22, 2012, at 11:02 AM, Noah Watkins wrote:
>>> 
>>>> Just gave the nightly release a try and I'm getting an error:
>>>> 
>>>> nwatkins@kyoto:~/projects/openmpi_java/openmpi-1.7a1r25994/examples$ mpirun
-np 1 java Hello
>>>> JAVA BINDINGS FAILED TO LOAD REQUIRED LIBRARIES
>>>> 
>>>> My setup is on the latest Ubuntu with:
>>>> 
>>>> 1. Built with contrib/platform/hadoop/linux
>>>> 2. Compiled example with mpijavac
>>>> 3. LD_LIBRARY_PATH set to /mpi/java/install/lib
>>>> 
>>>> Looks like Java is loading libmpi_java successfully, and something is going
awry with the library magic in mpi_MPI.c:loadGlobalLibraries()
>>>> 
>>>> Thanks,
>>>> Noah
>>>> 
>>>> On Feb 21, 2012, at 3:05 PM, Ralph Castain wrote:
>>>> 
>>>>> Hi folks
>>>>> 
>>>>> With support from EMC, several of us in the Open MPI community (including
LANL, Cisco, HLRS, Oracle, and IBM) have integrated Java bindings into the Open MPI code.
The new bindings are not part of a formal release as this time (will be in the upcoming 1.7
series), but can be obtained from the Open MPI web site at:
>>>>> 
>>>>> http://www.open-mpi.org/nightly/trunk/
>>>>> 
>>>>> Instructions on how to build the binding support, build and run applications,
etc. can be found in our FAQ section:
>>>>> 
>>>>> http://www.open-mpi.org/faq/?category=java
>>>>> 
>>>>> Please feel free to post questions and bug reports to the OMPI User mailing
list:
>>>>> 
>>>>> http://www.open-mpi.org/community/lists/ompi.php
>>>>> 
>>>>> 
>>>>> I hope to release a version of Hamster in the not-too-distant future,
once I finally get the 0.23 Hadoop release branch to successfully build and run on at least
one of my machines (I've given up on the trunk). :-/
>>>>> 
>>>>> Ralph
>>>>> 
>>>> 
>>> 
>> 
> 


Mime
View raw message