lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Dominique Bejean <>
Subject Test of MapReduceIndexerTool with Solr 5.0.0 and Hadoop 2.6.0
Date Mon, 23 Mar 2015 13:59:36 GMT

I try to adapt Mark Miller's solr-map-reduce-example scripts in order to
try to use MapReduceIndexerTool with Solr 5.0.0 and Hadoop 2.6.0.
I use the same twitter sample data with the same avro configuration, ...

I had to change the file provided with Solr 5
under server/scripts/map-reduce/, because it still uses the old path
"$solr_distrib/example/" instead of "$solr_distrib/server/"

The variables HADOOP_CLASSPATH and HADOOP_LIBJAR are correct, but when I
launch the command

jar $SOLR_HOME/dist/solr-map-reduce-*.jar
--libjars "$HADOOP_LIBJAR"
-D ''
--morphline-file $ROOT_DIR/solr-map-reduce-example/readAvroContainer.conf
--output-dir hdfs://
--collection $collection
--log4j $ROOT_DIR/solr-map-reduce-example/
--verbose "hdfs://"

I have the error :

1227 [main] INFO  org.apache.hadoop.mapreduce.JobSubmitter  - Cleaning up
the staging area
Exception in thread "main" File does not

The MapReduce job try to find the jar file in HDFS
"hdfs://localhost:9000/opt/solr-hadoop/solr/dist/..."and not in the local
file system "/opt/solr-hadoop/solr/dist/".

May be I forgot a step and I had to push jar files into HDFS ?

Thank you for your help


  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message