lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Joan <>
Subject Re: Creating Solr index from map/reduce
Date Wed, 29 Dec 2010 10:50:23 GMT
If I rename my custom schema file (schema-xx.xml), whitch is located in
SOLR_HOME/schema/, and then I copy it to "conf" folder and finally I try to
run CSVIndexer, it shows me an other error:

Caused by: java.lang.RuntimeException: Can't find resource 'solrconfig.xml'
in classpath or

I dont't understand because I've a solr configuration file (solr.xml) where
I define all core:

  <core name="core_name"
        properties="solr/conf/"/ >

But I think that when I run CSVIndexer, it doesn't know that solr.xml exist,
and it try to looking for schema.xml and solrconfig.xml by default in
default folder (conf)

2010/12/29 Joan <>

> Hi,
> I'm trying generate Solr index from hadoop (map/reduce) so I'm using this
> patch SOLR-301 <>, however
> I don't get it.
> When I try to run CSVIndexer with some arguments: <directory Solr index>
> -solr <Solr home> <input, in this case CSV>
> I'm runnig CSVIndexer:
> <HADOOP_INSTALL>/bin/hadoop jar my.jar CSVIndexer <INDEX_FOLDER> -solr
> Before that I run CSVIndexer, I've put csv file into HDFS.
> My Solr home hasn't default files configurations, but which is divided
> into multiple folders
> /conf
> /schema
> I have custom solr file configurations so CSVIndexer can't find schema.xml,
> obviously It won't be able to find it because this file doesn't exist, in my
> case, this file is named "schema-xx.xml" and CSVIndexer is looking for it
> inside "conf" folder and It don't know that schema folder exist. And I have
> solr configuration file (solr.xml) where I configure multiple cores.
> I tried to modify solr's paths but It still not working .
> I understand that CSVIndexer copy Solr Home specified into HDFS
> (/tmp/hadoop-user/mapred/local/taskTracker/archive/...) and when It try to
> find "schema.xml" it doesn't exit:
> 10/12/29 10:18:11 INFO mapred.JobClient: Task Id :
> attempt_201012291016_0002_r_000000_1, Status : FAILED
> java.lang.IllegalStateException: Failed to initialize record writer for
> my.jar, attempt_201012291016_0002_r_000000_1
>         at
> org.apache.solr.hadoop.SolrRecordWriter.<init>(
>         at
> org.apache.solr.hadoop.SolrOutputFormat.getRecordWriter(
>         at
> org.apache.hadoop.mapred.ReduceTask.runNewReducer(
>         at
>         at org.apache.hadoop.mapred.Child.main(
> Caused by: Source
> '/tmp/hadoop-guest/mapred/local/taskTracker/archive/localhost/tmp/'
> does not exist
>         at
>         at
>         at
> org.apache.solr.hadoop.SolrRecordWriter.<init>(
>         ... 4 more

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message