Mailing-List: contact user-help@nutch.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@nutch.apache.org
Received-SPF: pass (nike.apache.org: domain of alexander.aristov@gmail.com
 designates 209.85.212.182 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:from:date:message-id:subject:to
         :cc:content-type;
        b=AcoK2aocp8gVMqsZJ0yPDOgliKYkaOoXzVCIeOGm7lBU8Yva39D2SMHyTL6kBfpYYv
         xla/EHB/HAjrGI4or9wGFely8NaP7JdsZnbTrw6A+7+e54WtjipjKi43w1J9D9+CmKNK
         pFsZJ43TeJ5tfbWoPxskgM6YOejFPGH1q8pbo=
MIME-Version: 1.0
In-Reply-To: <201011041940.45346.markus.jelsma@openindex.io>
References: <AANLkTim-ZjTeW1R=JTR41+Yj1iq3HzkJzTQ=AyQx-jh5@mail.gmail.com>
 <201011041940.45346.markus.jelsma@openindex.io>
From: Alexander Aristov <alexander.aristov@gmail.com>
Date: Thu, 4 Nov 2010 23:12:39 +0300
Message-ID: <AANLkTikJbvEHS-w9OFO3-ufUO2Nu3k3wMUuwOezhNH9K@mail.gmail.com>
Subject: Re: nutch - solrindex map reduce error
To: user@nutch.apache.org, markus.jelsma@openindex.io
Cc: Steve Cohen <mail4steve@gmail.com>
Content-Type: multipart/alternative; boundary=000e0cd32d2ad0f54d04943fc878

--000e0cd32d2ad0f54d04943fc878
Content-Type: text/plain; charset=ISO-8859-1

Check your classpaths, maybe you have different solr versions in it and
nutch doesn't picks up correct version.

Best Regards
Alexander Aristov


On 4 November 2010 21:40, Markus Jelsma <markus.jelsma@openindex.io> wrote:

> What version of Solr are you indexing to and what is the Solr log telling
> you?
>
>
> > Hello I am trying to get nutch to work after upgrading from nutch 1.0 to
> > 1.2:
> >
> > solrindex map is working but as soon as I hit the reduce stage I start
> > getting errors. I fixed a couple of the errors but I don't understand
> what
> > the latest one means:
> >
> > Task TASKID="task_201011031547_0001_m_000153" TASK_TYPE="MAP"
> > TASK_STATUS="SUCCESS" FINISH_TIME="1288814131303"
> > COUNTERS="{(FileSystemCounters)(FileSystemCou
> >
> nters)[(FILE_BYTES_READ)(FILE_BYTES_READ)(138)][(FILE_BYTES_WRITTEN)(FILE_B
> >
> YTES_WRITTEN)(218)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
> > Framew
> > ork)[(COMBINE_OUTPUT_RECORDS)(Combine output
> > records)(0)][(MAP_INPUT_RECORDS)(Map input
> > records)(0)][(SPILLED_RECORDS)(Spilled Records)(0)][(MAP_OUTPUT_BYTES
> > )(Map output bytes)(0)][(MAP_INPUT_BYTES)(Map input
> > bytes)(0)][(COMBINE_INPUT_RECORDS)(Combine input
> > records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(0)
> > ]}" .
> > ReduceAttempt TASK_TYPE="REDUCE" TASKID="task_201011031547_0001_r_000000"
> > TASK_ATTEMPT_ID="attempt_201011031547_0001_r_000000_0"
> > START_TIME="1288813765434" T
> > RACKER_NAME="tracker_search1:localhost/127\.0\.0\.1:34577"
> > HTTP_PORT="50060" .
> > ReduceAttempt TASK_TYPE="REDUCE" TASKID="task_201011031547_0001_r_000000"
> > TASK_ATTEMPT_ID="attempt_201011031547_0001_r_000000_0"
> TASK_STATUS="FAILED"
> > FINISH_
> > TIME="1288814153180" HOSTNAME="search1"
> > ERROR="org\.apache\.solr\.common\.SolrException: Severe errors in solr
> > configuration\.  Check your log files for more
> >  detailed information on what may be wrong\.  If you want solr to
> continue
> > after configuration errors, change:
> > <abortOnConfigurationError>false</abortOnCo
> > nfigurationError>  in null
> > -------------------------------------------------------------
> > java\.lang\.RuntimeException:
> > org\.apache\.lucene\.index\.CorruptIn
> > dexException: Incompatible format version: 2 expected 1 or lower
>  at
> > org\.apache\.solr\.core\.SolrCore\.getSearcher(SolrCore\.java:1068)  at
> > org\.apach
> > e\.solr\.core\.SolrCore\.<init>(SolrCore\.java:579)     at
> >
> org\.apache\.solr\.core\.CoreContainer$Initializer\.initialize(CoreContaine
> > r\.java:137) at or
> >
> g\.apache\.solr\.servlet\.SolrDispatchFilter\.init(SolrDispatchFilter\.java
> > :83) at
> org\.apache\.catalina\.core\.ApplicationFilterConfig\.getFilter(Ap
> > plicationFilterConfig\.java:259)        at
> >
> org\.apache\.catalina\.core\.ApplicationFilterChain\.internalDoFilter(Appli
> > cationFilterChain\.java:237) at or
> >
> g\.apache\.catalina\.core\.ApplicationFilterChain\.doFilter(ApplicationFilt
> > erChain\.java:215) at
> > org\.apache\.catalina\.core\.StandardWrapperValve\.invoke(
> > StandardWrapperValve\.java:277)         at
> >
> org\.apache\.catalina\.core\.StandardContextValve\.invoke(StandardContextVa
> > lve\.java:188) at org\.apache\.catal
> > ina\.core\.StandardPipeline\.invoke(StandardPipeline\.java:641)
> at
> > com\.sun\.enterprise\.web\.WebPipeline\.invoke(WebPipeline\.java:97)
> > at co
> >
> m\.sun\.enterprise\.web\.PESessionLockingStandardPipeline\.invoke(PESession
> > LockingStandardPipeline\.java:85) at
> > org\.apache\.catalina\.core\.StandardHostV
> > alve\.invoke(StandardHostValve\.java:185)       at
> >
> org\.apache\.catalina\.connector\.CoyoteAdapter\.doService(CoyoteAdapter\.j
> > ava:332) at org\.apache\.catal
> > ina\.connector\.CoyoteAdapter\.service(CoyoteAdapter\.java:233)
> at
> >
> com\.sun\.enterprise\.v3\.services\.impl\.ContainerMapper\.service(Containe
> > rMapper \.java:165)     at
> >
> com\.sun\.grizzly\.http\.ProcessorTask\.invokeAdapter(ProcessorTask\.java:7
> > 91) at com\.sun\.grizzly\.http\.ProcessorTask\.doProcess(
> > ProcessorTask\.java:693)        at
> > com\.sun\.grizzly\.http\.ProcessorTask\.process(ProcessorTask\.java:954)
> > at com\.sun\.grizzly\.http\.DefaultProtocolFi
> > lter\.execute(DefaultProtocolFilter\.java:170)  at
> >
> com\.sun\.grizzly\.DefaultProtocolChain\.executeProtocolFilter(DefaultProto
> > colChain\.java:135) at co
> >
> m\.sun\.grizzly\.DefaultProtocolChain\.execute(DefaultProtocolChain\.java:1
> > 02) at
> >
> com\.sun\.grizzly\.DefaultProtocolChain\.execute(DefaultProtocolChain\.jav
> > a:88)   at
> >
> com\.sun\.grizzly\.http\.HttpProtocolChain\.execute(HttpProtocolChain\.java
> > :76) at com\.sun\.grizzly\.ProtocolChainContextTask\.doCall(Protoc
> > olChainContextTask\.java:53)    at
> >
> com\.sun\.grizzly\.SelectionKeyContextTask\.call(SelectionKeyContextTask\.j
> > ava:57) at com\.sun\.grizzly\.ContextTask\.ru
> > n(ContextTask\.java:69)         at
> >
> com\.sun\.grizzly\.util\.AbstractThreadPool$Worker\.doWork(AbstractThreadPo
> > ol\.java:330) at com\.sun\.grizzly\.util\.A
> > bstractThreadPool$Worker\.run(AbstractThreadPool\.java:309)     at
> > java\.lang\.Thread\.run(Thread\.java:619) Caused by:
> > org\.apache\.lucene\.index\.CorruptIn
> > dexException: Incompatible format version: 2 expected 1 or lower
>  at
> > org\.apache\.lucene\.index\.FieldsReader\.<init>(FieldsReader\.java:117)
> > at or
> >
> g\.apache\.lucene\.index\.SegmentReader$CoreReaders\.openDocStores(SegmentR
> > eader\.java:277) at
> > org\.apache\.lucene\.index\.SegmentReader\.get(SegmentRead
> > er\.java:640)   at
> > org\.apache\.lucene\.index\.SegmentReader\.get(SegmentReader\.java:599)
> > at org\.apache\.lucene\.index\.DirectoryReader\.<init>(Direct
> > oryReader\.java:104)    at
> >
> org\.apache\.lucene\.index\.ReadOnlyDirectoryReader\.<init>(ReadOnlyDirecto
> > ryReader\.java:27) at org\.apache\.lucene\.index
> > \.DirectoryReader$1\.doBody(DirectoryReader\.java:74)   at
> >
> org\.apache\.lucene\.index\.SegmentInfos$FindSegmentsFile\.run(SegmentInfos
> > \.java:704) at or
> > g\.apache\.lucene\.index\.DirectoryReader\.open(DirectoryReader\.java:69)
> > at org\.apache\.lucene\.index\.IndexReader\.open(IndexReader\.java:476)
> >         at
> > org\.apache\.lucene\.index\.IndexReader\.open(IndexReader\.java:403)
> > at org\.apache\.solr\.core\.StandardIndexReaderFactory\.newReader(Sta
> > ndardIndexReaderFactory\.java:38)       at
> > org\.apache\.solr\.core\.SolrCore\.getSearcher(SolrCore\.java:1057)
>  \.\.\.
> > 29 more
> >
> > Would someone help me out?
> >
> > Thanks,
> > Steve Cohen
>

--000e0cd32d2ad0f54d04943fc878--