lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Karl Wright (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SOLR-4358) SolrJ, by preventing multi-part post, loses key information about file name that Tika needs
Date Fri, 19 Apr 2013 08:35:16 GMT

    [ https://issues.apache.org/jira/browse/SOLR-4358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13636184#comment-13636184
] 

Karl Wright commented on SOLR-4358:
-----------------------------------

Ok, I found one that fails repeatably - but it seems to fail not due to HttpSolrServer but
due to problems shutting down threads.

This is how to repeat it:

ant test  -Dtestcase=BasicDistributedZk2Test -Dtests.seed=398C285200313054 -Dtests.slow=true
-Dtests.locale=uk_UA -Dtests.timezone=Africa/Kigali -Dtests.file.encoding=Cp1252

The error it gets is this:

{code}
[junit4:junit4]   2> Creating dataDir: C:\wip\solr\branch_4x\solr\build\solr-cor
e\test\J0\.\solrtest-BasicDistributedZk2Test-1366359983221
[junit4:junit4]   2> !!!! WARNING: best effort to remove C:\wip\solr\branch_4x\s
olr\build\solr-core\test\J0\.\org.apache.solr.cloud.BasicDistributedZk2Test-1366
359983220\jetty2\index\org.apache.lucene.store.RAMDirectory@10c6406 lockFactory=
org.apache.lucene.store.NativeFSLockFactory@2573a8-write.lock FAILED !!!!!
[junit4:junit4]   2> !!!! WARNING: best effort to remove C:\wip\solr\branch_4x\s
olr\build\solr-core\test\J0\.\org.apache.solr.cloud.BasicDistributedZk2Test-1366
359983220\jetty2\index FAILED !!!!!
[junit4:junit4]   2> !!!! WARNING: best effort to remove C:\wip\solr\branch_4x\s
olr\build\solr-core\test\J0\.\org.apache.solr.cloud.BasicDistributedZk2Test-1366
359983220\jetty2 FAILED !!!!!
[junit4:junit4]   2> !!!! WARNING: best effort to remove C:\wip\solr\branch_4x\s
olr\build\solr-core\test\J0\.\org.apache.solr.cloud.BasicDistributedZk2Test-1366
359983220 FAILED !!!!!
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=BasicDistributed
Zk2Test -Dtests.method=testDistribSearch -Dtests.seed=398C285200313054 -Dtests.s
low=true -Dtests.locale=uk_UA -Dtests.timezone=Africa/Kigali -Dtests.file.encodi
ng=Cp1252
[junit4:junit4] ERROR   57.2s | BasicDistributedZk2Test.testDistribSearch <<<
[junit4:junit4]    > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrSer
ver$RemoteSolrException: Server at http://127.0.0.1:59625/onenodecollectioncore
returned non ok status:500, message:Server Error
[junit4:junit4]    >    at __randomizedtesting.SeedInfo.seed([398C285200313054:B
86AA64A776E5068]:0)
[junit4:junit4]    >    at org.apache.solr.client.solrj.impl.HttpSolrServer.requ
est(HttpSolrServer.java:385)
[junit4:junit4]    >    at org.apache.solr.client.solrj.impl.HttpSolrServer.requ
est(HttpSolrServer.java:180)
[junit4:junit4]    >    at org.apache.solr.client.solrj.request.AbstractUpdateRe
quest.process(AbstractUpdateRequest.java:117)
[junit4:junit4]    >    at org.apache.solr.client.solrj.SolrServer.add(SolrServe
r.java:116)
[junit4:junit4]    >    at org.apache.solr.client.solrj.SolrServer.add(SolrServe
r.java:102)
[junit4:junit4]    >    at org.apache.solr.cloud.BasicDistributedZk2Test.testNod
eWithoutCollectionForwarding(BasicDistributedZk2Test.java:197)
[junit4:junit4]    >    at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(
BasicDistributedZk2Test.java:89)
[junit4:junit4]    >    at org.apache.solr.BaseDistributedSearchTestCase.testDis
tribSearch(BaseDistributedSearchTestCase.java:806)
[junit4:junit4]    >    at java.lang.Thread.run(Thread.java:619)
[junit4:junit4]   1> INFO  - 2013-04-19 04:27:20.374; org.apache.solr.SolrTestCa
seJ4; ###deleteCore
[junit4:junit4] HEARTBEAT J0 PID(14064@acromantula): 2013-04-19T04:28:30, stalle
d for 69.7s at: BasicDistributedZk2Test.testDistribSearch
[junit4:junit4]   1> ERROR - 2013-04-19 04:29:21.383; org.apache.solr.SolrTestCa
seJ4; ERROR: SolrIndexSearcher opens=10 closes=8
[junit4:junit4]   2> 178598 T9 ccr.ThreadLeakControl.checkThreadLeaks WARNING Wi
ll linger awaiting termination of 1 leaked thread(s).
[junit4:junit4] HEARTBEAT J0 PID(14064@acromantula): 2013-04-19T04:29:30, stalle
d for  130s at: BasicDistributedZk2Test.testDistribSearch
[junit4:junit4]   2> 198601 T9 ccr.ThreadLeakControl.checkThreadLeaks SEVERE 1 t
hread leaked from SUITE scope at org.apache.solr.cloud.BasicDistributedZk2Test:

[junit4:junit4]   2>       1) Thread[id=71, name=searcherExecutor-25-thread-1, s
tate=WAITING, group=TGRP-BasicDistributedZk2Test]
[junit4:junit4]   2>            at sun.misc.Unsafe.park(Native Method)
[junit4:junit4]   2>            at java.util.concurrent.locks.LockSupport.park(L
ockSupport.java:158)
[junit4:junit4]   2>            at java.util.concurrent.locks.AbstractQueuedSync
hronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
[junit4:junit4]   2>            at java.util.concurrent.LinkedBlockingQueue.take
(LinkedBlockingQueue.java:399)
[junit4:junit4]   2>            at java.util.concurrent.ThreadPoolExecutor.getTa
sk(ThreadPoolExecutor.java:947)
[junit4:junit4]   2>            at java.util.concurrent.ThreadPoolExecutor$Worke
r.run(ThreadPoolExecutor.java:907)
[junit4:junit4]   2>            at java.lang.Thread.run(Thread.java:619)
[junit4:junit4]   2> 198601 T9 ccr.ThreadLeakControl.tryToInterruptAll Starting
to interrupt leaked threads:
[junit4:junit4]   2>       1) Thread[id=71, name=searcherExecutor-25-thread-1, s
tate=WAITING, group=TGRP-BasicDistributedZk2Test]
[junit4:junit4]   2> 201602 T9 ccr.ThreadLeakControl.tryToInterruptAll SEVERE Th
ere are still zombie threads that couldn't be terminated:
[junit4:junit4]   2>       1) Thread[id=71, name=searcherExecutor-25-thread-1, s
tate=WAITING, group=TGRP-BasicDistributedZk2Test]
[junit4:junit4]   2>            at sun.misc.Unsafe.park(Native Method)
[junit4:junit4]   2>            at java.util.concurrent.locks.LockSupport.park(L
ockSupport.java:158)
[junit4:junit4]   2>            at java.util.concurrent.locks.AbstractQueuedSync
hronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
[junit4:junit4]   2>            at java.util.concurrent.LinkedBlockingQueue.take
(LinkedBlockingQueue.java:399)
[junit4:junit4]   2>            at java.util.concurrent.ThreadPoolExecutor.getTa
sk(ThreadPoolExecutor.java:947)
[junit4:junit4]   2>            at java.util.concurrent.ThreadPoolExecutor$Worke
r.run(ThreadPoolExecutor.java:907)
[junit4:junit4]   2>            at java.lang.Thread.run(Thread.java:619)
[junit4:junit4]   2> NOTE: test params are: codec=Lucene42: {}, docValues:{}, si
m=DefaultSimilarity, locale=uk_UA, timezone=Africa/Kigali
[junit4:junit4]   2> NOTE: Windows Vista 6.0 x86/Sun Microsystems Inc. 1.6.0_21
(32-bit)/cpus=2,threads=2,free=8746296,total=33193984
[junit4:junit4]   2> NOTE: All tests run in this JVM: [BasicDistributedZk2Test]
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=BasicDistributed
Zk2Test -Dtests.seed=398C285200313054 -Dtests.slow=true -Dtests.locale=uk_UA -Dt
ests.timezone=Africa/Kigali -Dtests.file.encoding=Cp1252
[junit4:junit4] ERROR   0.00s | BasicDistributedZk2Test (suite) <<<
[junit4:junit4]    > Throwable #1: java.lang.AssertionError: ERROR: SolrIndexSea
rcher opens=10 closes=8
[junit4:junit4]    >    at __randomizedtesting.SeedInfo.seed([398C285200313054]:
0)
[junit4:junit4]    >    at org.apache.solr.SolrTestCaseJ4.endTrackingSearchers(S
olrTestCaseJ4.java:252)
[junit4:junit4]    >    at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCas
eJ4.java:101)
[junit4:junit4]    >    at java.lang.Thread.run(Thread.java:619)Throwable #2: co
m.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE sco
pe at org.apache.solr.cloud.BasicDistributedZk2Test:
[junit4:junit4]    >    1) Thread[id=71, name=searcherExecutor-25-thread-1, stat
e=WAITING, group=TGRP-BasicDistributedZk2Test]
[junit4:junit4]    >         at sun.misc.Unsafe.park(Native Method)
[junit4:junit4]    >         at java.util.concurrent.locks.LockSupport.park(Lock
Support.java:158)
[junit4:junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchro
nizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
[junit4:junit4]    >         at java.util.concurrent.LinkedBlockingQueue.take(Li
nkedBlockingQueue.java:399)
[junit4:junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(
ThreadPoolExecutor.java:947)
[junit4:junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.r
un(ThreadPoolExecutor.java:907)
[junit4:junit4]    >         at java.lang.Thread.run(Thread.java:619)
[junit4:junit4]    >    at __randomizedtesting.SeedInfo.seed([398C285200313054]:
0)Throwable #3: com.carrotsearch.randomizedtesting.ThreadLeakError: There are st
ill zombie threads that couldn't be terminated:
[junit4:junit4]    >    1) Thread[id=71, name=searcherExecutor-25-thread-1, stat
e=WAITING, group=TGRP-BasicDistributedZk2Test]
[junit4:junit4]    >         at sun.misc.Unsafe.park(Native Method)
[junit4:junit4]    >         at java.util.concurrent.locks.LockSupport.park(Lock
Support.java:158)
[junit4:junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchro
nizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
[junit4:junit4]    >         at java.util.concurrent.LinkedBlockingQueue.take(Li
nkedBlockingQueue.java:399)
[junit4:junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(
ThreadPoolExecutor.java:947)
[junit4:junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.r
un(ThreadPoolExecutor.java:907)
[junit4:junit4]    >         at java.lang.Thread.run(Thread.java:619)
[junit4:junit4]    >    at __randomizedtesting.SeedInfo.seed([398C285200313054]:
0)
[junit4:junit4] Completed in 203.91s, 1 test, 1 failure, 3 errors <<< FAILURES!
[junit4:junit4]
[junit4:junit4]
[junit4:junit4] Tests with failures:
[junit4:junit4]   - org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSea
rch
[junit4:junit4]   - org.apache.solr.cloud.BasicDistributedZk2Test (suite)
[junit4:junit4]
[junit4:junit4]
[junit4:junit4] JVM J0:     1.55 ..   206.98 =   205.43s
[junit4:junit4] Execution time total: 3 minutes 27 seconds
[junit4:junit4] Tests summary: 1 suite, 1 test, 3 suite-level errors, 1 error

BUILD FAILED
{code}

I don't think this is related to the patch for this ticket, but to be sure I'll peel the patch
out and try it again.

                
> SolrJ, by preventing multi-part post, loses key information about file name that Tika
needs
> -------------------------------------------------------------------------------------------
>
>                 Key: SOLR-4358
>                 URL: https://issues.apache.org/jira/browse/SOLR-4358
>             Project: Solr
>          Issue Type: Bug
>          Components: clients - java
>    Affects Versions: 4.0
>            Reporter: Karl Wright
>            Assignee: Ryan McKinley
>         Attachments: additional_changes.diff, SOLR-4358.patch, SOLR-4358.patch, SOLR-4358.patch
>
>
> SolrJ accepts a ContentStream, which has a name field.  Within HttpSolrServer.java, if
SolrJ makes the decision to use multipart posts, this filename is transmitted as part of the
form boundary information.  However, if SolrJ chooses not to use multipart post, the filename
information is lost.
> This information is used by SolrCell (Tika) to make decisions about content extraction,
so it is very important that it makes it into Solr in one way or another.  Either SolrJ should
set appropriate equivalent headers to send the filename automatically, or it should force
multipart posts when this information is present.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message