couchdb-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Robert Newson <rnew...@apache.org>
Subject Re: [jira] [Commented] (COUCHDB-1346) CouchDB hangs during start of view indexing
Date Tue, 11 Dec 2012 09:56:11 GMT
+1 for A, -1 for B.

The optimization in question is one we've lived without for some time,
introducing it conditional on platform is a mistake in my opinion.
Let's get it right in 1.4.

Obviously if we find the root cause and fix it, then I'm +1 on
including it, but I'd rather get 1.3 out, and get us onto the post-1.3
cycle of more frequent releases.

On 11 December 2012 08:30, Paul Davis <paul.joseph.davis@gmail.com> wrote:
> Tiger,
>
> This particular thread is in regards to the 1.3.x branch which is
> experiencing issues on Windows.
>
> Being an ASF project our official releases are source releases and as such
> we don't really use the alpha/beta demarcation because we expect everyone
> that is testing our code to be building from source. We do have a notion of
> a release candidate but that comes during the official release process in
> terms of specific sha1 verifiable tarballs of source code. Until then we
> work directly off the version branches as we get ready to start the
> official release procedure.
>
> As to being unstructured, I'd just point out that this is the dev@ list for
> CouchDB where we discuss project development. If you're interested in
> listening for official release announcements and specific upgrade
> instructions you'll want to subscribe to the user@ or
> announce@apache.orglists for official release announcements.
> Subscribing to this list is only
> showing you how the sausage is made.
>
> HTH,
> Paul Davis
>
>
> On Mon, Dec 10, 2012 at 10:46 PM, Tiger Nassau Inc <
> john.tigernassau@gmail.com> wrote:
>
>> Maybe because its not very clear what stage the release is at, where the
>> pre builds are, etc.  We have tested many oss pre-releases from distros
>> like ubuntu, fedora to dbs like postgres,mongo to apps like inkscape, etc
>> but with couch we are confused - are we at beta, rc ?  Is it at master or
>> branch ?  Is cors in?   We are not sure what exactly we are supposed to
>> test - maybe we are missing blog posts or something?  It all just seems
>> somewhat unstructured for something that requires so much effort to upgrade
>> as a db
>>
>> Sent from my LG Mobile
>>
>> Jason Smith <jhs@iriscouch.com> wrote:
>>
>> >Only a handful of people requested to run the 1.3 prebuilds. However I
>> have
>> >not heard complaints so far.
>> >
>> >
>> >On Tue, Dec 11, 2012 at 7:01 AM, Jan Lehnardt (JIRA) <jira@apache.org
>> >wrote:
>> >
>> >>
>> >>     [
>> >>
>> https://issues.apache.org/jira/browse/COUCHDB-1346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13528465#comment-13528465
>> ]
>> >>
>> >> Jan Lehnardt commented on COUCHDB-1346:
>> >> ---------------------------------------
>> >>
>> >> And as a point of confirmation, master with the patch reverted works as
>> >> expected.
>> >>
>> >> Our options:
>> >>
>> >> A)
>> >>  - revert and release 1.3.0
>> >>  - understand the root cause and work around it if possible and re-land
>> in
>> >> 1.4 or later.
>> >>
>> >> B)
>> >>  - revert and reintroduce with a OS-switch that disables the code on
>> Win32.
>> >>  - understand the root cause and work around it if possible and
>> re-enable
>> >> in Win32 in 1.4 or later.
>> >>
>> >> Given that we had zero reports of random lockups with 1.3.0 yet (would
>> >> love to hear from Jason who has 1.3.x running on IrisCouch for a few
>> >> weeks), I currently opt for B).
>> >>
>> >> People who should look at this:
>> >>
>> >>  - Jason
>> >>  - Paul
>> >>  - Dave
>> >>  - Anyone else who is interested.
>> >>
>> >> > CouchDB hangs during start of view indexing
>> >> > -------------------------------------------
>> >> >
>> >> >                 Key: COUCHDB-1346
>> >> >                 URL:
>> https://issues.apache.org/jira/browse/COUCHDB-1346
>> >> >             Project: CouchDB
>> >> >          Issue Type: Bug
>> >> >          Components: View Server Support
>> >> >    Affects Versions: 1.3
>> >> >         Environment: Windows 7 Enterprise only, not able to replicate
>> on
>> >> Mac OS X.
>> >> > Erlang R14B03 + crypto patches.
>> >> > Mozilla Javascript 1.8.5
>> >> >            Reporter: Dave Cottlehuber
>> >> >            Assignee: Adam Kocoloski
>> >> >            Priority: Blocker
>> >> >              Labels: Windows
>> >> >             Fix For: 1.3
>> >> >
>> >> >
>> >> > [info] [<0.20499.0>] Opening index for db: test_suite_db idx:
>> >> f4421bf4e9c9bf2acb3db91bca9e9adc sig: "d5c87ad33242b181f86be2139cbccd96"
>> >> > [info] [<0.20504.0>] Starting index update for db: test_suite_db
idx:
>> >> f4421bf4e9c9bf2acb3db91bca9e9adc
>> >> > [info] [<0.20334.0>] 172.16.40.1 - - POST /test_suite_db/_temp_view
>> 500
>> >> > [info] [<0.20513.0>] 172.16.40.1 - - GET
>> >> /_utils/couch_tests.html?script/couch_tests.js 200
>> >> > [info] [<0.20514.0>] 172.16.40.1 - - GET /_utils/index.html 200
>> >> > [info] [<0.20060.0>] 172.16.40.1 - - DELETE /test_suite_db_a/
200
>> >> > [info] [<0.20407.0>] 172.16.40.1 - - GET /test_suite_reports/
404
>> >> > [info] [<0.20058.0>] 172.16.40.1 - - DELETE /test_suite_db/ 404
>> >> > [info] [<0.20071.0>] 172.16.40.1 - - DELETE /test_suite_db/ 404
>> >> > [info] [<0.20069.0>] 172.16.40.1 - - DELETE /test_suite_db/ 404
>> >> > [info] [<0.20484.0>] 172.16.40.1 - - DELETE /test_suite_db/ 404
>> >> > [info] [<0.20364.0>] 172.16.40.1 - - DELETE /test_suite_db/ 404
>> >> > [info] [<0.20062.0>] 172.16.40.1 - - DELETE /test_suite_db/ 404
>> >> > [info] [<0.20388.0>] 172.16.40.1 - - DELETE /test_suite_db/ 404
>> >> > [info] [<0.20345.0>] 172.16.40.1 - - DELETE /test_suite_db/ 404
>> >> > [info] [<0.20072.0>] 172.16.40.1 - - DELETE /test_suite_db/ 404
>> >> > [info] [<0.20059.0>] 172.16.40.1 - - DELETE /test_suite_db/ 404
>> >> > [info] [<0.20061.0>] 172.16.40.1 - - DELETE /test_suite_db/ 404
>> >> > [info] [<0.20472.0>] 172.16.40.1 - - DELETE /test_suite_db/ 200
>> >> > [error] [<0.20050.0>] ** Generic server couch_index_server terminating
>> >> > ** Last message in was
>> {'$gen_cast',{reset_indexes,<<"test_suite_db">>}}
>> >> > ** When Server state == {st,"../var/lib/couchdb"}
>> >> > ** Reason for termination ==
>> >> > ** {{case_clause,{error,eacces}},
>> >> >     [{couch_file,'-nuke_dir/2-fun-0-',3},
>> >> >      {lists,foreach,2},
>> >> >      {couch_file,nuke_dir,2},
>> >> >      {couch_index_server,handle_cast,2},
>> >> >      {gen_server,handle_msg,5},
>> >> >      {proc_lib,init_p_do_apply,3}]}
>> >> > =ERROR REPORT==== 23-Nov-2011::21:17:14 ===
>> >> > ** Generic server couch_index_server terminating
>> >> > ** Last message in was
>> {'$gen_cast',{reset_indexes,<<"test_suite_db">>}}
>> >> > ** When Server state == {st,"../var/lib/couchdb"}
>> >> > ** Reason for termination ==
>> >> > ** {{case_clause,{error,eacces}},
>> >> >     [{couch_file,'-nuke_dir/2-fun-0-',3},
>> >> >      {lists,foreach,2},
>> >> >      {couch_file,nuke_dir,2},
>> >> >      {couch_index_server,handle_cast,2},
>> >> >      {gen_server,handle_msg,5},
>> >> >      {proc_lib,init_p_do_apply,3}]}
>> >> > [error] [<0.20050.0>] {error_report,<0.19957.0>,
>> >> >                           {<0.20050.0>,crash_report,
>> >> >                            [[{initial_call,
>> >> >
>> >>  {couch_index_server,init,['Argument__1']}},
>> >> >                              {pid,<0.20050.0>},
>> >> >                              {registered_name,couch_index_server},
>> >> >                              {error_info,
>> >> >                                  {exit,
>> >> >                                      {{case_clause,{error,eacces}},
>> >> >
>> >> [{couch_file,'-nuke_dir/2-fun-0-',3},
>> >> >                                        {lists,foreach,2},
>> >> >                                        {couch_file,nuke_dir,2},
>> >> >
>> >>  {couch_index_server,handle_cast,2},
>> >> >                                        {gen_server,handle_msg,5},
>> >> >                                        {proc_lib,init_p_do_apply,3}]},
>> >> >                                      [{gen_server,terminate,6},
>> >> >                                       {proc_lib,init_p_do_apply,3}]}},
>> >> >                              {ancestors,
>> >> >
>> >>  [couch_secondary_services,couch_server_sup,
>> >> >                                   <0.19958.0>]},
>> >> >                              {messages,
>> >> >                                  [{'$gen_cast',
>> >> >
>> >> {reset_indexes,<<"test_suite_db_a">>}}]},
>> >> >                              {links,[<0.20051.0>,<0.20026.0>]},
>> >> >                              {dictionary,[]},
>> >> >                              {trap_exit,true},
>> >> >                              {status,running},
>> >> >                              {heap_size,1597},
>> >> >                              {stack_size,24},
>> >> >                              {reductions,12211}],
>> >> >                             [{neighbour,
>> >> >                                  [{pid,<0.20051.0>},
>> >> >                                   {registered_name,[]},
>> >> >                                   {initial_call,
>> >> >
>> >> {couch_event_sup,init,['Argument__1']}},
>> >> >
>> {current_function,{gen_server,loop,6}},
>> >> >                                   {ancestors,
>> >> >                                       [couch_index_server,
>> >> >                                        couch_secondary_services,
>> >> >                                        couch_server_sup,<0.19958.0>]},
>> >> >                                   {messages,[]},
>> >> >                                   {links,[<0.20050.0>,<0.20018.0>]},
>> >> >                                   {dictionary,[]},
>> >> >                                   {trap_exit,false},
>> >> >                                   {status,waiting},
>> >> >                                   {heap_size,233},
>> >> >                                   {stack_size,9},
>> >> >                                   {reductions,32}]}]]}}
>> >> > =CRASH REPORT==== 23-Nov-2011::21:17:14 ===
>> >> >   crasher:
>> >> >     initial call: couch_index_server:init/1
>> >> >     pid: <0.20050.0>
>> >> >     registered_name: couch_index_server
>> >> >     exception exit: {{case_clause,{error,eacces}},
>> >> >                      [{couch_file,'-nuke_dir/2-fun-0-',3},
>> >> >                       {lists,foreach,2},
>> >> >                       {couch_file,nuke_dir,2},
>> >> >                       {couch_index_server,handle_cast,2},
>> >> >                       {gen_server,handle_msg,5},
>> >> >                       {proc_lib,init_p_do_apply,3}]}
>> >> >       in function  gen_server:terminate/6
>> >> >     ancestors: [couch_secondary_services,couch_server_sup,<0.19958.0>]
>> >> >     messages: [{'$gen_cast',{reset_indexes,<<"test_suite_db_a">>}}]
>> >> >     links: [<0.20051.0>,<0.20026.0>]
>> >> >     dictionary: []
>> >> >     trap_exit: true
>> >> >     status: running
>> >> >     heap_size: 1597
>> >> >     stack_size: 24
>> >> >     reductions: 12211
>> >> >   neighbours:
>> >> >     neighbour: [{pid,<0.20051.0>},
>> >> >                   {registered_name,[]},
>> >> >
>> {initial_call,{couch_event_sup,init,['Argument__1']}},
>> >> >                   {current_function,{gen_server,loop,6}},
>> >> >
>> >> {ancestors,[couch_index_server,couch_secondary_services,
>> >> >                               couch_server_sup,<0.19958.0>]},
>> >> >                   {messages,[]},
>> >> >                   {links,[<0.20050.0>,<0.20018.0>]},
>> >> >                   {dictionary,[]},
>> >> >                   {trap_exit,false},
>> >> >                   {status,waiting},
>> >> >                   {heap_size,233},
>> >> >                   {stack_size,9},
>> >> >                   {reductions,32}]
>> >> > [error] [<0.20026.0>] {error_report,<0.19957.0>,
>> >> >                           {<0.20026.0>,supervisor_report,
>> >> >
>> >>  [{supervisor,{local,couch_secondary_services}},
>> >> >                             {errorContext,child_terminated},
>> >> >                             {reason,
>> >> >                                 {{case_clause,{error,eacces}},
>> >> >                                  [{couch_file,'-nuke_dir/2-fun-0-',3},
>> >> >                                   {lists,foreach,2},
>> >> >                                   {couch_file,nuke_dir,2},
>> >> >                                   {couch_index_server,handle_cast,2},
>> >> >                                   {gen_server,handle_msg,5},
>> >> >                                   {proc_lib,init_p_do_apply,3}]}},
>> >> >                             {offender,
>> >> >                                 [{pid,<0.20050.0>},
>> >> >                                  {name,index_server},
>> >> >
>> >>  {mfargs,{couch_index_server,start_link,[]}},
>> >> >                                  {restart_type,permanent},
>> >> >                                  {shutdown,brutal_kill},
>> >> >                                  {child_type,worker}]}]}}
>> >> > OS process tree at this time is:
>> >> > Process information for SENDAI:
>> >> > Name                             Pid Pri Thd  Hnd      VM      WS
>>  Priv
>> >> > Idle                               0   0   2    0       0      24
>>   0
>> >> >   System                           4   8  79  477    3380     304
>> 108
>> >> > explorer                        1984   8  21  664  213732   46340
>> 21540
>> >> >   cmd                           2104   8   1   25   48132    3304
>>  2144
>> >> >     pslist                      2776  13   1  133   63584    4976
>>  2000
>> >> >   cmd                           2504   8   1   26   44980    3512
>>  3012
>> >> >     werl                        2680   8  16  390  196232   40064
>> 28628
>> >> >       win32sysinfo              1152   8   1   21   12624    2124
>> 640
>> >> >       couchspawnkillable        1444   8   1   30   12992    2284
>> 688
>> >> >         couchjs                 1468   8   1   39   55900    6572
>>  4056
>> >> >       couchspawnkillable        2740   8   1   30   12992    2280
>> 684
>> >> >         couchjs                 2756   8   1   39   55900    7108
>>  4444
>> >> > Erlang resumes running CouchDB when couchjs procs are terminated with
>> >> extreme
>> >> > prejudice. The hang still occurs after reverting fdmanana's
>> COUCHDB-1334
>> >> > commit. This could be a race condition during invalidation of the
>> views,
>> >> and
>> >> > subsequent deletion of the related ddoc view directory prior to
>> >> reindexing.
>> >> > On Windows a filesystem object cannot be deleted if there are open
>> >> handles
>> >> > remaining.
>> >>
>> >> --
>> >> This message is automatically generated by JIRA.
>> >> If you think it was sent incorrectly, please contact your JIRA
>> >> administrators
>> >> For more information on JIRA, see:
>> http://www.atlassian.com/software/jira
>> >>
>> >
>> >
>> >
>> >--
>> >Iris Couch
>>

Mime
View raw message