couchdb-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Paweł Melon (JIRA) <j...@apache.org>
Subject [jira] Created: (COUCHDB-149) Compactation failure when *.compact file reach 2116687115 (ap. 2GB) size
Date Fri, 31 Oct 2008 21:05:44 GMT
Compactation failure when *.compact file reach 2116687115 (ap. 2GB) size
------------------------------------------------------------------------

                 Key: COUCHDB-149
                 URL: https://issues.apache.org/jira/browse/COUCHDB-149
             Project: CouchDB
          Issue Type: Bug
          Components: Database Core
    Affects Versions: 0.8.1
         Environment: Ubuntu 8.04 2.6.24-21-generic x86_64 GNU/Linux processor Duo 2 Quad,
8 GB RAM
            Reporter: Paweł Melon


CouchDB is has been working 3 days without stop. I tried to insert large amount of data. From
time to time I was doing compactation.

One when database has 50GB of size and 3 mln records, then tried second time when there was
4,7 mln records and 12 GB but something failed. I tried to restart compaction from futon interface
but it wasn't working.

On console where was working inserting script written in erlang I received message.

Err add {event,{session,965,3,2005718},
               {session_data,os,"Ubuntu 8.10",icecast,"WinampMPEG/5.53"},
               {listener,999999999999999,12301897,"85.112.221.200"},
               1213297703,undefined,21,undefined,undefined}  {ok,
                                                              {{"HTTP/1.1",
                                                                500,
                                                                "Internal Server Error"},
                                                               [{"cache-control",
                                                                 "must-revalidate"},
                                                                {"date",
                                                                 "Fri, 31 Oct 2008 19:13:43
GMT"},
                                                                {"server",
                                                                 "CouchDB/0.8.1-incubating
(Erlang OTP/R12B)"},
                                                                {"content-length",
                                                                 "1665"},
                                                                {"content-type",
                                                                 "text/plain;charset=utf-8"}],
                                                               "{\"error\":\"EXIT\",\"reason\":\"{{function_clause,\\n
    [{couch_db,'-copy_docs\\/3-fun-0-',\\n          [not_found,<0.24367.262>,\\n   
       {stream,<0.25264.262>,<0.25263.262>},\\n           <0.25263.262>]},\\n
     {lists,map,2},\\n      {lists,map,2},\\n      {couch_db,copy_docs,3},\\n      {couch_db,'-copy_compact_docs\\/2-fun-0-',4},\\n
     {couch_btree,stream_kv_node2,7},\\n      {couch_btree,stream_kp_node,6},\\n      {couch_btree,stream_kp_node,7}]},\\n
{gen_server,call,\\n     [<0.24368.262>,\\n      {update_docs,\\n          [[{doc,\\\"965:3:2005718\\\",\\n
               [\\\"102178913\\\"],\\n                {obj,\\n                    [{\\\"type\\\",\\\"event\\\"},\\n
                    {\\\"session\\\",\\n                      {obj,\\n                   
      [{\\\"server_id\\\",965},\\n                           {\\\"instance_id\\\",3},\\n 
                         {\\\"id\\\",2005718}]}},\\n                     {\\\"session_data\\\",\\n
                     {obj,\\n                          [{\\\"origin\\\",\\\"os\\\"},\\n  
                        {\\\"os_type\\\",\\\"Ubuntu 8.10\\\"},\\n                        
  {\\\"server_type\\\",\\\"icecast\\\"},\\n                           {\\\"player\\\",\\\"WinampMPEG\\/5.53\\\"}]}},\\n
                    {\\\"listener\\\",\\n                      {obj,\\n                  
       [{\\\"pid\\\",999999999999999},\\n                           {\\\"gg\\\",12301897},\\n
                          {\\\"ip\\\",\\\"85.112.221.200\\\"}]}},\\n                     {\\\"start_time\\\",1213297703},\\n
                    {\\\"end_time\\\",\\\"undefined\\\"},\\n                     {\\\"channel\\\",21},\\n
                    {\\\"intro\\\",\\\"undefined\\\"}]},\\n                [],false,[]}]],\\n
         [new_edits]},\\n      infinity]}}\"}"}}

I think that the most important part is error reason:

"{\"error\":\"EXIT\",\"reason\":\"{{function_clause,\\n     [{couch_db,'-copy_docs\\/3-fun-0-',\\n
         [not_found,<0.24367.262>,\\n           {stream,<0.25264.262>,<0.25263.262>},\\n
          <0.25263.262>]},\\n      {lists,map,2},\\n      {lists,map,2},\\n      {couch_db,copy_docs,3},\\n
     {couch_db,'-copy_compact_docs\\/2-fun-0-',4},\\n      {couch_btree,stream_kv_node2,7},\\n
     {couch_btree,stream_kp_node,6},\\n      {couch_btree,stream_kp_node,7}]},\\n {gen_server,call,\\n
    [<0.24368.262>,\\n      {update_docs,\\n          [[{doc,\\\"965:3:2005718\\\",\\n
               [\\\"102178913\\\"],\\n                {obj,\\n                    [{\\\"type\\\",\\\"event\\\"},\\n
                    {\\\"session\\\",\\n                      {obj,\\n                   
      [{\\\"server_id\\\",965},\\n                          

or second time

 "{\"error\":\"EXIT\",\"reason\":\"{noproc,{gen_server,call,\\n                    [<0.25341.262>,{pread_bin,18695772967},infinity]}}\"}"}


It is strange that compaction alway failed when *.compact file has 2116687115 or 2116963527
bytes of size. Always approximately 2GB.

Is it bug? or there is some config parameter which says about result compact file size. If
here is one, why file before compaction can has 50 GB size?

Im sory for my poor English.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message