incubator-blur-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Aaron McCurry <amccu...@gmail.com>
Subject Re: [jira] [Commented] (BLUR-93) A bug was created in the transaction log reported on mail list
Date Thu, 23 May 2013 17:38:42 GMT
That's the normal behavior, during a commit on a writer.  The commit time
is configurable but occurs every 60 seconds (I think) by default.

The rolling operation works as follows:

Commit the writer.
If successful (no exceptions)
  sync the Write Ahead Log (WAL)
    Delete the old log
    Create a new log



On Thu, May 23, 2013 at 1:35 PM, Rahul Challapalli (JIRA)
<jira@apache.org>wrote:

>
>     [
> https://issues.apache.org/jira/browse/BLUR-93?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13665385#comment-13665385]
>
> Rahul Challapalli commented on BLUR-93:
> ---------------------------------------
>
> TableAdmin.createTable method completes successfully but after that I get
> the below messages in my console(they keep going infinitely) and when I
> stop the program in eclipse it also kills the Blur process. Don't know if
> it is an issue with my configuration or a problem in code
>
> INFO  20130522_18:53:29:029_PDT [Commit Thread [words1/shard-00000000]]
> writer.TransactionRecorder: Commit took [11.043 ms] for
> [words1/shard-00000000]
> INFO  20130522_18:53:29:029_PDT [Commit Thread [words1/shard-00000000]]
> writer.TransactionRecorder: Rolling WAL path
> [hdfs://localhost:9000/blur/tables/words/logs/shard-00000000]
> INFO  20130522_18:53:29:029_PDT [Commit Thread [words1/shard-00000000]]
> writer.TransactionRecorder: Log roller took [9.284 ms] for
> [words1/shard-00000000]
>
>
> > A bug was created in the transaction log reported on mail list
> > --------------------------------------------------------------
> >
> >                 Key: BLUR-93
> >                 URL: https://issues.apache.org/jira/browse/BLUR-93
> >             Project: Apache Blur
> >          Issue Type: Bug
> >    Affects Versions: 0.1.5
> >            Reporter: Aaron McCurry
> >             Fix For: 0.1.5
> >
> >
> > Getting the below error while creating a Table in blur. Any ideas?
> > INFO  20130519_20:08:05:005_PDT [Commit Thread [words/shard-00000000]]
> > writer.TransactionRecorder: Log roller took [52.565] for [IndexWriter
> with
> > directory [HdfsDirectory
> > path=[hdfs://localhost:9000/blur/tables/words/shard-00000000]]]
> > INFO  20130519_20:08:08:008_PDT [thrift-processors5]
> > server.ShardServerEventHandler: Method called
> > INFO  20130519_20:08:08:008_PDT [thrift-processors0] thrift.TableAdmin:
> > Opening - Shards Open [1], Shards Opening [0] of table [words]
> > INFO  20130519_20:09:05:005_PDT [Commit Thread [words/shard-00000000]]
> > writer.TransactionRecorder: Commit took [5.219] for [IndexWriter with
> > directory [HdfsDirectory
> > path=[hdfs://localhost:9000/blur/tables/words/shard-00000000]]]
> > INFO  20130519_20:09:05:005_PDT [Commit Thread [words/shard-00000000]]
> > writer.TransactionRecorder: Rolling WAL path
> > [hdfs://localhost:9000/blur/tables/words/logs/shard-00000000]
> > INFO  20130519_20:09:05:005_PDT [Commit Thread [words/shard-00000000]]
> > writer.TransactionRecorder: Log roller took [7.706] for [IndexWriter with
> > directory [HdfsDirectory
> > path=[hdfs://localhost:9000/blur/tables/words/shard-00000000]]]
> > INFO  20130519_20:10:05:005_PDT [Commit Thread [words/shard-00000000]]
> > writer.TransactionRecorder: Commit took [5.394] for [IndexWriter with
> > directory [HdfsDirectory
> > path=[hdfs://localhost:9000/blur/tables/words/shard-00000000]]]
> > INFO  20130519_20:10:05:005_PDT [Commit Thread [words/shard-00000000]]
> > writer.TransactionRecorder: Rolling WAL path
> > [hdfs://localhost:9000/blur/tables/words/logs/shard-00000000]
> > ERROR 20130519_20:10:05:005_PDT [wal-sync-[words/shard-00000000]]
> > writer.TransactionRecorder: Known error while trying to sync.
> > java.io.IOException: DFSOutputStream is closed
> > at
> >
> org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.sync(DFSClient.java:3669)
> > at
> org.apache.hadoop.fs.FSDataOutputStream.sync(FSDataOutputStream.java:97)
> >  at
> >
> org.apache.blur.manager.writer.TransactionRecorder.tryToSync(TransactionRecorder.java:301)
> > at
> >
> org.apache.blur.manager.writer.TransactionRecorder.tryToSync(TransactionRecorder.java:291)
> >  at
> >
> org.apache.blur.manager.writer.TransactionRecorder.run(TransactionRecorder.java:380)
>
> --
> This message is automatically generated by JIRA.
> If you think it was sent incorrectly, please contact your JIRA
> administrators
> For more information on JIRA, see: http://www.atlassian.com/software/jira
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message