hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Uma Maheswara Rao G (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-2743) Streamline usage of bookkeeper journal manager
Date Thu, 26 Apr 2012 11:23:17 GMT

    [ https://issues.apache.org/jira/browse/HDFS-2743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13262527#comment-13262527

Uma Maheswara Rao G commented on HDFS-2743:

Ivan, Patch looks fine for me.
I have applied this patch and used the genrated BK jar in HA setsup. 

As we know, the other problem still exists.

2012-04-18 10:39:09,423 ERROR org.apache.bookkeeper.client.PendingReadOp: Error: No such entry
while reading entry: 1 ledgerId: 5 from bookie: /
2012-04-18 10:39:09,457 WARN org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer: Edits
tailer failed to find any streams. Will try again later.
java.io.IOException: No ledger for fromTxnId -12344 found.
	at org.apache.hadoop.contrib.bkjournal.BookKeeperJournalManager.getInputStream(BookKeeperJournalManager.java:329)
	at org.apache.hadoop.hdfs.server.namenode.JournalSet.getInputStream(JournalSet.java:246)
	at org.apache.hadoop.hdfs.server.namenode.FSEditLog.selectInputStreams(FSEditLog.java:1100)
	at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer.doTailEdits(EditLogTailer.java:206)
	at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer.access$700(EditLogTailer.java:59)
	at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.doWork(EditLogTailer.java:318)
	at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.access$200(EditLogTailer.java:276)
	at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread$1.run(EditLogTailer.java:293)
	at org.apache.hadoop.security.SecurityUtil.doAsLoginUserOrFatal(SecurityUtil.java:504)
	at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.run(EditLogTailer.java:289)

I think you already handled them as part of other issues, like HDFS-2717, HDFS-3058.

I am ok with this patch. I will commit the patch tomorrow, if there are no objections.

> Streamline usage of bookkeeper journal manager
> ----------------------------------------------
>                 Key: HDFS-2743
>                 URL: https://issues.apache.org/jira/browse/HDFS-2743
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>            Reporter: Ivan Kelly
>            Assignee: Ivan Kelly
>             Fix For: 0.24.0
>         Attachments: HDFS-2743.diff, HDFS-2743.diff
> The current method of installing bkjournal manager involves generating a tarball, and
extracting it with special flags over the hdfs distribution. This is cumbersome and prone
to being broken by other changes (see https://svn.apache.org/repos/asf/hadoop/common/trunk@1220940).
I think a cleaner way to doing this is to generate a single jar that can be placed in the
lib dir of hdfs.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message