hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Uma Maheswara Rao G (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-2743) Streamline usage of bookkeeper journal manager
Date Thu, 26 Apr 2012 11:23:17 GMT

    [ https://issues.apache.org/jira/browse/HDFS-2743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13262527#comment-13262527
] 

Uma Maheswara Rao G commented on HDFS-2743:
-------------------------------------------

Ivan, Patch looks fine for me.
I have applied this patch and used the genrated BK jar in HA setsup. 

As we know, the other problem still exists.

{code}
2012-04-18 10:39:09,423 ERROR org.apache.bookkeeper.client.PendingReadOp: Error: No such entry
while reading entry: 1 ledgerId: 5 from bookie: /10.18.52.157:3181
2012-04-18 10:39:09,457 WARN org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer: Edits
tailer failed to find any streams. Will try again later.
java.io.IOException: No ledger for fromTxnId -12344 found.
	at org.apache.hadoop.contrib.bkjournal.BookKeeperJournalManager.getInputStream(BookKeeperJournalManager.java:329)
	at org.apache.hadoop.hdfs.server.namenode.JournalSet.getInputStream(JournalSet.java:246)
	at org.apache.hadoop.hdfs.server.namenode.FSEditLog.selectInputStreams(FSEditLog.java:1100)
	at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer.doTailEdits(EditLogTailer.java:206)
	at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer.access$700(EditLogTailer.java:59)
	at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.doWork(EditLogTailer.java:318)
	at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.access$200(EditLogTailer.java:276)
	at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread$1.run(EditLogTailer.java:293)
	at org.apache.hadoop.security.SecurityUtil.doAsLoginUserOrFatal(SecurityUtil.java:504)
	at org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer$EditLogTailerThread.run(EditLogTailer.java:289)
{code}

I think you already handled them as part of other issues, like HDFS-2717, HDFS-3058.

I am ok with this patch. I will commit the patch tomorrow, if there are no objections.

                
> Streamline usage of bookkeeper journal manager
> ----------------------------------------------
>
>                 Key: HDFS-2743
>                 URL: https://issues.apache.org/jira/browse/HDFS-2743
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>            Reporter: Ivan Kelly
>            Assignee: Ivan Kelly
>             Fix For: 0.24.0
>
>         Attachments: HDFS-2743.diff, HDFS-2743.diff
>
>
> The current method of installing bkjournal manager involves generating a tarball, and
extracting it with special flags over the hdfs distribution. This is cumbersome and prone
to being broken by other changes (see https://svn.apache.org/repos/asf/hadoop/common/trunk@1220940).
I think a cleaner way to doing this is to generate a single jar that can be placed in the
lib dir of hdfs.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message