hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Vladimir Rodionov <vrodio...@carrieriq.com>
Subject RE: Local sockets
Date Mon, 06 Dec 2010 21:39:36 GMT
Unless you write your own, optimized for M/R applications.
Yes, application level I/O scheduler for M/R kind of applications can be much efficient than

standard Linux I/O scheduler. But this is off topic in hbase-dev list, I presume.

Best regards,
Vladimir Rodionov
Principal Platform Engineer
Carrier IQ, www.carrieriq.com
e-mail: vrodionov@carrieriq.com

From: Rajappa Iyer [rsi@panix.com]
Sent: Monday, December 06, 2010 12:24 PM
To: dev@hbase.apache.org
Subject: Re: Local sockets

Ryan Rawson <ryanobjc@gmail.com> writes:

> So are we talking about re-implementing IO scheduling in Hadoop at the
> application level?

Essentially yes.  It does seem nasty to do that, but realistically
there's no way that a general purpose I/O scheduler in the OS can
schedule I/O optimally for M/R kind of applications.


View raw message