hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From 윤진석 <uda...@nhncorp.com>
Subject RE: [jira] Updated: (HADOOP-1375) a simple parser for hbase.
Date Fri, 08 Jun 2007 00:40:19 GMT
Thank you for your advice, stack.

Then, I'll focus efforts to enhance the basic functions of 1375 issue.

 

 

> Date: Thu, 7 Jun 2007 09:33:23 -0700

> From: stack@duboce.net

> To: hadoop-dev@lucene.apache.org

> Subject: Re: [jira] Updated: (HADOOP-1375) a simple parser for hbase.

> 

> Edward:

> 

> I reformatted your message below because the original runs together w/o

> new lines and so is hard to read.

> 

> Matrix support in an hbaseshell looks like an interesting addition but

> I'm more interested in getting basic hbaseshell functionality,

> hadoop-1375, committed first (smile).

> 

> I'd suggest the matrix extensions happen in an issue distinct from

> hadoop-1375.

> 

> St.Ack

> 

> 

> 

> 

> HBase > CREATE m_temp COLUMNFAMILIES('A','B','C') LIMIT=3;

> //Create Constant Matrix

> HBase > A = Matrix(number_of_rows, number_of_columns, constant);

> //multiply a matrix by a scalar in place, A = s*A

> HBase > A = A.timesEquals(3);....

> HBase > B = Matrix(number_of_rows, number_of_columns, constant);

> HBase > C = A + B;....

> 

> I intend to provide the following grammars to users.

> Processing takes place on top of Hadoop + HBase parallelly.

> but... How much does it mean to users to provide this feature of

> processing data via user-oriented interface on shell?

> 

> If you could give me an opinion on the above question, it would be great.

> 

> 

> 

> edward yoon wrote:

> > HBase > CREATE m_temp COLUMNFAMILIES('A','B','C') LIMIT=3;

> > //Create Constant MatrixHBase > A = Matrix(number_of_rows, number_of_columns,
constant);

> > //multiply a matrix by a scalar in place, A = s*AHBase > A = A.timesEquals(3);....HBase
> B = Matrix(number_of_rows, number_of_columns, constant);HBase > C = A + B;....

> > I intend to provide the following grammars to users.Processing takes place on top
of Hadoop + HBase parallelly. 

> > but... How much does it mean to users to provide this feature of processing data
via user-oriented interface on shell?If you could give me an opinion on the above question,
it would be great.

> > ----B. regards,edward yoon(NHN, Inc) webmaster@udanax.org+82-31-784-4038, +82-10-7149-7856
http://www.udanax.org/

> >

> > 

> >> Date: Thu, 7 Jun 2007 02:58:26 -0700> From: jira@apache.org> To: hadoop-dev@lucene.apache.org>
Subject: [jira] Updated: (HADOOP-1375) a simple parser for hbase.> > > [ https://issues.apache.org/jira/browse/HADOOP-1375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]> > udanax updated HADOOP-1375:> ---------------------------> > Description:
> http://wiki.apache.org/lucene-hadoop/HbaseShell (work in progress)> > > HBase
Shell is developed to achieve the following goals. > > * Generic Monitoring Function
> * A Simplified Import/Export/Migrate Functionality Between different data sources (Hadoop,
HBase) > * A Simplified processing of a logical data model > * A Simplified algebraic
operations > (Parallel Numerical Analysis by abstracting/numericalizing points, lines,
or plane data across multiple maps in HBase.)> > > {code}> [# root@localhost]
./bin/hadoop jar ./build/hadoop-hbase org.apache.hadoop.hbase.shell.HbaseShell> > Hbase
> help;> blah blah...> Hbase 

> >> 

> > > create webtable > --> columnfamilies('anchors', 'language') limit=3;>
Hbase > set webtable values('anchors:http://www.udanax.org/','opensource') where row="http://www.hadoop.co.kr";>
Hbase > scan webtable where row="http://www.hadoop.co.kr";> blah blah...> Hbase >
set webtable values('language:kr','euc-kr') where row="http://www.hadoop.co.kr";> Hbase
> scan webtable where row="http://www.hadoop.co.kr" and column="language:kr";> blah
blah...> Hbase > scan webtable;> Hbase > exit> > [# root@localhost] >
{code}> > was:> this is a simple parser for hbase test.> i just write it.>
you can use this syntax to create and set.> > {code}> [# root@localhost] ./bin/hadoop
jar ./build/hadoop-hbase org.apache.hadoop.hbase.shell.HbaseShell> > Hbase > help;>
blah blah...> Hbase > create webtable > --> columnfamilies('anchors', 'language')
limit=3;> Hbase > set webtable values('anchors:http://www.udanax.org/','opensource')
where row="http://www.hadoop.co.kr";> Hbase > scan webtable where ro

> > w="http://www.hadoop.co.kr";> blah blah...> Hbase > set webtable values('language:kr','euc-kr')
where row="http://www.hadoop.co.kr";> Hbase > scan webtable where row="http://www.hadoop.co.kr"
and column="language:kr";> blah blah...> Hbase > scan webtable;> Hbase > exit>
> [# root@localhost] > {code}> > > > a simple parser for hbase.> >
--------------------------> >> > Key: HADOOP-1375> > URL: https://issues.apache.org/jira/browse/HADOOP-1375>
> Project: Hadoop> > Issue Type: Improvement> > Components: contrib/hbase>
> Environment: All environments > > Reporter: udanax> > Priority: Minor>
> Attachments: hadoop1375-v12.patch, jline-0.9.91.jar, patch.txt, patch.txt, patch.txt,
patch.txt, patch.txt, patch.txt, patch.txt, patch.txt, patch.txt, patch.txt> >> >>
> http://wiki.apache.org/lucene-hadoop/HbaseShell (work in progress)> > HBase Shell
is developed to achieve the following goals. > > * Generic Monitoring Function >
> * A Simplified Import/Export/Migrate Functionality Betwe

> > en different data sources (Hadoop, HBase) > > * A Simplified processing of
a logical data model > > * A Simplified algebraic operations > > (Parallel Numerical
Analysis by abstracting/numericalizing points, lines, or plane data across multiple maps in
HBase.)> > {code}> > [# root@localhost] ./bin/hadoop jar ./build/hadoop-hbase
org.apache.hadoop.hbase.shell.HbaseShell> > Hbase > help;> > blah blah...>
> Hbase > create webtable > > --> columnfamilies('anchors', 'language') limit=3;>
> Hbase > set webtable values('anchors:http://www.udanax.org/','opensource') where row="http://www.hadoop.co.kr";>
> Hbase > scan webtable where row="http://www.hadoop.co.kr";> > blah blah...>
> Hbase > set webtable values('language:kr','euc-kr') where row="http://www.hadoop.co.kr";>
> Hbase > scan webtable where row="http://www.hadoop.co.kr" and column="language:kr";>
> blah blah...> > Hbase > scan webtable;> > Hbase > exit> > [#
root@localhost] > > {code}> > -- > This message is automatically ge

> > nerated by JIRA.> -> You can reply to this email to add a comment to the issue
online.> 

> > _________________________________________________________________

> > Express yourself instantly with MSN Messenger! Download today it's FREE!

> > http://messenger.msn.click-url.com/go/onm00200471ave/direct/01/

> > 

> 

> > Date: Thu, 7 Jun 2007 09:33:23 -0700
> From: stack@duboce.net
> To: hadoop-dev@lucene.apache.org
> Subject: Re: [jira] Updated: (HADOOP-1375) a simple parser for hbase.
> 
> Edward:
> 
> I reformatted your message below because the original runs together w/o
> new lines and so is hard to read.
> 
> Matrix support in an hbaseshell looks like an interesting addition but
> I'm more interested in getting basic hbaseshell functionality,
> hadoop-1375, committed first (smile).
> 
> I'd suggest the matrix extensions happen in an issue distinct from
> hadoop-1375.
> 
> St.Ack
> 
> 
> 
> 
> HBase > CREATE m_temp COLUMNFAMILIES('A','B','C') LIMIT=3;
> //Create Constant Matrix
> HBase > A = Matrix(number_of_rows, number_of_columns, constant);
> //multiply a matrix by a scalar in place, A = s*A
> HBase > A = A.timesEquals(3);....
> HBase > B = Matrix(number_of_rows, number_of_columns, constant);
> HBase > C = A + B;....
> 
> I intend to provide the following grammars to users.
> Processing takes place on top of Hadoop + HBase parallelly.
> but... How much does it mean to users to provide this feature of
> processing data via user-oriented interface on shell?
> 
> If you could give me an opinion on the above question, it would be great.
> 
> 
> 
> edward yoon wrote:
> > HBase > CREATE m_temp COLUMNFAMILIES('A','B','C') LIMIT=3;
> > //Create Constant MatrixHBase > A = Matrix(number_of_rows, number_of_columns,
constant);
> > //multiply a matrix by a scalar in place, A = s*AHBase > A = A.timesEquals(3);....HBase
> B = Matrix(number_of_rows, number_of_columns, constant);HBase > C = A + B;....
> > I intend to provide the following grammars to users.Processing takes place on top
of Hadoop + HBase parallelly. 
> > but... How much does it mean to users to provide this feature of processing data
via user-oriented interface on shell?If you could give me an opinion on the above question,
it would be great.
> > ----B. regards,edward yoon(NHN, Inc) webmaster@udanax.org+82-31-784-4038, +82-10-7149-7856
http://www.udanax.org/
> >
> > 
> >> Date: Thu, 7 Jun 2007 02:58:26 -0700> From: jira@apache.org> To: hadoop-dev@lucene.apache.org>
Subject: [jira] Updated: (HADOOP-1375) a simple parser for hbase.> > > [ https://issues.apache.org/jira/browse/HADOOP-1375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]> > udanax updated HADOOP-1375:> ---------------------------> > Description:
> http://wiki.apache.org/lucene-hadoop/HbaseShell (work in progress)> > > HBase
Shell is developed to achieve the following goals. > > * Generic Monitoring Function
> * A Simplified Import/Export/Migrate Functionality Between different data sources (Hadoop,
HBase) > * A Simplified processing of a logical data model > * A Simplified algebraic
operations > (Parallel Numerical Analysis by abstracting/numericalizing points, lines,
or plane data across multiple maps in HBase.)> > > {code}> [# root@localhost]
./bin/hadoop jar ./build/hadoop-hbase org.apache.hadoop.hbase.shell.HbaseShell> > Hbase
> help;> blah blah...> Hbase 
> >> 
> > > create webtable > --> columnfamilies('anchors', 'language') limit=3;>
Hbase > set webtable values('anchors:http://www.udanax.org/','opensource') where row="http://www.hadoop.co.kr";>
Hbase > scan webtable where row="http://www.hadoop.co.kr";> blah blah...> Hbase >
set webtable values('language:kr','euc-kr') where row="http://www.hadoop.co.kr";> Hbase
> scan webtable where row="http://www.hadoop.co.kr" and column="language:kr";> blah
blah...> Hbase > scan webtable;> Hbase > exit> > [# root@localhost] >
{code}> > was:> this is a simple parser for hbase test.> i just write it.>
you can use this syntax to create and set.> > {code}> [# root@localhost] ./bin/hadoop
jar ./build/hadoop-hbase org.apache.hadoop.hbase.shell.HbaseShell> > Hbase > help;>
blah blah...> Hbase > create webtable > --> columnfamilies('anchors', 'language')
limit=3;> Hbase > set webtable values('anchors:http://www.udanax.org/','opensource')
where row="http://www.hadoop.co.kr";> Hbase > scan webtable where ro
> > w="http://www.hadoop.co.kr";> blah blah...> Hbase > set webtable values('language:kr','euc-kr')
where row="http://www.hadoop.co.kr";> Hbase > scan webtable where row="http://www.hadoop.co.kr"
and column="language:kr";> blah blah...> Hbase > scan webtable;> Hbase > exit>
> [# root@localhost] > {code}> > > > a simple parser for hbase.> >
--------------------------> >> > Key: HADOOP-1375> > URL: https://issues.apache.org/jira/browse/HADOOP-1375>
> Project: Hadoop> > Issue Type: Improvement> > Components: contrib/hbase>
> Environment: All environments > > Reporter: udanax> > Priority: Minor>
> Attachments: hadoop1375-v12.patch, jline-0.9.91.jar, patch.txt, patch.txt, patch.txt,
patch.txt, patch.txt, patch.txt, patch.txt, patch.txt, patch.txt, patch.txt> >> >>
> http://wiki.apache.org/lucene-hadoop/HbaseShell (work in progress)> > HBase Shell
is developed to achieve the following goals. > > * Generic Monitoring Function >
> * A Simplified Import/Export/Migrate Functionality Betwe
> > en different data sources (Hadoop, HBase) > > * A Simplified processing of
a logical data model > > * A Simplified algebraic operations > > (Parallel Numerical
Analysis by abstracting/numericalizing points, lines, or plane data across multiple maps in
HBase.)> > {code}> > [# root@localhost] ./bin/hadoop jar ./build/hadoop-hbase
org.apache.hadoop.hbase.shell.HbaseShell> > Hbase > help;> > blah blah...>
> Hbase > create webtable > > --> columnfamilies('anchors', 'language') limit=3;>
> Hbase > set webtable values('anchors:http://www.udanax.org/','opensource') where row="http://www.hadoop.co.kr";>
> Hbase > scan webtable where row="http://www.hadoop.co.kr";> > blah blah...>
> Hbase > set webtable values('language:kr','euc-kr') where row="http://www.hadoop.co.kr";>
> Hbase > scan webtable where row="http://www.hadoop.co.kr" and column="language:kr";>
> blah blah...> > Hbase > scan webtable;> > Hbase > exit> > [#
root@localhost] > > {code}> > -- > This message is automatically ge
> > nerated by JIRA.> -> You can reply to this email to add a comment to the issue
online.> 
> > _________________________________________________________________
> > Express yourself instantly with MSN Messenger! Download today it's FREE!
> > http://messenger.msn.click-url.com/go/onm00200471ave/direct/01/
> > 
> 
> > Date: Thu, 7 Jun 2007 09:33:23 -0700
> From: stack@duboce.net
> To: hadoop-dev@lucene.apache.org
> Subject: Re: [jira] Updated: (HADOOP-1375) a simple parser for hbase.
> 
> Edward:
> 
> I reformatted your message below because the original runs together w/o
> new lines and so is hard to read.
> 
> Matrix support in an hbaseshell looks like an interesting addition but
> I'm more interested in getting basic hbaseshell functionality,
> hadoop-1375, committed first (smile).
> 
> I'd suggest the matrix extensions happen in an issue distinct from
> hadoop-1375.
> 
> St.Ack
> 
> 
> 
> 
> HBase > CREATE m_temp COLUMNFAMILIES('A','B','C') LIMIT=3;
> //Create Constant Matrix
> HBase > A = Matrix(number_of_rows, number_of_columns, constant);
> //multiply a matrix by a scalar in place, A = s*A
> HBase > A = A.timesEquals(3);....
> HBase > B = Matrix(number_of_rows, number_of_columns, constant);
> HBase > C = A + B;....
> 
> I intend to provide the following grammars to users.
> Processing takes place on top of Hadoop + HBase parallelly.
> but... How much does it mean to users to provide this feature of
> processing data via user-oriented interface on shell?
> 
> If you could give me an opinion on the above question, it would be great.
> 
> 
> 
> edward yoon wrote:
> > HBase > CREATE m_temp COLUMNFAMILIES('A','B','C') LIMIT=3;
> > //Create Constant MatrixHBase > A = Matrix(number_of_rows, number_of_columns,
constant);
> > //multiply a matrix by a scalar in place, A = s*AHBase > A = A.timesEquals(3);....HBase
> B = Matrix(number_of_rows, number_of_columns, constant);HBase > C = A + B;....
> > I intend to provide the following grammars to users.Processing takes place on top
of Hadoop + HBase parallelly. 
> > but... How much does it mean to users to provide this feature of processing data
via user-oriented interface on shell?If you could give me an opinion on the above question,
it would be great.
> > ----B. regards,edward yoon(NHN, Inc) webmaster@udanax.org+82-31-784-4038, +82-10-7149-7856
http://www.udanax.org/
> >
> > 
> >> Date: Thu, 7 Jun 2007 02:58:26 -0700> From: jira@apache.org> To: hadoop-dev@lucene.apache.org>
Subject: [jira] Updated: (HADOOP-1375) a simple parser for hbase.> > > [ https://issues.apache.org/jira/browse/HADOOP-1375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]> > udanax updated HADOOP-1375:> ---------------------------> > Description:
> http://wiki.apache.org/lucene-hadoop/HbaseShell (work in progress)> > > HBase
Shell is developed to achieve the following goals. > > * Generic Monitoring Function
> * A Simplified Import/Export/Migrate Functionality Between different data sources (Hadoop,
HBase) > * A Simplified processing of a logical data model > * A Simplified algebraic
operations > (Parallel Numerical Analysis by abstracting/numericalizing points, lines,
or plane data across multiple maps in HBase.)> > > {code}> [# root@localhost]
./bin/hadoop jar ./build/hadoop-hbase org.apache.hadoop.hbase.shell.HbaseShell> > Hbase
> help;> blah blah...> Hbase 
> >> 
> > > create webtable > --> columnfamilies('anchors', 'language') limit=3;>
Hbase > set webtable values('anchors:http://www.udanax.org/','opensource') where row="http://www.hadoop.co.kr";>
Hbase > scan webtable where row="http://www.hadoop.co.kr";> blah blah...> Hbase >
set webtable values('language:kr','euc-kr') where row="http://www.hadoop.co.kr";> Hbase
> scan webtable where row="http://www.hadoop.co.kr" and column="language:kr";> blah
blah...> Hbase > scan webtable;> Hbase > exit> > [# root@localhost] >
{code}> > was:> this is a simple parser for hbase test.> i just write it.>
you can use this syntax to create and set.> > {code}> [# root@localhost] ./bin/hadoop
jar ./build/hadoop-hbase org.apache.hadoop.hbase.shell.HbaseShell> > Hbase > help;>
blah blah...> Hbase > create webtable > --> columnfamilies('anchors', 'language')
limit=3;> Hbase > set webtable values('anchors:http://www.udanax.org/','opensource')
where row="http://www.hadoop.co.kr";> Hbase > scan webtable where ro
> > w="http://www.hadoop.co.kr";> blah blah...> Hbase > set webtable values('language:kr','euc-kr')
where row="http://www.hadoop.co.kr";> Hbase > scan webtable where row="http://www.hadoop.co.kr"
and column="language:kr";> blah blah...> Hbase > scan webtable;> Hbase > exit>
> [# root@localhost] > {code}> > > > a simple parser for hbase.> >
--------------------------> >> > Key: HADOOP-1375> > URL: https://issues.apache.org/jira/browse/HADOOP-1375>
> Project: Hadoop> > Issue Type: Improvement> > Components: contrib/hbase>
> Environment: All environments > > Reporter: udanax> > Priority: Minor>
> Attachments: hadoop1375-v12.patch, jline-0.9.91.jar, patch.txt, patch.txt, patch.txt,
patch.txt, patch.txt, patch.txt, patch.txt, patch.txt, patch.txt, patch.txt> >> >>
> http://wiki.apache.org/lucene-hadoop/HbaseShell (work in progress)> > HBase Shell
is developed to achieve the following goals. > > * Generic Monitoring Function >
> * A Simplified Import/Export/Migrate Functionality Betwe
> > en different data sources (Hadoop, HBase) > > * A Simplified processing of
a logical data model > > * A Simplified algebraic operations > > (Parallel Numerical
Analysis by abstracting/numericalizing points, lines, or plane data across multiple maps in
HBase.)> > {code}> > [# root@localhost] ./bin/hadoop jar ./build/hadoop-hbase
org.apache.hadoop.hbase.shell.HbaseShell> > Hbase > help;> > blah blah...>
> Hbase > create webtable > > --> columnfamilies('anchors', 'language') limit=3;>
> Hbase > set webtable values('anchors:http://www.udanax.org/','opensource') where row="http://www.hadoop.co.kr";>
> Hbase > scan webtable where row="http://www.hadoop.co.kr";> > blah blah...>
> Hbase > set webtable values('language:kr','euc-kr') where row="http://www.hadoop.co.kr";>
> Hbase > scan webtable where row="http://www.hadoop.co.kr" and column="language:kr";>
> blah blah...> > Hbase > scan webtable;> > Hbase > exit> > [#
root@localhost] > > {code}> > -- > This message is automatically ge
> > nerated by JIRA.> -> You can reply to this email to add a comment to the issue
online.> 
> > _________________________________________________________________
> > Express yourself instantly with MSN Messenger! Download today it's FREE!
> > http://messenger.msn.click-url.com/go/onm00200471ave/direct/01/
> > 
> 
>


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message