cassandra-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jeremy Hanna <jeremy.hanna1...@gmail.com>
Subject Re: Cassandra + Pig + PHP
Date Wed, 06 Oct 2010 10:32:36 GMT
Yes - the HadoopSupport should be updated for the functionality that is added to 0.7.  It's
still a little in flux.  There is an output format and output streaming support on trunk/0.7
beta2.  The output format has a java example in the contrib/word_count example code.  The
output streaming, which would be useful for those using languages other than java, has an
example in contrib/hadoop_streaming_output and that is written in python.  I'm not sure if
PHP could be used for that method though because it makes use of avro and avro php support
is limited currently.  Anyway, just 2 cents about some in flux developments as 0.7 finalizes.

On Oct 6, 2010, at 5:20 AM, Aaron Morton wrote:

> AFAIK you can submit a pig job to the Hadoop job server via the pig command line interface.
If you have not done so already have a read of the Hadoop Book it discusses pig as well  
> http://bit.ly/9gGRyH
> 
> Not sure how you go about monitoring the hadoop job though.
> 
> There is support for hadoop to output to Cassandra, not sure if this has made it into
the pig code (am on iPad now)   See http://wiki.apache.org/cassandra/HadoopSupport
> 
> Aaron
> 
> On 6 Oct 2010, at 21:35, Jeff Zhang <zjffdu@gmail.com> wrote:
> 
>> Pig do not have thrift interface, But I believe you can create it. And
>> another way I think is create a web service for your pig service, and
>> call the web service in your php.
>> 
>> 
>> 
>> On Wed, Oct 6, 2010 at 4:17 PM, Petr Odut <petr.odut@gmail.com> wrote:
>>> Hi,
>>> PHP: I basicaly need to start pig program from a php script (via thrift or
>>> something..?)
>>> PIG: there is a LoadFunc that loads data from Cassandra, is there also a
>>> StoreFunc?
>>> 
>>> On Tue, Oct 5, 2010 at 9:22 PM, Aaron Morton <aaron@thelastpickle.com>
>>> wrote:
>>>> 
>>>> There is an example for pig in contrib/pig and a hadoop example in
>>>> contrib/hadoop .
>>>> What role did you want PHP to fill?
>>>> Aaron
>>>> 
>>>> 
>>>> On 06 Oct, 2010,at 06:05 AM, Petr Odut <petr.odut@gmail.com> wrote:
>>>> 
>>>> Is there any example / tutorial combining these technologies?
>>>> Thanks
>>>> 
>>>> --
>>>> Petr Odut [petr.odut@gmail.com]
>>> 
>>> 
>>> 
>>> --
>>> Petr Odut [petr.odut@gmail.com]
>>> 
>> 
>> 
>> 
>> -- 
>> Best Regards
>> 
>> Jeff Zhang
> 


Mime
View raw message