hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Richard Ding (JIRA)" <j...@apache.org>
Subject [jira] Updated: (PIG-1141) Make streaming work with the new load-store interfaces
Date Wed, 16 Dec 2009 18:36:18 GMT

     [ https://issues.apache.org/jira/browse/PIG-1141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Richard Ding updated PIG-1141:
------------------------------

    Attachment: PIG-1141.patch

This patch implemented the proposed changes to streaming with the following modification:

* PigToStream interface:

{code}
package org.apache.pig.impl.streaming;

public interface PigToStream {
    
    /**
     * Given a tuple, produce an array of bytes to be passed to the streaming
     * executable.
     */
    public byte[] serialize(Tuple t) throws IOException;

}
{code}

* StreamToPig interface:

{code}
package org.apache.pig.impl.streaming;

public interface StreamToPig {
    /**
     *  Given a byte array from a streaming executable, produce a tuple.
     */
    public Tuple deserialize(byte[] bytes) throws IOException;

    /**
     * This will be called on the front end during planning and not on the back 
     * end during execution.
     * 
     * @return the {@link LoadCaster} associated with this object. 
     * @throws IOException if there is an exception during LoadCaster 
     */
    public LoadCaster getLoadCaster() throws IOException;

}

{code}

* The class that provides the default implementation of these interfaces: 

{code}

org.apache.pig.impl.streaming.PigStreaming

{code} 


> Make streaming work with the new load-store interfaces 
> -------------------------------------------------------
>
>                 Key: PIG-1141
>                 URL: https://issues.apache.org/jira/browse/PIG-1141
>             Project: Pig
>          Issue Type: Sub-task
>            Reporter: Richard Ding
>            Assignee: Richard Ding
>         Attachments: PIG-1141.patch
>
>


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message