hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vinod Kumar Vavilapalli (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-710) Add to ser/deser methods to RecordFactory
Date Wed, 22 May 2013 20:50:20 GMT

    [ https://issues.apache.org/jira/browse/YARN-710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13664508#comment-13664508
] 

Vinod Kumar Vavilapalli commented on YARN-710:
----------------------------------------------

FWIU, Just having the a public util class which selectively serializes/deserializes records
is fine. No need for tagging records.

We don't want to support compatibility of disk serialization of some records, for e.g. AllocateResponse.

And as Sid says, Records/RecordFactory are all YARN private APIs. So, I'd ideally separate
this serialization from YARN internal serialization, by creating a parallel factory class
for reading and writing records. Instead if you just want to depend on existing stuff by adding
methods to RecordFactory, sure. But like mentioned, it is going to be private and not supportable.
                
> Add to ser/deser methods to RecordFactory
> -----------------------------------------
>
>                 Key: YARN-710
>                 URL: https://issues.apache.org/jira/browse/YARN-710
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: api
>    Affects Versions: 2.0.4-alpha
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>         Attachments: YARN-710.patch
>
>
> I order to do things like AMs failover and checkpointing I need to serialize app IDs,
app attempt IDs, containers and/or IDs,  resource requests, etc.
> Because we are wrapping/hiding the PB implementation from the APIs, we are hiding the
built in PB ser/deser capabilities.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message