hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Pradeep Kamath (JIRA)" <j...@apache.org>
Subject [jira] Updated: (PIG-1317) LOLoad should cache results of LoadMetadata.getSchema() for use in subsequent calls to LOLoad.getSchema() or LOLoad.determineSchema()
Date Thu, 25 Mar 2010 23:58:27 GMT

     [ https://issues.apache.org/jira/browse/PIG-1317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Pradeep Kamath updated PIG-1317:
--------------------------------

      Resolution: Fixed
    Hadoop Flags: [Reviewed]
          Status: Resolved  (was: Patch Available)

Patch committed to trunk and branch-0.7

> LOLoad should cache results of LoadMetadata.getSchema() for use in subsequent calls to
LOLoad.getSchema() or LOLoad.determineSchema()
> -------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: PIG-1317
>                 URL: https://issues.apache.org/jira/browse/PIG-1317
>             Project: Pig
>          Issue Type: Improvement
>    Affects Versions: 0.7.0
>            Reporter: Pradeep Kamath
>            Assignee: Pradeep Kamath
>             Fix For: 0.7.0
>
>         Attachments: PIG-1317.patch
>
>
> In LOLoad.getProjectionMap(), the private method determineSchema() is called which inturn
calls LoadMetadata.getSchema() - the latter call could potentially be expensive if the input
file is read to determine the schema or a metadata system is contacted to get the schema -
determineSchema() can cache the schema it gets so that subsequent calls use the cached version.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message