InternalCachedBag.java generates javac warning and findbug warning
------------------------------------------------------------------
Key: PIG-1000
URL: https://issues.apache.org/jira/browse/PIG-1000
Project: Pig
Issue Type: Improvement
Affects Versions: 0.4.0
Reporter: Ying He
Assignee: Ying He
Fix For: 0.6.0
POPackage uses DefaultDataBag during reduce process to hold data. It is registered with SpillableMemoryManager
and prone to OutOfMemoryException. It's better to pro-actively managers the usage of the
memory. The bag fills in memory to a specified amount, and dump the rest the disk. The amount
of memory to hold tuples is configurable. This can avoid out of memory error.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
|