hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Vinod Kumar Vavilapalli <vino...@hortonworks.com>
Subject Re: How are 'PHYSICAL_MEMORY_BYTES' and 'VIRTUAL_MEMORY_BYTES' calculated?
Date Fri, 12 Jul 2013 17:24:48 GMT
They are the running metrics. While the task is running, they will tell you how much pmem/vmem
it is using at that point of time. Obviously at the end of job, it will be the last snapshot.

Thanks,
+Vinod

On Jul 12, 2013, at 6:47 AM, Shahab Yunus wrote:

> I think they are cumulative but per task.
> 
> Physical memory bytes
> (PHYSICAL_MEMORY_BYTES)
> The physical memory being used by a task in bytes, as reported by /proc/meminfo.
> Virtual memory bytes
> (VIRTUAL_MEMORY_BYTES)
> The virtual memory being used by a task in bytes, as reported by /proc/meminfo.
> 
> This is from the Definitive Guide book. Page 260.
> 
> Regards,
> Shhab
> 
> 
> On Thu, Jul 11, 2013 at 12:47 PM, hadoop qi <hadoop.jqi@gmail.com> wrote:
> Hello, 
> 
> I am wondering how memory counters  'PHYSICAL_MEMORY_BYTES'  and 'VIRTUAL_MEMORY_BYTES'
 are calculated? They are peaks of memory usage or cumulative usage? 
> 
> Thanks for help, 
> 


Mime
View raw message