Mailing-List: contact user-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hbase.apache.org
MIME-Version: 1.0
In-Reply-To: <CAAT7MkoMrrVzw7e2dOyXMcUqkmZcSsKkH8kWGxNeFBTNGp4TKw@mail.gmail.com>
References: <CA+yygYLJsybb+4TP2FxOq55CtgAsKz9dOpZy2b26bJu73qih7w@mail.gmail.com>
 <CA+yygYJOY3J__FM67sYv7GBACOqg6s2LFNqLgTQXDDwANLmT=A@mail.gmail.com>
 <CAAT7MkrvbRFr_Li25DNDLpvBjmfwXhi_sYvOWnD4oGQdZVx0NQ@mail.gmail.com>
 <CA+yygYKbBANp_CGDBFJeZi5gcPyFeiayMoh1UKp5pX57+TY1fA@mail.gmail.com>
 <CAAT7Mkpya_tQCA0uzd6ffzXMXMrdBg1pDptjMpAr5e3f8bZYKA@mail.gmail.com>
 <CA+yygYK-f8LQoM3kb3bzJfv+CS59-Wyr-7GiQwzZf=d_-G_uoA@mail.gmail.com> <CAAT7MkoMrrVzw7e2dOyXMcUqkmZcSsKkH8kWGxNeFBTNGp4TKw@mail.gmail.com>
From: Lalit Jadhav <lalit.jadhav@nciportal.com>
Date: Thu, 7 Dec 2017 12:07:03 +0530
Message-ID: <CA+yygYJJejC4RiFN-7mEKq4TFS8QUaB+1bRe9CZ_19tU2nC-vA@mail.gmail.com>
Subject: Re: Regionservers consuming too much ram in HDP 2.6.
To: user@hbase.apache.org
Content-Type: multipart/alternative; boundary="94eb2c0c39b2cedb28055fba4be2"
archived-at: Thu, 07 Dec 2017 06:37:11 -0000

--94eb2c0c39b2cedb28055fba4be2
Content-Type: text/plain; charset="UTF-8"

Hello,

Yes, it is an interesting case.
Ram, Sorry I cannot share whole details, but let me know params you need.


On Thu, Dec 7, 2017 at 11:58 AM, ramkrishna vasudevan <
ramkrishna.s.vasudevan@gmail.com> wrote:

> I don have any idea now from this. Seems to be an interesting case since
> none of the users have reported such an issue. I need to try out this to
> ascertain what is really happening.
>
> Can you paste your hbase-env.sh details and the hbase-site.xml just to be
> sure there is nothing overriding the configs?
>
> Regards
> Ram
>
>
> On Wed, Dec 6, 2017 at 5:41 PM, Lalit Jadhav <lalit.jadhav@nciportal.com>
> wrote:
>
> > Are you sure the 16G taken up in the RAM is due to the region server?
> > :Yes
> >
> > Are you having any other cache configuration like  bucket cache?
> > :No
> >
> > Are you allocating any Direct_memory for the region servers?
> > :No
> >
> > So when does this raise to 16G happen - is it after the regions are
> created
> > or even before them i.e just when you start the region server?
> > : Even before regions are created.
> >
> > Which version of hbase is it?
> > 1.1.2
> >
> > On Dec 6, 2017 4:02 PM, "ramkrishna vasudevan" <
> > ramkrishna.s.vasudevan@gmail.com> wrote:
> >
> > > Few more questions,
> > > Are you sure the 16G taken up in the RAM is due to the region server?
> Are
> > > you having any other cache configuration like  bucket cache?
> > > Are you allocating any Direct_memory for the region servers?
> > >
> > > So when does this raise to 16G happen - is it after the regions are
> > created
> > > or even before them i.e just when you start the region server? Which
> > > version of hbase is it?
> > >
> > > Regards
> > > Ram
> > >
> > > On Wed, Dec 6, 2017 at 3:57 PM, Lalit Jadhav <
> lalit.jadhav@nciportal.com
> > >
> > > wrote:
> > >
> > > > Hi Ramkrishna,
> > > >
> > > > Thanks for reply,
> > > > Right now I am not performing any operation on HBase(it is idle),
> > Still,
> > > > utilization is 16GB. But when I shut down them, It frees this memory.
> > > >
> > > > On Wed, Dec 6, 2017 at 2:41 PM, ramkrishna vasudevan <
> > > > ramkrishna.s.vasudevan@gmail.com> wrote:
> > > >
> > > > > Hi Lalith
> > > > >
> > > > > Seems you have configured very minimum heap space.
> > > > > So when you say RAM size is increasing  what are the operations
> that
> > > you
> > > > > are performing when the memory increases. I can see heap is only 1G
> > but
> > > > > still your  memory is 16G.Are you sure that 16G is only due to
> Region
> > > > > servers? Are you having heavy writes or reads during that time.
> > > > >
> > > > > Regards
> > > > > Ram
> > > > >
> > > > > On Wed, Dec 6, 2017 at 2:31 PM, Lalit Jadhav <
> > > lalit.jadhav@nciportal.com
> > > > >
> > > > > wrote:
> > > > >
> > > > > > Adding More info,
> > > > > >
> > > > > > Regions per region server : 13-15 Regions per RS
> > > > > >
> > > > > > memory region server is taking : 16GB
> > > > > >
> > > > > > Memstore size : 64 MB
> > > > > >
> > > > > > configured heap for Master : 1 GB
> > > > > >
> > > > > > configured heap for RegionServer : 1 GB
> > > > > >
> > > > > > On Tue, Dec 5, 2017 at 5:40 PM, Lalit Jadhav <
> > > > lalit.jadhav@nciportal.com
> > > > > >
> > > > > > wrote:
> > > > > >
> > > > > > > Hello All,
> > > > > > >
> > > > > > > When we do any operations on the database(HBase), RegionServers
> > are
> > > > > > taking
> > > > > > > too much ram and not releases until we restart them. Is there
> any
> > > > > > parameter
> > > > > > > or property to release ram or to restrict RegionServers to take
> > > this
> > > > > much
> > > > > > > of memory? Help will be appreciated.
> > > > > > >
> > > > > > > --
> > > > > > > Regards,
> > > > > > > Lalit Jadhav
> > > > > > > Network Component Private Limited.
> > > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > > --
> > > > > > Regards,
> > > > > > Lalit Jadhav
> > > > > > Network Component Private Limited.
> > > > > >
> > > > >
> > > >
> > > >
> > > >
> > > > --
> > > > Regards,
> > > > Lalit Jadhav
> > > > Network Component Private Limited.
> > > >
> > >
> >
>


-- 
Regards,
Lalit Jadhav
Network Component Private Limited.

--94eb2c0c39b2cedb28055fba4be2--