High memory consumption in bind 9.18.2
Raman kumar
kumarraman.mca at gmail.com
Thu Jun 23 17:06:57 UTC 2022
Hello,
Thanks for your reply!
I did the analysis of stats generated, top command output and statm file.
Memory consumption(inUse) in 9.16 is matching in all places.
In 9.18 memory consumption(inUse) is matching in statm file and top command
output, but it is not matching with stats generated (please see images
below for stats, top command output and statm of bind version 9.16 and
9.18).
Can you please guide us to debug high memory uses in bind 9.18 based upon
the data shared below?
Also need your inputs why stats are not matching with memory(InUse) in bind
version 9.18?
[image: image.png]
[image: image.png]
[image: image.png]
Regards,
Raman
On Wed, Jun 22, 2022 at 10:54 AM Ondřej Surý <ondrej at isc.org> wrote:
> And what did you find looking at the new data? What are the differences?
> And by how much?
>
> You should not expect other people doing the analysis for yourself.
>
> Ondrej
> --
> Ondřej Surý — ISC (He/Him)
>
> My working hours and your working hours may be different. Please do not
> feel obligated to reply outside your normal working hours.
>
> On 22. 6. 2022, at 6:30, Raman kumar <kumarraman.mca at gmail.com> wrote:
>
>
> Hello,
>
> As suggested, please find the attached artifacts which includes stats by
> configuring statistics channel in named.conf, content at /proc/<PID>/statm,
> top command output for both 9.16.21 and 9.18.3.
>
> Regards,
> Raman
>
> On Thu, Jun 16, 2022 at 12:55 PM Ondřej Surý <ondrej at isc.org> wrote:
>
>> Hi,
>>
>> we cannot really help you if you ignore everything that was said to you
>> regarding the memory measurements.
>>
>> Ondrej.
>> --
>> Ondřej Surý (He/Him)
>> ondrej at isc.org
>>
>> My working hours and your working hours may be different. Please do not
>> feel obligated to reply outside your normal working hours.
>>
>> > On 16. 6. 2022, at 9:02, Raman kumar <kumarraman.mca at gmail.com> wrote:
>> >
>> > Hello All,
>> >
>> > We configured bind 9.18, using jemalloc but still memory consumption is
>> high in 9.18 as compared to 9.16.
>> >
>> > On version 9.16.21, RAM consumption was 3.8 GB without jemalloc. And on
>> 9.18.2, RAM consumption is 4.2 GB with jemalloc with the same data.
>> >
>> > Is this the expected behaviour or any more tuning is needed?
>> >
>> > One more thing: does CNAME record length also impact the memory used?
>> >
>> > Regards,
>> > Raman
>> >
>> >
>> > On Thu, May 19, 2022 at 3:52 PM Petr Špaček <pspacek at isc.org> wrote:
>> > On 18. 05. 22 22:39, Ondřej Surý wrote:
>> > > Hi Klarstein,
>> > >
>> > > Gathering the output of named statschannel should be good enough for
>> initial assessment (json please).
>> > >
>> > > For 9.18, make sure the jemalloc is being used at runtime.
>> >
>> > Here are commands you asked for:
>> >
>> > 1. when running ./configure, make sure the output at the end has this:
>> >
>> > Configuration summary:
>> >
>> -------------------------------------------------------------------------------
>> > Optional features enabled:
>> > Memory allocator: jemalloc
>> >
>> >
>> > 2. Then, configure statistics channel in named.conf like this:
>> >
>> > statistics-channels {
>> > inet 127.0.0.1 port 8080;
>> > };
>> >
>> >
>> > 3. With that in place you can grab stats from this URL:
>> > http://127.0.0.1:8080/json/v1
>> >
>> > Configuration for v9.16 is the same, just skip the jemalloc part.
>> >
>> > 4. Bonus points for grabbing /proc/<PID>/statm content at the same time
>> > as content of the JSON stats endpoint (if you are on Linux).
>> >
>> > I hope it helps.
>> > Petr Špaček
>> >
>> >
>> >
>> > >
>> > > Ondrej
>> > > --
>> > > Ondřej Surý — ISC (He/Him)
>> > >
>> > > My working hours and your working hours may be different. Please do
>> not feel obligated to reply outside your normal working hours.
>> > >
>> > >> On 18. 5. 2022, at 22:32, Klaus Darilion via bind-users <
>> bind-users at lists.isc.org> wrote:
>> > >>
>> > >> Can you please provide some commands whose output you are
>> interested? I want to collect the statistics for 9.16 before updating to
>> 9.18.
>> > >> Thanks
>> > >> Klaus
>> > >>
>> > >>> -----Ursprüngliche Nachricht-----
>> > >>> Von: bind-users <bind-users-bounces at lists.isc.org> Im Auftrag von
>> Petr
>> > >>> Špacek
>> > >>> Gesendet: Mittwoch, 18. Mai 2022 18:20
>> > >>> An: bind-users at lists.isc.org
>> > >>> Betreff: Re: AW: High memory consumption in bind 9.18.2
>> > >>>
>> > >>> I would be very interested in hearing more!
>> > >>>
>> > >>> In majority of our internal testing 9.16 has higher memory
>> consumption
>> > >>> than 9.18, especially when 9.18 is compiled with libjemalloc. And
>> the
>> > >>> differences are not small, for some configurations it can be even
>> 2x or
>> > >>> 3x more on 9.16 than it is on 9.18.
>> > >>>
>> > >>> If you encounter it again please get back to us so we can diagnose
>> it.
>> > >>>
>> > >>> Thank you!
>> > >>> Petr Špaček
>> > >>>
>> > >>>
>> > >>>> On 18. 05. 22 8:56, Klaus Darilion via bind-users wrote:
>> > >>>> I remember we had similar issues with 9.18 (isc ppa packages) and
>> hence
>> > >>> wen't back to 9.16. But I can not remember the details.
>> > >>>>
>> > >>>> regards
>> > >>>> Klaus
>> > >>>>
>> > >>>>> -----Ursprüngliche Nachricht-----
>> > >>>>> Von: bind-users <bind-users-bounces at lists.isc.org> Im Auftrag von
>> > >>> Ondrej
>> > >>>>> Surý101 71 l t1h, 18. Mai 2022 08:37
>> > >>>>> An: Raman kumar <kumarraman.mca at gmail.com>
>> > >>>>> Cc: bind-users at lists.isc.org
>> > >>>>> Betreff: Re: High memory consumption in bind 9.18.2
>> > >>>>>
>> > >>>>> You did not provided any details, so we can’t really help you.
>> > >>>>>
>> > >>>>> What is “RAM consumption” anyway? VSZ, RSS, numbers pulled from
>> > >>> stats
>> > >>>>> channel from named?
>> > >>>>>
>> > >>>>> What’s the hardware, what is the configuration, how was BIND 9
>> compiled
>> > >>>>> (or packaged)?
>> > >>>>>
>> > >>>>> The more details, the better
>> > >>>>>
>> > >>>>> Ondrej
>> > >>>>> --
>> > >>>>> Ondřej Surý (He/Him)
>> > >>>>> ondrej at isc.org
>> > >>>>>
>> > >>>>> My working hours and your working hours may be different. Please
>> do
>> > >>> not
>> > >>>>> feel obligated to reply outside your normal working hours.
>> > >>>>>
>> > >>>>>> On 18. 5. 2022, at 8:32, Raman kumar <kumarraman.mca at gmail.com>
>> > >>>>> wrote:
>> > >>>>>>
>> > >>>>>> Hello Team,
>> > >>>>>>
>> > >>>>>> While upgrading from BIND 9.16.10 to 9.18.2, we have observed
>> high
>> > >>>>> memory consumption.
>> > >>>>>>
>> > >>>>>> On version 9.16.2, RAM consumption was 3.8 GB. And on 9.18.2, RAM
>> > >>>>> consumption is 4.5 GB. Due to this an increase of approximately
>> 20 %
>> > >>>>> memory is observed.
>> > >>>>>>
>> > >>>>>> Is this the expected behaviour or any tuning is needed?
>> > >>>>>>
>> > >>>>>> Thanks in advance.
>> > >>>>>>
>> > >>>>>> Regards,
>> > >>>>>> Raman
>> > >>>>>> --
>> > >>>>>> Visit https://lists.isc.org/mailman/listinfo/bind-users to
>> unsubscribe
>> > >>> from
>> > >>>>> this list
>> > >>>>>>
>> > >>>>>> ISC funds the development of this software with paid support
>> > >>>>> subscriptions. Contact us at https://www.isc.org/contact/ for
>> more
>> > >>>>> information.
>> > >>>>>>
>> > >>>>>>
>> > >>>>>> bind-users mailing list
>> > >>>>>> bind-users at lists.isc.org
>> > >>>>>> https://lists.isc.org/mailman/listinfo/bind-users
>> > >>>>
>> > >>>
>> > >>>
>> > >>> --
>> > >>> Petr Špaček
>> > >>> --
>> > >>> Visit https://lists.isc.org/mailman/listinfo/bind-users to
>> unsubscribe from this
>> > >>> list
>> > >>>
>> > >>> ISC funds the development of this software with paid support
>> subscriptions.
>> > >>> Contact us at https://www.isc.org/contact/ for more information.
>> > >>>
>> > >>>
>> > >>> bind-users mailing list
>> > >>> bind-users at lists.isc.org
>> > >>> https://lists.isc.org/mailman/listinfo/bind-users
>> > >> --
>> > >> Visit https://lists.isc.org/mailman/listinfo/bind-users to
>> unsubscribe from this list
>> > >>
>> > >> ISC funds the development of this software with paid support
>> subscriptions. Contact us at https://www.isc.org/contact/ for more
>> information.
>> > >>
>> > >>
>> > >> bind-users mailing list
>> > >> bind-users at lists.isc.org
>> > >> https://lists.isc.org/mailman/listinfo/bind-users
>> >
>> >
>> > --
>> > Petr Špaček
>> > --
>> > Visit https://lists.isc.org/mailman/listinfo/bind-users to unsubscribe
>> from this list
>> >
>> > ISC funds the development of this software with paid support
>> subscriptions. Contact us at https://www.isc.org/contact/ for more
>> information.
>> >
>> >
>> > bind-users mailing list
>> > bind-users at lists.isc.org
>> > https://lists.isc.org/mailman/listinfo/bind-users
>> > --
>> > Visit https://lists.isc.org/mailman/listinfo/bind-users to unsubscribe
>> from this list
>> >
>> > ISC funds the development of this software with paid support
>> subscriptions. Contact us at https://www.isc.org/contact/ for more
>> information.
>> >
>> >
>> > bind-users mailing list
>> > bind-users at lists.isc.org
>> > https://lists.isc.org/mailman/listinfo/bind-users
>>
>>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.isc.org/pipermail/bind-users/attachments/20220623/42e8f474/attachment-0001.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image.png
Type: image/png
Size: 50781 bytes
Desc: not available
URL: <https://lists.isc.org/pipermail/bind-users/attachments/20220623/42e8f474/attachment-0003.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image.png
Type: image/png
Size: 9224 bytes
Desc: not available
URL: <https://lists.isc.org/pipermail/bind-users/attachments/20220623/42e8f474/attachment-0004.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image.png
Type: image/png
Size: 55947 bytes
Desc: not available
URL: <https://lists.isc.org/pipermail/bind-users/attachments/20220623/42e8f474/attachment-0005.png>
More information about the bind-users
mailing list