AW: High memory consumption in bind 9.18.2

Thu May 19 11:26:24 UTC 2022

Hi Petr!

Thanks for the commands. But it seems I do not need them. I have updated 2 of our RcodeZero nameservers and on both servers the memory consumption is now lower than it was with 9.16. So I am not sure any more if memory was the problem why we went back to 9.16. I will check again in a few days.

Meanwhile I think the problem with 9.18 was a different one: we use bind as "distribution" name server with several hughe zones. So XFR from customer in, and XRF out to 20+ slaves. When we upgraded to 9.18, suddenly the slaves (Bind, Nsd...) needed longer to update their zones. As we did not had time to investigate we went back to 9.16 and suddenly slaves updated fast again. If this is still an issue we will see when we upgrade our distribution master to 9.18 and if yes, I will start another thread.

Thanks
Klaus

> -----Ursprüngliche Nachricht-----
> Von: Petr Špaček <pspacek at isc.org>
> Gesendet: Donnerstag, 19. Mai 2022 12:22
> An: Klaus Darilion <klaus.darilion at nic.at>
> Cc: bind-users at lists.isc.org
> Betreff: Re: High memory consumption in bind 9.18.2
> 
> On 18. 05. 22 22:39, Ondřej Surý wrote:
> > Hi Klarstein,
> >
> > Gathering the output of named statschannel should be good enough for
> initial assessment (json please).
> >
> > For 9.18, make sure the jemalloc is being used at runtime.
> 
> Here are commands you asked for:
> 
> 1. when running ./configure, make sure the output at the end has this:
> 
> Configuration summary:
> -------------------------------------------------------------------------------
> Optional features enabled:
>      Memory allocator: jemalloc
> 
> 
> 2. Then, configure statistics channel in named.conf like this:
> 
> statistics-channels {
> 	inet 127.0.0.1 port 8080;
> };
> 
> 
> 3. With that in place you can grab stats from this URL:
> http://127.0.0.1:8080/json/v1
> 
> Configuration for v9.16 is the same, just skip the jemalloc part.
> 
> 4. Bonus points for grabbing /proc/<PID>/statm content at the same time
> as content of the JSON stats endpoint (if you are on Linux).
> 
> I hope it helps.
> Petr Špaček
> 
> 
> 
> >
> > Ondrej
> > --
> > Ondřej Surý — ISC (He/Him)
> >
> > My working hours and your working hours may be different. Please do not
> feel obligated to reply outside your normal working hours.
> >
> >> On 18. 5. 2022, at 22:32, Klaus Darilion via bind-users <bind-
> users at lists.isc.org> wrote:
> >>
> >> Can you please provide some commands whose output you are
> interested? I want to collect the statistics for 9.16 before updating to 9.18.
> >> Thanks
> >> Klaus
> >>
> >>> -----Ursprüngliche Nachricht-----
> >>> Von: bind-users <bind-users-bounces at lists.isc.org> Im Auftrag von Petr
> >>> Špacek
> >>> Gesendet: Mittwoch, 18. Mai 2022 18:20
> >>> An: bind-users at lists.isc.org
> >>> Betreff: Re: AW: High memory consumption in bind 9.18.2
> >>>
> >>> I would be very interested in hearing more!
> >>>
> >>> In majority of our internal testing 9.16 has higher memory consumption
> >>> than 9.18, especially when 9.18 is compiled with libjemalloc. And the
> >>> differences are not small, for some configurations it can be even 2x or
> >>> 3x more on 9.16 than it is on 9.18.
> >>>
> >>> If you encounter it again please get back to us so we can diagnose it.
> >>>
> >>> Thank you!
> >>> Petr Špaček
> >>>
> >>>
> >>>> On 18. 05. 22 8:56, Klaus Darilion via bind-users wrote:
> >>>> I remember we had similar issues with 9.18 (isc ppa packages) and
> hence
> >>> wen't back to 9.16. But I can not remember the details.
> >>>>
> >>>> regards
> >>>> Klaus
> >>>>
> >>>>> -----Ursprüngliche Nachricht-----
> >>>>> Von: bind-users <bind-users-bounces at lists.isc.org> Im Auftrag von
> >>> Ondrej
> >>>>> Surý101 71 l t1h, 18. Mai 2022 08:37
> >>>>> An: Raman kumar <kumarraman.mca at gmail.com>
> >>>>> Cc: bind-users at lists.isc.org
> >>>>> Betreff: Re: High memory consumption in bind 9.18.2
> >>>>>
> >>>>> You did not provided any details, so we can’t really help you.
> >>>>>
> >>>>> What is “RAM consumption” anyway? VSZ, RSS, numbers pulled from
> >>> stats
> >>>>> channel from named?
> >>>>>
> >>>>> What’s the hardware, what is the configuration, how was BIND 9
> compiled
> >>>>> (or packaged)?
> >>>>>
> >>>>> The more details, the better
> >>>>>
> >>>>> Ondrej
> >>>>> --
> >>>>> Ondřej Surý (He/Him)
> >>>>> ondrej at isc.org
> >>>>>
> >>>>> My working hours and your working hours may be different. Please
> do
> >>> not
> >>>>> feel obligated to reply outside your normal working hours.
> >>>>>
> >>>>>> On 18. 5. 2022, at 8:32, Raman kumar
> <kumarraman.mca at gmail.com>
> >>>>> wrote:
> >>>>>>
> >>>>>> Hello Team,
> >>>>>>
> >>>>>> While upgrading from BIND 9.16.10 to 9.18.2, we have observed high
> >>>>> memory consumption.
> >>>>>>
> >>>>>> On version 9.16.2, RAM consumption was 3.8 GB. And on 9.18.2,
> RAM
> >>>>> consumption is 4.5 GB. Due to this an increase of approximately 20 %
> >>>>> memory is observed.
> >>>>>>
> >>>>>> Is this the expected behaviour or any tuning is needed?
> >>>>>>
> >>>>>> Thanks in advance.
> >>>>>>
> >>>>>> Regards,
> >>>>>> Raman
> >>>>>> --
> >>>>>> Visit https://lists.isc.org/mailman/listinfo/bind-users to unsubscribe
> >>> from
> >>>>> this list
> >>>>>>
> >>>>>> ISC funds the development of this software with paid support
> >>>>> subscriptions. Contact us at https://www.isc.org/contact/ for more
> >>>>> information.
> >>>>>>
> >>>>>>
> >>>>>> bind-users mailing list
> >>>>>> bind-users at lists.isc.org
> >>>>>> https://lists.isc.org/mailman/listinfo/bind-users
> >>>>
> >>>
> >>>
> >>> --
> >>> Petr Špaček
> >>> --
> >>> Visit https://lists.isc.org/mailman/listinfo/bind-users to unsubscribe
> from this
> >>> list
> >>>
> >>> ISC funds the development of this software with paid support
> subscriptions.
> >>> Contact us at https://www.isc.org/contact/ for more information.
> >>>
> >>>
> >>> bind-users mailing list
> >>> bind-users at lists.isc.org
> >>> https://lists.isc.org/mailman/listinfo/bind-users
> >> --
> >> Visit https://lists.isc.org/mailman/listinfo/bind-users to unsubscribe from
> this list
> >>
> >> ISC funds the development of this software with paid support
> subscriptions. Contact us at https://www.isc.org/contact/ for more
> information.
> >>
> >>
> >> bind-users mailing list
> >> bind-users at lists.isc.org
> >> https://lists.isc.org/mailman/listinfo/bind-users
> 
> 
> --
> Petr Špaček