High memory consumption in bind 9.18.2

Ondřej Surý ondrej at isc.org
Wed Jun 22 05:24:25 UTC 2022


And what did you find looking at the new data? What are the differences? And by how much?

You should not expect other people doing the analysis for yourself.

Ondrej
--
Ondřej Surý — ISC (He/Him)

My working hours and your working hours may be different. Please do not feel obligated to reply outside your normal working hours.

> On 22. 6. 2022, at 6:30, Raman kumar <kumarraman.mca at gmail.com> wrote:
> 
> 
> Hello,
> 
> As suggested, please find the attached artifacts which includes stats by configuring statistics channel in named.conf, content at /proc/<PID>/statm, top command output for both 9.16.21 and 9.18.3.
> 
> Regards,
> Raman
> 
>> On Thu, Jun 16, 2022 at 12:55 PM Ondřej Surý <ondrej at isc.org> wrote:
>> Hi,
>> 
>> we cannot really help you if you ignore everything that was said to you regarding the memory measurements.
>> 
>> Ondrej.
>> --
>> Ondřej Surý (He/Him)
>> ondrej at isc.org
>> 
>> My working hours and your working hours may be different. Please do not feel obligated to reply outside your normal working hours.
>> 
>> > On 16. 6. 2022, at 9:02, Raman kumar <kumarraman.mca at gmail.com> wrote:
>> > 
>> > Hello All,
>> > 
>> > We configured bind 9.18, using jemalloc but still memory consumption is high in 9.18 as compared to 9.16.
>> > 
>> > On version 9.16.21, RAM consumption was 3.8 GB without jemalloc. And on 9.18.2, RAM consumption is 4.2 GB with jemalloc with the same data.
>> > 
>> > Is this the expected behaviour or any more tuning is needed?
>> > 
>> > One more thing: does CNAME record length also impact the memory used?
>> > 
>> > Regards,
>> > Raman
>> > 
>> > 
>> > On Thu, May 19, 2022 at 3:52 PM Petr Špaček <pspacek at isc.org> wrote:
>> > On 18. 05. 22 22:39, Ondřej Surý wrote:
>> > > Hi Klarstein,
>> > >
>> > > Gathering the output of named statschannel should be good enough for initial assessment (json please).
>> > >
>> > > For 9.18, make sure the jemalloc is being used at runtime.
>> > 
>> > Here are commands you asked for:
>> > 
>> > 1. when running ./configure, make sure the output at the end has this:
>> > 
>> > Configuration summary:
>> > -------------------------------------------------------------------------------
>> > Optional features enabled:
>> >      Memory allocator: jemalloc
>> > 
>> > 
>> > 2. Then, configure statistics channel in named.conf like this:
>> > 
>> > statistics-channels {
>> >         inet 127.0.0.1 port 8080;
>> > };
>> > 
>> > 
>> > 3. With that in place you can grab stats from this URL:
>> > http://127.0.0.1:8080/json/v1
>> > 
>> > Configuration for v9.16 is the same, just skip the jemalloc part.
>> > 
>> > 4. Bonus points for grabbing /proc/<PID>/statm content at the same time
>> > as content of the JSON stats endpoint (if you are on Linux).
>> > 
>> > I hope it helps.
>> > Petr Špaček
>> > 
>> > 
>> > 
>> > >
>> > > Ondrej
>> > > --
>> > > Ondřej Surý — ISC (He/Him)
>> > >
>> > > My working hours and your working hours may be different. Please do not feel obligated to reply outside your normal working hours.
>> > >
>> > >> On 18. 5. 2022, at 22:32, Klaus Darilion via bind-users <bind-users at lists.isc.org> wrote:
>> > >>
>> > >> Can you please provide some commands whose output you are interested? I want to collect the statistics for 9.16 before updating to 9.18.
>> > >> Thanks
>> > >> Klaus
>> > >>
>> > >>> -----Ursprüngliche Nachricht-----
>> > >>> Von: bind-users <bind-users-bounces at lists.isc.org> Im Auftrag von Petr
>> > >>> Špacek
>> > >>> Gesendet: Mittwoch, 18. Mai 2022 18:20
>> > >>> An: bind-users at lists.isc.org
>> > >>> Betreff: Re: AW: High memory consumption in bind 9.18.2
>> > >>>
>> > >>> I would be very interested in hearing more!
>> > >>>
>> > >>> In majority of our internal testing 9.16 has higher memory consumption
>> > >>> than 9.18, especially when 9.18 is compiled with libjemalloc. And the
>> > >>> differences are not small, for some configurations it can be even 2x or
>> > >>> 3x more on 9.16 than it is on 9.18.
>> > >>>
>> > >>> If you encounter it again please get back to us so we can diagnose it.
>> > >>>
>> > >>> Thank you!
>> > >>> Petr Špaček
>> > >>>
>> > >>>
>> > >>>> On 18. 05. 22 8:56, Klaus Darilion via bind-users wrote:
>> > >>>> I remember we had similar issues with 9.18 (isc ppa packages) and hence
>> > >>> wen't back to 9.16. But I can not remember the details.
>> > >>>>
>> > >>>> regards
>> > >>>> Klaus
>> > >>>>
>> > >>>>> -----Ursprüngliche Nachricht-----
>> > >>>>> Von: bind-users <bind-users-bounces at lists.isc.org> Im Auftrag von
>> > >>> Ondrej
>> > >>>>> Surý101 71 l t1h, 18. Mai 2022 08:37
>> > >>>>> An: Raman kumar <kumarraman.mca at gmail.com>
>> > >>>>> Cc: bind-users at lists.isc.org
>> > >>>>> Betreff: Re: High memory consumption in bind 9.18.2
>> > >>>>>
>> > >>>>> You did not provided any details, so we can’t really help you.
>> > >>>>>
>> > >>>>> What is “RAM consumption” anyway? VSZ, RSS, numbers pulled from
>> > >>> stats
>> > >>>>> channel from named?
>> > >>>>>
>> > >>>>> What’s the hardware, what is the configuration, how was BIND 9 compiled
>> > >>>>> (or packaged)?
>> > >>>>>
>> > >>>>> The more details, the better
>> > >>>>>
>> > >>>>> Ondrej
>> > >>>>> --
>> > >>>>> Ondřej Surý (He/Him)
>> > >>>>> ondrej at isc.org
>> > >>>>>
>> > >>>>> My working hours and your working hours may be different. Please do
>> > >>> not
>> > >>>>> feel obligated to reply outside your normal working hours.
>> > >>>>>
>> > >>>>>> On 18. 5. 2022, at 8:32, Raman kumar <kumarraman.mca at gmail.com>
>> > >>>>> wrote:
>> > >>>>>>
>> > >>>>>> Hello Team,
>> > >>>>>>
>> > >>>>>> While upgrading from BIND 9.16.10 to 9.18.2, we have observed high
>> > >>>>> memory consumption.
>> > >>>>>>
>> > >>>>>> On version 9.16.2, RAM consumption was 3.8 GB. And on 9.18.2, RAM
>> > >>>>> consumption is 4.5 GB. Due to this an increase of approximately 20 %
>> > >>>>> memory is observed.
>> > >>>>>>
>> > >>>>>> Is this the expected behaviour or any tuning is needed?
>> > >>>>>>
>> > >>>>>> Thanks in advance.
>> > >>>>>>
>> > >>>>>> Regards,
>> > >>>>>> Raman
>> > >>>>>> --
>> > >>>>>> Visit https://lists.isc.org/mailman/listinfo/bind-users to unsubscribe
>> > >>> from
>> > >>>>> this list
>> > >>>>>>
>> > >>>>>> ISC funds the development of this software with paid support
>> > >>>>> subscriptions. Contact us at https://www.isc.org/contact/ for more
>> > >>>>> information.
>> > >>>>>>
>> > >>>>>>
>> > >>>>>> bind-users mailing list
>> > >>>>>> bind-users at lists.isc.org
>> > >>>>>> https://lists.isc.org/mailman/listinfo/bind-users
>> > >>>>
>> > >>>
>> > >>>
>> > >>> --
>> > >>> Petr Špaček
>> > >>> --
>> > >>> Visit https://lists.isc.org/mailman/listinfo/bind-users to unsubscribe from this
>> > >>> list
>> > >>>
>> > >>> ISC funds the development of this software with paid support subscriptions.
>> > >>> Contact us at https://www.isc.org/contact/ for more information.
>> > >>>
>> > >>>
>> > >>> bind-users mailing list
>> > >>> bind-users at lists.isc.org
>> > >>> https://lists.isc.org/mailman/listinfo/bind-users
>> > >> --
>> > >> Visit https://lists.isc.org/mailman/listinfo/bind-users to unsubscribe from this list
>> > >>
>> > >> ISC funds the development of this software with paid support subscriptions. Contact us at https://www.isc.org/contact/ for more information.
>> > >>
>> > >>
>> > >> bind-users mailing list
>> > >> bind-users at lists.isc.org
>> > >> https://lists.isc.org/mailman/listinfo/bind-users
>> > 
>> > 
>> > --
>> > Petr Špaček
>> > --
>> > Visit https://lists.isc.org/mailman/listinfo/bind-users to unsubscribe from this list
>> > 
>> > ISC funds the development of this software with paid support subscriptions. Contact us at https://www.isc.org/contact/ for more information.
>> > 
>> > 
>> > bind-users mailing list
>> > bind-users at lists.isc.org
>> > https://lists.isc.org/mailman/listinfo/bind-users
>> > --
>> > Visit https://lists.isc.org/mailman/listinfo/bind-users to unsubscribe from this list
>> > 
>> > ISC funds the development of this software with paid support subscriptions. Contact us at https://www.isc.org/contact/ for more information.
>> > 
>> > 
>> > bind-users mailing list
>> > bind-users at lists.isc.org
>> > https://lists.isc.org/mailman/listinfo/bind-users
>> 
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.isc.org/pipermail/bind-users/attachments/20220622/0aba4f83/attachment-0002.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: BindMemoryIssue.rar
Type: application/octet-stream
Size: 15351 bytes
Desc: not available
URL: <https://lists.isc.org/pipermail/bind-users/attachments/20220622/0aba4f83/attachment-0001.obj>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.isc.org/pipermail/bind-users/attachments/20220622/0aba4f83/attachment-0003.htm>


More information about the bind-users mailing list