High memory consumption in bind 9.18.2

Mon Aug 1 15:35:31 UTC 2022

Hi,

Sorry one more thing. It is not a memory leak . In the experiment the data is being pulled from the disk zone file and loaded into memory. Then the process sits idle. RAM utilization is stable.  In other words, it is a footprint of the file into the cache. Easy experiment -> just the time-consuming task is to generate 100 MIL A + CANME dummy records into the zone file.

#9.18.5
/usr/local/sbin/named -v
BIND 9.18.5 (Stable Release) <id:6593103>
3.10.0-1160.71.1.el7.x86_64 #1 SMP Wed Jun 15 08:55:08 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux
Virtualized AWS EC2 - Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8 CORE / 32 GB ram
Named.file as simple as possible as the experiment is only to measure a memory footprint of “many” records.

#BIND 9.16.21
/usr/local/sbin/named -v
BIND 9.16.21 (Extended Support Version) <id:a8aa450>
#Other parameters are the same.
Named.file as simple as possible as the experiment is only to measure a memory footprint of “many” records.

Regards,
Dmitri.

From: bind-users <bind-users-bounces at lists.isc.org> On Behalf Of Dmitri Pavlov
Sent: Monday, August 1, 2022 6:19 PM
To: Victoria Risk <vicky at isc.org>
Cc: bind-users at lists.isc.org; Ond≈ôej Sur√Ω <ondrej at isc.org>
Subject: RE: High memory consumption in bind 9.18.2

Thank you ISC,

New run with the same input

#9.18.5
pmap -x ... | tail -n 1
total kB         34892476 29399048 29395316

#9.16.21
pmap -x ... | tail -n 1
total kB         27935060 27341676 27338344

The diff. Is still the same ~ 2 GB.

I’m pretty much sure you will get the same results in your lab.  My guess the earlier experiment with 1 mil zones and small number of machines could not visualize the diff.

With 100 MIL of records the diff. is more visual.

Hence the same question -> Should the memory reduction apply to our experiment? Please let us know if any additional details about our experiment are required.

Regards,
Dmitri.

From: bind-users <bind-users-bounces at lists.isc.org<mailto:bind-users-bounces at lists.isc.org>> On Behalf Of Victoria Risk
Sent: Monday, August 1, 2022 6:08 PM
To: Doug Whitfield <dwhitfield at perforce.com<mailto:dwhitfield at perforce.com>>
Cc: bind-users at lists.isc.org<mailto:bind-users at lists.isc.org>; Ond≈ôej Sur√Ω <ondrej at isc.org<mailto:ondrej at isc.org>>
Subject: Re: High memory consumption in bind 9.18.2

Hi Doug,

I think Ondrej is referring to this post from a prior month: https://lists.isc.org/pipermail/bind-users/2022-June/106350.html<https://nam12.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.isc.org%2Fpipermail%2Fbind-users%2F2022-June%2F106350.html&data=05%7C01%7Cdpavlov%40perforce.com%7C32439a5f16474cb8331608da73d1433c%7C95b666d19a7549ab95a38969fbcdc08c%7C0%7C0%7C637949639865510996%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000%7C%7C%7C&sdata=9gRb3fv14k1DAieNwnoJ%2BAp1T9caTv32cAKWh4YUqdY%3D&reserved=0>

….
For tips on how to measure memory usage you might want to look at https://stackoverflow.com/questions/131303/how-can-i-measure-the-actual-memory-usage-of-an-application-or-process<https://nam12.safelinks.protection.outlook.com/?url=https%3A%2F%2Fstackoverflow.com%2Fquestions%2F131303%2Fhow-can-i-measure-the-actual-memory-usage-of-an-application-or-process&data=05%7C01%7Cdpavlov%40perforce.com%7C32439a5f16474cb8331608da73d1433c%7C95b666d19a7549ab95a38969fbcdc08c%7C0%7C0%7C637949639865510996%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000%7C%7C%7C&sdata=q7aTYA6yrB7ZjRRyJrC0y4zrUK4M7IM6UUyqxFoFp38%3D&reserved=0> …..

Also note the comment about ignoring ’total’ memory.

Vicky

On Aug 1, 2022, at 10:32 AM, Ondřej Surý <ondrej at isc.org<mailto:ondrej at isc.org>> wrote:

On 1. 8. 2022, at 16:14, Doug Whitfield <dwhitfield at perforce.com<mailto:dwhitfield at perforce.com>> wrote:

as monitored from "top" RES value

Please read the whole thread on measuring the real consumed memory.

The '“top” RES value' has little or no value at all.

Ondrej
--
Ondřej Surý (He/Him)
ondrej at isc.org<mailto:ondrej at isc.org>

My working hours and your working hours may be different. Please do not feel obligated to reply outside your normal working hours.

--
Visit https://lists.isc.org/mailman/listinfo/bind-users<https://nam12.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.isc.org%2Fmailman%2Flistinfo%2Fbind-users&data=05%7C01%7Cdpavlov%40perforce.com%7C32439a5f16474cb8331608da73d1433c%7C95b666d19a7549ab95a38969fbcdc08c%7C0%7C0%7C637949639865510996%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000%7C%7C%7C&sdata=PXqs4J3AOnLLp0KRdKhAHXgGQqd1AVWMKsge4pRtK3c%3D&reserved=0> to unsubscribe from this list

ISC funds the development of this software with paid support subscriptions. Contact us at https://www.isc.org/contact/<https://nam12.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.isc.org%2Fcontact%2F&data=05%7C01%7Cdpavlov%40perforce.com%7C32439a5f16474cb8331608da73d1433c%7C95b666d19a7549ab95a38969fbcdc08c%7C0%7C0%7C637949639865510996%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000%7C%7C%7C&sdata=sH%2FVsjink11lqvRd58k7DXOXU7tPfAUk6g6QxqzMirc%3D&reserved=0> for more information.

bind-users mailing list
bind-users at lists.isc.org<mailto:bind-users at lists.isc.org>
https://lists.isc.org/mailman/listinfo/bind-users<https://nam12.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.isc.org%2Fmailman%2Flistinfo%2Fbind-users&data=05%7C01%7Cdpavlov%40perforce.com%7C32439a5f16474cb8331608da73d1433c%7C95b666d19a7549ab95a38969fbcdc08c%7C0%7C0%7C637949639865510996%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000%7C%7C%7C&sdata=PXqs4J3AOnLLp0KRdKhAHXgGQqd1AVWMKsge4pRtK3c%3D&reserved=0>

CAUTION: This email originated from outside of the organization. Do not click on links or open attachments unless you recognize the sender and know the content is safe.

This e-mail may contain information that is privileged or confidential. If you are not the intended recipient, please delete the e-mail and any attachments and notify us immediately.

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.isc.org/pipermail/bind-users/attachments/20220801/e51fb5c8/attachment-0001.htm>