[Kea-users] kea-2.2.0 - HA cluster - communication between stork and dhcp4 gets lost

[Eric Graham]

Check the permissions of the control socket on your server:

  *   Confirm that the Kea control agent can read it
  *   Confirm that SELinux is not denying the attempt

Your control agent on the other server isn't configured to connect to the socket for dhcp4 on your primary server, correct?

Eric Graham
DevOps Specialist
Direct: 605.990.1859
Eric.Graham at vantagepnt.com<mailto:eric.graham at vantagepnt.com>
[cid:fa418b8e-e445-4e50-adc4-29ffc34b9590]
________________________________
From: Stefan G. Weichinger <lists at xunil.at>
Sent: Thursday, June 22, 2023 12:18 PM
To: Eric Graham <eric.graham at vantagepnt.com>; kea-users at lists.isc.org <kea-users at lists.isc.org>
Subject: Re: [Kea-users] kea-2.2.0 - HA cluster - communication between stork and dhcp4 gets lost

CAUTION: This email originated outside the organization. Do not click any links or attachments unless you have verified the sender.

Am 22.06.23 um 16:35 schrieb Eric Graham:
> Stefan,
>
> What version of Stork are you using? I saw a similar issue
> <https://gitlab.isc.org/isc-projects/stork/-/issues/792> in 1.7.

1.10.0

> Do your Kea control agent logs show any issues during the event?

Didn't find the time today to browse the logs.

the problematic server adc1 logs something after the event in stork.

stork displays


2023-06-20 20:01:23 daemon [2] dhcp4 is unreachable

kea-debug.log:

2023-06-20 20:00:54.374 CEST INFO
[kea-dhcp4.commands/664.140016487107008] COMMAND_RECEIVED Received
command 'subnet4-list'
2023-06-20 20:00:54.679 CEST INFO
[kea-dhcp4.commands/664.140016487107008] COMMAND_RECEIVED Received
command 'ha-heartbeat'
2023-06-20 20:02:04.789 CEST INFO
[kea-dhcp4.ha-hooks/664.140016487107008] HA_STATE_TRANSITION server
transitions from HOT-STANDBY to WAITING state, partner state is PARTNER-DOWN
2023-06-20 20:02:04.790 CEST INFO
[kea-dhcp4.ha-hooks/664.140016487107008] HA_LEASE_UPDATES_DISABLED lease
updates will not be sent to the partner while in WAITING state
2023-06-20 20:02:04.790 CEST INFO
[kea-dhcp4.ha-hooks/664.140016487107008] HA_LOCAL_DHCP_DISABLE local
DHCP service is disabled while the adc1 is in the WAITING state
2023-06-20 20:02:04.790 CEST INFO
[kea-dhcp4.ha-hooks/664.140016487107008] HA_STATE_TRANSITION server
transitions from WAITING to SYNCING state, partner state is PARTNER-DOWN
2023-06-20 20:02:04.790 CEST INFO
[kea-dhcp4.ha-hooks/664.140016487107008] HA_LEASE_UPDATES_DISABLED lease
updates will not be sent to the partner while in SYNCING state
2023-06-20 20:02:04.790 CEST INFO
[kea-dhcp4.ha-hooks/664.140016487107008] HA_SYNC_START starting lease
database synchronization with adc2
2023-06-20 20:02:04.807 CEST INFO
[kea-dhcp4.ha-hooks/664.140016487107008]
HA_LEASES_SYNC_LEASE_PAGE_RECEIVED received 118 leases from adc2
2023-06-20 20:02:04.809 CEST INFO
[kea-dhcp4.ha-hooks/664.140016487107008] HA_SYNC_SUCCESSFUL lease
database synchronization with adc2 completed successfully in 19.611 ms
2023-06-20 20:02:04.809 CEST INFO
[kea-dhcp4.ha-hooks/664.140016487107008] HA_STATE_TRANSITION server
transitions from SYNCING to READY state, partner state is PARTNER-DOWN
2023-06-20 20:02:04.810 CEST INFO
[kea-dhcp4.ha-hooks/664.140016487107008] HA_LEASE_UPDATES_DISABLED lease
updates will not be sent to the partner while in READY state
2023-06-20 20:06:51.205 CEST INFO
[kea-dhcp4.dhcpsrv/664.140016487107008] DHCPSRV_MEMFILE_LFC_START
starting Lease File Cleanup
2023-06-20 20:06:51.206 CEST INFO
[kea-dhcp4.dhcpsrv/664.140016487107008] DHCPSRV_MEMFILE_LFC_EXECUTE
executing Lease File Cleanup using: /usr/sbin/kea-lfc -4 -x
/var/lib/kea/dhcp4.leases.2 -i /var/lib/kea/dhcp4.leases.1 -o
/var/lib/kea/dhcp4.leases.output -f /var/lib/kea/dhcp4.leases.completed
-p /var/lib/kea/dhcp4.leases.pid -c ignored-path
2023-06-20 21:06:52.202 CEST INFO
[kea-dhcp4.dhcpsrv/664.140016487107008] DHCPSRV_MEMFILE_LFC_START
starting Lease File Cleanup
2023-06-20 21:06:52.203 CEST INFO
[kea-dhcp4.dhcpsrv/664.140016487107008] DHCPSRV_MEMFILE_LFC_EXECUTE
executing Lease File Cleanup using: /usr/sbin/kea-lfc -4 -x
/var/lib/kea/dhcp4.leases.2 -i /var/lib/kea/dhcp4.leases.1 -o
/var/lib/kea/dhcp4.leases.output -f /var/lib/kea/dhcp4.leases.completed
-p /var/lib/kea/dhcp4.leases.pid -c ignored-path
2023-06-20 22:06:52.466 CEST INFO
[kea-dhcp4.dhcpsrv/664.140016487107008] DHCPSRV_MEMFILE_LFC_START
starting Lease File Cleanup
2023-06-20 22:06:52.467 CEST INFO
[kea-dhcp4.dhcpsrv/664.140016487107008] DHCPSRV_MEMFILE_LFC_EXECUTE
executing Lease File Cleanup using: /usr/sbin/kea-lfc -4 -x
/var/lib/kea/dhcp4.leases.2 -i /var/lib/kea/dhcp4.leases.1 -o
/var/lib/kea/dhcp4.leases.output -f /var/lib/kea/dhcp4.leases.completed
-p /var/lib/kea/dhcp4.leases.pid -c ignored-path
2023-06-20 23:06:53.457 CEST INFO
[kea-dhcp4.dhcpsrv/664.140016487107008] DHCPSRV_MEMFILE_LFC_START
starting Lease File Cleanup

The other server only says:

2023-06-20 20:01:04.701 CEST WARN
[kea-dhcp4.ha-hooks/291908.140125778662080] HA_HEARTBEAT_FAILED
heartbeat to adc1 (http://10.0.0.231:8000/) failed: unable to forward
command to the dhcp4 service: No such file or directory. The server is
likely to be offline, error code 1




-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.isc.org/pipermail/kea-users/attachments/20230622/3cb757fd/attachment-0001.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: Outlook-p4nql53y.png
Type: image/png
Size: 16388 bytes
Desc: Outlook-p4nql53y.png
URL: <https://lists.isc.org/pipermail/kea-users/attachments/20230622/3cb757fd/attachment-0001.png>