[Kea-users] kea-2.2.0 - HA cluster - communication between stork and dhcp4 gets lost

[Stefan G. Weichinger]

Am 22.06.23 um 16:35 schrieb Eric Graham:
> Stefan,
> 
> What version of Stork are you using? I saw a similar issue 
> <https://gitlab.isc.org/isc-projects/stork/-/issues/792> in 1.7.

1.10.0

> Do your Kea control agent logs show any issues during the event?

Didn't find the time today to browse the logs.

the problematic server adc1 logs something after the event in stork.

stork displays


2023-06-20 20:01:23 daemon [2] dhcp4 is unreachable

kea-debug.log:

2023-06-20 20:00:54.374 CEST INFO 
[kea-dhcp4.commands/664.140016487107008] COMMAND_RECEIVED Received 
command 'subnet4-list'
2023-06-20 20:00:54.679 CEST INFO 
[kea-dhcp4.commands/664.140016487107008] COMMAND_RECEIVED Received 
command 'ha-heartbeat'
2023-06-20 20:02:04.789 CEST INFO 
[kea-dhcp4.ha-hooks/664.140016487107008] HA_STATE_TRANSITION server 
transitions from HOT-STANDBY to WAITING state, partner state is PARTNER-DOWN
2023-06-20 20:02:04.790 CEST INFO 
[kea-dhcp4.ha-hooks/664.140016487107008] HA_LEASE_UPDATES_DISABLED lease 
updates will not be sent to the partner while in WAITING state
2023-06-20 20:02:04.790 CEST INFO 
[kea-dhcp4.ha-hooks/664.140016487107008] HA_LOCAL_DHCP_DISABLE local 
DHCP service is disabled while the adc1 is in the WAITING state
2023-06-20 20:02:04.790 CEST INFO 
[kea-dhcp4.ha-hooks/664.140016487107008] HA_STATE_TRANSITION server 
transitions from WAITING to SYNCING state, partner state is PARTNER-DOWN
2023-06-20 20:02:04.790 CEST INFO 
[kea-dhcp4.ha-hooks/664.140016487107008] HA_LEASE_UPDATES_DISABLED lease 
updates will not be sent to the partner while in SYNCING state
2023-06-20 20:02:04.790 CEST INFO 
[kea-dhcp4.ha-hooks/664.140016487107008] HA_SYNC_START starting lease 
database synchronization with adc2
2023-06-20 20:02:04.807 CEST INFO 
[kea-dhcp4.ha-hooks/664.140016487107008] 
HA_LEASES_SYNC_LEASE_PAGE_RECEIVED received 118 leases from adc2
2023-06-20 20:02:04.809 CEST INFO 
[kea-dhcp4.ha-hooks/664.140016487107008] HA_SYNC_SUCCESSFUL lease 
database synchronization with adc2 completed successfully in 19.611 ms
2023-06-20 20:02:04.809 CEST INFO 
[kea-dhcp4.ha-hooks/664.140016487107008] HA_STATE_TRANSITION server 
transitions from SYNCING to READY state, partner state is PARTNER-DOWN
2023-06-20 20:02:04.810 CEST INFO 
[kea-dhcp4.ha-hooks/664.140016487107008] HA_LEASE_UPDATES_DISABLED lease 
updates will not be sent to the partner while in READY state
2023-06-20 20:06:51.205 CEST INFO 
[kea-dhcp4.dhcpsrv/664.140016487107008] DHCPSRV_MEMFILE_LFC_START 
starting Lease File Cleanup
2023-06-20 20:06:51.206 CEST INFO 
[kea-dhcp4.dhcpsrv/664.140016487107008] DHCPSRV_MEMFILE_LFC_EXECUTE 
executing Lease File Cleanup using: /usr/sbin/kea-lfc -4 -x 
/var/lib/kea/dhcp4.leases.2 -i /var/lib/kea/dhcp4.leases.1 -o 
/var/lib/kea/dhcp4.leases.output -f /var/lib/kea/dhcp4.leases.completed 
-p /var/lib/kea/dhcp4.leases.pid -c ignored-path
2023-06-20 21:06:52.202 CEST INFO 
[kea-dhcp4.dhcpsrv/664.140016487107008] DHCPSRV_MEMFILE_LFC_START 
starting Lease File Cleanup
2023-06-20 21:06:52.203 CEST INFO 
[kea-dhcp4.dhcpsrv/664.140016487107008] DHCPSRV_MEMFILE_LFC_EXECUTE 
executing Lease File Cleanup using: /usr/sbin/kea-lfc -4 -x 
/var/lib/kea/dhcp4.leases.2 -i /var/lib/kea/dhcp4.leases.1 -o 
/var/lib/kea/dhcp4.leases.output -f /var/lib/kea/dhcp4.leases.completed 
-p /var/lib/kea/dhcp4.leases.pid -c ignored-path
2023-06-20 22:06:52.466 CEST INFO 
[kea-dhcp4.dhcpsrv/664.140016487107008] DHCPSRV_MEMFILE_LFC_START 
starting Lease File Cleanup
2023-06-20 22:06:52.467 CEST INFO 
[kea-dhcp4.dhcpsrv/664.140016487107008] DHCPSRV_MEMFILE_LFC_EXECUTE 
executing Lease File Cleanup using: /usr/sbin/kea-lfc -4 -x 
/var/lib/kea/dhcp4.leases.2 -i /var/lib/kea/dhcp4.leases.1 -o 
/var/lib/kea/dhcp4.leases.output -f /var/lib/kea/dhcp4.leases.completed 
-p /var/lib/kea/dhcp4.leases.pid -c ignored-path
2023-06-20 23:06:53.457 CEST INFO 
[kea-dhcp4.dhcpsrv/664.140016487107008] DHCPSRV_MEMFILE_LFC_START 
starting Lease File Cleanup

The other server only says:

2023-06-20 20:01:04.701 CEST WARN 
[kea-dhcp4.ha-hooks/291908.140125778662080] HA_HEARTBEAT_FAILED 
heartbeat to adc1 (http://10.0.0.231:8000/) failed: unable to forward 
command to the dhcp4 service: No such file or directory. The server is 
likely to be offline, error code 1