dhcpd crashes from time to time

[Tobias Szyndler]

Hello list

one of our dhcp crashes from time to time. To further trace this problem 
we setup traces to narrow down the cause of the crash.
As I'm definetly not the pro is reading such traces I attach here some 
of the traces contents. As you can see the dhcp dies because of a 
segmentation fault. The last action the server does is writing to our 
special lease file
<<
gettimeofday({1347245590, 894030}, NULL) = 0
select(22, [4 5 7], [], NULL, {58, 316173}) = 2 (in [5 7], left {57, 
530665})
gettimeofday({1347245591, 679695}, NULL) = 0
gettimeofday({1347245591, 679766}, NULL) = 0
read(5, 
"\0\26>\0\0\10\0\t\17\f[\202\10\0E\0\1P\363\6@\0<\0213r\254\30\0\1\325\304"..., 
1536) = 350
gettimeofday({1347245591, 679951}, NULL) = 0
sendto(3, "<190>Sep 10 02:53:11 dhcpd: DHCP"..., 144, MSG_NOSIGNAL, 
NULL, 0) = 144
gettimeofday({1347245591, 680166}, NULL) = 0
recvfrom(7, 
"\1\1\6\1\253\315\0\6\0\0\0\0\325\304\250=\0\0\0\0\0\0\0\0\254\30\0\1\0\17\223\0"..., 
1540, 0, {sa_family=AF_INET, sin_port=htons(67), 
sin_addr=inet_addr("172.24.0.1")}, [16]) = 308
gettimeofday({1347245591, 680317}, NULL) = 0
select(22, [4 5 7], [], NULL, {57, 529886}) = 2 (in [5 7], left {57, 
495855})
gettimeofday({1347245591, 714495}, NULL) = 0
gettimeofday({1347245591, 714553}, NULL) = 0
read(5, 
"\0\26>\0\0\10\0\t\17\f[\202\10\0E\0\1P\363\7@\0<\0213q\254\30\0\1\325\304"..., 
1536) = 350
gettimeofday({1347245591, 714877}, NULL) = 0
sendto(3, "<190>Sep 10 02:53:11 dhcpd: DHCP"..., 78, MSG_NOSIGNAL, NULL, 
0) = 78
sendto(4, 
"\10\0\347%\20\332\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0", 28, 0, 
{sa_family=AF_INET, sin_port=htons(0), 
sin_addr=inet_addr("213.196.169.92")}, 16) = 28
gettimeofday({1347245591, 715185}, NULL) = 0
gettimeofday({1347245591, 715246}, NULL) = 0
gettimeofday({1347245591, 715309}, NULL) = 0
recvfrom(7, 
"\1\1\6\1\253\315\0\2\0\0\0\0\325\304\251\\\0\0\0\0\0\0\0\0\254\30\0\1\0\17\223\0"..., 
1540, 0, {sa_family=AF_INET, sin_port=htons(67), 
sin_addr=inet_addr("172.24.0.1")}, [16]) = 308
gettimeofday({1347245591, 715457}, NULL) = 0
select(22, [4 5 7], [], NULL, {0, 999728}) = 1 (in [4], left {0, 981846})
gettimeofday({1347245591, 733486}, NULL) = 0
gettimeofday({1347245591, 733544}, NULL) = 0
recvfrom(4, 
"E\0\0000\0\0@\0006\1Z\241\325\304\251\\\325\304\225F\0\0\357%\20\332\0\0\0\0\0\0"..., 
1500, 0, {sa_family=AF_INET, sin_port=htons(0), 
sin_addr=inet_addr("213.196.169.92")}, [16]) = 48
gettimeofday({1347245591, 733701}, NULL) = 0
sendto(3, "<191>Sep 10 02:53:11 dhcpd: ICMP"..., 77, MSG_NOSIGNAL, NULL, 
0) = 77
gettimeofday({1347245591, 733913}, NULL) = 0
sendto(3, "<187>Sep 10 02:53:11 dhcpd: Aban"..., 85, MSG_NOSIGNAL, NULL, 
0) = 85
write(6, "lease 213.196.169.92 {\n  starts "..., 230) = 230
fsync(6)                                = 0
gettimeofday({1347245591, 735525}, NULL) = 0
select(22, [4 5 7], [], NULL, {0, 979660}) = 2 (in [5 7], left {0, 843117})
gettimeofday({1347245591, 872221}, NULL) = 0
gettimeofday({1347245591, 872280}, NULL) = 0
read(5, 
"\0\26>\0\0\10\0\t\17\f[\202\10\0E\0\1P\363\10@\0<\0213p\254\30\0\1\325\304"..., 
1536) = 350
gettimeofday({1347245591, 872446}, NULL) = 0
stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=118, ...}) = 0
open("/var/log/dhcpd/leaselog", O_RDWR|O_CREAT|O_APPEND, 0666) = 8
fstat(8, {st_mode=S_IFREG|0644, st_size=2132, ...}) = 0
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) 
= 0x7f54bc0f5000
--- SIGSEGV (Segmentation fault) @ 0 (0) ---
 >>
We have those crashes several time during the night and always Seg Fault 
while doing something with the leaselog file. Actually we do not know if 
the problem is really associated with the leaselog file but we strongly 
assume so, because opening the leaselog is always one of the last 
message before the daemon crashes into the ground.
The "normal" dhcp logs do not show anything suspicious before the crash.

Any ideas would be highly appreciated
Cheers

tobi
-- 
Freundliche Grüsse

Datapark AG
Tobias Szyndler
Hubstrasse 101
CH-9500 Wil SG

Tel. +41 71 560 60 95
szyndler at datapark.ch <mailto:szyndler at datapark.ch>
www.datapark.ch <http://www.datapark.ch>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.isc.org/pipermail/dhcp-users/attachments/20120910/ef42f7c7/attachment.html>