Query timeouts on FreeBSD 7 over network

Vinny Abello vinny at tellurian.com
Tue Aug 5 14:50:29 UTC 2008


> -----Original Message-----
> From: Jeremy Chadwick [mailto:koitsu at FreeBSD.org]
> Sent: Tuesday, August 05, 2008 8:25 AM
> To: Igor V. Ruzanov
> Cc: Vinny Abello; freebsd-stable at freebsd.org; bind-users at isc.org
> Subject: Re: Query timeouts on FreeBSD 7 over network
>
> On Tue, Aug 05, 2008 at 03:04:50PM +0400, Igor V. Ruzanov wrote:
> >> I've tried with the ULE scheduler and 4BSD and tried with and with
> >> out PREEMPTION turned on. Nothing makes a difference.
> > First of all you could try to connect only two machines via cross-
> over
> > cable, no any switches between the machines, no any VLANs and so on.
> > FreeBSD-7.0 works better with ULE-scheduler and kernel should be
> > preemtive (options PREEMPTION in kernel config).
> > - what is your kernel config?
> >
> >> I'm pretty sure this is related to the OS or the em driver in some
> way, because if I disable all ICMP rate limiting and run an extended
> ping from the local firewall, I experience a very low amount of random
> packet loss in no pattern, unlike if you have the ICMP rate limiting
> enabled.
>
> I believe -stable just got added to this thread, so I'm not sure if
> these details were provided prior.  My apologies if this stuff has
> already been dealt with.
>
> 1) Are there any messages from the kernel about watchdog timeouts or
> other anomalies pertaining to the network?  Look in dmesg.

Nothing I have noticed. I keep checking for errors by using dmesg or just checking the console, but nothing out of the ordinary.

>
> 2) pciconf -lv (only include the Ethernet entries please), vmstat -i
> and netstat -in output.

rns1# pciconf -lv
hostb0 at pci0:0:0:0:      class=0x060000 card=0x016d1028 chip=0x35908086 rev=0x09                                                                              hdr=0x00
    vendor     = 'Intel Corporation'
    device     = 'E7520 Server Memory Controller Hub'
    class      = bridge
    subclass   = HOST-PCI
pcib1 at pci0:0:2:0:       class=0x060400 card=0x00000000 chip=0x35958086 rev=0x09                                                                              hdr=0x01
    vendor     = 'Intel Corporation'
    device     = 'E752x Memory Controller Hub PCIe Port A0'
    class      = bridge
    subclass   = PCI-PCI
pcib4 at pci0:0:4:0:       class=0x060400 card=0x00000000 chip=0x35978086 rev=0x09                                                                              hdr=0x01
    vendor     = 'Intel Corporation'
    device     = 'E752x Memory Controller Hub PCIe Port B0'
    class      = bridge
    subclass   = PCI-PCI
pcib5 at pci0:0:5:0:       class=0x060400 card=0x00000000 chip=0x35988086 rev=0x09                                                                              hdr=0x01
    vendor     = 'Intel Corporation'
    device     = 'E752x Memory Controller Hub PCIe Port B1'
    class      = bridge
    subclass   = PCI-PCI
pcib8 at pci0:0:6:0:       class=0x060400 card=0x00000000 chip=0x35998086 rev=0x09                                                                              hdr=0x01
    vendor     = 'Intel Corporation'
    device     = 'E752x Memory Controller Hub PCIe Port C0'
    class      = bridge
    subclass   = PCI-PCI
uhci0 at pci0:0:29:0:      class=0x0c0300 card=0x016d1028 chip=0x24d28086 rev=0x02                                                                              hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '82801EB/ER (ICH5/ICH5R) USB UHCI Controller'
    class      = serial bus
    subclass   = USB
uhci1 at pci0:0:29:1:      class=0x0c0300 card=0x016d1028 chip=0x24d48086 rev=0x02                                                                              hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '82801EB/ER (ICH5/ICH5R) USB UHCI Controller'
    class      = serial bus
    subclass   = USB
uhci2 at pci0:0:29:2:      class=0x0c0300 card=0x016d1028 chip=0x24d78086 rev=0x02                                                                              hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '82801EB/ER (ICH5/ICH5R) USB UHCI Controller'
    class      = serial bus
    subclass   = USB
ehci0 at pci0:0:29:7:      class=0x0c0320 card=0x016d1028 chip=0x24dd8086 rev=0x02                                                                              hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '82801EB/ER (ICH5/ICH5R) USB 2.0 EHCI Controller'
    class      = serial bus
    subclass   = USB
pcib11 at pci0:0:30:0:     class=0x060400 card=0x00000000 chip=0x244e8086 rev=0xc2                                                                              hdr=0x01
    vendor     = 'Intel Corporation'
    device     = '82801 Family (ICH2/3/4/4/5/5/6/7/8/9,63xxESB) Hub Interface to                                                                              PCI Bridge'
    class      = bridge
    subclass   = PCI-PCI
isab0 at pci0:0:31:0:      class=0x060100 card=0x00000000 chip=0x24d08086 rev=0x02                                                                              hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '82801EB/ER (ICH5/ICH5R) LPC Interface Bridge'
    class      = bridge
    subclass   = PCI-ISA
atapci0 at pci0:0:31:1:    class=0x01018a card=0x016d1028 chip=0x24db8086 rev=0x02                                                                              hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '82801EB/ER (ICH5/ICH5R) EIDE Controller'
    class      = mass storage
    subclass   = ATA
pcib2 at pci0:1:0:0:       class=0x060400 card=0x00000000 chip=0x03308086 rev=0x06                                                                              hdr=0x01
    vendor     = 'Intel Corporation'
    device     = '80332 [Dobson] I/O processor A-segment Bridge'
    class      = bridge
    subclass   = PCI-PCI
pcib3 at pci0:1:0:2:       class=0x060400 card=0x00000000 chip=0x03328086 rev=0x06                                                                              hdr=0x01
    vendor     = 'Intel Corporation'
    device     = '80332 [Dobson] I/O processor B-segment Bridge'
    class      = bridge
    subclass   = PCI-PCI
amr0 at pci0:2:14:0:       class=0x010400 card=0x016d1028 chip=0x00131028 rev=0x06                                                                              hdr=0x00
    vendor     = 'Dell Computer Corporation'
    device     = 'PERC 4e/Si and PERC 4e/Di Expandable RAID Controller'
    class      = mass storage
    subclass   = RAID
pcib6 at pci0:5:0:0:       class=0x060400 card=0x00000000 chip=0x03298086 rev=0x09                                                                              hdr=0x01
    vendor     = 'Intel Corporation'
    device     = '6700PXH PCI Express-to-PCI Express Bridge A'
    class      = bridge
    subclass   = PCI-PCI
pcib7 at pci0:5:0:2:       class=0x060400 card=0x00000000 chip=0x032a8086 rev=0x09                                                                              hdr=0x01
    vendor     = 'Intel Corporation'
    device     = '6700PXH PCI Express-to-PCI Express Bridge B'
    class      = bridge
    subclass   = PCI-PCI
em0 at pci0:6:7:0: class=0x020000 card=0x016d1028 chip=0x10768086 rev=0x05 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '82541EI Gigabit Ethernet Controller'
    class      = network
    subclass   = ethernet
em1 at pci0:7:8:0: class=0x020000 card=0x016d1028 chip=0x10768086 rev=0x05 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '82541EI Gigabit Ethernet Controller'
    class      = network
    subclass   = ethernet
pcib9 at pci0:8:0:0:       class=0x060400 card=0x00000000 chip=0x03298086 rev=0x09                                                                              hdr=0x01
    vendor     = 'Intel Corporation'
    device     = '6700PXH PCI Express-to-PCI Express Bridge A'
    class      = bridge
    subclass   = PCI-PCI
pcib10 at pci0:8:0:2:      class=0x060400 card=0x00000000 chip=0x032a8086 rev=0x09                                                                              hdr=0x01
    vendor     = 'Intel Corporation'
    device     = '6700PXH PCI Express-to-PCI Express Bridge B'
    class      = bridge
    subclass   = PCI-PCI
vgapci0 at pci0:11:13:0:   class=0x030000 card=0x016d1028 chip=0x51591002 rev=0x00                                                                              hdr=0x00
    vendor     = 'ATI Technologies Inc'
    device     = 'RV100 Radeon 7000 / Radeon VE'
    class      = display
    subclass   = VGA

rns1# vmstat -i
interrupt                          total       rate
irq1: atkbd0                           2          0
irq6: fdc0                            10          0
irq14: ata0                           58          0
irq18: uhci2                      354670          9
irq23: ehci0                           3          0
irq46: amr0                       299008          8
irq64: em0                        265437          7
cpu0: timer                     69997281       1967
cpu1: timer                     70001365       1967
Total                          140917834       3961

rns1# netstat -in
Name    Mtu Network       Address              Ipkts Ierrs    Opkts Oerrs  Coll
em0    1500 <Link#1>      00:11:43:eb:fa:3c   245493     0    55953     0     0
em0    1500 216.182.1.0/2 216.182.1.160       134425     -    55463     -     -
em1*   1500 <Link#2>      00:11:43:eb:fa:3d        0     0        0     0     0
lo0   16384 <Link#3>                              59     0       59     0     0
lo0   16384 fe80:3::1/64  fe80:3::1                0     -        0     -     -
lo0   16384 ::1/128       ::1                      0     -        0     -     -
lo0   16384 127.0.0.0/8   127.0.0.1               59     -       59     -     -


> 3) Try disabling MSI/MSI-X via /boot/loader.conf variables (you'll
> need to reboot after this):
>      hw.pci.enable_msi="0"
>      hw.pci.enable_msix="0"

No luck... Still seeing the problem.

>
> 4) Disabling TSO on the interface, and in the OS:
>      ifconfig emXX -tso
>      sysctl net.inet.tcp.tso=0

No change here either, unfortunately.

Any other suggestions based on the above information? Just to make sure I don't have defective hardware, I'm going to move my RAID set to a completely different 2850 chassis.

>
> --
> | Jeremy Chadwick                                jdc at parodius.com |
> | Parodius Networking                       http://www.parodius.com/ |
> | UNIX Systems Administrator                  Mountain View, CA, USA |
> | Making life hard for others since 1977.              PGP: 4BD6C0CB |



More information about the bind-users mailing list