On /tmp I have more than 5GB. The system is a dual CPU. This is the listing from /var/log/allmessages and /var/log/warn after 22:12 was the "dead".... ... Oct 16 21:50:00 fileserver /USR/SBIN/CRON[18272]: (root) CMD (/home/scripts/photo_ftp_downloader.sh) Oct 16 21:52:00 fileserver /USR/SBIN/CRON[18375]: (root) CMD (/home/scripts/photo_temp_parse.sh) Oct 16 21:59:00 fileserver /USR/SBIN/CRON[18635]: (root) CMD ( rm -f /var/spool/cron/lastrun/cron.hourly) Oct 16 22:02:00 fileserver /USR/SBIN/CRON[18780]: (root) CMD (/home/scripts/photo_temp_parse.sh) Oct 16 22:10:00 fileserver /USR/SBIN/CRON[19079]: (root) CMD (/home/scripts/db_vacuum_all) Oct 16 22:10:00 fileserver /USR/SBIN/CRON[19080]: (root) CMD (/home/scripts/dfu_imsmca_in) Oct 16 22:12:00 fileserver /USR/SBIN/CRON[19166]: (root) CMD (/home/scripts/photo_temp_parse.sh) Oct 17 08:11:10 fileserver syslogd 1.4.1: restart. Oct 17 08:11:11 fileserver webmin[2015]: Webmin starting Oct 17 08:11:14 fileserver modprobe: FATAL: Error inserting hw_random (/lib/modules/2.6.4-52-smp/kernel/drivers/char/hw_random.ko): No such device Oct 17 08:11:14 fileserver /etc/hotplug/pci.agent[1490]: ... can't load module hw_random Oct 17 08:11:14 fileserver /etc/hotplug/pci.agent[1490]: missing kernel or user mode driver hw_random Oct 17 08:11:15 fileserver kernel: klogd 1.4.1, log source = /proc/kmsg started. Oct 17 08:11:15 fileserver kernel: Inspecting /boot/System.map-2.6.4-52-smp Oct 17 08:11:15 fileserver kernel: Loaded 23810 symbols from /boot/System.map-2.6.4-52-smp. Oct 17 08:11:15 fileserver kernel: Symbols match kernel version 2.6.4. Oct 17 08:11:15 fileserver kernel: No module symbols loaded - kernel modules not enabled. Oct 17 08:11:15 fileserver kernel: drivers/usb/core/usb.c: registered new driver usbfs Oct 17 08:11:15 fileserver kernel: drivers/usb/core/usb.c: registered new driver hub Oct 17 08:11:15 fileserver kernel: tg3.c:v2.9 (March 8, 2004) Oct 17 08:11:15 fileserver kernel: eth0: Tigon3 [partno(BCM95705A50) rev 3003 PHY(5705)] (PCI:33MHz:32-bit) 10/100/1000BaseT Ethernet 00:11:d8:33:3c:0e Oct 17 08:11:15 fileserver kernel: tg3: eth0: Link is up at 100 Mbps, full duplex. Oct 17 08:11:15 fileserver kernel: tg3: eth0: Flow control is on for TX and on for RX. Oct 17 08:11:15 fileserver kernel: hw_random: RNG not detected Oct 17 08:11:15 fileserver kernel: agpgart: Unsupported Intel chipset (device id: 3592) Oct 17 08:11:17 fileserver kernel: NET: Registered protocol family 10 Oct 17 08:11:17 fileserver kernel: Disabled Privacy Extensions on device ffffffff803cd7c0(lo) Oct 17 08:11:17 fileserver kernel: IPv6 over IPv4 tunneling driver Oct 17 08:11:17 fileserver sshd[2400]: Server listening on :: port 22. Oct 17 08:11:17 fileserver kernel: Disabled Privacy Extensions on device 000001003cac7800(sit0) Oct 17 08:11:17 fileserver kernel: ACPI: Power Button (FF) [PWRF] Oct 17 08:11:17 fileserver kernel: ACPI: Processor [CPU1] (supports C1, 8 throttling states) Oct 17 08:11:17 fileserver kernel: ACPI: Processor [CPU2] (supports C1) Oct 17 08:11:17 fileserver kernel: ACPI: Processor [CPU3] (supports C1) Oct 17 08:11:17 fileserver kernel: ACPI: Processor [CPU4] (supports C1) Oct 17 08:11:17 fileserver [powersaved][2452]: WARNING in Function ACPI_Interface; line 26: could not set battery alarm, you may need to force polling mode. Oct 17 08:11:17 fileserver [powersaved][2452]: resmgr: server response code 200 Oct 17 08:11:17 fileserver su: (to postgres) root on /dev/pts/27 Oct 17 08:11:17 fileserver su: pam_unix2: session started for user postgres, service su Oct 17 08:11:22 fileserver ifup: No configuration found for sit0 Oct 17 08:11:28 fileserver kernel: eth0: no IPv6 routers present Oct 17 08:11:30 fileserver su: pam_unix2: session finished for user postgres, service su Oct 17 08:11:35 fileserver kernel: lp: driver loaded but no devices found Oct 17 08:11:35 fileserver kernel: drivers/usb/serial/usb-serial.c: USB Serial support registered for Generic Oct 17 08:11:35 fileserver kernel: drivers/usb/core/usb.c: registered new driver usbserial Oct 17 08:11:35 fileserver kernel: drivers/usb/serial/usb-serial.c: USB Serial Driver core v2.0 Oct 17 08:11:45 fileserver /usr/sbin/cron[3172]: (CRON) STARTUP (fork ok) Oct 17 08:11:45 fileserver xinetd[3191]: Reading included configuration file: /etc/xinetd.d/chargen [file=/etc/xinetd.conf] [line=26] Oct 17 08:11:45 fileserver xinetd[3191]: Reading included configuration file: /etc/xinetd.d/chargen-udp [file=/etc/xinetd.d/chargen-udp] [line=13] Oct 17 08:11:45 fileserver xinetd[3191]: Reading included configuration file: /etc/xinetd.d/cups-lpd [file=/etc/xinetd.d/cups-lpd] [line=14] Oct 17 08:11:45 fileserver xinetd[3191]: Reading included configuration file: /etc/xinetd.d/daytime [file=/etc/xinetd.d/daytime] [line=11] Oct 17 08:11:45 fileserver xinetd[3191]: Reading included configuration file: /etc/xinetd.d/daytime-udp [file=/etc/xinetd.d/daytime-udp] [line=13] Oct 17 08:11:45 fileserver xinetd[3191]: Reading included configuration file: /etc/xinetd.d/echo [file=/etc/xinetd.d/echo] [line=14] Oct 17 08:11:45 fileserver xinetd[3191]: Reading included configuration file: /etc/xinetd.d/echo-udp [file=/etc/xinetd.d/echo-udp] [line=13] Oct 17 08:11:45 fileserver xinetd[3191]: Reading included configuration file: /etc/xinetd.d/netstat [file=/etc/xinetd.d/netstat] [line=14] Oct 17 08:11:45 fileserver xinetd[3191]: Reading included configuration file: /etc/xinetd.d/rsync [file=/etc/xinetd.d/rsync] [line=16] Oct 17 08:11:45 fileserver xinetd[3191]: Reading included configuration file: /etc/xinetd.d/servers [file=/etc/xinetd.d/servers] [line=12] Oct 17 08:11:45 fileserver xinetd[3191]: Reading included configuration file: /etc/xinetd.d/services [file=/etc/xinetd.d/services] [line=13] Oct 17 08:11:45 fileserver xinetd[3191]: Reading included configuration file: /etc/xinetd.d/swat [file=/etc/xinetd.d/swat] [line=13] Oct 17 08:11:45 fileserver xinetd[3191]: Reading included configuration file: /etc/xinetd.d/systat [file=/etc/xinetd.d/systat] [line=12] Oct 17 08:11:45 fileserver xinetd[3191]: Reading included configuration file: /etc/xinetd.d/time [file=/etc/xinetd.d/time] [line=17] Oct 17 08:11:45 fileserver xinetd[3191]: Reading included configuration file: /etc/xinetd.d/time-udp [file=/etc/xinetd.d/time-udp] [line=14] Oct 17 08:11:45 fileserver xinetd[3191]: Reading included configuration file: /etc/xinetd.d/vnc [file=/etc/xinetd.d/vnc] [line=14] Oct 17 08:11:45 fileserver kernel: inserting floppy driver for 2.6.4-52-smp Oct 17 08:11:45 fileserver kernel: Floppy drive(s): fd0 is 1.44M Oct 17 08:11:45 fileserver kernel: FDC 0 is a post-1991 82077 Oct 17 08:11:46 fileserver kernel: end_request: I/O error, dev fd0, sector 0 Oct 17 08:11:46 fileserver kernel: end_request: I/O error, dev fd0, sector 0 Oct 17 08:11:46 fileserver kernel: st: Version 20040318, fixed bufsize 32768, s/g segs 256 Oct 17 08:11:46 fileserver xinetd[3191]: Reading included configuration file: /etc/xinetd.d/vsftpd [file=/etc/xinetd.d/vsftpd] [line=90] Oct 17 08:11:46 fileserver /etc/hotplug/block.agent[3198]: try 1 while waiting for /block/fd0's bus_id Oct 17 08:11:46 fileserver xinetd[3191]: removing chargen Oct 17 08:11:46 fileserver xinetd[3191]: removing chargen Oct 17 08:11:46 fileserver xinetd[3191]: removing printer Oct 17 08:11:46 fileserver xinetd[3191]: removing daytime Oct 17 08:11:46 fileserver xinetd[3191]: removing daytime Oct 17 08:11:46 fileserver xinetd[3191]: removing echo Oct 17 08:11:46 fileserver xinetd[3191]: removing echo Oct 17 08:11:46 fileserver xinetd[3191]: removing netstat Oct 17 08:11:46 fileserver xinetd[3191]: removing rsync Oct 17 08:11:46 fileserver xinetd[3191]: removing servers Oct 17 08:11:46 fileserver xinetd[3191]: removing services Oct 17 08:11:46 fileserver xinetd[3191]: removing swat Oct 17 08:11:47 fileserver /etc/hotplug/block.agent[3198]: try 2 while waiting for /block/fd0's bus_id Oct 17 08:11:46 fileserver xinetd[3191]: removing systat Oct 17 08:11:47 fileserver xinetd[3191]: removing time Oct 17 08:11:47 fileserver xinetd[3191]: removing time Oct 17 08:11:47 fileserver xinetd[3191]: removing vnc1 Oct 17 08:11:47 fileserver xinetd[3191]: removing vnc2 Oct 17 08:11:47 fileserver xinetd[3191]: removing vnc3 Oct 17 08:11:47 fileserver xinetd[3191]: removing vnchttpd1 Oct 17 08:11:47 fileserver xinetd[3191]: removing vnchttpd2 Oct 17 08:11:47 fileserver xinetd[3191]: removing vnchttpd3 Oct 17 08:11:47 fileserver xinetd[3191]: xinetd Version 2.3.13 started with libwrap loadavg options compiled in. Oct 17 08:11:47 fileserver xinetd[3191]: Started working: 1 available service Oct 17 08:11:47 fileserver kernel: Attached scsi generic sg0 at scsi0, channel 0, id 0, lun 0, type 0 Oct 17 08:11:47 fileserver kernel: Attached scsi generic sg1 at scsi1, channel 0, id 0, lun 0, type 0 Oct 17 08:11:48 fileserver /etc/hotplug/block.agent[3198]: try 3 while waiting for /block/fd0's bus_id Oct 17 08:11:49 fileserver /etc/hotplug/block.agent[3198]: try 4 while waiting for /block/fd0's bus_id Oct 17 08:11:50 fileserver /etc/hotplug/block.agent[3198]: try 5 while waiting for /block/fd0's bus_id Oct 17 08:11:51 fileserver /etc/hotplug/block.agent[3198]: new block device /block/fd0 Oct 17 08:12:00 fileserver /USR/SBIN/CRON[3543]: (root) CMD (/home/scripts/photo_temp_parse.sh) Oct 17 08:15:46 fileserver syslogd 1.4.1: restart. Oct 17 08:15:47 fileserver webmin[1931]: Webmin starting Oct 17 08:15:49 fileserver [powersaved][2193]: WARNING in Function ACPI_Interface; line 26: could not set battery alarm, you may need to force polling mode. Oct 17 08:15:49 fileserver sshd[2232]: Server listening on :: port 22. Oct 17 08:15:49 fileserver su: (to postgres) root on /dev/pts/27 Oct 17 08:15:49 fileserver su: pam_unix2: session started for user postgres, service su Oct 17 08:15:49 fileserver [powersaved][2193]: resmgr: server response code 200 Oct 17 08:15:50 fileserver modprobe: FATAL: Error inserting hw_random (/lib/modules/2.6.4-52-smp/kernel/drivers/char/hw_random.ko): No such device Oct 17 08:15:50 fileserver /etc/hotplug/pci.agent[1491]: ... can't load module hw_random Oct 17 08:15:50 fileserver /etc/hotplug/pci.agent[1491]: missing kernel or user mode driver hw_random Oct 17 08:15:51 fileserver kernel: klogd 1.4.1, log source = /proc/kmsg started. Oct 17 08:15:51 fileserver kernel: Inspecting /boot/System.map-2.6.4-52-smp Oct 17 08:15:51 fileserver kernel: Loaded 23810 symbols from /boot/System.map-2.6.4-52-smp. Oct 17 08:15:51 fileserver kernel: Symbols match kernel version 2.6.4. Oct 17 08:15:51 fileserver kernel: No module symbols loaded - kernel modules not enabled. Oct 17 08:15:51 fileserver kernel: drivers/usb/core/usb.c: registered new driver usbfs Oct 17 08:15:51 fileserver kernel: drivers/usb/core/usb.c: registered new driver hub Oct 17 08:15:51 fileserver kernel: tg3.c:v2.9 (March 8, 2004) Oct 17 08:15:51 fileserver kernel: eth0: Tigon3 [partno(BCM95705A50) rev 3003 PHY(5705)] (PCI:33MHz:32-bit) 10/100/1000BaseT Ethernet 00:11:d8:33:3c:0e Oct 17 08:15:51 fileserver kernel: tg3: eth0: Link is up at 100 Mbps, full duplex. Oct 17 08:15:51 fileserver kernel: tg3: eth0: Flow control is on for TX and on for RX. Oct 17 08:15:51 fileserver kernel: ACPI: Power Button (FF) [PWRF] Oct 17 08:15:51 fileserver kernel: ACPI: Processor [CPU1] (supports C1, 8 throttling states) Oct 17 08:15:51 fileserver kernel: ACPI: Processor [CPU2] (supports C1) Oct 17 08:15:51 fileserver kernel: ACPI: Processor [CPU3] (supports C1) Oct 17 08:15:51 fileserver kernel: ACPI: Processor [CPU4] (supports C1) Oct 17 08:15:51 fileserver kernel: NET: Registered protocol family 10 Oct 17 08:15:51 fileserver kernel: Disabled Privacy Extensions on device ffffffff803cd7c0(lo) Oct 17 08:15:51 fileserver kernel: IPv6 over IPv4 tunneling driver Oct 17 08:15:51 fileserver kernel: Disabled Privacy Extensions on device 0000010038628000(sit0) Oct 17 08:15:51 fileserver kernel: hw_random: RNG not detected Oct 17 08:15:51 fileserver kernel: agpgart: Unsupported Intel chipset (device id: 3592) Oct 17 08:15:54 fileserver ifup: No configuration found for sit0 Oct 17 08:15:56 fileserver su: pam_unix2: session finished for user postgres, service su Oct 17 08:15:58 fileserver kernel: lp: driver loaded but no devices found Oct 17 08:15:59 fileserver kernel: drivers/usb/serial/usb-serial.c: USB Serial support registered for Generic Oct 17 08:15:59 fileserver kernel: drivers/usb/core/usb.c: registered new driver usbserial Oct 17 08:15:59 fileserver kernel: drivers/usb/serial/usb-serial.c: USB Serial Driver core v2.0 Oct 17 08:16:00 fileserver kernel: eth0: no IPv6 routers present Oct 17 08:16:07 fileserver /usr/sbin/cron[3135]: (CRON) STARTUP (fork ok) Oct 17 08:16:07 fileserver xinetd[3140]: Reading included configuration file: /etc/xinetd.d/chargen [file=/etc/xinetd.conf] [line=26] Oct 17 08:16:07 fileserver xinetd[3140]: Reading included configuration file: /etc/xinetd.d/chargen-udp [file=/etc/xinetd.d/chargen-udp] [line=13] Oct 17 08:16:07 fileserver xinetd[3140]: Reading included configuration file: /etc/xinetd.d/cups-lpd [file=/etc/xinetd.d/cups-lpd] [line=14] Oct 17 08:16:07 fileserver xinetd[3140]: Reading included configuration file: /etc/xinetd.d/daytime [file=/etc/xinetd.d/daytime] [line=11] Oct 17 08:16:07 fileserver xinetd[3140]: Reading included configuration file: /etc/xinetd.d/daytime-udp [file=/etc/xinetd.d/daytime-udp] [line=13] Oct 17 08:16:07 fileserver xinetd[3140]: Reading included configuration file: /etc/xinetd.d/echo [file=/etc/xinetd.d/echo] [line=14] Oct 17 08:16:07 fileserver xinetd[3140]: Reading included configuration file: /etc/xinetd.d/echo-udp [file=/etc/xinetd.d/echo-udp] [line=13] Oct 17 08:16:07 fileserver xinetd[3140]: Reading included configuration file: /etc/xinetd.d/netstat [file=/etc/xinetd.d/netstat] [line=14] Oct 17 08:16:07 fileserver xinetd[3140]: Reading included configuration file: /etc/xinetd.d/rsync [file=/etc/xinetd.d/rsync] [line=16] Oct 17 08:16:07 fileserver xinetd[3140]: Reading included configuration file: /etc/xinetd.d/servers [file=/etc/xinetd.d/servers] [line=12] Oct 17 08:16:07 fileserver xinetd[3140]: Reading included configuration file: /etc/xinetd.d/services [file=/etc/xinetd.d/services] [line=13] Oct 17 08:16:07 fileserver xinetd[3140]: Reading included configuration file: /etc/xinetd.d/swat [file=/etc/xinetd.d/swat] [line=13] Oct 17 08:16:07 fileserver xinetd[3140]: Reading included configuration file: /etc/xinetd.d/systat [file=/etc/xinetd.d/systat] [line=12] Oct 17 08:16:07 fileserver xinetd[3140]: Reading included configuration file: /etc/xinetd.d/time [file=/etc/xinetd.d/time] [line=17] Oct 17 08:16:07 fileserver xinetd[3140]: Reading included configuration file: /etc/xinetd.d/time-udp [file=/etc/xinetd.d/time-udp] [line=14] Oct 17 08:16:07 fileserver xinetd[3140]: Reading included configuration file: /etc/xinetd.d/vnc [file=/etc/xinetd.d/vnc] [line=14] Oct 17 08:16:08 fileserver xinetd[3140]: Reading included configuration file: /etc/xinetd.d/vsftpd [file=/etc/xinetd.d/vsftpd] [line=90] Oct 17 08:16:08 fileserver xinetd[3140]: removing chargen Oct 17 08:16:08 fileserver xinetd[3140]: removing chargen Oct 17 08:16:08 fileserver xinetd[3140]: removing printer Oct 17 08:16:08 fileserver xinetd[3140]: removing daytime Oct 17 08:16:08 fileserver xinetd[3140]: removing daytime Oct 17 08:16:08 fileserver xinetd[3140]: removing echo Oct 17 08:16:08 fileserver xinetd[3140]: removing echo Oct 17 08:16:08 fileserver xinetd[3140]: removing netstat Oct 17 08:16:08 fileserver xinetd[3140]: removing rsync Oct 17 08:16:08 fileserver xinetd[3140]: removing servers Oct 17 08:16:08 fileserver xinetd[3140]: removing services Oct 17 08:16:08 fileserver xinetd[3140]: removing swat Oct 17 08:16:08 fileserver xinetd[3140]: removing systat Oct 17 08:16:08 fileserver xinetd[3140]: removing time Oct 17 08:16:08 fileserver xinetd[3140]: removing time Oct 17 08:16:08 fileserver xinetd[3140]: removing vnc1 Oct 17 08:16:08 fileserver xinetd[3140]: removing vnc2 Oct 17 08:16:08 fileserver xinetd[3140]: removing vnc3 Oct 17 08:16:08 fileserver xinetd[3140]: removing vnchttpd1 Oct 17 08:16:08 fileserver xinetd[3140]: removing vnchttpd2 Oct 17 08:16:08 fileserver xinetd[3140]: removing vnchttpd3 Oct 17 08:16:08 fileserver xinetd[3140]: xinetd Version 2.3.13 started with libwrap loadavg options compiled in. Oct 17 08:16:08 fileserver xinetd[3140]: Started working: 1 available service Oct 17 08:16:08 fileserver kernel: inserting floppy driver for 2.6.4-52-smp Oct 17 08:16:08 fileserver kernel: Floppy drive(s): fd0 is 1.44M Oct 17 08:16:08 fileserver kernel: FDC 0 is a post-1991 82077 Oct 17 08:16:08 fileserver kernel: end_request: I/O error, dev fd0, sector 0 Oct 17 08:16:08 fileserver kernel: end_request: I/O error, dev fd0, sector 0 Oct 17 08:16:08 fileserver /etc/hotplug/block.agent[3161]: try 1 while waiting for /block/fd0's bus_id Oct 17 08:16:08 fileserver kernel: st: Version 20040318, fixed bufsize 32768, s/g segs 256 Oct 17 08:16:08 fileserver kernel: Attached scsi generic sg0 at scsi0, channel 0, id 0, lun 0, type 0 Oct 17 08:16:08 fileserver kernel: Attached scsi generic sg1 at scsi1, channel 0, id 0, lun 0, type 0 Oct 17 08:16:09 fileserver /etc/hotplug/block.agent[3161]: try 2 while waiting for /block/fd0's bus_id Oct 17 08:16:10 fileserver /etc/hotplug/block.agent[3161]: try 3 while waiting for /block/fd0's bus_id Oct 17 08:16:11 fileserver /etc/hotplug/block.agent[3161]: try 4 while waiting for /block/fd0's bus_id Oct 17 08:16:12 fileserver /etc/hotplug/block.agent[3161]: try 5 while waiting for /block/fd0's bus_id Oct 17 08:16:13 fileserver /etc/hotplug/block.agent[3161]: new block device /block/fd0 Oct 17 08:20:55 fileserver sshd[3857]: reverse mapping checking getaddrinfo for ar-sd.net.155.77.82.in-addr.arpa failed - POSSIBLE BREAKIN ATTEMPT! Oct 17 08:20:58 fileserver sshd[3857]: Accepted keyboard-interactive/pam for root from ::ffff:82.77.155.72 port 44704 ssh2 Oct 17 08:22:00 fileserver /USR/SBIN/CRON[3977]: (root) CMD (/home/scripts/photo_temp_parse.sh) /var/log/warn ... Oct 14 16:02:05 fileserver sshd[17256]: error: PAM: Authentication failure Oct 14 16:13:47 fileserver sshd[17828]: error: PAM: Authentication failure Oct 14 16:13:54 fileserver last message repeated 2 times Oct 15 23:15:01 fileserver sshd[27917]: error: PAM: Authentication failure Oct 17 08:11:15 fileserver kernel: hw_random: RNG not detected Oct 17 08:11:15 fileserver kernel: agpgart: Unsupported Intel chipset (device id: 3592) Oct 17 08:11:17 fileserver [powersaved][2452]: WARNING in Function ACPI_Interface; line 26: could not set battery alarm, you may need to force polling mode. Oct 17 08:11:22 fileserver ifup: No configuration found for sit0 Oct 17 08:11:46 fileserver kernel: end_request: I/O error, dev fd0, sector 0 Oct 17 08:11:46 fileserver kernel: end_request: I/O error, dev fd0, sector 0 Oct 17 08:15:49 fileserver [powersaved][2193]: WARNING in Function ACPI_Interface; line 26: could not set battery alarm, you may need to force polling mode. Oct 17 08:15:51 fileserver kernel: hw_random: RNG not detected Oct 17 08:15:51 fileserver kernel: agpgart: Unsupported Intel chipset (device id: 3592) Oct 17 08:15:54 fileserver ifup: No configuration found for sit0 Oct 17 08:16:08 fileserver kernel: end_request: I/O error, dev fd0, sector 0 Oct 17 08:16:08 fileserver kernel: end_request: I/O error, dev fd0, sector 0 Oct 17 09:27:10 fileserver kernel: RAID1 conf printout: Oct 17 09:27:10 fileserver kernel: --- wd:2 rd:2 Oct 17 09:27:10 fileserver kernel: disk 0, wo:0, o:1, dev:sdb3 Oct 17 09:27:10 fileserver kernel: disk 1, wo:0, o:1, dev:sda3 Andy.