* [gentoo-user] Kernel 2.6.28 BUGS
@ 2009-01-14 12:38 David Relson
2009-01-14 12:46 ` Dirk Heinrichs
0 siblings, 1 reply; 10+ messages in thread
From: David Relson @ 2009-01-14 12:38 UTC (permalink / raw
To: gentoo-user
[-- Attachment #1: Type: text/plain, Size: 406 bytes --]
Yesterday evening, I had a series of kernel BUG events logged. They
didn't actually _crash_ my workstation but I rebooted it anyway. Last
night at 02:27:09 another BUG halted the machine. Attached file
BUGS.txt summarizes the BUGs logged. Attached files messages.*.txt
have the full messages.
I presume it'd be useful to report these upstream. What's the proper
method for doing so?
Regards,
David
[-- Attachment #2: BUGS.txt --]
[-- Type: text/plain, Size: 980 bytes --]
Jan 13 21:35:04 osage BUG: soft lockup - CPU#1 stuck for 61s! [rrdtool:13119]
Jan 13 21:36:10 osage BUG: soft lockup - CPU#1 stuck for 61s! [rrdtool:13119]
Jan 13 21:40:32 osage BUG: soft lockup - CPU#1 stuck for 61s! [rrdtool:13119]
Jan 13 21:50:21 osage BUG: soft lockup - CPU#1 stuck for 61s! [rrdtool:13119]
Jan 13 21:55:49 osage BUG: soft lockup - CPU#1 stuck for 61s! [rrdtool:13119]
Jan 13 21:59:05 osage BUG: soft lockup - CPU#1 stuck for 61s! [rrdtool:13119]
Jan 13 22:01:16 osage BUG: soft lockup - CPU#1 stuck for 61s! [rrdtool:13119]
Jan 13 22:11:06 osage BUG: soft lockup - CPU#1 stuck for 61s! [rrdtool:13119]
Jan 13 22:13:17 osage BUG: soft lockup - CPU#1 stuck for 61s! [rrdtool:13119]
Jan 13 22:15:03 osage kernel BUG at mm/rmap.c:725!
Jan 13 22:20:55 osage BUG: soft lockup - CPU#1 stuck for 61s! [rrdtool:13119]
Jan 13 22:25:02 osage kernel BUG at mm/rmap.c:725!
Jan 14 02:26:21 osage BUG: unable to handle kernel NULL pointer dereference at 0000000000000010
[-- Attachment #3: messages.0113.2059.txt --]
[-- Type: text/plain, Size: 37650 bytes --]
Jan 13 20:59:06 osage 0 akff80045d)<>tc:<>ff80db63 ff20002000000002 ffff061d<>00000000 ff8014e8ffffffff 00000000<>ff80db63 ff8014e0000003cd 00000000<>alTae
Jan 13 20:59:06 osage 0 <ffff061d]?umpva+0x400/0x706
Jan 13 20:59:06 osage [<ffffffff80265013>] ? exit_mmap+0xa2/0x119
Jan 13 20:59:06 osage [<ffffffff8022dd2e>] ? mmput+0x2c/0xa2
Jan 13 20:59:06 osage [<ffffffff80231148>] ? exit_mm+0xee/0xf9
Jan 13 20:59:06 osage [<ffffffff80232505>] ? do_exit+0x1b2/0x728
Jan 13 20:59:06 osage [<ffffffff80232ae1>] ? do_group_exit+0x66/0x96
Jan 13 20:59:06 osage [<ffff000b]?sse_alfspt+x601
Jan 13 20:59:06 osage 0Cd:8 82 df f4 b8 00 00 88 07 94 b4 04 5c 41 88 05 8c 76 94 0e 25 ef 0>0 bf b7 85 b5 3e 1f e8 60 91 4
Jan 13 20:59:06 osage 1RP <ffff065d]pg_eoera+xf01a<>RP<ff8014d8
Jan 13 20:59:06 osage 4-- n rc 7d053000]-
Jan 13 20:59:06 osage 1Fxn eusv al u eoti edd
Jan 13 21:00:01 osage cron[12841]: (root) CMD (rm -f /var/spool/cron/lastrun/cron.hourly)
Jan 13 21:00:01 osage cron[12843]: (health) CMD (/home/health/bin/system_health.py --log --graph > /dev/null 2>&1)
Jan 13 21:00:01 osage cron[12839]: (root) CMD (test -x /usr/sbin/run-crons && /usr/sbin/run-crons )
Jan 13 21:00:01 osage sSMTP[12855]: Sent mail for health@osage (221 Bye)
Jan 13 21:05:01 osage cron[12861]: (health) CMD (/home/health/bin/system_health.py --log --graph > /dev/null 2>&1)
Jan 13 21:05:04 osage sSMTP[12954]: Sent mail for health@osage (221 Bye)
Jan 13 21:10:01 osage cron[12958]: (health) CMD (/home/health/bin/system_health.py --log --graph > /dev/null 2>&1)
Jan 13 21:10:01 osage cron[12956]: (root) CMD (test -x /usr/sbin/run-crons && /usr/sbin/run-crons )
Jan 13 21:15:01 osage cron[13062]: (health) CMD (/home/health/bin/system_health.py --log --graph > /dev/null 2>&1)
Jan 13 21:15:01 osage sSMTP[13064]: Sent mail for health@osage (221 Bye)
Jan 13 21:20:01 osage cron[13068]: (health) CMD (/home/health/bin/system_health.py --log --graph > /dev/null 2>&1)
Jan 13 21:20:01 osage cron[13066]: (root) CMD (test -x /usr/sbin/run-crons && /usr/sbin/run-crons )
Jan 13 21:20:01 osage 0D2 00000000<>R:00000000 R:0000ff0f R:00000000
Jan 13 21:20:01 osage 4Poessnmi pd 38,traif ff80fa00 akff800f69)<>tc:<>00000000 ff80fac8ffffffff 0000000000000
Jan 13 21:20:01 osage ffff8800a61f9138 ffff88008fca3c60 00000000002b0296 0000000000000000
Jan 13 21:20:01 osage 0000000101424080 00007fc1b814a000 ffff8800115147f8 ffff88001625a830
Jan 13 21:20:01 osage Call Trace:
Jan 13 21:20:01 osage [<ffffffff80265013>] ? exit_mmap+0xa2/0x119
Jan 13 21:20:01 osage [<fffffff82d2> mu+xc0a
Jan 13 21:20:01 osage 0 <ffff0318]?ei_m0e/x9<>[ffff8220> oei+xb/x2
Jan 13 21:20:01 osage 0 <ffff03f7]?_dqeesga+xe01c<>[ffff822e> ogopei+x609
Jan 13 21:20:01 osage 0 <ffff03fc]?gtsga_odlvr02502f<>[ffff82aa> ontf_eue08/xa
Jan 13 21:20:01 osage 0 <ffff020f]?ts_qlc+x007
Jan 13 21:20:01 osage 0 <ffff0214]?tyt_aeu+x6/x7
Jan 13 21:20:01 osage 0 <ffff03f5]?sga_aeu+x002
Jan 13 21:20:01 osage 0 <ffff034b]?sn_inl01f01b<>[ffff82c9> oivldo+x508
Jan 13 21:20:01 osage 0 <ffff078f]?vsra+x1/x3
Jan 13 21:20:01 osage 0 <ffff006d]?rtn_inl03/x0<>oe 5c 42 c8 04 b4 84 b5 04 1e c4 38 80 00 83 07 c4 1e c4 3c 04 95 0<6 31 17 6f c2 8e 48 58 5f f0 04 <>I [ffff821f> na_ms033076<>RP<ff80fab8
Jan 13 21:25:01 osage cron[13082]: (health) CMD (/home/health/bin/system_health.py --log --graph > /dev/null 2>&1)
Jan 13 21:25:01 osage sSMTP[13084]: Sent mail for health@osage (221 Bye)
Jan 13 21:27:58 osage 0C2 ff204f38<>-[edtae14d65c3c --<>iigrcriefutbtrbo snee!<6>emacs[1587] general protection ip:7fbe08b5d419 sp:7fff14e12740 error:0 in libc-2.6.1.so[7fbe08ae8000+136000]
Jan 13 21:27:58 osage f7c8 R14: 00007fbe01e00000 R15: ffff88002802d340
Jan 13 21:27:58 osage FS: 00007fbe0ccdb6f0(0000) GS:ffff88011f878ac0(0000) knlGS:00000000f426eb90
Jan 13 21:27:58 osage CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
Jan 13 21:27:58 osage CR2: 00007fbe08af71a0 CR3: 0000000011785000 CR4: 00000000000006e0
Jan 13 21:27:58 osage DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Jan 13 21:27:58 osage DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Jan 13 21:27:58 osage Process emacs (pid: 1587, threadinfo ffff88000bb40000, task ffff8800060405d0)
Jan 13 21:27:58 osage Stack:
Jan 13 21:27:58 osage ffff88011eaa6848 ffffe200018b2650 0000000000000000 ffffffff8026112d
Jan 13 21:27:58 osage 0000000000000000 ffff88000bb41c58 ffffffffffffffff 0000000000000000
Jan 13 21:27:58 osage ffff88008a100720 ffff88000bb41c60 0000000000210000 0000000000000000
Jan 13 21:27:58 osage Call Trace:
Jan 13 21:27:58 osage [<ffffffff8026112d>] ? unmap_vmas+0x400/0x706
Jan 13 21:27:58 osage [<ffffffff80265013>] ? exit_mmap+0xa2/0x119
Jan 13 21:27:58 osage [<ffffffff8022dd2e>] ? mmput+0x2c/0xa2
Jan 13 21:27:58 osage [<ffffffff80231148>] ? exit_mm+0xee/0xf9
Jan 13 21:27:58 osage [<ffffffff80232505>] ? do_exit+0x1b2/0x728
Jan 13 21:27:58 osage [<ffffffff80238fa7>] ? __dequeue_signal+0xee/0x11c
Jan 13 21:27:58 osage [<ffffffff80232ae1>] ? do_group_exit+0x66/0x96
Jan 13 21:27:58 osage [<ffffffff8023af3c>] ? gtsga_odlvr02502f<>[ffff82aa> ontf_eue08/xa
Jan 13 21:27:58 osage 0 <ffff020f]?ts_qlc+x007
Jan 13 21:27:58 osage 0 <ffff03f5]?sga_aeu+x002
Jan 13 21:27:58 osage 0 <ffff034b]?sn_inl01f01b<>[ffff82b9> eitsga+xd08
Jan 13 21:27:58 osage 0Cd:8 82 df f4 b8 00 00 88 07 94 b4 04 5c 41 88 05 8c 76 94 0e 25 ef 0>0 bf b7 85 b5 3e 1f e8 60 91 4
Jan 13 21:27:58 osage 1RP <ffff065d]pg_eoera+xf01a<>RP<ff80b4b8
Jan 13 21:27:58 osage 4-- n rc 7d053000]-
Jan 13 21:27:58 osage 1Fxn eusv al u eoti edd
Jan 13 21:30:01 osage cron[13090]: (root) CMD (test -x /usr/sbin/run-crons && /usr/sbin/run-crons )
Jan 13 21:30:01 osage cron[13091]: (health) CMD (/home/health/bin/system_health.py --log --graph > /dev/null 2>&1)
Jan 13 21:35:01 osage cron[13122]: (health) CMD (/home/health/bin/system_health.py --log --graph > /dev/null 2>&1)
Jan 13 21:35:02 osage sSMTP[13124]: Sent mail for health@osage (221 Bye)
Jan 13 21:35:04 osage BUG: soft lockup - CPU#1 stuck for 61s! [rrdtool:13119]
Jan 13 21:35:04 osage Modules linked in: fan r8169 thermal processor mii button ohci_hcd uhci_hcd usb_storage ehci_hcd usbcore sg ahci scsi_wait_scan libata
Jan 13 21:35:04 osage CPU 1:
Jan 13 21:35:04 osage Modules linked in: fan r8169 thermal processor mii button ohci_hcd uhci_hcd usb_storage ehci_hcd usbcore sg ahci scsi_wait_scan libata
Jan 13 21:35:04 osage Pid: 13119, comm: rrdtool Tainted: G D W 2.6.28-gentoo #11
Jan 13 21:35:04 osage RIP: 0010:[<ffffffff80334455>] [<ffffffff80334455>] __read_lock_failed+0x5/0x14
Jan 13 21:35:04 osage RSP: 0018:ffff88010735fdb8 EFLAGS: 00000297
Jan 13 21:35:04 osage RAX: ffff8800114a32d0 RBX: ffff88010735fe68 RCX: ffff88010735fe68
Jan 13 21:35:04 osage RDX: 0000000000000101 RSI: ffff880109ea8000 RDI: ffff88010f87cc44
Jan 13 21:35:04 osage RBP: ffff88010735fe68 R08: 0000000000008001 R09: 0000000000000000
Jan 13 21:35:04 osage R10: 0000000000000000 R11: 0000000000000246 R12: ffffffff80257602
Jan 13 21:35:04 osage R13: 000000000000001f R14: 0000000000000002 R15: 000000000000001e
Jan 13 21:35:04 osage FS: 00007f441185b6f0(0000) GS:ffff88011f878ac0(0000) knlGS:00000000f426eb90
Jan 13 21:35:04 osage CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jan 13 21:35:04 osage CR2: 0000000000635000 CR3: 000000011a1cb000 CR4: 00000000000006e0
Jan 13 21:35:04 osage DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Jan 13 21:35:04 osage DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Jan 13 21:35:04 osage Call Trace:
Jan 13 21:35:04 osage [<ffffffff8042cb25>] ? _read_lock+0xb/0xc
Jan 13 21:35:04 osage [<ffffffff8027ddc4>] ? do_path_lookup+0x3f/0x121
Jan 13 21:35:04 osage [<ffffffff8027e96c>] ? path_lookup_open+0x54/0x95
Jan 13 21:35:04 osage [<ffffffff8027ebbb>] ? do_filp_open+0x9d/0x782
Jan 13 21:35:04 osage [<ffffffff8026349f>] free_pgtables+0x87/0x99
Jan 13 21:35:04 osage [<ffffffff80264ed7>] ? unmap_region+0xe5/0x126
Jan 13 21:35:04 osage [<ffffffff80285f5c>] ? alloc_fd+0x69/0x10c
Jan 13 21:35:04 osage [<ffffffff802739c9>] ? do_sys_open+0x48/0xcc
Jan 13 21:35:04 osage [<ffffffff8020b0cb>] ? system_call_fastpath+0x16/0x1b
Jan 13 21:36:10 osage BUG: soft lockup - CPU#1 stuck for 61s! [rrdtool:13119]
Jan 13 21:36:10 osage Modules linked in: fan r8169 thermal processor mii button ohci_hcd uhci_hcd usb_storage ehci_hcd usbcore sg ahci scsi_wait_scan libata
Jan 13 21:36:10 osage CPU 1:
Jan 13 21:36:10 osage Modules linked in: fan r8169 thermal processor mii button ohci_hcd uhci_hcd usb_storage ehci_hcd usbcore sg ahci scsi_wait_scan libata
Jan 13 21:36:10 osage Pid: 13119, comm: rrdtool Tainted: G D W 2.6.28-gentoo #11
Jan 13 21:36:10 osage RIP: 0010:[<ffffffff80334455>] [<ffffffff80334455>] __read_lock_failed+0x5/0x14
Jan 13 21:36:10 osage RSP: 0018:ffff88010735fdb8 EFLAGS: 00000297
Jan 13 21:36:10 osage RAX: ffff8800114a32d0 RBX: ffff88010735fe68 RCX: ffff88010735fe68
Jan 13 21:36:10 osage RDX: 0000000000000101 RSI: ffff880109ea8000 RDI: ffff88010f87cc44
Jan 13 21:36:10 osage RBP: ffff88010735fe68 R08: 0000000000008001 R09: 0000000000000000
Jan 13 21:36:10 osage R10: 0000000000000000 R11: 0000000000000246 R12: ffffffff80257602
Jan 13 21:36:10 osage R13: 000000000000001f R14: 0000000000000002 R15: 000000000000001e
Jan 13 21:36:10 osage FS: 00007f441185b6f0(0000) GS:ffff88011f878ac0(0000) knlGS:00000000f426eb90
Jan 13 21:36:10 osage CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jan 13 21:36:10 osage CR2: 0000000000635000 CR3: 000000011a1cb000 CR4: 00000000000006e0
Jan 13 21:36:10 osage DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Jan 13 21:36:10 osage DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Jan 13 21:36:10 osage Call Trace:
Jan 13 21:36:10 osage [<ffffffff8042cb25>] ? _read_lock+0xb/0xc
Jan 13 21:36:10 osage [<ffffffff8027ddc4>] ? do_path_lookup+0x3f/0x121
Jan 13 21:36:10 osage [<ffffffff8027e96c>] ? path_lookup_open+0x54/0x95
Jan 13 21:36:10 osage [<ffffffff8027ebbb>] ? do_filp_open+0x9d/0x782
Jan 13 21:36:10 osage [<ffffffff8026349f>] free_pgtables+0x87/0x99
Jan 13 21:36:10 osage [<ffffffff80264ed7>] ? unmap_region+0xe5/0x126
Jan 13 21:36:10 osage [<ffffffff80285f5c>] ? alloc_fd+0x69/0x10c
Jan 13 21:36:10 osage [<ffffffff802739c9>] ? do_sys_open+0x48/0xcc
Jan 13 21:36:10 osage [<ffffffff8020b0cb>] ? system_call_fastpath+0x16/0x1b
Jan 13 21:40:01 osage cron[13126]: (root) CMD (test -x /usr/sbin/run-crons && /usr/sbin/run-crons )
Jan 13 21:40:01 osage cron[13131]: (health) CMD (/home/health/bin/system_health.py --log --graph > /dev/null 2>&1)
Jan 13 21:40:03 osage rrdtool[13227]: segfault at 7fd12668c8c6 ip 00007fd136d7ee20 sp 00007fff3ef84558 error 4 in ld-2.6.1.so[7fd136d6b000+1b000]
Jan 13 21:40:03 osage system_health.p[13132]: segfault at 34fff43a81 ip 00007f9aa8d90f28 sp 00007fffb12480c0 error 4 in libpython2.6.so.1.0[7f9aa8c99000+14b000]
Jan 13 21:40:03 osage sSMTP[13231]: Sent mail for health@osage (221 Bye)
Jan 13 21:40:32 osage BUG: soft lockup - CPU#1 stuck for 61s! [rrdtool:13119]
Jan 13 21:40:32 osage Modules linked in: fan r8169 thermal processor mii button ohci_hcd uhci_hcd usb_storage ehci_hcd usbcore sg ahci scsi_wait_scan libata
Jan 13 21:40:32 osage CPU 1:
Jan 13 21:40:32 osage Modules linked in: fan r8169 thermal processor mii button ohci_hcd uhci_hcd usb_storage ehci_hcd usbcore sg ahci scsi_wait_scan libata
Jan 13 21:40:32 osage Pid: 13119, comm: rrdtool Tainted: G D W 2.6.28-gentoo #11
Jan 13 21:40:32 osage RIP: 0010:[<ffffffff80334455>] [<ffffffff80334455>] __read_lock_failed+0x5/0x14
Jan 13 21:40:32 osage RSP: 0018:ffff88010735fdb8 EFLAGS: 00000297
Jan 13 21:40:32 osage RAX: ffff8800114a32d0 RBX: ffff88010735fe68 RCX: ffff88010735fe68
Jan 13 21:40:32 osage RDX: 0000000000000101 RSI: ffff880109ea8000 RDI: ffff88010f87cc44
Jan 13 21:40:32 osage RBP: ffff88010735fe68 R08: 0000000000008001 R09: 0000000000000000
Jan 13 21:40:32 osage R10: 0000000000000000 R11: 0000000000000246 R12: ffffffff80257602
Jan 13 21:40:32 osage R13: 000000000000001f R14: 0000000000000002 R15: 000000000000001e
Jan 13 21:40:32 osage FS: 00007f441185b6f0(0000) GS:ffff88011f878ac0(0000) knlGS:00000000f426eb90
Jan 13 21:40:32 osage CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jan 13 21:40:32 osage CR2: 0000000000635000 CR3: 000000011a1cb000 CR4: 00000000000006e0
Jan 13 21:40:32 osage DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Jan 13 21:40:32 osage DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Jan 13 21:40:32 osage Call Trace:
Jan 13 21:40:32 osage [<ffffffff8042cb25>] ? _read_lock+0xb/0xc
Jan 13 21:40:32 osage [<ffffffff8027ddc4>] ? do_path_lookup+0x3f/0x121
Jan 13 21:40:32 osage [<ffffffff8027e96c>] ? path_lookup_open+0x54/0x95
Jan 13 21:40:32 osage [<ffffffff8027ebbb>] ? do_filp_open+0x9d/0x782
Jan 13 21:40:32 osage [<ffffffff8026349f>] free_pgtables+0x87/0x99
Jan 13 21:40:32 osage [<ffffffff80264ed7>] ? unmap_region+0xe5/0x126
Jan 13 21:40:32 osage [<ffffffff80285f5c>] ? alloc_fd+0x69/0x10c
Jan 13 21:40:32 osage [<ffffffff802739c9>] ? do_sys_open+0x48/0xcc
Jan 13 21:40:32 osage [<ffffffff8020b0cb>] ? system_call_fastpath+0x16/0x1b
Jan 13 21:45:01 osage cron[13233]: (health) CMD (/home/health/bin/system_health.py --log --graph > /dev/null 2>&1)
Jan 13 21:45:02 osage rrdtool[13271]: segfault at 7fa4af06c230 ip 00007fa4af06c230 sp 00007ffff7ef48e8 error 14 in libart_lgpl_2.so.2.3.20[7fa4eebed000+17000]
Jan 13 21:50:01 osage cron[13327]: (root) CMD (test -x /usr/sbin/run-crons && /usr/sbin/run-crons )
Jan 13 21:50:01 osage cron[13332]: (health) CMD (/home/health/bin/system_health.py --log --graph > /dev/null 2>&1)
Jan 13 21:50:02 osage sSMTP[13336]: Sent mail for health@osage (221 Bye)
Jan 13 21:50:21 osage BUG: soft lockup - CPU#1 stuck for 61s! [rrdtool:13119]
Jan 13 21:50:21 osage Modules linked in: fan r8169 thermal processor mii button ohci_hcd uhci_hcd usb_storage ehci_hcd usbcore sg ahci scsi_wait_scan libata
Jan 13 21:50:21 osage CPU 1:
Jan 13 21:50:21 osage Modules linked in: fan r8169 thermal processor mii button ohci_hcd uhci_hcd usb_storage ehci_hcd usbcore sg ahci scsi_wait_scan libata
Jan 13 21:50:21 osage Pid: 13119, comm: rrdtool Tainted: G D W 2.6.28-gentoo #11
Jan 13 21:50:21 osage RIP: 0010:[<ffffffff80334455>] [<ffffffff80334455>] __read_lock_failed+0x5/0x14
Jan 13 21:50:21 osage RSP: 0018:ffff88010735fdb8 EFLAGS: 00000297
Jan 13 21:50:21 osage RAX: ffff8800114a32d0 RBX: ffff88010735fe68 RCX: ffff88010735fe68
Jan 13 21:50:21 osage RDX: 0000000000000101 RSI: ffff880109ea8000 RDI: ffff88010f87cc44
Jan 13 21:50:21 osage RBP: ffff88010735fe68 R08: 0000000000008001 R09: 0000000000000000
Jan 13 21:50:21 osage R10: 0000000000000000 R11: 0000000000000246 R12: ffffffff80257602
Jan 13 21:50:21 osage R13: 000000000000001f R14: 0000000000000002 R15: 000000000000001e
Jan 13 21:50:21 osage FS: 00007f441185b6f0(0000) GS:ffff88011f878ac0(0000) knlGS:00000000f426eb90
Jan 13 21:50:21 osage CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jan 13 21:50:21 osage CR2: 0000000000635000 CR3: 000000011a1cb000 CR4: 00000000000006e0
Jan 13 21:50:21 osage DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Jan 13 21:50:21 osage DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Jan 13 21:50:21 osage Call Trace:
Jan 13 21:50:21 osage [<ffffffff8042cb25>] ? _read_lock+0xb/0xc
Jan 13 21:50:21 osage [<ffffffff8027ddc4>] ? do_path_lookup+0x3f/0x121
Jan 13 21:50:21 osage [<ffffffff8027e96c>] ? path_lookup_open+0x54/0x95
Jan 13 21:50:21 osage [<ffffffff8027ebbb>] ? do_filp_open+0x9d/0x782
Jan 13 21:50:21 osage [<ffffffff8026349f>] free_pgtables+0x87/0x99
Jan 13 21:50:21 osage [<ffffffff80264ed7>] ? unmap_region+0xe5/0x126
Jan 13 21:50:21 osage [<ffffffff80285f5c>] ? alloc_fd+0x69/0x10c
Jan 13 21:50:21 osage [<ffffffff802739c9>] ? do_sys_open+0x48/0xcc
Jan 13 21:50:21 osage [<ffffffff8020b0cb>] ? system_call_fastpath+0x16/0x1b
Jan 13 21:55:01 osage cron[13343]: (health) CMD (/home/health/bin/system_health.py --log --graph > /dev/null 2>&1)
Jan 13 21:55:01 osage sSMTP[13345]: Sent mail for health@osage (221 Bye)
Jan 13 21:55:49 osage BUG: soft lockup - CPU#1 stuck for 61s! [rrdtool:13119]
Jan 13 21:55:49 osage Modules linked in: fan r8169 thermal processor mii button ohci_hcd uhci_hcd usb_storage ehci_hcd usbcore sg ahci scsi_wait_scan libata
Jan 13 21:55:49 osage CPU 1:
Jan 13 21:55:49 osage Modules linked in: fan r8169 thermal processor mii button ohci_hcd uhci_hcd usb_storage ehci_hcd usbcore sg ahci scsi_wait_scan libata
Jan 13 21:55:49 osage Pid: 13119, comm: rrdtool Tainted: G D W 2.6.28-gentoo #11
Jan 13 21:55:49 osage RIP: 0010:[<ffffffff80334455>] [<ffffffff80334455>] __read_lock_failed+0x5/0x14
Jan 13 21:55:49 osage RSP: 0018:ffff88010735fdb8 EFLAGS: 00000297
Jan 13 21:55:49 osage RAX: ffff8800114a32d0 RBX: ffff88010735fe68 RCX: ffff88010735fe68
Jan 13 21:55:49 osage RDX: 0000000000000101 RSI: ffff880109ea8000 RDI: ffff88010f87cc44
Jan 13 21:55:49 osage RBP: ffff88010735fe68 R08: 0000000000008001 R09: 0000000000000000
Jan 13 21:55:49 osage R10: 0000000000000000 R11: 0000000000000246 R12: ffffffff80257602
Jan 13 21:55:49 osage R13: 000000000000001f R14: 0000000000000002 R15: 000000000000001e
Jan 13 21:55:49 osage FS: 00007f441185b6f0(0000) GS:ffff88011f878ac0(0000) knlGS:00000000f426eb90
Jan 13 21:55:49 osage CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jan 13 21:55:49 osage CR2: 0000000000635000 CR3: 000000011a1cb000 CR4: 00000000000006e0
Jan 13 21:55:49 osage DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Jan 13 21:55:49 osage DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Jan 13 21:55:49 osage Call Trace:
Jan 13 21:55:49 osage [<ffffffff8042cb25>] ? _read_lock+0xb/0xc
Jan 13 21:55:49 osage [<ffffffff8027ddc4>] ? do_path_lookup+0x3f/0x121
Jan 13 21:55:49 osage [<ffffffff8027e96c>] ? path_lookup_open+0x54/0x95
Jan 13 21:55:49 osage [<ffffffff8027ebbb>] ? do_filp_open+0x9d/0x782
Jan 13 21:55:49 osage [<ffffffff8026349f>] free_pgtables+0x87/0x99
Jan 13 21:55:49 osage [<ffffffff80264ed7>] ? unmap_region+0xe5/0x126
Jan 13 21:55:49 osage [<ffffffff80285f5c>] ? alloc_fd+0x69/0x10c
Jan 13 21:55:49 osage [<ffffffff802739c9>] ? do_sys_open+0x48/0xcc
Jan 13 21:55:49 osage [<ffffffff8020b0cb>] ? system_call_fastpath+0x16/0x1b
Jan 13 21:58:01 osage cron[13347]: (root) CMD (/usr/sbin/ntpdate -s nic)
Jan 13 21:58:01 osage ntpdate[13347]: adjust time server 192.168.1.2 offset -0.047710 sec
Jan 13 21:59:05 osage BUG: soft lockup - CPU#1 stuck for 61s! [rrdtool:13119]
Jan 13 21:59:05 osage Modules linked in: fan r8169 thermal processor mii button ohci_hcd uhci_hcd usb_storage ehci_hcd usbcore sg ahci scsi_wait_scan libata
Jan 13 21:59:05 osage CPU 1:
Jan 13 21:59:05 osage Modules linked in: fan r8169 thermal processor mii button ohci_hcd uhci_hcd usb_storage ehci_hcd usbcore sg ahci scsi_wait_scan libata
Jan 13 21:59:05 osage Pid: 13119, comm: rrdtool Tainted: G D W 2.6.28-gentoo #11
Jan 13 21:59:05 osage RIP: 0010:[<ffffffff80334455>] [<ffffffff80334455>] __read_lock_failed+0x5/0x14
Jan 13 21:59:05 osage RSP: 0018:ffff88010735fdb8 EFLAGS: 00000297
Jan 13 21:59:05 osage RAX: ffff8800114a32d0 RBX: ffff88010735fe68 RCX: ffff88010735fe68
Jan 13 21:59:05 osage RDX: 0000000000000101 RSI: ffff880109ea8000 RDI: ffff88010f87cc44
Jan 13 21:59:05 osage RBP: ffff88010735fe68 R08: 0000000000008001 R09: 0000000000000000
Jan 13 21:59:05 osage R10: 0000000000000000 R11: 0000000000000246 R12: ffffffff80257602
Jan 13 21:59:05 osage R13: 000000000000001f R14: 0000000000000002 R15: 000000000000001e
Jan 13 21:59:05 osage FS: 00007f441185b6f0(0000) GS:ffff88011f878ac0(0000) knlGS:00000000f426eb90
Jan 13 21:59:05 osage CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jan 13 21:59:05 osage CR2: 0000000000635000 CR3: 000000011a1cb000 CR4: 00000000000006e0
Jan 13 21:59:05 osage DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Jan 13 21:59:05 osage DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Jan 13 21:59:05 osage Call Trace:
Jan 13 21:59:05 osage [<ffffffff8042cb25>] ? _read_lock+0xb/0xc
Jan 13 21:59:05 osage [<ffffffff8027ddc4>] ? do_path_lookup+0x3f/0x121
Jan 13 21:59:05 osage [<ffffffff8027e96c>] ? path_lookup_open+0x54/0x95
Jan 13 21:59:05 osage [<ffffffff8027ebbb>] ? do_filp_open+0x9d/0x782
Jan 13 21:59:05 osage [<ffffffff8026349f>] free_pgtables+0x87/0x99
Jan 13 21:59:05 osage [<ffffffff80264ed7>] ? unmap_region+0xe5/0x126
Jan 13 21:59:05 osage [<ffffffff80285f5c>] ? alloc_fd+0x69/0x10c
Jan 13 21:59:05 osage [<ffffffff802739c9>] ? do_sys_open+0x48/0xcc
Jan 13 21:59:05 osage [<ffffffff8020b0cb>] ? system_call_fastpath+0x16/0x1b
Jan 13 22:00:01 osage cron[13352]: (root) CMD (test -x /usr/sbin/run-crons && /usr/sbin/run-crons )
Jan 13 22:00:01 osage cron[13357]: (root) CMD (rm -f /var/spool/cron/lastrun/cron.hourly)
Jan 13 22:00:01 osage cron[13359]: (health) CMD (/home/health/bin/system_health.py --log --graph > /dev/null 2>&1)
Jan 13 22:00:01 osage system_health.p[13360]: segfault at 7f34d08eb758 ip 00007f34d25fe418 sp 00007fffdaaebda0 error 4 in libpython2.6.so.1.0[7f34d253e000+14b000]
Jan 13 22:00:01 osage sSMTP[13367]: Sent mail for health@osage (221 Bye)
Jan 13 22:00:38 osage su[10577]: pam_unix(su:session): session closed for user root
Jan 13 22:01:16 osage BUG: soft lockup - CPU#1 stuck for 61s! [rrdtool:13119]
Jan 13 22:01:16 osage Modules linked in: fan r8169 thermal processor mii button ohci_hcd uhci_hcd usb_storage ehci_hcd usbcore sg ahci scsi_wait_scan libata
Jan 13 22:01:16 osage CPU 1:
Jan 13 22:01:16 osage Modules linked in: fan r8169 thermal processor mii button ohci_hcd uhci_hcd usb_storage ehci_hcd usbcore sg ahci scsi_wait_scan libata
Jan 13 22:01:16 osage Pid: 13119, comm: rrdtool Tainted: G D W 2.6.28-gentoo #11
Jan 13 22:01:16 osage RIP: 0010:[<ffffffff80334455>] [<ffffffff80334455>] __read_lock_failed+0x5/0x14
Jan 13 22:01:16 osage RSP: 0018:ffff88010735fdb8 EFLAGS: 00000297
Jan 13 22:01:16 osage RAX: ffff8800114a32d0 RBX: ffff88010735fe68 RCX: ffff88010735fe68
Jan 13 22:01:16 osage RDX: 0000000000000101 RSI: ffff880109ea8000 RDI: ffff88010f87cc44
Jan 13 22:01:16 osage RBP: ffff88010735fe68 R08: 0000000000008001 R09: 0000000000000000
Jan 13 22:01:16 osage R10: 0000000000000000 R11: 0000000000000246 R12: ffffffff80257602
Jan 13 22:01:16 osage R13: 000000000000001f R14: 0000000000000002 R15: 000000000000001e
Jan 13 22:01:16 osage FS: 00007f441185b6f0(0000) GS:ffff88011f878ac0(0000) knlGS:00000000f426eb90
Jan 13 22:01:16 osage CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jan 13 22:01:16 osage CR2: 0000000000635000 CR3: 000000011a1cb000 CR4: 00000000000006e0
Jan 13 22:01:16 osage DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Jan 13 22:01:16 osage DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Jan 13 22:01:16 osage Call Trace:
Jan 13 22:01:16 osage [<ffffffff8042cb25>] ? _read_lock+0xb/0xc
Jan 13 22:01:16 osage [<ffffffff8027ddc4>] ? do_path_lookup+0x3f/0x121
Jan 13 22:01:16 osage [<ffffffff8027e96c>] ? path_lookup_open+0x54/0x95
Jan 13 22:01:16 osage [<ffffffff8027ebbb>] ? do_filp_open+0x9d/0x782
Jan 13 22:01:16 osage [<ffffffff8026349f>] free_pgtables+0x87/0x99
Jan 13 22:01:16 osage [<ffffffff80264ed7>] ? unmap_region+0xe5/0x126
Jan 13 22:01:16 osage [<ffffffff80285f5c>] ? alloc_fd+0x69/0x10c
Jan 13 22:01:16 osage [<ffffffff802739c9>] ? do_sys_open+0x48/0xcc
Jan 13 22:01:16 osage [<ffffffff8020b0cb>] ? system_call_fastpath+0x16/0x1b
Jan 13 22:05:01 osage cron[13371]: (health) CMD (/home/health/bin/system_health.py --log --graph > /dev/null 2>&1)
Jan 13 22:10:01 osage cron[13466]: (root) CMD (test -x /usr/sbin/run-crons && /usr/sbin/run-crons )
Jan 13 22:10:01 osage cron[13470]: (health) CMD (/home/health/bin/system_health.py --log --graph > /dev/null 2>&1)
Jan 13 22:10:01 osage sSMTP[13475]: Sent mail for health@osage (221 Bye)
Jan 13 22:11:06 osage BUG: soft lockup - CPU#1 stuck for 61s! [rrdtool:13119]
Jan 13 22:11:06 osage Modules linked in: fan r8169 thermal processor mii button ohci_hcd uhci_hcd usb_storage ehci_hcd usbcore sg ahci scsi_wait_scan libata
Jan 13 22:11:06 osage CPU 1:
Jan 13 22:11:06 osage Modules linked in: fan r8169 thermal processor mii button ohci_hcd uhci_hcd usb_storage ehci_hcd usbcore sg ahci scsi_wait_scan libata
Jan 13 22:11:06 osage Pid: 13119, comm: rrdtool Tainted: G D W 2.6.28-gentoo #11
Jan 13 22:11:06 osage RIP: 0010:[<ffffffff80334455>] [<ffffffff80334455>] __read_lock_failed+0x5/0x14
Jan 13 22:11:06 osage RSP: 0018:ffff88010735fdb8 EFLAGS: 00000297
Jan 13 22:11:06 osage RAX: ffff8800114a32d0 RBX: ffff88010735fe68 RCX: ffff88010735fe68
Jan 13 22:11:06 osage RDX: 0000000000000101 RSI: ffff880109ea8000 RDI: ffff88010f87cc44
Jan 13 22:11:06 osage RBP: ffff88010735fe68 R08: 0000000000008001 R09: 0000000000000000
Jan 13 22:11:06 osage R10: 0000000000000000 R11: 0000000000000246 R12: ffffffff80257602
Jan 13 22:11:06 osage R13: 000000000000001f R14: 0000000000000002 R15: 000000000000001e
Jan 13 22:11:06 osage FS: 00007f441185b6f0(0000) GS:ffff88011f878ac0(0000) knlGS:00000000f426eb90
Jan 13 22:11:06 osage CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jan 13 22:11:06 osage CR2: 0000000000635000 CR3: 000000011a1cb000 CR4: 00000000000006e0
Jan 13 22:11:06 osage DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Jan 13 22:11:06 osage DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Jan 13 22:11:06 osage Call Trace:
Jan 13 22:11:06 osage [<ffffffff8042cb25>] ? _read_lock+0xb/0xc
Jan 13 22:11:06 osage [<ffffffff8027ddc4>] ? do_path_lookup+0x3f/0x121
Jan 13 22:11:06 osage [<ffffffff8027e96c>] ? path_lookup_open+0x54/0x95
Jan 13 22:11:06 osage [<ffffffff8027ebbb>] ? do_filp_open+0x9d/0x782
Jan 13 22:11:06 osage [<ffffffff8026349f>] free_pgtables+0x87/0x99
Jan 13 22:11:06 osage [<ffffffff80264ed7>] ? unmap_region+0xe5/0x126
Jan 13 22:11:06 osage [<ffffffff80285f5c>] ? alloc_fd+0x69/0x10c
Jan 13 22:11:06 osage [<ffffffff802739c9>] ? do_sys_open+0x48/0xcc
Jan 13 22:11:06 osage [<ffffffff8020b0cb>] ? system_call_fastpath+0x16/0x1b
Jan 13 22:13:17 osage BUG: soft lockup - CPU#1 stuck for 61s! [rrdtool:13119]
Jan 13 22:13:17 osage Modules linked in: fan r8169 thermal processor mii button ohci_hcd uhci_hcd usb_storage ehci_hcd usbcore sg ahci scsi_wait_scan libata
Jan 13 22:13:17 osage CPU 1:
Jan 13 22:13:17 osage Modules linked in: fan r8169 thermal processor mii button ohci_hcd uhci_hcd usb_storage ehci_hcd usbcore sg ahci scsi_wait_scan libata
Jan 13 22:13:17 osage Pid: 13119, comm: rrdtool Tainted: G D W 2.6.28-gentoo #11
Jan 13 22:13:17 osage RIP: 0010:[<ffffffff80334455>] [<ffffffff80334455>] __read_lock_failed+0x5/0x14
Jan 13 22:13:17 osage RSP: 0018:ffff88010735fdb8 EFLAGS: 00000297
Jan 13 22:13:17 osage RAX: ffff8800114a32d0 RBX: ffff88010735fe68 RCX: ffff88010735fe68
Jan 13 22:13:17 osage RDX: 0000000000000101 RSI: ffff880109ea8000 RDI: ffff88010f87cc44
Jan 13 22:13:17 osage RBP: ffff88010735fe68 R08: 0000000000008001 R09: 0000000000000000
Jan 13 22:13:17 osage R10: 0000000000000000 R11: 0000000000000246 R12: ffffffff80257602
Jan 13 22:13:17 osage R13: 000000000000001f R14: 0000000000000002 R15: 000000000000001e
Jan 13 22:13:17 osage FS: 00007f441185b6f0(0000) GS:ffff88011f878ac0(0000) knlGS:00000000f426eb90
Jan 13 22:13:17 osage CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jan 13 22:13:17 osage CR2: 0000000000635000 CR3: 000000011a1cb000 CR4: 00000000000006e0
Jan 13 22:13:17 osage DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Jan 13 22:13:17 osage DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Jan 13 22:13:17 osage Call Trace:
Jan 13 22:13:17 osage [<ffffffff8042cb25>] ? _read_lock+0xb/0xc
Jan 13 22:13:17 osage [<ffffffff8027ddc4>] ? do_path_lookup+0x3f/0x121
Jan 13 22:13:17 osage [<ffffffff8027e96c>] ? path_lookup_open+0x54/0x95
Jan 13 22:13:17 osage [<ffffffff8027ebbb>] ? do_filp_open+0x9d/0x782
Jan 13 22:13:17 osage [<ffffffff8026349f>] free_pgtables+0x87/0x99
Jan 13 22:13:17 osage [<ffffffff80264ed7>] ? unmap_region+0xe5/0x126
Jan 13 22:13:17 osage [<ffffffff80285f5c>] ? alloc_fd+0x69/0x10c
Jan 13 22:13:17 osage [<ffffffff802739c9>] ? do_sys_open+0x48/0xcc
Jan 13 22:13:17 osage [<ffffffff8020b0cb>] ? system_call_fastpath+0x16/0x1b
Jan 13 22:15:01 osage cron[13482]: (health) CMD (/home/health/bin/system_health.py --log --graph > /dev/null 2>&1)
Jan 13 22:15:03 osage Eeek! page_mapcount(page) went negative! (-1)
Jan 13 22:15:03 osage page pfn = 5739
Jan 13 22:15:03 osage page->flags = 400000000004001c
Jan 13 22:15:03 osage page->count = 0
Jan 13 22:15:03 osage page->mapping = 0000000000000000
Jan 13 22:15:03 osage vma->vm_ops = 0x0
Jan 13 22:15:03 osage ------------[ cut here ]------------
Jan 13 22:15:03 osage kernel BUG at mm/rmap.c:725!
Jan 13 22:15:03 osage invalid opcode: 0000 [#6] SMP
Jan 13 22:15:03 osage last sysfs file: /sys/devices/pci0000:00/0000:00:14.4/0000:03:05.2/usb2/manufacturer
Jan 13 22:15:03 osage CPU 0
Jan 13 22:15:03 osage Modules linked in: fan r8169 thermal processor mii button ohci_hcd uhci_hcd usb_storage ehci_hcd usbcore sg ahci scsi_wait_scan libata
Jan 13 22:15:03 osage Pid: 13534, comm: rrdtool Tainted: G D W 2.6.28-gentoo #11
Jan 13 22:15:03 osage RIP: 0010:[<ffffffff8026852d>] [<ffffffff8026852d>] page_remove_rmap+0xff/0x11a
Jan 13 22:15:03 osage RSP: 0018:ffff880001599dc8 EFLAGS: 00010246
Jan 13 22:15:03 osage RAX: 0000000000000000 RBX: ffffe20000131478 RCX: 000000000001c456
Jan 13 22:15:03 osage RDX: ffff8800a7a6d000 RSI: 0000000000000046 RDI: ffffffff805d6cf4
Jan 13 22:15:03 osage RBP: ffff880016b25330 R08: ffff8800155236c8 R09: 0000000000000000
Jan 13 22:15:03 osage R10: 00000000ffffffff R11: 0000000000000000 R12: 00007faddb4d9000
Jan 13 22:15:03 osage R13: ffff8800155236c8 R14: 00007faddb57c000 R15: ffff880028022340
Jan 13 22:15:03 osage FS: 00007faddb57c6f0(0000) GS:ffffffff80557980(0000) knlGS:00000000f7139b20
Jan 13 22:15:03 osage CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jan 13 22:15:03 osage CR2: 0000000000651000 CR3: 00000000bbf29000 CR4: 00000000000006e0
Jan 13 22:15:03 osage DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Jan 13 22:15:03 osage DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Jan 13 22:15:03 osage Process rrdtool (pid: 13534, threadinfo ffff880001598000, task ffff88000158e110)
Jan 13 22:15:03 osage Stack:
Jan 13 22:15:03 osage ffffe200004b1c90 ffffe20000131478 0000000000000020 ffffffff8026112d
Jan 13 22:15:03 osage 0000000000000000 ffff880001599ec0 00007faddb57c000 00007faddb4b6000
Jan 13 22:15:03 osage ffff880016b25330 ffff880001599ec8 00000000003dc000 0000000000000000
Jan 13 22:15:03 osage Call Trace:
Jan 13 22:15:03 osage [<ffffffff8026112d>] ? unmap_vmas+0x400/0x706
Jan 13 22:15:03 osage [<ffffffff80264ea5>] ? unmap_region+0xb3/0x126
Jan 13 22:15:03 osage [<ffffffff80265a6c>] ? do_munmap+0x246/0x2b0
Jan 13 22:15:03 osage [<ffffffff8042c8b1>] ? __down_write_nested+0x12/0x93
Jan 13 22:15:03 osage [<ffffffff802668b3>] ? sys_munmap+0x3b/0x55
Jan 13 22:15:03 osage [<ffffffff8020b0cb>] ? system_call_fastpath+0x16/0x1b
Jan 13 22:15:03 osage Code: 80 e8 27 5d fe ff 48 8b 85 90 00 00 00 48 85 c0 74 19 48 8b 40 20 48 85 c0 74 10 48 8b 70 58 48 c7 c7 66 f9 4a 80 e8 02 5d fe ff <0f> 0b eb fe 8b 77 18 5a 5b 5d 83 e6 01 f7 de 83 c6 08 e9 16 64
Jan 13 22:15:03 osage RIP [<ffffffff8026852d>] page_remove_rmap+0xff/0x11a
Jan 13 22:15:03 osage RSP <ffff880001599dc8>
Jan 13 22:15:03 osage ---[ end trace 174dd06553c030c0 ]---
Jan 13 22:20:01 osage cron[13536]: (root) CMD (test -x /usr/sbin/run-crons && /usr/sbin/run-crons )
Jan 13 22:20:01 osage cron[13541]: (health) CMD (/home/health/bin/system_health.py --log --graph > /dev/null 2>&1)
Jan 13 22:20:02 osage sSMTP[13550]: Sent mail for health@osage (221 Bye)
Jan 13 22:20:55 osage BUG: soft lockup - CPU#1 stuck for 61s! [rrdtool:13119]
Jan 13 22:20:55 osage Modules linked in: fan r8169 thermal processor mii button ohci_hcd uhci_hcd usb_storage ehci_hcd usbcore sg ahci scsi_wait_scan libata
Jan 13 22:20:55 osage CPU 1:
Jan 13 22:20:55 osage Modules linked in: fan r8169 thermal processor mii button ohci_hcd uhci_hcd usb_storage ehci_hcd usbcore sg ahci scsi_wait_scan libata
Jan 13 22:20:55 osage Pid: 13119, comm: rrdtool Tainted: G D W 2.6.28-gentoo #11
Jan 13 22:20:55 osage RIP: 0010:[<ffffffff80334455>] [<ffffffff80334455>] __read_lock_failed+0x5/0x14
Jan 13 22:20:55 osage RSP: 0018:ffff88010735fdb8 EFLAGS: 00000297
Jan 13 22:20:55 osage RAX: ffff8800114a32d0 RBX: ffff88010735fe68 RCX: ffff88010735fe68
Jan 13 22:20:55 osage RDX: 0000000000000101 RSI: ffff880109ea8000 RDI: ffff88010f87cc44
Jan 13 22:20:55 osage RBP: ffff88010735fe68 R08: 0000000000008001 R09: 0000000000000000
Jan 13 22:20:55 osage R10: 0000000000000000 R11: 0000000000000246 R12: ffffffff80257602
Jan 13 22:20:55 osage R13: 000000000000001f R14: 0000000000000002 R15: 000000000000001e
Jan 13 22:20:55 osage FS: 00007f441185b6f0(0000) GS:ffff88011f878ac0(0000) knlGS:00000000f426eb90
Jan 13 22:20:55 osage CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jan 13 22:20:55 osage CR2: 0000000000635000 CR3: 000000011a1cb000 CR4: 00000000000006e0
Jan 13 22:20:55 osage DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Jan 13 22:20:55 osage DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Jan 13 22:20:55 osage Call Trace:
Jan 13 22:20:55 osage [<ffffffff8042cb25>] ? _read_lock+0xb/0xc
Jan 13 22:20:55 osage [<ffffffff8027ddc4>] ? do_path_lookup+0x3f/0x121
Jan 13 22:20:55 osage [<ffffffff8027e96c>] ? path_lookup_open+0x54/0x95
Jan 13 22:20:55 osage [<ffffffff8027ebbb>] ? do_filp_open+0x9d/0x782
Jan 13 22:20:55 osage [<ffffffff8026349f>] free_pgtables+0x87/0x99
Jan 13 22:20:55 osage [<ffffffff80264ed7>] ? unmap_region+0xe5/0x126
Jan 13 22:20:55 osage [<ffffffff80285f5c>] ? alloc_fd+0x69/0x10c
Jan 13 22:20:55 osage [<ffffffff802739c9>] ? do_sys_open+0x48/0xcc
Jan 13 22:20:55 osage [<ffffffff8020b0cb>] ? system_call_fastpath+0x16/0x1b
Jan 13 22:25:01 osage cron[13554]: (health) CMD (/home/health/bin/system_health.py --log --graph > /dev/null 2>&1)
Jan 13 22:25:02 osage Eeek! page_mapcount(page) went negative! (-2)
Jan 13 22:25:02 osage page pfn = 2db7a
Jan 13 22:25:02 osage page->flags = 4000000000000864
Jan 13 22:25:02 osage page->count = 2
Jan 13 22:25:02 osage page->mapping = ffff88011f4028c0
Jan 13 22:25:02 osage vma->vm_ops = 0xffffffff80516c00
Jan 13 22:25:02 osage vma->vm_ops->fault = filemap_fault+0x0/0x347
Jan 13 22:25:02 osage vma->vm_file->f_op->mmap = generic_file_mmap+0x0/0x47
Jan 13 22:25:02 osage ------------[ cut here ]------------
Jan 13 22:25:02 osage kernel BUG at mm/rmap.c:725!
Jan 13 22:25:02 osage invalid opcode: 0000 [#7] SMP
Jan 13 22:25:02 osage last sysfs file: /sys/devices/pci0000:00/0000:00:14.4/0000:03:05.2/usb2/manufacturer
Jan 13 22:25:02 osage CPU 0
Jan 13 22:25:02 osage Modules linked in: fan r8169 thermal processor mii button ohci_hcd uhci_hcd usb_storage ehci_hcd usbcore sg ahci scsi_wait_scan libata
Jan 13 22:25:02 osage Pid: 13618, comm: rrdtool Tainted: G D W 2.6.28-gentoo #11
Jan 13 22:25:02 osage RIP: 0010:[<ffffffff8026852d>] [<ffffffff8026852d>] page_remove_rmap+0xff/0x11a
Jan 13 22:25:02 osage RSP: 0018:ffff88000167bd88 EFLAGS: 00010292
Jan 13 22:25:02 osage RAX: 000000000000003b RBX: ffffe20000a002b0 RCX: 0000000000020a8f
Jan 13 22:25:02 osage RDX: ffff8800a7a6d000 RSI: 0000000000000046 RDI: ffffffff805d6cf4
Jan 13 22:25:02 osage RBP: ffff8800841f4678 R08: ffff88001324b568 R09: 0000000000000000
Jan 13 22:25:02 osage R10: 00000000ffffffff R11: 0000000000000000 R12: 00007fd4ec6ad000
Jan 13 22:25:02 osage R13: ffff88001324b568 R14: 00007fd4ec7db000 R15: ffff880028022340
Jan 13 22:25:02 osage FS: 00007fd4ed2b96f0(0000) GS:ffffffff80557980(0000) knlGS:00000000f7139b20
Jan 13 22:25:02 osage CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jan 13 22:25:02 osage CR2: 00007fd4ed0dc000 CR3: 000000001709a000 CR4: 00000000000006e0
Jan 13 22:25:02 osage DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Jan 13 22:25:02 osage DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Jan 13 22:25:02 osage Process rrdtool (pid: 13618, threadinfo ffff88000167a000, task ffff8800016726d0)
Jan 13 22:25:02 osage Stack:
Jan 13 22:25:02 osage ffff8800193bfd08 ffffe20000a002b0 0000000000000020 ffffffff8026112d
Jan 13 22:25:02 osage 0000000000000000 ffff88000167be78 ffffffffffffffff 0000000000000000
Jan 13 22:25:02 osage ffff8800841f4678 ffff88000167be80 000000000038b979 0000000000000000
Jan 13 22:25:02 osage Call Trace:
Jan 13 22:25:02 osage [<ffffffff8026112d>] ? unmap_vmas+0x400/0x706
Jan 13 22:25:02 osage [<ffffffff80265013>] ? exit_mmap+0xa2/0x119
Jan 13 22:25:02 osage [<ffffffff8022dd2e>] ? mmput+0x2c/0xa2
Jan 13 22:25:02 osage [<ffffffff80231148>] ? exit_mm+0xee/0xf9
Jan 13 22:25:02 osage [<ffffffff80232505>] ? do_exit+0x1b2/0x728
Jan 13 22:25:02 osage [<ffffffff80232ae1>] ? do_group_exit+0x66/0x96
Jan 13 22:25:02 osage [<ffffffff8020b0cb>] ? system_call_fastpath+0x16/0x1b
Jan 13 22:25:02 osage Code: 80 e8 27 5d fe ff 48 8b 85 90 00 00 00 48 85 c0 74 19 48 8b 40 20 48 85 c0 74 10 48 8b 70 58 48 c7 c7 66 f9 4a 80 e8 02 5d fe ff <0f> 0b eb fe 8b 77 18 5a 5b 5d 83 e6 01 f7 de 83 c6 08 e9 16 64
Jan 13 22:25:02 osage RIP [<ffffffff8026852d>] page_remove_rmap+0xff/0x11a
Jan 13 22:25:02 osage RSP <ffff88000167bd88>
Jan 13 22:25:02 osage ---[ end trace 174dd06553c030c0 ]---
Jan 13 22:25:02 osage Fixing recursive fault but reboot is needed!
[-- Attachment #4: messages.0114.0227.txt --]
[-- Type: text/plain, Size: 6625 bytes --]
Jan 14 02:26:01 osage /usr/bin/crontab[14032]: (root) LIST (nobody)
Jan 14 02:26:20 osage sSMTP[15408]: Sent mail for root@osage (221 Bye)
Jan 14 02:26:20 osage /usr/bin/crontab[15459]: (root) LIST (nobody)
Jan 14 02:26:21 osage BUG: unable to handle kernel NULL pointer dereference at 0000000000000010
Jan 14 02:26:21 osage IP: [<ffffffff80282e9f>] __d_lookup+0xd8/0xf9
Jan 14 02:26:21 osage PGD d7b66067 PUD d7b9e067 PMD 0
Jan 14 02:26:21 osage Oops: 0000 [#1] SMP
Jan 14 02:26:21 osage last sysfs file: /sys/devices/pci0000:00/0000:00:12.0/host3/target3:0:0/3:0:0:0/model
Jan 14 02:26:21 osage CPU 0
Jan 14 02:26:21 osage Modules linked in: r8169 fan thermal processor mii button ohci_hcd uhci_hcd usb_storage ehci_hcd usbcore sg ahci scsi_wait_scan libata
Jan 14 02:26:21 osage Pid: 15520, comm: chkrootkit Not tainted 2.6.28-gentoo #11
Jan 14 02:26:21 osage RIP: 0010:[<ffffffff80282e9f>] [<ffffffff80282e9f>] __d_lookup+0xd8/0xf9
Jan 14 02:26:21 osage RSP: 0018:ffff8800c243bd18 EFLAGS: 00010202
Jan 14 02:26:21 osage RAX: 0000000000000010 RBX: fffffffffffffff8 RCX: 0000000000000013
Jan 14 02:26:21 osage RDX: 000013de8de1ff3b RSI: 00c3832e8bc182c7 RDI: ffff88011f4019e0
Jan 14 02:26:21 osage RBP: 0000000000000010 R08: 0000000000000000 R09: ffff8800c243ba00
Jan 14 02:26:21 osage R10: 0000000000000000 R11: 0000000000000002 R12: ffff88011f4019e0
Jan 14 02:26:21 osage R13: ffff8800c243bd98 R14: 00000000085f05c9 R15: 0000000000000005
Jan 14 02:26:21 osage FS: 00007f255a2476f0(0000) GS:ffffffff80557980(0000) knlGS:00000000f67bab90
Jan 14 02:26:21 osage CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
Jan 14 02:26:21 osage CR2: 0000000000000010 CR3: 00000000c2530000 CR4: 00000000000006e0
Jan 14 02:26:21 osage DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Jan 14 02:26:21 osage DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Jan 14 02:26:21 osage Process chkrootkit (pid: 15520, threadinfo ffff8800c243a000, task ffff880106520b90)
Jan 14 02:26:21 osage Stack:
Jan 14 02:26:21 osage ffff8800c243bda8 0000000000001d42 ffff8800c243bd98 ffff88011f4019e0
Jan 14 02:26:21 osage ffff88011fabd6f0 ffff88011fabd6c0 ffff8800c243bda8 ffffffff80282ee6
Jan 14 02:26:21 osage ffff8800c243bd98 0000000000003ca1 ffff88011f82db80 ffffffff802acc34
Jan 14 02:26:21 osage Call Trace:
Jan 14 02:26:21 osage [<ffffffff80282ee6>] ? d_lookup+0x26/0x38
Jan 14 02:26:21 osage [<ffffffff802acc34>] ? proc_flush_task+0x14e/0x26e
Jan 14 02:26:21 osage [<ffffffff80229c79>] ? __dequeue_entity+0x1c/0x32
Jan 14 02:26:21 osage [<ffffffff80231487>] ? release_task+0x20/0x2de
Jan 14 02:26:21 osage [<ffffffff80231bb7>] ? wait_consider_task+0x472/0x7c6
Jan 14 02:26:21 osage [<ffffffff8023200a>] ? do_wait+0xff/0x314
Jan 14 02:26:21 osage [<ffffffff8022a1c6>] ? default_wake_function+0x0/0xe
Jan 14 02:26:21 osage [<ffffffff802322a9>] ? sys_wait4+0x8a/0xa1
Jan 14 02:26:21 osage [<ffffffff8020b0cb>] ? system_call_fastpath+0x16/0x1b
Jan 14 02:26:21 osage Code: 48 8b 34 24 44 89 fa e8 5c f4 0a 00 85 c0 75 0b f0 ff 03 fe 43 08 48 89 d8 eb 24 fe 43 08 48 8b 6d 00 48 85 ed 74 16 48 8d 5d e8 <48> 8b 45 00 44 39 73 30 0f 18 08 75 e6 e9 7a ff ff ff 31 c0 41
Jan 14 02:26:21 osage RIP [<ffffffff80282e9f>] __d_lookup+0xd8/0xf9
Jan 14 02:26:21 osage RSP <ffff8800c243bd18>
Jan 14 02:26:21 osage CR2: 0000000000000010
Jan 14 02:26:21 osage ---[ end trace 98b4fc7bcb1d49a6 ]---
Jan 14 02:26:21 osage BUG: unable to handle kernel NULL pointer dereference at 0000000000000010
Jan 14 02:26:21 osage IP: [<ffffffff80282e9f>] __d_lookup+0xd8/0xf9
Jan 14 02:26:21 osage PGD d791f067 PUD c2581067 PMD 0
Jan 14 02:26:21 osage Oops: 0000 [#2] SMP
Jan 14 02:26:21 osage last sysfs file: /sys/devices/pci0000:00/0000:00:12.0/host3/target3:0:0/3:0:0:0/model
Jan 14 02:26:21 osage CPU 0
Jan 14 02:26:21 osage Modules linked in: r8169 fan thermal processor mii button ohci_hcd uhci_hcd usb_storage ehci_hcd usbcore sg ahci scsi_wait_scan libata
Jan 14 02:26:21 osage Pid: 15629, comm: ps Tainted: G D 2.6.28-gentoo #11
Jan 14 02:26:21 osage RIP: 0010:[<ffffffff80282e9f>] [<ffffffff80282e9f>] __d_lookup+0xd8/0xf9
Jan 14 02:26:21 osage RSP: 0018:ffff8800c25e3d98 EFLAGS: 00010202
Jan 14 02:26:21 osage RAX: 0000000000000010 RBX: fffffffffffffff8 RCX: 0000000000000013
Jan 14 02:26:21 osage RDX: 000013de8de1ff3b RSI: 00c3832e8bc182c7 RDI: ffff88011f4019e0
Jan 14 02:26:21 osage RBP: 0000000000000010 R08: 0000000000000005 R09: ffffffff802ac6cb
Jan 14 02:26:21 osage R10: 0000000000000000 R11: 0000000000000002 R12: ffff88011f4019e0
Jan 14 02:26:21 osage R13: ffff8800c25e3e18 R14: 00000000085f05c9 R15: 0000000000000005
Jan 14 02:26:21 osage FS: 00007f2851f356f0(0000) GS:ffffffff80557980(0000) knlGS:00000000f713eb20
Jan 14 02:26:21 osage CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jan 14 02:26:21 osage CR2: 0000000000000010 CR3: 00000000d78d7000 CR4: 00000000000006e0
Jan 14 02:26:21 osage DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Jan 14 02:26:21 osage DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Jan 14 02:26:21 osage Process ps (pid: 15629, threadinfo ffff8800c25e2000, task ffff880106520b90)
Jan 14 02:26:21 osage Stack:
Jan 14 02:26:21 osage ffff8800c25e3ea8 0000000000001d42 ffff8800c25e3e18 ffff88011f4019e0
Jan 14 02:26:21 osage ffff88011f4019e0 0000000000000005 ffff8800c25e3ea8 ffffffff80282ee6
Jan 14 02:26:21 osage ffff8800c25e3ea8 ffff8800c25e3e18 ffffffff802ac6cb ffffffff802ab5ef
Jan 14 02:26:21 osage Call Trace:
Jan 14 02:26:21 osage [<ffffffff80282ee6>] ? d_lookup+0x26/0x38
Jan 14 02:26:21 osage [<ffffffff802ac6cb>] ? proc_pid_instantiate+0x0/0x99
Jan 14 02:26:21 osage [<ffffffff802ab5ef>] ? proc_fill_cache+0x73/0x137
Jan 14 02:26:21 osage [<ffffffff80280440>] ? filldir+0x0/0xb1
Jan 14 02:26:21 osage [<ffffffff802ade29>] ? proc_pid_readdir+0x118/0x19a
Jan 14 02:26:21 osage [<ffffffff80280440>] ? filldir+0x0/0xb1
Jan 14 02:26:21 osage [<ffffffff80280440>] ? filldir+0x0/0xb1
Jan 14 02:26:21 osage [<ffffffff80280556>] ? vfs_readdir+0x65/0x97
Jan 14 02:26:21 osage [<ffffffff802807b5>] ? sys_getdents+0x75/0xbc
Jan 14 02:26:21 osage [<ffffffff8020b0cb>] ? system_call_fastpath+0x16/0x1b
Jan 14 02:26:21 osage Code: 48 8b 34 24 44 89 fa e8 5c f4 0a 00 85 c0 75 0b f0 ff 03 fe 43 08 48 89 d8 eb 24 fe 43 08 48 8b 6d 00 48 85 ed 74 16 48 8d 5d e8 <48> 8b 45 00 44 39 73 30 0f 18 08 75 e6 e9 7a ff ff ff 31 c0 41
Jan 14 02:26:21 osage RIP [<ffffffff80282e9f>] __d_lookup+0xd8/0xf9
Jan 14 02:26:21 osage RSP <ffff8800c25e3d98>
Jan 14 02:26:21 osage CR2: 0000000000000010
Jan 14 02:26:21 osage ---[ end trace 98b4fc7bcb1d49a6 ]---
^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [gentoo-user] Kernel 2.6.28 BUGS
2009-01-14 12:38 [gentoo-user] Kernel 2.6.28 BUGS David Relson
@ 2009-01-14 12:46 ` Dirk Heinrichs
2009-01-14 12:55 ` David Relson
0 siblings, 1 reply; 10+ messages in thread
From: Dirk Heinrichs @ 2009-01-14 12:46 UTC (permalink / raw
To: gentoo-user
Am Mittwoch, den 14.01.2009, 07:38 -0500 schrieb ext David Relson:
> I presume it'd be useful to report these upstream.
According to the attached files, your kernel is tainted. Nobody will
care.
First try without the tainting modules. If the problem remains, _then_
file a bug report (on b.g.o, not kernel.org since you're using
gentoo-sources).
HTH...
Dirk
--
Dirk Heinrichs | Tel: +49 (0)162 234 3408
Configuration Manager | Fax: +49 (0)211 47068 111
Capgemini Deutschland | Mail: dirk.heinrichs@capgemini.com
Wanheimerstraße 68 | Web: http://www.capgemini.com
D-40468 Düsseldorf | ICQ#: 110037733
GPG Public Key C2E467BB | Keyserver: www.keyserver.net
^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [gentoo-user] Kernel 2.6.28 BUGS
2009-01-14 12:46 ` Dirk Heinrichs
@ 2009-01-14 12:55 ` David Relson
2009-01-14 13:01 ` Daniel Pielmeier
0 siblings, 1 reply; 10+ messages in thread
From: David Relson @ 2009-01-14 12:55 UTC (permalink / raw
To: gentoo-user
On Wed, 14 Jan 2009 13:46:47 +0100
Dirk Heinrichs wrote:
> Am Mittwoch, den 14.01.2009, 07:38 -0500 schrieb ext David Relson:
> > I presume it'd be useful to report these upstream.
>
> According to the attached files, your kernel is tainted. Nobody will
> care.
>
> First try without the tainting modules. If the problem remains, _then_
> file a bug report (on b.g.o, not kernel.org since you're using
> gentoo-sources).
>
> HTH...
I noticed the "taint" message and don't think that's right. How do I
identify the tainted module?
^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [gentoo-user] Kernel 2.6.28 BUGS
2009-01-14 12:55 ` David Relson
@ 2009-01-14 13:01 ` Daniel Pielmeier
2009-01-14 13:14 ` David Relson
0 siblings, 1 reply; 10+ messages in thread
From: Daniel Pielmeier @ 2009-01-14 13:01 UTC (permalink / raw
To: gentoo-user
2009/1/14 David Relson <relson@osagesoftware.com>:
>
> I noticed the "taint" message and don't think that's right. How do I
> identify the tainted module?
>
Jan 13 21:35:04 osage Pid: 13119, comm: rrdtool Tainted: G D W
2.6.28-gentoo #11
rrdtool?
--
Regards,
Daniel
^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [gentoo-user] Kernel 2.6.28 BUGS
2009-01-14 13:01 ` Daniel Pielmeier
@ 2009-01-14 13:14 ` David Relson
2009-01-14 13:32 ` Volker Armin Hemmann
` (2 more replies)
0 siblings, 3 replies; 10+ messages in thread
From: David Relson @ 2009-01-14 13:14 UTC (permalink / raw
To: gentoo-user
[-- Attachment #1: Type: text/plain, Size: 1033 bytes --]
On Wed, 14 Jan 2009 14:01:28 +0100
Daniel Pielmeier wrote:
> 2009/1/14 David Relson <relson@osagesoftware.com>:
> >
> > I noticed the "taint" message and don't think that's right. How do
> > I identify the tainted module?
> >
>
> Jan 13 21:35:04 osage Pid: 13119, comm: rrdtool Tainted: G D W
> 2.6.28-gentoo #11
>
> rrdtool?
>
> --
> Regards,
> Daniel
Attached is the full /var/log/messages from the reboot (Jan 13
22:26:17) to:
Jan 14 02:26:21 osage BUG: unable to handle kernel NULL pointer dereference at 0000000000000010
lines 738&739 are timestamped 02:26:21, list the modules linked in, and says "Not tainted".
lines 778&779 also timestamped 02:26:21, list the modules linked in, and says "Tainted".
The modules listed in lines 738 and 778 are identical.
What the heck? How does the kernel go from "Not tainted" to "Tainted"
in less than a second while generating BUG messages?
Can a program, i.e. rrdtool, be tainted? I'd not think so since the
program is in user space, not kernel space.
Regards,
David
[-- Attachment #2: messages.0113.2200.txt --]
[-- Type: text/plain, Size: 63554 bytes --]
Jan 13 22:26:17 osage syslog-ng[5152]: syslog-ng starting up; version='2.0.9'
Jan 13 22:26:17 osage BIOS EBDA/lowmem at: 0009f000/0009f000
Jan 13 22:26:17 osage Linux version 2.6.28-gentoo (root@osage) (gcc version 4.1.2 (Gentoo 4.1.2 p1.1)) #11 SMP Sun Jan 11 19:57:13 EST 2009
Jan 13 22:26:17 osage Command line: root=/dev/ram0 init=/linuxrc ramdisk=8192 real_root=/dev/sda4
Jan 13 22:26:17 osage KERNEL supported cpus:
Jan 13 22:26:17 osage Intel GenuineIntel
Jan 13 22:26:17 osage AMD AuthenticAMD
Jan 13 22:26:17 osage Centaur CentaurHauls
Jan 13 22:26:17 osage BIOS-provided physical RAM map:
Jan 13 22:26:17 osage BIOS-e820: 0000000000000000 - 000000000009f000 (usable)
Jan 13 22:26:17 osage BIOS-e820: 000000000009f000 - 00000000000a0000 (reserved)
Jan 13 22:26:17 osage BIOS-e820: 00000000000f0000 - 0000000000100000 (reserved)
Jan 13 22:26:17 osage BIOS-e820: 0000000000100000 - 00000000d7ee0000 (usable)
Jan 13 22:26:17 osage BIOS-e820: 00000000d7ee0000 - 00000000d7ee3000 (ACPI NVS)
Jan 13 22:26:17 osage BIOS-e820: 00000000d7ee3000 - 00000000d7ef0000 (ACPI data)
Jan 13 22:26:17 osage BIOS-e820: 00000000d7ef0000 - 00000000d7f00000 (reserved)
Jan 13 22:26:17 osage BIOS-e820: 00000000e0000000 - 00000000f0000000 (reserved)
Jan 13 22:26:17 osage BIOS-e820: 00000000fec00000 - 0000000100000000 (reserved)
Jan 13 22:26:17 osage BIOS-e820: 0000000100000000 - 0000000120000000 (usable)
Jan 13 22:26:17 osage DMI 2.4 present.
Jan 13 22:26:17 osage Phoenix BIOS detected: BIOS may corrupt low RAM, working it around.
Jan 13 22:26:17 osage last_pfn = 0x120000 max_arch_pfn = 0x3ffffffff
Jan 13 22:26:17 osage last_pfn = 0xd7ee0 max_arch_pfn = 0x3ffffffff
Jan 13 22:26:17 osage init_memory_mapping: 0000000000000000-00000000d7ee0000
Jan 13 22:26:17 osage 0000000000 - 00d7e00000 page 2M
Jan 13 22:26:17 osage 00d7e00000 - 00d7ee0000 page 4k
Jan 13 22:26:17 osage kernel direct mapping tables up to d7ee0000 @ 10000-16000
Jan 13 22:26:17 osage last_map_addr: d7ee0000 end: d7ee0000
Jan 13 22:26:17 osage init_memory_mapping: 0000000100000000-0000000120000000
Jan 13 22:26:17 osage 0100000000 - 0120000000 page 2M
Jan 13 22:26:17 osage kernel direct mapping tables up to 120000000 @ 14000-1a000
Jan 13 22:26:17 osage last_map_addr: 120000000 end: 120000000
Jan 13 22:26:17 osage RAMDISK: 37f22000 - 37fef95f
Jan 13 22:26:17 osage ACPI: RSDP 000F8280, 0024 (r2 ATI )
Jan 13 22:26:17 osage ACPI: XSDT D7EE3100, 004C (r1 ATI ASUSACPI 42302E31 AWRD 0)
Jan 13 22:26:17 osage ACPI: FACP D7EE8500, 00F4 (r3 ATI ASUSACPI 42302E31 AWRD 0)
Jan 13 22:26:17 osage FADT: X_PM1a_EVT_BLK.bit_width (8) does not match PM1_EVT_LEN (4)
Jan 13 22:26:17 osage ACPI: DSDT D7EE3280, 5213 (r1 ATI ASUSACPI 1000 MSFT 3000000)
Jan 13 22:26:17 osage ACPI: FACS D7EE0000, 0040
Jan 13 22:26:17 osage ACPI: SSDT D7EE8740, 028A (r1 PTLTD POWERNOW 1 LTP 1)
Jan 13 22:26:17 osage ACPI: HPET D7EE8A40, 0038 (r1 ATI ASUSACPI 42302E31 AWRD 98)
Jan 13 22:26:17 osage ACPI: MCFG D7EE8AC0, 003C (r1 ATI ASUSACPI 42302E31 AWRD 0)
Jan 13 22:26:17 osage ACPI: APIC D7EE8640, 0084 (r1 ATI ASUSACPI 42302E31 AWRD 0)
Jan 13 22:26:17 osage ACPI: Local APIC address 0xfee00000
Jan 13 22:26:17 osage (7 early reservations) ==> bootmem [0000000000 - 0120000000]
Jan 13 22:26:17 osage #0 [0000000000 - 0000001000] BIOS data page ==> [0000000000 - 0000001000]
Jan 13 22:26:17 osage #1 [0000006000 - 0000008000] TRAMPOLINE ==> [0000006000 - 0000008000]
Jan 13 22:26:17 osage #2 [0000200000 - 000060f9d4] TEXT DATA BSS ==> [0000200000 - 000060f9d4]
Jan 13 22:26:17 osage #3 [0037f22000 - 0037fef95f] RAMDISK ==> [0037f22000 - 0037fef95f]
Jan 13 22:26:17 osage #4 [000009f000 - 0000100000] BIOS reserved ==> [000009f000 - 0000100000]
Jan 13 22:26:17 osage #5 [0000010000 - 0000014000] PGTABLE ==> [0000010000 - 0000014000]
Jan 13 22:26:17 osage #6 [0000014000 - 0000015000] PGTABLE ==> [0000014000 - 0000015000]
Jan 13 22:26:17 osage found SMP MP-table at [ffff8800000f65d0] 000f65d0
Jan 13 22:26:17 osage [ffffe20000000000-ffffe20003ffffff] PMD -> [ffff880028200000-ffff88002c1fffff] on node 0
Jan 13 22:26:17 osage Zone PFN ranges:
Jan 13 22:26:17 osage DMA 0x00000010 -> 0x00001000
Jan 13 22:26:17 osage DMA32 0x00001000 -> 0x00100000
Jan 13 22:26:17 osage Normal 0x00100000 -> 0x00120000
Jan 13 22:26:17 osage Movable zone start PFN for each node
Jan 13 22:26:17 osage early_node_map[3] active PFN ranges
Jan 13 22:26:17 osage 0: 0x00000010 -> 0x0000009f
Jan 13 22:26:17 osage 0: 0x00000100 -> 0x000d7ee0
Jan 13 22:26:17 osage 0: 0x00100000 -> 0x00120000
Jan 13 22:26:17 osage On node 0 totalpages: 1015407
Jan 13 22:26:17 osage DMA zone: 56 pages used for memmap
Jan 13 22:26:17 osage DMA zone: 1146 pages reserved
Jan 13 22:26:17 osage DMA zone: 2781 pages, LIFO batch:0
Jan 13 22:26:17 osage DMA32 zone: 14280 pages used for memmap
Jan 13 22:26:17 osage DMA32 zone: 866072 pages, LIFO batch:31
Jan 13 22:26:17 osage Normal zone: 1792 pages used for memmap
Jan 13 22:26:17 osage Normal zone: 129280 pages, LIFO batch:31
Jan 13 22:26:17 osage Movable zone: 0 pages used for memmap
Jan 13 22:26:17 osage Detected use of extended apic ids on hypertransport bus
Jan 13 22:26:17 osage ACPI: PM-Timer IO Port: 0x4008
Jan 13 22:26:17 osage ACPI: Local APIC address 0xfee00000
Jan 13 22:26:17 osage ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
Jan 13 22:26:17 osage ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] enabled)
Jan 13 22:26:17 osage ACPI: LAPIC (acpi_id[0x02] lapic_id[0x02] disabled)
Jan 13 22:26:17 osage ACPI: LAPIC (acpi_id[0x03] lapic_id[0x03] disabled)
Jan 13 22:26:17 osage ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1])
Jan 13 22:26:17 osage ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1])
Jan 13 22:26:17 osage ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1])
Jan 13 22:26:17 osage ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1])
Jan 13 22:26:17 osage ACPI: IOAPIC (id[0x04] address[0xfec00000] gsi_base[0])
Jan 13 22:26:17 osage IOAPIC[0]: apic_id 4, version 0, address 0xfec00000, GSI 0-23
Jan 13 22:26:17 osage ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
Jan 13 22:26:17 osage ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 low level)
Jan 13 22:26:17 osage ACPI: IRQ0 used by override.
Jan 13 22:26:17 osage ACPI: IRQ2 used by override.
Jan 13 22:26:17 osage ACPI: IRQ9 used by override.
Jan 13 22:26:17 osage ACPI: HPET id: 0x8200 base: 0xfed00000
Jan 13 22:26:17 osage Using ACPI (MADT) for SMP configuration information
Jan 13 22:26:17 osage SMP: Allowing 2 CPUs, 0 hotplug CPUs
Jan 13 22:26:17 osage Allocating PCI resources starting at f1000000 (gap: f0000000:ec00000)
Jan 13 22:26:17 osage PERCPU: Allocating 45056 bytes of per cpu data
Jan 13 22:26:17 osage NR_CPUS: 2, nr_cpu_ids: 2, nr_node_ids 1
Jan 13 22:26:17 osage Built 1 zonelists in Zone order, mobility grouping on. Total pages: 998133
Jan 13 22:26:17 osage Kernel command line: root=/dev/ram0 init=/linuxrc ramdisk=8192 real_root=/dev/sda4
Jan 13 22:26:17 osage Initializing CPU#0
Jan 13 22:26:17 osage PID hash table entries: 4096 (order: 12, 32768 bytes)
Jan 13 22:26:17 osage Fast TSC calibration using PIT
Jan 13 22:26:17 osage Detected 2599.713 MHz processor.
Jan 13 22:26:17 osage Console: colour VGA+ 80x25
Jan 13 22:26:17 osage console [tty0] enabled
Jan 13 22:26:17 osage Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes)
Jan 13 22:26:17 osage Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes)
Jan 13 22:26:17 osage Checking aperture...
Jan 13 22:26:17 osage No AGP bridge found
Jan 13 22:26:17 osage Node 0: aperture @ 20000000 size 32 MB
Jan 13 22:26:17 osage Aperture pointing to e820 RAM. Ignoring.
Jan 13 22:26:17 osage Your BIOS doesn't leave a aperture memory hole
Jan 13 22:26:17 osage Please enable the IOMMU option in the BIOS setup
Jan 13 22:26:17 osage This costs you 64 MB of RAM
Jan 13 22:26:17 osage Mapping aperture over 65536 KB of RAM @ 20000000
Jan 13 22:26:17 osage Memory: 3918312k/4718592k available (2239k kernel code, 656964k absent, 142488k reserved, 1098k data, 348k init)
Jan 13 22:26:17 osage hpet clockevent registered
Jan 13 22:26:17 osage HPET: 4 timers in total, 0 timers will be used for per-cpu timer
Jan 13 22:26:17 osage Calibrating delay loop (skipped), value calculated using timer frequency.. 5199.42 BogoMIPS (lpj=2599713)
Jan 13 22:26:17 osage Mount-cache hash table entries: 256
Jan 13 22:26:17 osage CPU: L1 I Cache: 64K (64 bytes/line), D cache 64K (64 bytes/line)
Jan 13 22:26:17 osage CPU: L2 Cache: 512K (64 bytes/line)
Jan 13 22:26:17 osage tseg: 00d7f00000
Jan 13 22:26:17 osage CPU: Physical Processor ID: 0
Jan 13 22:26:17 osage CPU: Processor Core ID: 0
Jan 13 22:26:17 osage using C1E aware idle routine
Jan 13 22:26:17 osage Freeing SMP alternatives: 21k freed
Jan 13 22:26:17 osage ACPI: Core revision 20080926
Jan 13 22:26:17 osage Setting APIC routing to flat
Jan 13 22:26:17 osage ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
Jan 13 22:26:17 osage CPU0: AMD Athlon(tm) 64 X2 Dual Core Processor 5000+ stepping 01
Jan 13 22:26:17 osage Booting processor 1 APIC 0x1 ip 0x6000
Jan 13 22:26:17 osage Initializing CPU#1
Jan 13 22:26:17 osage Calibrating delay using timer specific routine.. 5199.67 BogoMIPS (lpj=2599835)
Jan 13 22:26:17 osage CPU: L1 I Cache: 64K (64 bytes/line), D cache 64K (64 bytes/line)
Jan 13 22:26:17 osage CPU: L2 Cache: 512K (64 bytes/line)
Jan 13 22:26:17 osage CPU: Physical Processor ID: 0
Jan 13 22:26:17 osage CPU: Processor Core ID: 1
Jan 13 22:26:17 osage CPU1: AMD Athlon(tm) 64 X2 Dual Core Processor 5000+ stepping 01
Jan 13 22:26:17 osage Brought up 2 CPUs
Jan 13 22:26:17 osage Total of 2 processors activated (10399.09 BogoMIPS).
Jan 13 22:26:17 osage net_namespace: 552 bytes
Jan 13 22:26:17 osage NET: Registered protocol family 16
Jan 13 22:26:17 osage node 0 link 0: io port [b000, ffff]
Jan 13 22:26:17 osage TOM: 00000000e0000000 aka 3584M
Jan 13 22:26:17 osage node 0 link 0: mmio [a0000, bffff]
Jan 13 22:26:17 osage node 0 link 0: mmio [e0000000, dfffffff]
Jan 13 22:26:17 osage node 0 link 0: mmio [f0000000, fe02ffff]
Jan 13 22:26:17 osage node 0 link 0: mmio [e0000000, e03fffff]
Jan 13 22:26:17 osage TOM2: 0000000120000000 aka 4608M
Jan 13 22:26:17 osage bus: [00,03] on node 0 link 0
Jan 13 22:26:17 osage bus: 00 index 0 io port: [0, ffff]
Jan 13 22:26:17 osage bus: 00 index 1 mmio: [a0000, bffff]
Jan 13 22:26:17 osage bus: 00 index 2 mmio: [e0000000, efffffff]
Jan 13 22:26:17 osage bus: 00 index 3 mmio: [f0000000, ffffffff]
Jan 13 22:26:17 osage bus: 00 index 4 mmio: [120000000, fcffffffff]
Jan 13 22:26:17 osage ACPI: bus type pci registered
Jan 13 22:26:17 osage PCI: MCFG configuration 0: base e0000000 segment 0 buses 0 - 255
Jan 13 22:26:17 osage PCI: MCFG area at e0000000 reserved in E820
Jan 13 22:26:17 osage PCI: Using MMCONFIG at e0000000 - efffffff
Jan 13 22:26:17 osage PCI: Using configuration type 1 for base access
Jan 13 22:26:17 osage ACPI: EC: Look up EC in DSDT
Jan 13 22:26:17 osage ACPI: Interpreter enabled
Jan 13 22:26:17 osage ACPI: (supports S0 S5)
Jan 13 22:26:17 osage ACPI: Using IOAPIC for interrupt routing
Jan 13 22:26:17 osage ACPI: No dock devices found.
Jan 13 22:26:17 osage ACPI: PCI Root Bridge [PCI0] (0000:00)
Jan 13 22:26:17 osage pci 0000:00:07.0: PME# supported from D0 D3hot D3cold
Jan 13 22:26:17 osage pci 0000:00:07.0: PME# disabled
Jan 13 22:26:17 osage pci 0000:00:12.0: reg 10 io port: [0xfc00-0xfc07]
Jan 13 22:26:17 osage pci 0000:00:12.0: reg 14 io port: [0xf800-0xf803]
Jan 13 22:26:17 osage pci 0000:00:12.0: reg 18 io port: [0xf400-0xf407]
Jan 13 22:26:17 osage pci 0000:00:12.0: reg 1c io port: [0xf000-0xf003]
Jan 13 22:26:17 osage pci 0000:00:12.0: reg 20 io port: [0xec00-0xec0f]
Jan 13 22:26:17 osage pci 0000:00:12.0: reg 24 32bit mmio: [0xfe02f000-0xfe02f3ff]
Jan 13 22:26:17 osage pci 0000:00:12.0: set SATA to AHCI mode
Jan 13 22:26:17 osage pci 0000:00:13.0: reg 10 32bit mmio: [0xfe02e000-0xfe02efff]
Jan 13 22:26:17 osage pci 0000:00:13.1: reg 10 32bit mmio: [0xfe02d000-0xfe02dfff]
Jan 13 22:26:17 osage pci 0000:00:13.2: reg 10 32bit mmio: [0xfe02c000-0xfe02cfff]
Jan 13 22:26:17 osage pci 0000:00:13.3: reg 10 32bit mmio: [0xfe02b000-0xfe02bfff]
Jan 13 22:26:17 osage pci 0000:00:13.4: reg 10 32bit mmio: [0xfe02a000-0xfe02afff]
Jan 13 22:26:17 osage pci 0000:00:13.5: reg 10 32bit mmio: [0xfe029000-0xfe0290ff]
Jan 13 22:26:17 osage pci 0000:00:13.5: supports D1 D2
Jan 13 22:26:17 osage pci 0000:00:13.5: PME# supported from D0 D1 D2 D3hot
Jan 13 22:26:17 osage pci 0000:00:13.5: PME# disabled
Jan 13 22:26:17 osage pci 0000:00:14.0: reg 10 io port: [0xb00-0xb0f]
Jan 13 22:26:17 osage pci 0000:00:14.1: reg 10 io port: [0x00-0x07]
Jan 13 22:26:17 osage pci 0000:00:14.1: reg 14 io port: [0x00-0x03]
Jan 13 22:26:17 osage pci 0000:00:14.1: reg 18 io port: [0x00-0x07]
Jan 13 22:26:17 osage pci 0000:00:14.1: reg 1c io port: [0x00-0x03]
Jan 13 22:26:17 osage pci 0000:00:14.1: reg 20 io port: [0xe400-0xe40f]
Jan 13 22:26:17 osage pci 0000:00:14.2: reg 10 64bit mmio: [0xfe020000-0xfe023fff]
Jan 13 22:26:17 osage pci 0000:00:14.2: PME# supported from D0 D3hot D3cold
Jan 13 22:26:17 osage pci 0000:00:14.2: PME# disabled
Jan 13 22:26:17 osage pci 0000:01:05.0: reg 10 64bit mmio: [0xf0000000-0xf7ffffff]
Jan 13 22:26:17 osage pci 0000:01:05.0: reg 18 64bit mmio: [0xfdcf0000-0xfdcfffff]
Jan 13 22:26:17 osage pci 0000:01:05.0: reg 20 io port: [0xcc00-0xccff]
Jan 13 22:26:17 osage pci 0000:01:05.0: reg 24 32bit mmio: [0xfdb00000-0xfdbfffff]
Jan 13 22:26:17 osage pci 0000:01:05.0: supports D1 D2
Jan 13 22:26:17 osage pci 0000:00:01.0: bridge io port: [0xc000-0xcfff]
Jan 13 22:26:17 osage pci 0000:00:01.0: bridge 32bit mmio: [0xfdb00000-0xfdcfffff]
Jan 13 22:26:17 osage pci 0000:00:01.0: bridge 64bit mmio pref: [0xf0000000-0xf7ffffff]
Jan 13 22:26:17 osage pci 0000:02:00.0: reg 10 io port: [0xdc00-0xdcff]
Jan 13 22:26:17 osage pci 0000:02:00.0: reg 18 64bit mmio: [0xfdaff000-0xfdafffff]
Jan 13 22:26:17 osage pci 0000:02:00.0: reg 30 32bit mmio: [0x000000-0x01ffff]
Jan 13 22:26:17 osage pci 0000:02:00.0: supports D1 D2
Jan 13 22:26:17 osage pci 0000:02:00.0: PME# supported from D1 D2 D3hot D3cold
Jan 13 22:26:17 osage pci 0000:02:00.0: PME# disabled
Jan 13 22:26:17 osage pci 0000:00:07.0: bridge io port: [0xd000-0xdfff]
Jan 13 22:26:17 osage pci 0000:00:07.0: bridge 32bit mmio: [0xfda00000-0xfdafffff]
Jan 13 22:26:17 osage pci 0000:00:07.0: bridge 64bit mmio pref: [0xfdf00000-0xfdffffff]
Jan 13 22:26:17 osage pci 0000:03:05.0: reg 10 32bit mmio: [0xfdeff000-0xfdefffff]
Jan 13 22:26:17 osage pci 0000:03:05.0: supports D1 D2
Jan 13 22:26:17 osage pci 0000:03:05.0: PME# supported from D0 D1 D2 D3hot
Jan 13 22:26:17 osage pci 0000:03:05.0: PME# disabled
Jan 13 22:26:17 osage pci 0000:03:05.1: reg 10 32bit mmio: [0xfdefe000-0xfdefefff]
Jan 13 22:26:17 osage pci 0000:03:05.1: supports D1 D2
Jan 13 22:26:17 osage pci 0000:03:05.1: PME# supported from D0 D1 D2 D3hot
Jan 13 22:26:17 osage pci 0000:03:05.1: PME# disabled
Jan 13 22:26:17 osage pci 0000:03:05.2: reg 10 32bit mmio: [0xfdefd000-0xfdefd0ff]
Jan 13 22:26:17 osage pci 0000:03:05.2: supports D1 D2
Jan 13 22:26:17 osage pci 0000:03:05.2: PME# supported from D0 D1 D2 D3hot
Jan 13 22:26:17 osage pci 0000:03:05.2: PME# disabled
Jan 13 22:26:17 osage pci 0000:03:07.0: reg 10 32bit mmio: [0xfdefc000-0xfdefc7ff]
Jan 13 22:26:17 osage pci 0000:03:07.0: reg 14 io port: [0xbc00-0xbc7f]
Jan 13 22:26:17 osage pci 0000:03:07.0: supports D2
Jan 13 22:26:17 osage pci 0000:03:07.0: PME# supported from D2 D3hot D3cold
Jan 13 22:26:17 osage pci 0000:03:07.0: PME# disabled
Jan 13 22:26:17 osage pci 0000:00:14.4: transparent bridge
Jan 13 22:26:17 osage pci 0000:00:14.4: bridge io port: [0xb000-0xbfff]
Jan 13 22:26:17 osage pci 0000:00:14.4: bridge 32bit mmio: [0xfde00000-0xfdefffff]
Jan 13 22:26:17 osage pci 0000:00:14.4: bridge 32bit mmio pref: [0xfdd00000-0xfddfffff]
Jan 13 22:26:17 osage bus 00 -> node 0
Jan 13 22:26:17 osage ACPI: PCI Interrupt Routing Table [\_SB_.PCI0._PRT]
Jan 13 22:26:17 osage ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.P2P_._PRT]
Jan 13 22:26:17 osage ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PCE7._PRT]
Jan 13 22:26:17 osage ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.AGP_._PRT]
Jan 13 22:26:17 osage ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 7 10 11) *0, disabled.
Jan 13 22:26:17 osage ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 7 10 11) *0, disabled.
Jan 13 22:26:17 osage ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 5 6 7 10 11) *0, disabled.
Jan 13 22:26:17 osage ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 7 10 11) *0, disabled.
Jan 13 22:26:17 osage ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 5 6 7 *10 11)
Jan 13 22:26:17 osage ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 7 10 *11)
Jan 13 22:26:17 osage ACPI: PCI Interrupt Link [LNK0] (IRQs 3 4 5 6 7 10 *11)
Jan 13 22:26:17 osage ACPI: PCI Interrupt Link [LNK1] (IRQs 3 4 5 6 7 10 11) *0, disabled.
Jan 13 22:26:17 osage SCSI subsystem initialized
Jan 13 22:26:17 osage PCI: Using ACPI for IRQ routing
Jan 13 22:26:17 osage PCI-DMA: Disabling AGP.
Jan 13 22:26:17 osage PCI-DMA: aperture base @ 20000000 size 65536 KB
Jan 13 22:26:17 osage PCI-DMA: using GART IOMMU.
Jan 13 22:26:17 osage PCI-DMA: Reserving 64MB of IOMMU area in the AGP aperture
Jan 13 22:26:17 osage pnp: PnP ACPI init
Jan 13 22:26:17 osage ACPI: bus type pnp registered
Jan 13 22:26:17 osage pnp: PnP ACPI: found 15 devices
Jan 13 22:26:17 osage ACPI: ACPI bus type pnp unregistered
Jan 13 22:26:17 osage system 00:01: ioport range 0x4100-0x411f has been reserved
Jan 13 22:26:17 osage system 00:01: ioport range 0x228-0x22f has been reserved
Jan 13 22:26:17 osage system 00:01: ioport range 0x40b-0x40b has been reserved
Jan 13 22:26:17 osage system 00:01: ioport range 0x4d6-0x4d6 has been reserved
Jan 13 22:26:17 osage system 00:01: ioport range 0xc00-0xc01 has been reserved
Jan 13 22:26:17 osage system 00:01: ioport range 0xc14-0xc14 has been reserved
Jan 13 22:26:17 osage system 00:01: ioport range 0xc50-0xc52 has been reserved
Jan 13 22:26:17 osage system 00:01: ioport range 0xc6c-0xc6d has been reserved
Jan 13 22:26:17 osage system 00:01: ioport range 0xc6f-0xc6f has been reserved
Jan 13 22:26:17 osage system 00:01: ioport range 0xcd0-0xcd1 has been reserved
Jan 13 22:26:17 osage system 00:01: ioport range 0xcd2-0xcd3 has been reserved
Jan 13 22:26:17 osage system 00:01: ioport range 0xcd4-0xcdf has been reserved
Jan 13 22:26:17 osage system 00:01: ioport range 0x4000-0x40fe has been reserved
Jan 13 22:26:17 osage system 00:01: ioport range 0x4210-0x4217 has been reserved
Jan 13 22:26:17 osage system 00:01: ioport range 0xb00-0xb0f has been reserved
Jan 13 22:26:17 osage system 00:01: ioport range 0xb10-0xb1f has been reserved
Jan 13 22:26:17 osage system 00:07: ioport range 0x4d0-0x4d1 has been reserved
Jan 13 22:26:17 osage system 00:07: ioport range 0x220-0x225 has been reserved
Jan 13 22:26:17 osage system 00:0d: iomem range 0xe0000000-0xefffffff has been reserved
Jan 13 22:26:17 osage system 00:0e: iomem range 0xcd600-0xcffff has been reserved
Jan 13 22:26:17 osage system 00:0e: iomem range 0xf0000-0xf7fff could not be reserved
Jan 13 22:26:17 osage system 00:0e: iomem range 0xf8000-0xfbfff could not be reserved
Jan 13 22:26:17 osage system 00:0e: iomem range 0xfc000-0xfffff could not be reserved
Jan 13 22:26:17 osage system 00:0e: iomem range 0xd7ef0000-0xd7feffff could not be reserved
Jan 13 22:26:17 osage system 00:0e: iomem range 0xfed00000-0xfed000ff has been reserved
Jan 13 22:26:17 osage system 00:0e: iomem range 0xd7ee0000-0xd7efffff could not be reserved
Jan 13 22:26:17 osage system 00:0e: iomem range 0xffff0000-0xffffffff has been reserved
Jan 13 22:26:17 osage system 00:0e: iomem range 0x0-0x9ffff could not be reserved
Jan 13 22:26:17 osage system 00:0e: iomem range 0x100000-0xd7edffff could not be reserved
Jan 13 22:26:17 osage system 00:0e: iomem range 0xd7ff0000-0xdffeffff has been reserved
Jan 13 22:26:17 osage system 00:0e: iomem range 0xfec00000-0xfec00fff has been reserved
Jan 13 22:26:17 osage system 00:0e: iomem range 0xfee00000-0xfee00fff has been reserved
Jan 13 22:26:17 osage system 00:0e: iomem range 0xfff80000-0xfffeffff has been reserved
Jan 13 22:26:17 osage pci 0000:00:01.0: PCI bridge, secondary bus 0000:01
Jan 13 22:26:17 osage pci 0000:00:01.0: IO window: 0xc000-0xcfff
Jan 13 22:26:17 osage pci 0000:00:01.0: MEM window: 0xfdb00000-0xfdcfffff
Jan 13 22:26:17 osage pci 0000:00:01.0: PREFETCH window: 0x000000f0000000-0x000000f7ffffff
Jan 13 22:26:17 osage pci 0000:00:07.0: PCI bridge, secondary bus 0000:02
Jan 13 22:26:17 osage pci 0000:00:07.0: IO window: 0xd000-0xdfff
Jan 13 22:26:17 osage pci 0000:00:07.0: MEM window: 0xfda00000-0xfdafffff
Jan 13 22:26:17 osage pci 0000:00:07.0: PREFETCH window: 0x000000fdf00000-0x000000fdffffff
Jan 13 22:26:17 osage pci 0000:00:14.4: PCI bridge, secondary bus 0000:03
Jan 13 22:26:17 osage pci 0000:00:14.4: IO window: 0xb000-0xbfff
Jan 13 22:26:17 osage pci 0000:00:14.4: MEM window: 0xfde00000-0xfdefffff
Jan 13 22:26:17 osage pci 0000:00:14.4: PREFETCH window: 0x000000fdd00000-0x000000fddfffff
Jan 13 22:26:17 osage pci 0000:00:07.0: setting latency timer to 64
Jan 13 22:26:17 osage bus: 00 index 0 io port: [0x00-0xffff]
Jan 13 22:26:17 osage bus: 00 index 1 mmio: [0x000000-0xffffffffffffffff]
Jan 13 22:26:17 osage bus: 01 index 0 io port: [0xc000-0xcfff]
Jan 13 22:26:17 osage bus: 01 index 1 mmio: [0xfdb00000-0xfdcfffff]
Jan 13 22:26:17 osage bus: 01 index 2 mmio: [0xf0000000-0xf7ffffff]
Jan 13 22:26:17 osage bus: 01 index 3 mmio: [0x0-0x0]
Jan 13 22:26:17 osage bus: 02 index 0 io port: [0xd000-0xdfff]
Jan 13 22:26:17 osage bus: 02 index 1 mmio: [0xfda00000-0xfdafffff]
Jan 13 22:26:17 osage bus: 02 index 2 mmio: [0xfdf00000-0xfdffffff]
Jan 13 22:26:17 osage bus: 02 index 3 mmio: [0x0-0x0]
Jan 13 22:26:17 osage bus: 03 index 0 io port: [0xb000-0xbfff]
Jan 13 22:26:17 osage bus: 03 index 1 mmio: [0xfde00000-0xfdefffff]
Jan 13 22:26:17 osage bus: 03 index 2 mmio: [0xfdd00000-0xfddfffff]
Jan 13 22:26:17 osage bus: 03 index 3 io port: [0x00-0xffff]
Jan 13 22:26:17 osage bus: 03 index 4 mmio: [0x000000-0xffffffffffffffff]
Jan 13 22:26:17 osage NET: Registered protocol family 2
Jan 13 22:26:17 osage IP route cache hash table entries: 131072 (order: 8, 1048576 bytes)
Jan 13 22:26:17 osage TCP established hash table entries: 262144 (order: 10, 4194304 bytes)
Jan 13 22:26:17 osage TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
Jan 13 22:26:17 osage TCP: Hash tables configured (established 262144 bind 65536)
Jan 13 22:26:17 osage TCP reno registered
Jan 13 22:26:17 osage NET: Registered protocol family 1
Jan 13 22:26:17 osage checking if image is initramfs... it is
Jan 13 22:26:17 osage Freeing initrd memory: 822k freed
Jan 13 22:26:17 osage squashfs: version 3.4 (2008/08/26) Phillip Lougher
Jan 13 22:26:17 osage msgmni has been set to 7656
Jan 13 22:26:17 osage alg: No test for stdrng (krng)
Jan 13 22:26:17 osage io scheduler noop registered
Jan 13 22:26:17 osage io scheduler cfq registered (default)
Jan 13 22:26:17 osage pci 0000:01:05.0: Boot video device
Jan 13 22:26:17 osage pcieport-driver 0000:00:07.0: setting latency timer to 64
Jan 13 22:26:17 osage pcieport-driver 0000:00:07.0: found MSI capability
Jan 13 22:26:17 osage pcieport-driver 0000:00:07.0: irq 319 for MSI/MSI-X
Jan 13 22:26:17 osage pci_express 0000:00:07.0:pcie00: allocate port service
Jan 13 22:26:17 osage pci_express 0000:00:07.0:pcie03: allocate port service
Jan 13 22:26:17 osage Linux agpgart interface v0.103
Jan 13 22:26:17 osage brd: module loaded
Jan 13 22:26:17 osage loop: module loaded
Jan 13 22:26:17 osage Uniform Multi-Platform E-IDE driver
Jan 13 22:26:17 osage atiixp 0000:00:14.1: IDE controller (0x1002:0x438c rev 0x00)
Jan 13 22:26:17 osage pci 0000:00:14.1: PCI INT A -> GSI 16 (level, low) -> IRQ 16
Jan 13 22:26:17 osage atiixp 0000:00:14.1: not 100% native mode: will probe irqs later
Jan 13 22:26:17 osage ide0: BM-DMA at 0xe400-0xe407
Jan 13 22:26:17 osage Probing IDE interface ide0...
Jan 13 22:26:17 osage ide0 at 0x1f0-0x1f7,0x3f6 on irq 14
Jan 13 22:26:17 osage ide_generic: please use "probe_mask=0x3f" module parameter for probing all legacy ISA IDE ports
Jan 13 22:26:17 osage ide-gd driver 1.18
Jan 13 22:26:17 osage ide-cd driver 5.00
Jan 13 22:26:17 osage Driver 'sd' needs updating - please use bus_type methods
Jan 13 22:26:17 osage PNP: PS/2 Controller [PNP0303:PS2K,PNP0f13:PS2M] at 0x60,0x64 irq 1,12
Jan 13 22:26:17 osage serio: i8042 KBD port at 0x60,0x64 irq 1
Jan 13 22:26:17 osage serio: i8042 AUX port at 0x60,0x64 irq 12
Jan 13 22:26:17 osage mice: PS/2 mouse device common for all mice
Jan 13 22:26:17 osage TCP cubic registered
Jan 13 22:26:17 osage NET: Registered protocol family 17
Jan 13 22:26:17 osage Freeing unused kernel memory: 348k freed
Jan 13 22:26:17 osage input: AT Translated Set 2 keyboard as /class/input/input0
Jan 13 22:26:17 osage libata version 3.00 loaded.
Jan 13 22:26:17 osage ahci 0000:00:12.0: version 3.0
Jan 13 22:26:17 osage ahci 0000:00:12.0: PCI INT A -> GSI 22 (level, low) -> IRQ 22
Jan 13 22:26:17 osage ahci 0000:00:12.0: controller can't do 64bit DMA, forcing 32bit
Jan 13 22:26:17 osage ahci 0000:00:12.0: AHCI 0001.0100 32 slots 4 ports 3 Gbps 0xf impl SATA mode
Jan 13 22:26:17 osage ahci 0000:00:12.0: flags: ncq sntf ilck pm led clo pmp pio slum part
Jan 13 22:26:17 osage scsi0 : ahci
Jan 13 22:26:17 osage scsi1 : ahci
Jan 13 22:26:17 osage scsi2 : ahci
Jan 13 22:26:17 osage scsi3 : ahci
Jan 13 22:26:17 osage ata1: SATA max UDMA/133 abar m1024@0xfe02f000 port 0xfe02f100 irq 22
Jan 13 22:26:17 osage ata2: SATA max UDMA/133 abar m1024@0xfe02f000 port 0xfe02f180 irq 22
Jan 13 22:26:17 osage ata3: SATA max UDMA/133 abar m1024@0xfe02f000 port 0xfe02f200 irq 22
Jan 13 22:26:17 osage ata4: SATA max UDMA/133 abar m1024@0xfe02f000 port 0xfe02f280 irq 22
Jan 13 22:26:17 osage ata1: SATA link down (SStatus 0 SControl 300)
Jan 13 22:26:17 osage input: ImPS/2 Generic Wheel Mouse as /class/input/input1
Jan 13 22:26:17 osage ata2: SATA link down (SStatus 0 SControl 300)
Jan 13 22:26:17 osage ata3: SATA link down (SStatus 0 SControl 300)
Jan 13 22:26:17 osage ata4: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
Jan 13 22:26:17 osage ata4.00: ATA-8: ST3500320AS, SD15, max UDMA/133
Jan 13 22:26:17 osage ata4.00: 976773168 sectors, multi 1: LBA48 NCQ (depth 31/32)
Jan 13 22:26:17 osage ata4.00: SB600 AHCI: limiting to 255 sectors per cmd
Jan 13 22:26:17 osage ata4.00: SB600 AHCI: limiting to 255 sectors per cmd
Jan 13 22:26:17 osage ata4.00: configured for UDMA/133
Jan 13 22:26:17 osage scsi 3:0:0:0: Direct-Access ATA ST3500320AS SD15 PQ: 0 ANSI: 5
Jan 13 22:26:17 osage sd 3:0:0:0: [sda] 976773168 512-byte hardware sectors: (500 GB/465 GiB)
Jan 13 22:26:17 osage sd 3:0:0:0: [sda] Write Protect is off
Jan 13 22:26:17 osage sd 3:0:0:0: [sda] Mode Sense: 00 3a 00 00
Jan 13 22:26:17 osage sd 3:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
Jan 13 22:26:17 osage sd 3:0:0:0: [sda] 976773168 512-byte hardware sectors: (500 GB/465 GiB)
Jan 13 22:26:17 osage sd 3:0:0:0: [sda] Write Protect is off
Jan 13 22:26:17 osage sd 3:0:0:0: [sda] Mode Sense: 00 3a 00 00
Jan 13 22:26:17 osage sd 3:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
Jan 13 22:26:17 osage sda: sda1 sda2 sda3 sda4
Jan 13 22:26:17 osage sd 3:0:0:0: [sda] Attached SCSI disk
Jan 13 22:26:17 osage sd 3:0:0:0: Attached scsi generic sg0 type 0
Jan 13 22:26:17 osage usbcore: registered new interface driver usbfs
Jan 13 22:26:17 osage usbcore: registered new interface driver hub
Jan 13 22:26:17 osage usbcore: registered new device driver usb
Jan 13 22:26:17 osage ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
Jan 13 22:26:17 osage ehci_hcd 0000:00:13.5: PCI INT D -> GSI 19 (level, low) -> IRQ 19
Jan 13 22:26:17 osage ehci_hcd 0000:00:13.5: EHCI Host Controller
Jan 13 22:26:17 osage ehci_hcd 0000:00:13.5: new USB bus registered, assigned bus number 1
Jan 13 22:26:17 osage ehci_hcd 0000:00:13.5: applying AMD SB600/SB700 USB freeze workaround
Jan 13 22:26:17 osage ehci_hcd 0000:00:13.5: debug port 1
Jan 13 22:26:17 osage ehci_hcd 0000:00:13.5: irq 19, io mem 0xfe029000
Jan 13 22:26:17 osage ehci_hcd 0000:00:13.5: USB 2.0 started, EHCI 1.00
Jan 13 22:26:17 osage usb usb1: configuration #1 chosen from 1 choice
Jan 13 22:26:17 osage hub 1-0:1.0: USB hub found
Jan 13 22:26:17 osage hub 1-0:1.0: 10 ports detected
Jan 13 22:26:17 osage usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
Jan 13 22:26:17 osage usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
Jan 13 22:26:17 osage usb usb1: Product: EHCI Host Controller
Jan 13 22:26:17 osage usb usb1: Manufacturer: Linux 2.6.28-gentoo ehci_hcd
Jan 13 22:26:17 osage usb usb1: SerialNumber: 0000:00:13.5
Jan 13 22:26:17 osage ehci_hcd 0000:03:05.2: PCI INT C -> GSI 22 (level, low) -> IRQ 22
Jan 13 22:26:17 osage ehci_hcd 0000:03:05.2: EHCI Host Controller
Jan 13 22:26:17 osage ehci_hcd 0000:03:05.2: new USB bus registered, assigned bus number 2
Jan 13 22:26:17 osage ehci_hcd 0000:03:05.2: irq 22, io mem 0xfdefd000
Jan 13 22:26:17 osage ehci_hcd 0000:03:05.2: USB 2.0 started, EHCI 1.00
Jan 13 22:26:17 osage usb usb2: configuration #1 chosen from 1 choice
Jan 13 22:26:17 osage hub 2-0:1.0: USB hub found
Jan 13 22:26:17 osage hub 2-0:1.0: 5 ports detected
Jan 13 22:26:17 osage usb usb2: New USB device found, idVendor=1d6b, idProduct=0002
Jan 13 22:26:17 osage usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
Jan 13 22:26:17 osage usb usb2: Product: EHCI Host Controller
Jan 13 22:26:17 osage usb usb2: Manufacturer: Linux 2.6.28-gentoo ehci_hcd
Jan 13 22:26:17 osage usb usb2: SerialNumber: 0000:03:05.2
Jan 13 22:26:17 osage Initializing USB Mass Storage driver...
Jan 13 22:26:17 osage usbcore: registered new interface driver usb-storage
Jan 13 22:26:17 osage USB Mass Storage support registered.
Jan 13 22:26:17 osage uhci_hcd: USB Universal Host Controller Interface driver
Jan 13 22:26:17 osage ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
Jan 13 22:26:17 osage ohci_hcd 0000:00:13.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
Jan 13 22:26:17 osage ohci_hcd 0000:00:13.0: OHCI Host Controller
Jan 13 22:26:17 osage ohci_hcd 0000:00:13.0: new USB bus registered, assigned bus number 3
Jan 13 22:26:17 osage ohci_hcd 0000:00:13.0: irq 16, io mem 0xfe02e000
Jan 13 22:26:17 osage usb usb3: configuration #1 chosen from 1 choice
Jan 13 22:26:17 osage hub 3-0:1.0: USB hub found
Jan 13 22:26:17 osage hub 3-0:1.0: 2 ports detected
Jan 13 22:26:17 osage usb usb3: New USB device found, idVendor=1d6b, idProduct=0001
Jan 13 22:26:17 osage usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1
Jan 13 22:26:17 osage usb usb3: Product: OHCI Host Controller
Jan 13 22:26:17 osage usb usb3: Manufacturer: Linux 2.6.28-gentoo ohci_hcd
Jan 13 22:26:17 osage usb usb3: SerialNumber: 0000:00:13.0
Jan 13 22:26:17 osage ohci_hcd 0000:00:13.1: PCI INT B -> GSI 17 (level, low) -> IRQ 17
Jan 13 22:26:17 osage ohci_hcd 0000:00:13.1: OHCI Host Controller
Jan 13 22:26:17 osage ohci_hcd 0000:00:13.1: new USB bus registered, assigned bus number 4
Jan 13 22:26:17 osage ohci_hcd 0000:00:13.1: irq 17, io mem 0xfe02d000
Jan 13 22:26:17 osage usb usb4: configuration #1 chosen from 1 choice
Jan 13 22:26:17 osage hub 4-0:1.0: USB hub found
Jan 13 22:26:17 osage hub 4-0:1.0: 2 ports detected
Jan 13 22:26:17 osage usb usb4: New USB device found, idVendor=1d6b, idProduct=0001
Jan 13 22:26:17 osage usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1
Jan 13 22:26:17 osage usb usb4: Product: OHCI Host Controller
Jan 13 22:26:17 osage usb usb4: Manufacturer: Linux 2.6.28-gentoo ohci_hcd
Jan 13 22:26:17 osage usb usb4: SerialNumber: 0000:00:13.1
Jan 13 22:26:17 osage ohci_hcd 0000:00:13.2: PCI INT C -> GSI 18 (level, low) -> IRQ 18
Jan 13 22:26:17 osage ohci_hcd 0000:00:13.2: OHCI Host Controller
Jan 13 22:26:17 osage ohci_hcd 0000:00:13.2: new USB bus registered, assigned bus number 5
Jan 13 22:26:17 osage ohci_hcd 0000:00:13.2: irq 18, io mem 0xfe02c000
Jan 13 22:26:17 osage usb usb5: configuration #1 chosen from 1 choice
Jan 13 22:26:17 osage hub 5-0:1.0: USB hub found
Jan 13 22:26:17 osage hub 5-0:1.0: 2 ports detected
Jan 13 22:26:17 osage usb usb5: New USB device found, idVendor=1d6b, idProduct=0001
Jan 13 22:26:17 osage usb usb5: New USB device strings: Mfr=3, Product=2, SerialNumber=1
Jan 13 22:26:17 osage usb usb5: Product: OHCI Host Controller
Jan 13 22:26:17 osage usb usb5: Manufacturer: Linux 2.6.28-gentoo ohci_hcd
Jan 13 22:26:17 osage usb usb5: SerialNumber: 0000:00:13.2
Jan 13 22:26:17 osage ohci_hcd 0000:00:13.3: PCI INT B -> GSI 17 (level, low) -> IRQ 17
Jan 13 22:26:17 osage ohci_hcd 0000:00:13.3: OHCI Host Controller
Jan 13 22:26:17 osage ohci_hcd 0000:00:13.3: new USB bus registered, assigned bus number 6
Jan 13 22:26:17 osage ohci_hcd 0000:00:13.3: irq 17, io mem 0xfe02b000
Jan 13 22:26:17 osage usb usb6: configuration #1 chosen from 1 choice
Jan 13 22:26:17 osage hub 6-0:1.0: USB hub found
Jan 13 22:26:17 osage hub 6-0:1.0: 2 ports detected
Jan 13 22:26:17 osage usb usb6: New USB device found, idVendor=1d6b, idProduct=0001
Jan 13 22:26:17 osage usb usb6: New USB device strings: Mfr=3, Product=2, SerialNumber=1
Jan 13 22:26:17 osage usb usb6: Product: OHCI Host Controller
Jan 13 22:26:17 osage usb usb6: Manufacturer: Linux 2.6.28-gentoo ohci_hcd
Jan 13 22:26:17 osage usb usb6: SerialNumber: 0000:00:13.3
Jan 13 22:26:17 osage ohci_hcd 0000:00:13.4: PCI INT C -> GSI 18 (level, low) -> IRQ 18
Jan 13 22:26:17 osage ohci_hcd 0000:00:13.4: OHCI Host Controller
Jan 13 22:26:17 osage ohci_hcd 0000:00:13.4: new USB bus registered, assigned bus number 7
Jan 13 22:26:17 osage ohci_hcd 0000:00:13.4: irq 18, io mem 0xfe02a000
Jan 13 22:26:17 osage usb usb7: configuration #1 chosen from 1 choice
Jan 13 22:26:17 osage hub 7-0:1.0: USB hub found
Jan 13 22:26:17 osage hub 7-0:1.0: 2 ports detected
Jan 13 22:26:17 osage usb usb7: New USB device found, idVendor=1d6b, idProduct=0001
Jan 13 22:26:17 osage usb usb7: New USB device strings: Mfr=3, Product=2, SerialNumber=1
Jan 13 22:26:17 osage usb usb7: Product: OHCI Host Controller
Jan 13 22:26:17 osage usb usb7: Manufacturer: Linux 2.6.28-gentoo ohci_hcd
Jan 13 22:26:17 osage usb usb7: SerialNumber: 0000:00:13.4
Jan 13 22:26:17 osage ohci_hcd 0000:03:05.0: PCI INT A -> GSI 20 (level, low) -> IRQ 20
Jan 13 22:26:17 osage ohci_hcd 0000:03:05.0: OHCI Host Controller
Jan 13 22:26:17 osage ohci_hcd 0000:03:05.0: new USB bus registered, assigned bus number 8
Jan 13 22:26:17 osage ohci_hcd 0000:03:05.0: irq 20, io mem 0xfdeff000
Jan 13 22:26:17 osage usb usb8: configuration #1 chosen from 1 choice
Jan 13 22:26:17 osage hub 8-0:1.0: USB hub found
Jan 13 22:26:17 osage hub 8-0:1.0: 3 ports detected
Jan 13 22:26:17 osage usb usb8: New USB device found, idVendor=1d6b, idProduct=0001
Jan 13 22:26:17 osage usb usb8: New USB device strings: Mfr=3, Product=2, SerialNumber=1
Jan 13 22:26:17 osage usb usb8: Product: OHCI Host Controller
Jan 13 22:26:17 osage usb usb8: Manufacturer: Linux 2.6.28-gentoo ohci_hcd
Jan 13 22:26:17 osage usb usb8: SerialNumber: 0000:03:05.0
Jan 13 22:26:17 osage ohci_hcd 0000:03:05.1: PCI INT B -> GSI 21 (level, low) -> IRQ 21
Jan 13 22:26:17 osage ohci_hcd 0000:03:05.1: OHCI Host Controller
Jan 13 22:26:17 osage ohci_hcd 0000:03:05.1: new USB bus registered, assigned bus number 9
Jan 13 22:26:17 osage ohci_hcd 0000:03:05.1: irq 21, io mem 0xfdefe000
Jan 13 22:26:17 osage usb usb9: configuration #1 chosen from 1 choice
Jan 13 22:26:17 osage hub 9-0:1.0: USB hub found
Jan 13 22:26:17 osage hub 9-0:1.0: 2 ports detected
Jan 13 22:26:17 osage usb usb9: New USB device found, idVendor=1d6b, idProduct=0001
Jan 13 22:26:17 osage usb usb9: New USB device strings: Mfr=3, Product=2, SerialNumber=1
Jan 13 22:26:17 osage usb usb9: Product: OHCI Host Controller
Jan 13 22:26:17 osage usb usb9: Manufacturer: Linux 2.6.28-gentoo ohci_hcd
Jan 13 22:26:17 osage usb usb9: SerialNumber: 0000:03:05.1
Jan 13 22:26:17 osage EXT3-fs: INFO: recovery required on readonly filesystem.
Jan 13 22:26:17 osage EXT3-fs: write access will be enabled during recovery.
Jan 13 22:26:17 osage kjournald starting. Commit interval 5 seconds
Jan 13 22:26:17 osage EXT3-fs: sda4: orphan cleanup on readonly fs
Jan 13 22:26:17 osage ext3_orphan_cleanup: deleting unreferenced inode 3703596
Jan 13 22:26:17 osage ext3_orphan_cleanup: deleting unreferenced inode 3703597
Jan 13 22:26:17 osage ext3_orphan_cleanup: deleting unreferenced inode 25752438
Jan 13 22:26:17 osage ext3_orphan_cleanup: deleting unreferenced inode 26584465
Jan 13 22:26:17 osage ext3_orphan_cleanup: deleting unreferenced inode 27077737
Jan 13 22:26:17 osage ext3_orphan_cleanup: deleting unreferenced inode 27076186
Jan 13 22:26:17 osage ext3_orphan_cleanup: deleting unreferenced inode 27076198
Jan 13 22:26:17 osage ext3_orphan_cleanup: deleting unreferenced inode 27076196
Jan 13 22:26:17 osage ext3_orphan_cleanup: deleting unreferenced inode 19598248
Jan 13 22:26:17 osage ext3_orphan_cleanup: deleting unreferenced inode 19598255
Jan 13 22:26:17 osage ext3_orphan_cleanup: deleting unreferenced inode 19598252
Jan 13 22:26:17 osage ext3_orphan_cleanup: deleting unreferenced inode 19598233
Jan 13 22:26:17 osage ext3_orphan_cleanup: deleting unreferenced inode 19600582
Jan 13 22:26:17 osage ext3_orphan_cleanup: deleting unreferenced inode 19598230
Jan 13 22:26:17 osage ext3_orphan_cleanup: deleting unreferenced inode 19598254
Jan 13 22:26:17 osage ext3_orphan_cleanup: deleting unreferenced inode 19598228
Jan 13 22:26:17 osage ext3_orphan_cleanup: deleting unreferenced inode 19598246
Jan 13 22:26:17 osage ext3_orphan_cleanup: deleting unreferenced inode 19600580
Jan 13 22:26:17 osage ext3_orphan_cleanup: deleting unreferenced inode 19598398
Jan 13 22:26:17 osage ext3_orphan_cleanup: deleting unreferenced inode 19598229
Jan 13 22:26:17 osage ext3_orphan_cleanup: deleting unreferenced inode 19598234
Jan 13 22:26:17 osage ext3_orphan_cleanup: deleting unreferenced inode 19598226
Jan 13 22:26:17 osage ext3_orphan_cleanup: deleting unreferenced inode 27099139
Jan 13 22:26:17 osage ext3_orphan_cleanup: deleting unreferenced inode 27085928
Jan 13 22:26:17 osage ext3_orphan_cleanup: deleting unreferenced inode 19473252
Jan 13 22:26:17 osage ext3_orphan_cleanup: deleting unreferenced inode 25751787
Jan 13 22:26:17 osage ext3_orphan_cleanup: deleting unreferenced inode 8533755
Jan 13 22:26:17 osage ext3_orphan_cleanup: deleting unreferenced inode 25078086
Jan 13 22:26:17 osage ext3_orphan_cleanup: deleting unreferenced inode 19596514
Jan 13 22:26:17 osage EXT3-fs: sda4: 29 orphan inodes deleted
Jan 13 22:26:17 osage EXT3-fs: recovery complete.
Jan 13 22:26:17 osage EXT3-fs: mounted filesystem with ordered data mode.
Jan 13 22:26:17 osage input: Power Button (FF) as /class/input/input2
Jan 13 22:26:17 osage ACPI: Power Button (FF) [PWRF]
Jan 13 22:26:17 osage input: Power Button (CM) as /class/input/input3
Jan 13 22:26:17 osage processor ACPI_CPU:00: registered as cooling_device0
Jan 13 22:26:17 osage processor ACPI_CPU:01: registered as cooling_device1
Jan 13 22:26:17 osage ACPI Warning (nspredef-0858): \_TZ_.THRM._PSL: Return Package type mismatch at index 0 - found [NULL Object Descriptor], expected Reference [20080926]
Jan 13 22:26:17 osage ACPI: Expecting a [Reference] package element, found type 0
Jan 13 22:26:17 osage thermal LNXTHERM:01: registered as thermal_zone0
Jan 13 22:26:17 osage ACPI: Thermal Zone [THRM] (40 C)
Jan 13 22:26:17 osage ACPI: Power Button (CM) [PWRB]
Jan 13 22:26:17 osage fan PNP0C0B:00: registered as cooling_device2
Jan 13 22:26:17 osage ACPI: Fan [FAN] (on)
Jan 13 22:26:17 osage r8169 Gigabit Ethernet driver 2.3LK-NAPI loaded
Jan 13 22:26:17 osage r8169 0000:02:00.0: PCI INT A -> GSI 19 (level, low) -> IRQ 19
Jan 13 22:26:17 osage r8169 0000:02:00.0: setting latency timer to 64
Jan 13 22:26:17 osage r8169 0000:02:00.0: irq 318 for MSI/MSI-X
Jan 13 22:26:17 osage eth0: RTL8168b/8111b at 0xffffc2000006a000, 00:1e:8c:80:39:57, XID 38000000 IRQ 318
Jan 13 22:26:17 osage EXT3 FS on sda4, internal journal
Jan 13 22:26:17 osage EXT2-fs warning: mounting unchecked fs, running e2fsck is recommended
Jan 13 22:26:17 osage r8169: eth0: link up
Jan 13 22:26:17 osage r8169: eth0: link up
Jan 13 22:26:17 osage sshd[5189]: Server listening on 0.0.0.0 port 22.
Jan 13 22:26:21 osage /etc/init.d/backuppc[5223]: start-stop-daemon: failed to start `/usr/BackupPC/bin/BackupPC'
Jan 13 22:26:21 osage /etc/init.d/backuppc[5215]: ERROR: backuppc failed to start
Jan 13 22:26:23 osage cron[5382]: (CRON) STARTUP (V5.0)
Jan 13 22:27:05 osage gdm[5550]: pam_unix(gdm:session): session opened for user relson by (uid=0)
Jan 13 22:27:06 osage (relson-5691): starting (version 2.22.0), pid 5691 user 'relson'
Jan 13 22:27:06 osage (relson-5691): Resolved address "xml:readonly:/etc/gconf/gconf.xml.mandatory" to a read-only configuration source at position 0
Jan 13 22:27:06 osage (relson-5691): Resolved address "xml:readwrite:/home/relson/.gconf" to a writable configuration source at position 1
Jan 13 22:27:06 osage (relson-5691): Resolved address "xml:readonly:/etc/gconf/gconf.xml.defaults" to a read-only configuration source at position 2
Jan 13 22:27:07 osage seahorse-agent[5699]: unsupported key server uri scheme: ldap
Jan 13 22:27:09 osage (relson-5691): Resolved address "xml:readwrite:/home/relson/.gconf" to a writable configuration source at position 0
Jan 13 22:28:12 osage su[5815]: Successful su for root by relson
Jan 13 22:28:12 osage su[5815]: + pts/2 relson:root
Jan 13 22:28:12 osage su[5815]: pam_unix(su:session): session opened for user root by relson(uid=1000)
Jan 13 22:30:01 osage cron[5948]: (root) CMD (test -x /usr/sbin/run-crons && /usr/sbin/run-crons )
Jan 13 22:30:01 osage cron[5949]: (health) CMD (/home/health/bin/system_health.py --log --graph > /dev/null 2>&1)
Jan 13 22:34:47 osage su[6148]: Successful su for relson by root
Jan 13 22:34:47 osage su[6148]: + pts/6 root:relson
Jan 13 22:34:47 osage su[6148]: pam_unix(su:session): session opened for user relson by (uid=0)
Jan 13 22:35:01 osage cron[6163]: (health) CMD (/home/health/bin/system_health.py --log --graph > /dev/null 2>&1)
Jan 13 22:35:18 osage su[6148]: pam_unix(su:session): session closed for user relson
Jan 13 22:40:01 osage cron[8304]: (health) CMD (/home/health/bin/system_health.py --log --graph > /dev/null 2>&1)
Jan 13 22:40:01 osage cron[8302]: (root) CMD (test -x /usr/sbin/run-crons && /usr/sbin/run-crons )
Jan 13 22:42:49 osage su[8435]: Successful su for relson by root
Jan 13 22:42:49 osage su[8435]: + pts/6 root:relson
Jan 13 22:42:49 osage su[8435]: pam_unix(su:session): session opened for user relson by (uid=0)
Jan 13 22:43:22 osage su[8446]: pam_unix(su:auth): authentication failure; logname= uid=1000 euid=0 tty=pts/6 ruser=relson rhost= user=health
Jan 13 22:43:24 osage su[8446]: pam_authenticate: Authentication failure
Jan 13 22:43:24 osage su[8446]: FAILED su for health by relson
Jan 13 22:43:24 osage su[8446]: - pts/6 relson:health
Jan 13 22:43:27 osage su[8435]: pam_unix(su:session): session closed for user relson
Jan 13 22:43:28 osage su[8448]: Successful su for health by root
Jan 13 22:43:28 osage su[8448]: + pts/6 root:health
Jan 13 22:43:28 osage su[8448]: pam_unix(su:session): session opened for user health by (uid=0)
Jan 13 22:45:01 osage cron[8492]: (health) CMD (/home/health/bin/system_health.py --log --graph > /dev/null 2>&1)
Jan 13 22:50:01 osage cron[8616]: (health) CMD (/home/health/bin/system_health.py --log --graph > /dev/null 2>&1)
Jan 13 22:50:01 osage cron[8614]: (root) CMD (test -x /usr/sbin/run-crons && /usr/sbin/run-crons )
Jan 13 22:55:01 osage cron[8749]: (health) CMD (/home/health/bin/system_health.py --log --graph > /dev/null 2>&1)
Jan 13 22:58:01 osage cron[8879]: (root) CMD (/usr/sbin/ntpdate -s nic)
Jan 13 22:58:04 osage ntpdate[8879]: step time server 192.168.1.2 offset 3.075746 sec
Jan 13 22:59:18 osage su[8448]: pam_unix(su:session): session closed for user health
Jan 13 23:00:01 osage cron[8997]: (root) CMD (rm -f /var/spool/cron/lastrun/cron.hourly)
Jan 13 23:00:01 osage cron[8999]: (health) CMD (/home/health/bin/system_health.py --log --graph > /dev/null 2>&1)
Jan 13 23:00:01 osage cron[8995]: (root) CMD (test -x /usr/sbin/run-crons && /usr/sbin/run-crons )
Jan 13 23:05:01 osage cron[9157]: (health) CMD (/home/health/bin/system_health.py --log --graph > /dev/null 2>&1)
Jan 13 23:10:01 osage cron[9285]: (health) CMD (/home/health/bin/system_health.py --log --graph > /dev/null 2>&1)
Jan 13 23:10:01 osage cron[9283]: (root) CMD (test -x /usr/sbin/run-crons && /usr/sbin/run-crons )
Jan 13 23:15:01 osage cron[9419]: (health) CMD (/home/health/bin/system_health.py --log --graph > /dev/null 2>&1)
Jan 13 23:20:01 osage cron[9577]: (root) CMD (test -x /usr/sbin/run-crons && /usr/sbin/run-crons )
Jan 13 23:20:01 osage cron[9578]: (health) CMD (/home/health/bin/system_health.py --log --graph > /dev/null 2>&1)
Jan 13 23:25:01 osage cron[9736]: (health) CMD (/home/health/bin/system_health.py --log --graph > /dev/null 2>&1)
Jan 13 23:30:01 osage cron[9864]: (root) CMD (test -x /usr/sbin/run-crons && /usr/sbin/run-crons )
Jan 13 23:30:01 osage cron[9865]: (health) CMD (/home/health/bin/system_health.py --log --graph > /dev/null 2>&1)
Jan 13 23:35:01 osage cron[9999]: (health) CMD (/home/health/bin/system_health.py --log --graph > /dev/null 2>&1)
Jan 13 23:40:01 osage cron[10124]: (root) CMD (test -x /usr/sbin/run-crons && /usr/sbin/run-crons )
Jan 13 23:40:01 osage cron[10125]: (health) CMD (/home/health/bin/system_health.py --log --graph > /dev/null 2>&1)
Jan 13 23:45:01 osage cron[10261]: (health) CMD (/home/health/bin/system_health.py --log --graph > /dev/null 2>&1)
Jan 13 23:50:01 osage cron[10386]: (root) CMD (test -x /usr/sbin/run-crons && /usr/sbin/run-crons )
Jan 13 23:50:01 osage cron[10387]: (health) CMD (/home/health/bin/system_health.py --log --graph > /dev/null 2>&1)
Jan 13 23:55:01 osage cron[10522]: (health) CMD (/home/health/bin/system_health.py --log --graph > /dev/null 2>&1)
Jan 13 23:58:01 osage cron[10637]: (root) CMD (/usr/sbin/ntpdate -s nic)
Jan 13 23:58:01 osage ntpdate[10637]: adjust time server 192.168.1.2 offset -0.074187 sec
Jan 13 23:59:01 osage cron[10646]: (relson) CMD (/usr/local/sbin/df.status.sh)
Jan 13 23:59:01 osage cron[10647]: (relson) CMD (/home/relson/bin/get.mail relson > /dev/null)
Jan 13 23:59:01 osage sSMTP[10675]: Sent mail for relson@osage (221 Bye)
Jan 14 00:00:01 osage cron[10689]: (root) CMD (rm -f /var/spool/cron/lastrun/cron.hourly)
Jan 14 00:00:01 osage cron[10687]: (root) CMD (test -x /usr/sbin/run-crons && /usr/sbin/run-crons )
Jan 14 00:00:01 osage cron[10691]: (health) CMD (/home/health/bin/system_health.py --log --graph > /dev/null 2>&1)
Jan 14 00:05:01 osage cron[10826]: (health) CMD (/home/health/bin/system_health.py --log --graph > /dev/null 2>&1)
Jan 14 00:09:01 osage cron[10945]: (relson) CMD (/home/relson/bogofilter/spam-fixups/check.wordlists)
Jan 14 00:10:01 osage cron[10961]: (health) CMD (/home/health/bin/system_health.py --log --graph > /dev/null 2>&1)
Jan 14 00:10:01 osage cron[10959]: (root) CMD (test -x /usr/sbin/run-crons && /usr/sbin/run-crons )
Jan 14 00:13:01 osage cron[11087]: (relson) CMD (/home/relson/bogofilter/mail/n2o)
Jan 14 00:13:46 osage sSMTP[11098]: Sent mail for relson@osage (221 Bye)
Jan 14 00:15:01 osage cron[11111]: (health) CMD (/home/health/bin/system_health.py --log --graph > /dev/null 2>&1)
Jan 14 00:16:14 osage sSMTP[11232]: Sent mail for relson@osage (221 Bye)
Jan 14 00:20:01 osage cron[11271]: (root) CMD (test -x /usr/sbin/run-crons && /usr/sbin/run-crons )
Jan 14 00:20:01 osage cron[11272]: (health) CMD (/home/health/bin/system_health.py --log --graph > /dev/null 2>&1)
Jan 14 00:20:01 osage system_health.p[11274]: segfault at 7f3b955231c0 ip 00007f3bb511d8de sp 00007fffbd60acf0 error 4 in libpython2.6.so.1.0[7f3bb505b000+14b000]
Jan 14 00:20:01 osage sSMTP[11276]: Sent mail for health@osage (221 Bye)
Jan 14 00:25:01 osage cron[11317]: (health) CMD (/home/health/bin/system_health.py --log --graph > /dev/null 2>&1)
Jan 14 00:25:02 osage rrdtool[11354]: segfault at 7f97fc7b6730 ip 00007f97fc7b6730 sp 00007fff06666048 error 14 in libart_lgpl_2.so.2.3.20[7f97fd361000+17000]
Jan 14 00:25:03 osage system_health.p[11318]: segfault at 7fe0fba3eab8 ip 00007fe0db607f21 sp 00007fffe3ac04e0 error 4 in libpython2.6.so.1.0[7fe0db510000+14b000]
Jan 14 00:25:03 osage sSMTP[11410]: Sent mail for health@osage (221 Bye)
Jan 14 00:30:01 osage cron[11447]: (health) CMD (/home/health/bin/system_health.py --log --graph > /dev/null 2>&1)
Jan 14 00:30:01 osage cron[11445]: (root) CMD (test -x /usr/sbin/run-crons && /usr/sbin/run-crons )
Jan 14 00:30:01 osage system_health.p[11448]: segfault at 7f26d60477b0 ip 00007f26f6da97a4 sp 00007fffff298a30 error 4 in libpython2.6.so.1.0[7f26f6ce9000+14b000]
Jan 14 00:30:01 osage sSMTP[11459]: Sent mail for health@osage (221 Bye)
Jan 14 00:35:01 osage cron[11492]: (health) CMD (/home/health/bin/system_health.py --log --graph > /dev/null 2>&1)
Jan 14 00:35:02 osage system_health.p[11493]: segfault at 7fff08d30a80 ip 00007fff29b2a6bf sp 00007fff32018710 error 4 in libpython2.6.so.1.0[7fff29a6a000+14b000]
Jan 14 00:35:02 osage sSMTP[11494]: Sent mail for health@osage (221 Bye)
Jan 14 00:40:01 osage cron[11528]: (health) CMD (/home/health/bin/system_health.py --log --graph > /dev/null 2>&1)
Jan 14 00:40:01 osage cron[11526]: (root) CMD (test -x /usr/sbin/run-crons && /usr/sbin/run-crons )
Jan 14 00:40:01 osage system_health.p[11529]: segfault at 7f1001bb4620 ip 00007f10228fa64a sp 00007fff2ade82b0 error 4 in libpython2.6.so.1.0[7f102283a000+14b000]
Jan 14 00:40:01 osage sSMTP[11540]: Sent mail for health@osage (221 Bye)
Jan 14 00:45:01 osage cron[11574]: (health) CMD (/home/health/bin/system_health.py --log --graph > /dev/null 2>&1)
Jan 14 00:45:01 osage rrdtool[11599]: segfault at 206226c0 ip 00007fc3377f4af0 sp 00007fff403b7568 error 4 in libc-2.6.1.so[7fc337781000+136000]
Jan 14 00:45:02 osage rrdtool[11610]: segfault at 20612890 ip 00007f22ed4f4af0 sp 00007ffff60b72b8 error 4 in libc-2.6.1.so[7f22ed481000+136000]
Jan 14 00:45:02 osage rrdtool[11634]: segfault at 7fad2da86cd8 ip 00007fad3d7ba8c4 sp 00007fff46382e60 error 4 in libc-2.6.1.so[7fad3d74c000+136000]
Jan 14 00:45:03 osage system_health.p[11575]: segfault at 7fb2cf684669 ip 00007fb2df414f28 sp 00007fffe78cd530 error 4 in libpython2.6.so.1.0[7fb2df31d000+14b000]
Jan 14 00:45:03 osage sSMTP[11667]: Sent mail for health@osage (221 Bye)
Jan 14 00:50:01 osage cron[11701]: (health) CMD (/home/health/bin/system_health.py --log --graph > /dev/null 2>&1)
Jan 14 00:50:01 osage cron[11699]: (root) CMD (test -x /usr/sbin/run-crons && /usr/sbin/run-crons )
Jan 14 00:50:01 osage system_health.p[11702]: segfault at 7fd3790010f8 ip 00007fd358cbd8de sp 00007fff611aa750 error 4 in libpython2.6.so.1.0[7fd358bfb000+14b000]
Jan 14 00:50:01 osage sSMTP[11713]: Sent mail for health@osage (221 Bye)
Jan 14 00:55:01 osage cron[11746]: (health) CMD (/home/health/bin/system_health.py --log --graph > /dev/null 2>&1)
Jan 14 00:55:01 osage system_health.p[11747]: segfault at 7f3aa88b5760 ip 00007f3ab975364a sp 00007fffc1c43430 error 4 in libpython2.6.so.1.0[7f3ab9693000+14b000]
Jan 14 00:55:02 osage sSMTP[11748]: Sent mail for health@osage (221 Bye)
Jan 14 00:58:01 osage cron[11771]: (root) CMD (/usr/sbin/ntpdate -s nic)
Jan 14 00:58:01 osage ntpdate[11771]: adjust time server 192.168.1.2 offset -0.038795 sec
Jan 14 01:00:01 osage cron[11786]: (root) CMD (test -x /usr/sbin/run-crons && /usr/sbin/run-crons )
Jan 14 01:00:01 osage cron[11791]: (health) CMD (/home/health/bin/system_health.py --log --graph > /dev/null 2>&1)
Jan 14 01:00:01 osage cron[11784]: (relson) CMD (/usr/local/bin/check.system > /dev/null)
Jan 14 01:00:01 osage cron[11789]: (root) CMD (rm -f /var/spool/cron/lastrun/cron.hourly)
Jan 14 01:00:01 osage sSMTP[11843]: Sent mail for relson@osage (221 Bye)
Jan 14 01:00:01 osage rrdtool[11849]: segfault at 7fff29345c0b ip 00007f2f30f01fef sp 00007fff39344920 error 4 in librrd.so.2.0.13[7f2f30ede000+46000]
Jan 14 01:00:02 osage sSMTP[11870]: Sent mail for relson@osage (221 Bye)
Jan 14 01:00:02 osage check_whois.py[11874]: segfault at 7f9e92155880 ip 00007f9eb1ce7f21 sp 00007fffba194a70 error 4 in libpython2.6.so.1.0[7f9eb1bf0000+14b000]
Jan 14 01:00:02 osage sSMTP[11910]: Sent mail for relson@osage (221 Bye)
Jan 14 01:00:02 osage sSMTP[11875]: Sent mail for relson@osage (221 Bye)
Jan 14 01:00:03 osage system_health.p[11792]: segfault at 7f2b39e590f0 ip 00007f2b1ac81a41 sp 00007fff231c3b80 error 4 in libpython2.6.so.1.0[7f2b1ac14000+14b000]
Jan 14 01:00:03 osage sSMTP[11950]: Sent mail for health@osage (221 Bye)
Jan 14 01:05:01 osage cron[11983]: (health) CMD (/home/health/bin/system_health.py --log --graph > /dev/null 2>&1)
Jan 14 01:05:01 osage system_health.p[11984]: segfault at 7f660fb32810 ip 00007f661f67bcf1 sp 00007fff27b882d0 error 4 in libpython2.6.so.1.0[7f661f5e9000+14b000]
Jan 14 01:05:01 osage sh[11983]: segfault at 7f0d7b0c3ce0 ip 00007f0d7b0c3ce0 sp 00007fff87a4e298 error 14 in libc-2.6.1.so[7f0d7f093000+136000]
Jan 14 01:10:01 osage cron[12018]: (health) CMD (/home/health/bin/system_health.py --log --graph > /dev/null 2>&1)
Jan 14 01:10:01 osage cron[12016]: (root) CMD (test -x /usr/sbin/run-crons && /usr/sbin/run-crons )
Jan 14 01:10:01 osage system_health.p[12019]: segfault at 7f31d1bf4620 ip 00007f31f17e864a sp 00007ffff9cd83d0 error 4 in libpython2.6.so.1.0[7f31f1728000+14b000]
Jan 14 01:10:01 osage sSMTP[12030]: Sent mail for health@osage (221 Bye)
Jan 14 01:15:01 osage cron[12062]: (health) CMD (/home/health/bin/system_health.py --log --graph > /dev/null 2>&1)
Jan 14 01:20:01 osage cron[12183]: (health) CMD (/home/health/bin/system_health.py --log --graph > /dev/null 2>&1)
Jan 14 01:20:01 osage cron[12181]: (root) CMD (test -x /usr/sbin/run-crons && /usr/sbin/run-crons )
Jan 14 01:25:01 osage cron[12313]: (health) CMD (/home/health/bin/system_health.py --log --graph > /dev/null 2>&1)
Jan 14 01:30:01 osage cron[12436]: (root) CMD (test -x /usr/sbin/run-crons && /usr/sbin/run-crons )
Jan 14 01:30:01 osage cron[12437]: (health) CMD (/home/health/bin/system_health.py --log --graph > /dev/null 2>&1)
Jan 14 01:35:01 osage cron[12567]: (health) CMD (/home/health/bin/system_health.py --log --graph > /dev/null 2>&1)
Jan 14 01:40:01 osage cron[12687]: (root) CMD (test -x /usr/sbin/run-crons && /usr/sbin/run-crons )
Jan 14 01:40:01 osage cron[12688]: (health) CMD (/home/health/bin/system_health.py --log --graph > /dev/null 2>&1)
Jan 14 01:45:01 osage cron[12819]: (health) CMD (/home/health/bin/system_health.py --log --graph > /dev/null 2>&1)
Jan 14 01:50:01 osage cron[12939]: (root) CMD (test -x /usr/sbin/run-crons && /usr/sbin/run-crons )
Jan 14 01:50:01 osage cron[12940]: (health) CMD (/home/health/bin/system_health.py --log --graph > /dev/null 2>&1)
Jan 14 01:55:01 osage cron[13070]: (health) CMD (/home/health/bin/system_health.py --log --graph > /dev/null 2>&1)
Jan 14 01:58:01 osage cron[13180]: (root) CMD (/usr/sbin/ntpdate -s nic)
Jan 14 01:58:01 osage ntpdate[13180]: adjust time server 192.168.1.2 offset -0.053883 sec
Jan 14 02:00:01 osage cron[13195]: (root) CMD (rm -f /var/spool/cron/lastrun/cron.hourly)
Jan 14 02:00:01 osage cron[13197]: (health) CMD (/home/health/bin/system_health.py --log --graph > /dev/null 2>&1)
Jan 14 02:00:01 osage cron[13193]: (root) CMD (test -x /usr/sbin/run-crons && /usr/sbin/run-crons )
Jan 14 02:03:01 osage cron[13317]: (relson) CMD (/home/relson/bin/bogo.test.all.sh)
Jan 14 02:03:02 osage sSMTP[13320]: Sent mail for relson@osage (221 Bye)
Jan 14 02:05:01 osage cron[13332]: (health) CMD (/home/health/bin/system_health.py --log --graph > /dev/null 2>&1)
Jan 14 02:10:01 osage cron[13453]: (health) CMD (/home/health/bin/system_health.py --log --graph > /dev/null 2>&1)
Jan 14 02:10:01 osage cron[13451]: (root) CMD (test -x /usr/sbin/run-crons && /usr/sbin/run-crons )
Jan 14 02:15:01 osage cron[13584]: (health) CMD (/home/health/bin/system_health.py --log --graph > /dev/null 2>&1)
Jan 14 02:20:01 osage cron[13705]: (health) CMD (/home/health/bin/system_health.py --log --graph > /dev/null 2>&1)
Jan 14 02:20:01 osage cron[13703]: (root) CMD (test -x /usr/sbin/run-crons && /usr/sbin/run-crons )
Jan 14 02:25:01 osage cron[13835]: (health) CMD (/home/health/bin/system_health.py --log --graph > /dev/null 2>&1)
Jan 14 02:26:01 osage cron[13934]: (root) CMD (/usr/local/sbin/chkrootkit.sh -s > /dev/null 2> /dev/null)
Jan 14 02:26:01 osage /usr/bin/crontab[14032]: (root) LIST (nobody)
Jan 14 02:26:20 osage sSMTP[15408]: Sent mail for root@osage (221 Bye)
Jan 14 02:26:20 osage /usr/bin/crontab[15459]: (root) LIST (nobody)
Jan 14 02:26:21 osage BUG: unable to handle kernel NULL pointer dereference at 0000000000000010
Jan 14 02:26:21 osage IP: [<ffffffff80282e9f>] __d_lookup+0xd8/0xf9
Jan 14 02:26:21 osage PGD d7b66067 PUD d7b9e067 PMD 0
Jan 14 02:26:21 osage Oops: 0000 [#1] SMP
Jan 14 02:26:21 osage last sysfs file: /sys/devices/pci0000:00/0000:00:12.0/host3/target3:0:0/3:0:0:0/model
Jan 14 02:26:21 osage CPU 0
Jan 14 02:26:21 osage Modules linked in: r8169 fan thermal processor mii button ohci_hcd uhci_hcd usb_storage ehci_hcd usbcore sg ahci scsi_wait_scan libata
Jan 14 02:26:21 osage Pid: 15520, comm: chkrootkit Not tainted 2.6.28-gentoo #11
Jan 14 02:26:21 osage RIP: 0010:[<ffffffff80282e9f>] [<ffffffff80282e9f>] __d_lookup+0xd8/0xf9
Jan 14 02:26:21 osage RSP: 0018:ffff8800c243bd18 EFLAGS: 00010202
Jan 14 02:26:21 osage RAX: 0000000000000010 RBX: fffffffffffffff8 RCX: 0000000000000013
Jan 14 02:26:21 osage RDX: 000013de8de1ff3b RSI: 00c3832e8bc182c7 RDI: ffff88011f4019e0
Jan 14 02:26:21 osage RBP: 0000000000000010 R08: 0000000000000000 R09: ffff8800c243ba00
Jan 14 02:26:21 osage R10: 0000000000000000 R11: 0000000000000002 R12: ffff88011f4019e0
Jan 14 02:26:21 osage R13: ffff8800c243bd98 R14: 00000000085f05c9 R15: 0000000000000005
Jan 14 02:26:21 osage FS: 00007f255a2476f0(0000) GS:ffffffff80557980(0000) knlGS:00000000f67bab90
Jan 14 02:26:21 osage CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
Jan 14 02:26:21 osage CR2: 0000000000000010 CR3: 00000000c2530000 CR4: 00000000000006e0
Jan 14 02:26:21 osage DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Jan 14 02:26:21 osage DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Jan 14 02:26:21 osage Process chkrootkit (pid: 15520, threadinfo ffff8800c243a000, task ffff880106520b90)
Jan 14 02:26:21 osage Stack:
Jan 14 02:26:21 osage ffff8800c243bda8 0000000000001d42 ffff8800c243bd98 ffff88011f4019e0
Jan 14 02:26:21 osage ffff88011fabd6f0 ffff88011fabd6c0 ffff8800c243bda8 ffffffff80282ee6
Jan 14 02:26:21 osage ffff8800c243bd98 0000000000003ca1 ffff88011f82db80 ffffffff802acc34
Jan 14 02:26:21 osage Call Trace:
Jan 14 02:26:21 osage [<ffffffff80282ee6>] ? d_lookup+0x26/0x38
Jan 14 02:26:21 osage [<ffffffff802acc34>] ? proc_flush_task+0x14e/0x26e
Jan 14 02:26:21 osage [<ffffffff80229c79>] ? __dequeue_entity+0x1c/0x32
Jan 14 02:26:21 osage [<ffffffff80231487>] ? release_task+0x20/0x2de
Jan 14 02:26:21 osage [<ffffffff80231bb7>] ? wait_consider_task+0x472/0x7c6
Jan 14 02:26:21 osage [<ffffffff8023200a>] ? do_wait+0xff/0x314
Jan 14 02:26:21 osage [<ffffffff8022a1c6>] ? default_wake_function+0x0/0xe
Jan 14 02:26:21 osage [<ffffffff802322a9>] ? sys_wait4+0x8a/0xa1
Jan 14 02:26:21 osage [<ffffffff8020b0cb>] ? system_call_fastpath+0x16/0x1b
Jan 14 02:26:21 osage Code: 48 8b 34 24 44 89 fa e8 5c f4 0a 00 85 c0 75 0b f0 ff 03 fe 43 08 48 89 d8 eb 24 fe 43 08 48 8b 6d 00 48 85 ed 74 16 48 8d 5d e8 <48> 8b 45 00 44 39 73 30 0f 18 08 75 e6 e9 7a ff ff ff 31 c0 41
Jan 14 02:26:21 osage RIP [<ffffffff80282e9f>] __d_lookup+0xd8/0xf9
Jan 14 02:26:21 osage RSP <ffff8800c243bd18>
Jan 14 02:26:21 osage CR2: 0000000000000010
Jan 14 02:26:21 osage ---[ end trace 98b4fc7bcb1d49a6 ]---
Jan 14 02:26:21 osage BUG: unable to handle kernel NULL pointer dereference at 0000000000000010
Jan 14 02:26:21 osage IP: [<ffffffff80282e9f>] __d_lookup+0xd8/0xf9
Jan 14 02:26:21 osage PGD d791f067 PUD c2581067 PMD 0
Jan 14 02:26:21 osage Oops: 0000 [#2] SMP
Jan 14 02:26:21 osage last sysfs file: /sys/devices/pci0000:00/0000:00:12.0/host3/target3:0:0/3:0:0:0/model
Jan 14 02:26:21 osage CPU 0
Jan 14 02:26:21 osage Modules linked in: r8169 fan thermal processor mii button ohci_hcd uhci_hcd usb_storage ehci_hcd usbcore sg ahci scsi_wait_scan libata
Jan 14 02:26:21 osage Pid: 15629, comm: ps Tainted: G D 2.6.28-gentoo #11
Jan 14 02:26:21 osage RIP: 0010:[<ffffffff80282e9f>] [<ffffffff80282e9f>] __d_lookup+0xd8/0xf9
Jan 14 02:26:21 osage RSP: 0018:ffff8800c25e3d98 EFLAGS: 00010202
Jan 14 02:26:21 osage RAX: 0000000000000010 RBX: fffffffffffffff8 RCX: 0000000000000013
Jan 14 02:26:21 osage RDX: 000013de8de1ff3b RSI: 00c3832e8bc182c7 RDI: ffff88011f4019e0
Jan 14 02:26:21 osage RBP: 0000000000000010 R08: 0000000000000005 R09: ffffffff802ac6cb
Jan 14 02:26:21 osage R10: 0000000000000000 R11: 0000000000000002 R12: ffff88011f4019e0
Jan 14 02:26:21 osage R13: ffff8800c25e3e18 R14: 00000000085f05c9 R15: 0000000000000005
Jan 14 02:26:21 osage FS: 00007f2851f356f0(0000) GS:ffffffff80557980(0000) knlGS:00000000f713eb20
Jan 14 02:26:21 osage CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jan 14 02:26:21 osage CR2: 0000000000000010 CR3: 00000000d78d7000 CR4: 00000000000006e0
Jan 14 02:26:21 osage DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Jan 14 02:26:21 osage DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Jan 14 02:26:21 osage Process ps (pid: 15629, threadinfo ffff8800c25e2000, task ffff880106520b90)
Jan 14 02:26:21 osage Stack:
Jan 14 02:26:21 osage ffff8800c25e3ea8 0000000000001d42 ffff8800c25e3e18 ffff88011f4019e0
Jan 14 02:26:21 osage ffff88011f4019e0 0000000000000005 ffff8800c25e3ea8 ffffffff80282ee6
Jan 14 02:26:21 osage ffff8800c25e3ea8 ffff8800c25e3e18 ffffffff802ac6cb ffffffff802ab5ef
Jan 14 02:26:21 osage Call Trace:
Jan 14 02:26:21 osage [<ffffffff80282ee6>] ? d_lookup+0x26/0x38
Jan 14 02:26:21 osage [<ffffffff802ac6cb>] ? proc_pid_instantiate+0x0/0x99
Jan 14 02:26:21 osage [<ffffffff802ab5ef>] ? proc_fill_cache+0x73/0x137
Jan 14 02:26:21 osage [<ffffffff80280440>] ? filldir+0x0/0xb1
Jan 14 02:26:21 osage [<ffffffff802ade29>] ? proc_pid_readdir+0x118/0x19a
Jan 14 02:26:21 osage [<ffffffff80280440>] ? filldir+0x0/0xb1
Jan 14 02:26:21 osage [<ffffffff80280440>] ? filldir+0x0/0xb1
Jan 14 02:26:21 osage [<ffffffff80280556>] ? vfs_readdir+0x65/0x97
Jan 14 02:26:21 osage [<ffffffff802807b5>] ? sys_getdents+0x75/0xbc
Jan 14 02:26:21 osage [<ffffffff8020b0cb>] ? system_call_fastpath+0x16/0x1b
Jan 14 02:26:21 osage Code: 48 8b 34 24 44 89 fa e8 5c f4 0a 00 85 c0 75 0b f0 ff 03 fe 43 08 48 89 d8 eb 24 fe 43 08 48 8b 6d 00 48 85 ed 74 16 48 8d 5d e8 <48> 8b 45 00 44 39 73 30 0f 18 08 75 e6 e9 7a ff ff ff 31 c0 41
Jan 14 02:26:21 osage RIP [<ffffffff80282e9f>] __d_lookup+0xd8/0xf9
Jan 14 02:26:21 osage RSP <ffff8800c25e3d98>
Jan 14 02:26:21 osage CR2: 0000000000000010
Jan 14 02:26:21 osage ---[ end trace 98b4fc7bcb1d49a6 ]---
^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [gentoo-user] Kernel 2.6.28 BUGS
2009-01-14 13:14 ` David Relson
@ 2009-01-14 13:32 ` Volker Armin Hemmann
2009-01-14 13:36 ` Daniel Pielmeier
2009-01-14 17:34 ` Xav'
2 siblings, 0 replies; 10+ messages in thread
From: Volker Armin Hemmann @ 2009-01-14 13:32 UTC (permalink / raw
To: gentoo-user
On Mittwoch 14 Januar 2009, David Relson wrote:
> On Wed, 14 Jan 2009 14:01:28 +0100
>
> Daniel Pielmeier wrote:
> > 2009/1/14 David Relson <relson@osagesoftware.com>:
> > > I noticed the "taint" message and don't think that's right. How do
> > > I identify the tainted module?
> >
> > Jan 13 21:35:04 osage Pid: 13119, comm: rrdtool Tainted: G D W
> > 2.6.28-gentoo #11
> >
> > rrdtool?
> >
> > --
> > Regards,
> > Daniel
>
> Attached is the full /var/log/messages from the reboot (Jan 13
> 22:26:17) to:
>
> Jan 14 02:26:21 osage BUG: unable to handle kernel NULL pointer dereference
> at 0000000000000010
>
> lines 738&739 are timestamped 02:26:21, list the modules linked in, and
> says "Not tainted". lines 778&779 also timestamped 02:26:21, list the
> modules linked in, and says "Tainted".
>
> The modules listed in lines 738 and 778 are identical.
>
> What the heck? How does the kernel go from "Not tainted" to "Tainted"
> in less than a second while generating BUG messages?
>
> Can a program, i.e. rrdtool, be tainted? I'd not think so since the
> program is in user space, not kernel space.
>
> Regards,
>
> David
AFAIK a kernel is tainted after the first bug/ooops. Am I wrong?
^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [gentoo-user] Kernel 2.6.28 BUGS
2009-01-14 13:14 ` David Relson
2009-01-14 13:32 ` Volker Armin Hemmann
@ 2009-01-14 13:36 ` Daniel Pielmeier
2009-01-14 17:33 ` Dirk Heinrichs
2009-01-14 17:34 ` Xav'
2 siblings, 1 reply; 10+ messages in thread
From: Daniel Pielmeier @ 2009-01-14 13:36 UTC (permalink / raw
To: gentoo-user
2009/1/14 David Relson <relson@osagesoftware.com>:
>
> Can a program, i.e. rrdtool, be tainted? I'd not think so since the
> program is in user space, not kernel space.
>
According to LWN [1] tainting the kernel from user space is possible.
[1] http://lwn.net/Articles/184879/
--
Regards,
Daniel
^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [gentoo-user] Kernel 2.6.28 BUGS
2009-01-14 13:36 ` Daniel Pielmeier
@ 2009-01-14 17:33 ` Dirk Heinrichs
0 siblings, 0 replies; 10+ messages in thread
From: Dirk Heinrichs @ 2009-01-14 17:33 UTC (permalink / raw
To: gentoo-user
[-- Attachment #1: Type: text/plain, Size: 537 bytes --]
Am Mittwoch, 14. Januar 2009 14:36:11 schrieb Daniel Pielmeier:
> 2009/1/14 David Relson <relson@osagesoftware.com>:
> > Can a program, i.e. rrdtool, be tainted? I'd not think so since the
> > program is in user space, not kernel space.
>
> According to LWN [1] tainting the kernel from user space is possible.
>
> [1] http://lwn.net/Articles/184879/
Although I've read every weekly edition since a couple of years, I didn't
remember :-)
So does that mean chkrootkit is going nuts on David's machine?
Bye...
Dirk
[-- Attachment #2: This is a digitally signed message part. --]
[-- Type: application/pgp-signature, Size: 189 bytes --]
^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [gentoo-user] Kernel 2.6.28 BUGS
2009-01-14 13:14 ` David Relson
2009-01-14 13:32 ` Volker Armin Hemmann
2009-01-14 13:36 ` Daniel Pielmeier
@ 2009-01-14 17:34 ` Xav'
2009-01-14 23:04 ` David Relson
2 siblings, 1 reply; 10+ messages in thread
From: Xav' @ 2009-01-14 17:34 UTC (permalink / raw
To: gentoo-user
On Wed, 14 Jan 2009 08:14:01 -0500, David Relson <relson@osagesoftware.com>
wrote:
> On Wed, 14 Jan 2009 14:01:28 +0100
> Daniel Pielmeier wrote:
>
>> 2009/1/14 David Relson <relson@osagesoftware.com>:
>> >
>> > I noticed the "taint" message and don't think that's right. How do
>> > I identify the tainted module?
>> >
>>
>> Jan 13 21:35:04 osage Pid: 13119, comm: rrdtool Tainted: G D W
>> 2.6.28-gentoo #11
>>
>> rrdtool?
>>
>>
It seems according to your trace that the Python script system_health.py
does not stop to do segfaults while it is executed by cron, so maybe you
can start checking this script to see if it does not write anywhere in the
memory and then cause the kernel to "bug".
--
Xavier
http://www.linuxant.fr
^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [gentoo-user] Kernel 2.6.28 BUGS
2009-01-14 17:34 ` Xav'
@ 2009-01-14 23:04 ` David Relson
0 siblings, 0 replies; 10+ messages in thread
From: David Relson @ 2009-01-14 23:04 UTC (permalink / raw
To: gentoo-user
On Wed, 14 Jan 2009 18:34:43 +0100
Xav' wrote:
> On Wed, 14 Jan 2009 08:14:01 -0500, David Relson
> <relson@osagesoftware.com> wrote:
> > On Wed, 14 Jan 2009 14:01:28 +0100
> > Daniel Pielmeier wrote:
> >
> >> 2009/1/14 David Relson <relson@osagesoftware.com>:
> >> >
> >> > I noticed the "taint" message and don't think that's right. How
> >> > do I identify the tainted module?
> >> >
> >>
> >> Jan 13 21:35:04 osage Pid: 13119, comm: rrdtool Tainted: G D W
> >> 2.6.28-gentoo #11
> >>
> >> rrdtool?
> >>
> >>
>
> It seems according to your trace that the Python script
> system_health.py does not stop to do segfaults while it is executed
> by cron, so maybe you can start checking this script to see if it
> does not write anywhere in the memory and then cause the kernel to
> "bug".
The LWN article is about RTSJ -- real-time services for java. Having
done some work with real-time and embedded systems I can understand
that access to physical memory is useful. However, I'm not running
java and _not_ using RTSJ.
As regards tainting, after a BUG the kernel sets its status to
"tainted". After all, having encountered a BUG problem, there's no
telling what else may be fubar'd. That explains one problem.
system_health.py is python code that reads system info and generates
"health" graphs for the computer. It's presently running under Python
2.6. Does python even have RTSJ-like capabilities???
Looking further at the log messages (see attached file):
system_health.py - segfaults at 20:50, then runs fine at 20:55, 21:00,
21:05, 21:10, and 21
At 20:59:06 is a stack backtrace. This is 9 minutes after the
system_health.py segfault and a successful run of system_health. The
problem seems to be mmap related. Unfortunately it seems that part of
the oops(?) is missing since the first line has a right paren without a
preceding left paren.
21:20:01 -- another stack backtrace -- different from previous
21:27:58 -- another stack backtrace -- different from all previous ones
21:35:04 -- first mention of BUG ... and tainting
Evidently bad things were happening for a while before the first BUG.
So, back to an earlier question:
To whom should these backtraces be sent -- in hope that they'll shed
light on a previously encountered problem and aid in a fix being
generated ??
Regards,
David
^ permalink raw reply [flat|nested] 10+ messages in thread
end of thread, other threads:[~2009-01-14 23:10 UTC | newest]
Thread overview: 10+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2009-01-14 12:38 [gentoo-user] Kernel 2.6.28 BUGS David Relson
2009-01-14 12:46 ` Dirk Heinrichs
2009-01-14 12:55 ` David Relson
2009-01-14 13:01 ` Daniel Pielmeier
2009-01-14 13:14 ` David Relson
2009-01-14 13:32 ` Volker Armin Hemmann
2009-01-14 13:36 ` Daniel Pielmeier
2009-01-14 17:33 ` Dirk Heinrichs
2009-01-14 17:34 ` Xav'
2009-01-14 23:04 ` David Relson
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox