Questa volta ringraziamo automount

Dalle 13:15 alle 14:00 di oggi il sito è stato giù grazie ad automount che ha deciso di fare le bizze, nei dettagli del post il log del crash.

Nonostante tutto, cinque minuti dopo che è successo il patatrac che ha bloccato la macchina, ntpd ha fatto il suo dovere:

Jul 23 13:20:15 ntpd[2125]: synchronized to 78.159.107.102, stratum 2

Ecco il dettaglio:

Jul 23 13:14:52 kernel: INFO: task automount:24375 blocked for more than 120 seconds.
Jul 23 13:14:52 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jul 23 13:14:52 kernel: automount D 00002aaaaacd5000 0 24375 1 24376 24056 (NOTLB)
Jul 23 13:14:52 kernel: ffff810049b9bf08 0000000000000082 ffff810076e57c40 00002abbf0a09f90
Jul 23 13:14:52 kernel: 0000000000000292 0000000000000007 ffff81000bbab100 ffff81001253d7e0
Jul 23 13:14:52 kernel: 0000d7a0483fefc5 0000000000009a12 ffff81000bbab2e8 000000012094dbc0
Jul 23 13:14:52 kernel: Call Trace:
Jul 23 13:14:54 kernel: [] __down_write_nested+0x7a/0x92
Jul 23 13:14:54 kernel: [] sys_munmap+0x32/0x59
Jul 23 13:14:54 kernel: [] system_call+0x7e/0x83
Jul 23 13:14:54 kernel:
Jul 23 13:14:54 kernel: INFO: task automount:24376 blocked for more than 120 seconds.
Jul 23 13:14:54 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jul 23 13:14:54 kernel: automount D 00002aaaaacd6000 0 24376 1 24375 (NOTLB)
Jul 23 13:14:54 kernel: ffff81000ef0df08 0000000000000082 ffff810076e57c40 00002abbef6ed02c
Jul 23 13:14:54 kernel: 0000000000000292 0000000000000007 ffff8100159e5100 ffff81004cc747e0
Jul 23 13:14:54 kernel: 0000d7a07633155e 0000000000006b16 ffff8100159e52e8 0000000155ca1c40
Jul 23 13:14:54 kernel: Call Trace:
Jul 23 13:14:54 kernel: [] _atomic_dec_and_lock+0x39/0x57
Jul 23 13:14:54 kernel: [] __down_write_nested+0x7a/0x92
Jul 23 13:14:54 kernel: [] sys_munmap+0x32/0x59
Jul 23 13:14:54 kernel: [] system_call+0x7e/0x83
Jul 23 13:14:55 kernel: Mem-info:
Jul 23 13:14:55 kernel: Node 0 DMA per-cpu:
Jul 23 13:14:55 kernel: cpu 0 hot: high 0, batch 1 used:0
Jul 23 13:14:55 kernel: cpu 0 cold: high 0, batch 1 used:0
Jul 23 13:14:55 kernel: cpu 1 hot: high 0, batch 1 used:0
Jul 23 13:14:55 kernel: cpu 1 cold: high 0, batch 1 used:0
Jul 23 13:14:55 kernel: Node 0 DMA32 per-cpu:
Jul 23 13:14:55 kernel: cpu 0 hot: high 186, batch 31 used:12
Jul 23 13:14:55 kernel: cpu 0 cold: high 62, batch 15 used:26
Jul 23 13:14:55 kernel: cpu 1 hot: high 186, batch 31 used:46
Jul 23 13:14:55 kernel: cpu 1 cold: high 62, batch 15 used:54
Jul 23 13:14:55 kernel: Node 0 Normal per-cpu: empty
Jul 23 13:14:55 kernel: Node 0 HighMem per-cpu: empty
Jul 23 13:14:55 kernel: Free pages: 8620kB (0kB HighMem)
Jul 23 13:14:55 kernel: Active:246614 inactive:208880 dirty:0 writeback:0 unstable:0 free:2155 slab:10062 mapped-file:980 mapped-anon:457567 pagetables:28697
Jul 23 13:14:55 kernel: Node 0 DMA free:2956kB min:24kB low:28kB high:36kB active:0kB inactive:0kB present:9696kB pages_scanned:0 all_unreclaimable? yes
Jul 23 13:14:55 kernel: lowmem_reserve[]: 0 1972 1972 1972
Jul 23 13:14:55 kernel: Node 0 DMA32 free:5664kB min:5668kB low:7084kB high:8500kB active:986584kB inactive:835520kB present:2019688kB pages_scanned:3819260 all_unreclaimable? yes
Jul 23 13:14:55 kernel: lowmem_reserve[]: 0 0 0 0
Jul 23 13:14:55 kernel: Node 0 Normal free:0kB min:0kB low:0kB high:0kB active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no
Jul 23 13:14:55 kernel: lowmem_reserve[]: 0 0 0 0
Jul 23 13:14:55 kernel: Node 0 HighMem free:0kB min:128kB low:128kB high:128kB active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no
Jul 23 13:14:55 kernel: lowmem_reserve[]: 0 0 0 0
Jul 23 13:14:55 kernel: Node 0 DMA: 5*4kB 7*8kB 4*16kB 4*32kB 4*64kB 3*128kB 2*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 2956kB
Jul 23 13:15:00 kernel: Node 0 DMA32: 58*4kB 1*8kB 1*16kB 1*32kB 0*64kB 2*128kB 0*256kB 0*512kB 1*1024kB 0*2048kB 1*4096kB = 5664kB
Jul 23 13:15:00 kernel: Node 0 Normal: empty
Jul 23 13:15:00 kernel: Node 0 HighMem: empty
Jul 23 13:15:00 kernel: 1314 pagecache pages
Jul 23 13:15:00 kernel: Swap cache: add 7333006, delete 7332743, find 2143642/2791367, race 53+519
Jul 23 13:15:00 kernel: Free swap = 0kB
Jul 23 13:15:00 kernel: Total swap = 4289344kB
Jul 23 13:15:00 kernel: Free swap: 0kB
Jul 23 13:15:00 kernel: 516016 pages of RAM
Jul 23 13:15:00 kernel: 9611 reserved pages
Jul 23 13:15:00 kernel: 70017 pages shared
Jul 23 13:15:00 kernel: 263 pages swap cached
Jul 23 13:15:00 kernel: Out of memory: Killed process 13231, UID 48, (httpd).
Jul 23 13:15:00 kernel: httpd invoked oom-killer: gfp_mask=0x201d2, order=0, oomkilladj=0
Jul 23 13:15:00 kernel:
Jul 23 13:15:00 kernel: Call Trace:
Jul 23 13:15:00 kernel: [] out_of_memory+0x8e/0x2f3
Jul 23 13:15:00 kernel: [] __alloc_pages+0x27f/0x308
Jul 23 13:15:00 kernel: [] __do_page_cache_readahead+0x96/0x17b
Jul 23 13:15:00 kernel: [] filemap_nopage+0x14c/0x360
Jul 23 13:15:00 kernel: [] __handle_mm_fault+0x1fd/0x103b
Jul 23 13:15:00 kernel: [] __handle_mm_fault+0x102d/0x103b
Jul 23 13:15:00 kernel: [] do_page_fault+0x499/0x842
Jul 23 13:15:00 kernel: [] remove_vma+0x5d/0x64
Jul 23 13:15:00 kernel: [] error_exit+0x0/0x84
Jul 23 13:15:00 kernel:
Jul 23 13:15:00 kernel: Mem-info:
Jul 23 13:15:00 kernel: Node 0 DMA per-cpu:
Jul 23 13:15:00 kernel: cpu 0 hot: high 0, batch 1 used:0
Jul 23 13:15:00 kernel: cpu 0 cold: high 0, batch 1 used:0
Jul 23 13:15:00 kernel: cpu 1 hot: high 0, batch 1 used:0
Jul 23 13:15:00 kernel: cpu 1 cold: high 0, batch 1 used:0
Jul 23 13:15:00 kernel: Node 0 DMA32 per-cpu:
Jul 23 13:15:00 kernel: cpu 0 hot: high 186, batch 31 used:9
Jul 23 13:15:00 kernel: cpu 0 cold: high 62, batch 15 used:22
Jul 23 13:15:00 kernel: cpu 1 hot: high 186, batch 31 used:57
Jul 23 13:15:00 kernel: cpu 1 cold: high 62, batch 15 used:53
Jul 23 13:15:00 kernel: Node 0 Normal per-cpu: empty
Jul 23 13:15:00 kernel: Node 0 HighMem per-cpu: empty
Jul 23 13:15:01 kernel: Free pages: 8860kB (0kB HighMem)
Jul 23 13:15:01 kernel: Active:217458 inactive:237022 dirty:0 writeback:0 unstable:0 free:2215 slab:10046 mapped-file:978 mapped-anon:457567 pagetables:28697
Jul 23 13:15:01 kernel: Node 0 DMA free:2956kB min:24kB low:28kB high:36kB active:0kB inactive:0kB present:9696kB pages_scanned:0 all_unreclaimable? yes
Jul 23 13:15:01 kernel: lowmem_reserve[]: 0 1972 1972 1972
Jul 23 13:15:01 kernel: Node 0 DMA32 free:5904kB min:5668kB low:7084kB high:8500kB active:869832kB inactive:948088kB present:2019688kB pages_scanned:536012 all_unreclaimable? no
Jul 23 13:15:01 kernel: lowmem_reserve[]: 0 0 0 0
Jul 23 13:15:01 kernel: Node 0 Normal free:0kB min:0kB low:0kB high:0kB active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no
Jul 23 13:15:01 kernel: lowmem_reserve[]: 0 0 0 0
Jul 23 13:15:01 kernel: Node 0 HighMem free:0kB min:128kB low:128kB high:128kB active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no
Jul 23 13:15:01 kernel: lowmem_reserve[]: 0 0 0 0
Jul 23 13:15:01 kernel: Node 0 DMA: 5*4kB 7*8kB 4*16kB 4*32kB 4*64kB 3*128kB 2*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 2956kB
Jul 23 13:15:01 kernel: Node 0 DMA32: 118*4kB 1*8kB 1*16kB 1*32kB 0*64kB 2*128kB 0*256kB 0*512kB 1*1024kB 0*2048kB 1*4096kB = 5904kB
Jul 23 13:15:01 kernel: Node 0 Normal: empty
Jul 23 13:15:01 kernel: Node 0 HighMem: empty
Jul 23 13:15:01 kernel: 1349 pagecache pages
Jul 23 13:15:01 kernel: Swap cache: add 7333015, delete 7332752, find 2143642/2791368, race 53+519
Jul 23 13:15:01 kernel: Free swap = 0kB
Jul 23 13:15:01 kernel: Total swap = 4289344kB
Jul 23 13:15:01 kernel: Free swap: 0kB
Jul 23 13:15:01 kernel: 516016 pages of RAM
Jul 23 13:15:01 kernel: 9611 reserved pages
Jul 23 13:15:01 kernel: 71067 pages shared
Jul 23 13:15:01 kernel: 263 pages swap cached

Autore: Luigi Rosa

Consulente IT, sviluppatore, SysAdmin, cazzaro, e, ovviamente, geek.

Un pensiero riguardo “Questa volta ringraziamo automount”

Spazio per un commento