CENTOS宕机，求分析

[wesay1]

昨天夜里4：55开始一直持续到今天9点多（起床后重启恢复～），看记录期间CPU一直100%，贴上这段时间的日志，求分析怎么解决啊。

[code=text]Mar 3 04:50:06 AY11 kernel: Out of memory: Kill process 4705 (httpd) score 129 or sacrifice child
Mar 3 04:50:06 AY11 kernel: Killed process 4705, UID 1000, (httpd) total-vm:262340kB, anon-rss:124760kB, file-rss:6392kB
Mar 3 04:50:10 AY11 kernel: httpd invoked oom-killer: gfp_mask=0x280da, order=0, oom_adj=0, oom_score_adj=0
Mar 3 04:50:10 AY11 kernel: httpd cpuset=/ mems_allowed=0
Mar 3 04:50:10 AY11 kernel: Pid: 4897, comm: httpd Not tainted 2.6.32-431.17.1.el6.x86_64 #1
Mar 3 04:50:10 AY11 kernel: Call Trace:
Mar 3 04:50:10 AY11 kernel: [<ffffffff810d0211>] ? cpuset_print_task_mems_allowed+0x91/0xb0
Mar 3 04:50:10 AY11 kernel: [<ffffffff811225c0>] ? dump_header+0x90/0x1b0
Mar 3 04:50:10 AY11 kernel: [<ffffffff8122761c>] ? security_real_capable_noaudit+0x3c/0x70
Mar 3 04:50:10 AY11 kernel: [<ffffffff81122a42>] ? oom_kill_process+0x82/0x2a0
Mar 3 04:50:10 AY11 kernel: [<ffffffff81122981>] ? select_bad_process+0xe1/0x120
Mar 3 04:50:10 AY11 kernel: [<ffffffff81122e80>] ? out_of_memory+0x220/0x3c0
Mar 3 04:50:10 AY11 kernel: [<ffffffff8112f79f>] ? __alloc_pages_nodemask+0x89f/0x8d0
Mar 3 04:50:10 AY11 kernel: [<ffffffff8116779a>] ? alloc_pages_vma+0x9a/0x150
Mar 3 04:50:10 AY11 kernel: [<ffffffff8114a89d>] ? handle_pte_fault+0x73d/0xb00
Mar 3 04:50:10 AY11 kernel: [<ffffffff811aa6b0>] ? mntput_no_expire+0x30/0x110
Mar 3 04:50:10 AY11 kernel: [<ffffffff8114ae8a>] ? handle_mm_fault+0x22a/0x300
Mar 3 04:50:10 AY11 kernel: [<ffffffff81196795>] ? release_open_intent+0x25/0x30
Mar 3 04:50:10 AY11 kernel: [<ffffffff8104a8d8>] ? __do_page_fault+0x138/0x480
Mar 3 04:50:10 AY11 kernel: [<ffffffff81288bec>] ? rb_erase+0x1bc/0x310
Mar 3 04:50:10 AY11 kernel: [<ffffffff8100988e>] ? __switch_to+0x26e/0x320
Mar 3 04:50:10 AY11 kernel: [<ffffffff81527bfe>] ? thread_return+0x4e/0x760
Mar 3 04:50:10 AY11 kernel: [<ffffffff8152d73e>] ? do_page_fault+0x3e/0xa0
Mar 3 04:50:10 AY11 kernel: [<ffffffff8152aaf5>] ? page_fault+0x25/0x30
Mar 3 04:50:10 AY11 kernel: Mem-Info:
Mar 3 04:50:10 AY11 kernel: Node 0 DMA per-cpu:
Mar 3 04:50:10 AY11 kernel: CPU 0: hi: 0, btch: 1 usd: 0
Mar 3 04:50:10 AY11 kernel: Node 0 DMA32 per-cpu:
Mar 3 04:50:10 AY11 kernel: CPU 0: hi: 186, btch: 31 usd: 30
Mar 3 04:50:10 AY11 kernel: active_anon:226596 inactive_anon:276 isolated_anon:0
Mar 3 04:50:10 AY11 kernel: active_file:390 inactive_file:427 isolated_file:0
Mar 3 04:50:10 AY11 kernel: unevictable:0 dirty:0 writeback:0 unstable:0
Mar 3 04:50:10 AY11 kernel: free:12237 slab_reclaimable:2093 slab_unreclaimable:5682
Mar 3 04:50:10 AY11 kernel: mapped:1981 shmem:2130 pagetables:3256 bounce:0
Mar 3 04:50:10 AY11 kernel: Node 0 DMA free:4652kB min:668kB low:832kB high:1000kB active_anon:10964kB inactive_anon:0kB active_file:8kB inactive_file:24kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15372kB mlocked:0kB dirty:0kB writeback:0kB mapped:8kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:72kB kernel_stack:8kB pagetables:32kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
Mar 3 04:50:10 AY11 kernel: lowmem_reserve[]: 0 994 994 994
Mar 3 04:50:10 AY11 kernel: Node 0 DMA32 free:44296kB min:44384kB low:55480kB high:66576kB active_anon:895420kB inactive_anon:1104kB active_file:1552kB inactive_file:1684kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:1018080kB mlocked:0kB dirty:0kB writeback:0kB mapped:7916kB shmem:8520kB slab_reclaimable:8372kB slab_unreclaimable:22656kB kernel_stack:1200kB pagetables:12992kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:928 all_unreclaimable? no
Mar 3 04:50:10 AY11 kernel: lowmem_reserve[]: 0 0 0 0
Mar 3 04:50:10 AY11 kernel: Node 0 DMA: 5*4kB 13*8kB 9*16kB 9*32kB 6*64kB 5*128kB 0*256kB 2*512kB 0*1024kB 1*2048kB 0*4096kB = 4652kB
Mar 3 04:50:10 AY11 kernel: Node 0 DMA32: 402*4kB 228*8kB 86*16kB 54*32kB 28*64kB 43*128kB 11*256kB 14*512kB 14*1024kB 1*2048kB 1*4096kB = 44296kB
Mar 3 04:50:10 AY11 kernel: 2959 total pagecache pages
Mar 3 04:50:10 AY11 kernel: 0 pages in swap cache
Mar 3 04:50:10 AY11 kernel: Swap cache stats: add 0, delete 0, find 0/0
Mar 3 04:50:10 AY11 kernel: Free swap = 0kB
Mar 3 04:50:10 AY11 kernel: Total swap = 0kB
Mar 3 04:50:10 AY11 kernel: 262143 pages RAM
Mar 3 04:50:10 AY11 kernel: 7492 pages reserved
Mar 3 04:50:10 AY11 kernel: 44833 pages shared
Mar 3 04:50:10 AY11 kernel: 235622 pages non-shared
Mar 3 04:50:10 AY11 kernel: [ pid ] uid tgid total_vm rss cpu oom_adj oom_score_adj name[code]

[j360009334]

内存不足，给主机多分配点内存，在用top命令查看系统资源占用情况对程序经行调优。

[Rotel-刘志东]

内存溢出原因，检查应用程序和系统资源分配情况。

[wesay1]

原来内存是1G，现在给又加了1G，两G了哎。