| Summary: | ASTERISK-16333: Conference with 60 Channels out of memory | ||
| Reporter: | Marco Loewl (marco_wc) | Labels: | |
| Date Opened: | 2010-07-08 09:19:44 | Date Closed: | 2011-06-07 14:00:44 |
| Priority: | Critical | Regression? | No |
| Status: | Closed/Complete | Components: | PBX/General |
| Versions: | Frequency of Occurrence | ||
| Related Issues: | |||
| Environment: | Attachments: | ||
| Description: | [262764.939034] Call Trace: [262764.939056] [<ffffffff8027388c>] oom_kill_process+0x57/0x1dc [262764.939060] [<ffffffff8023b49d>] __capable+0x9/0x1c [262764.939062] [<ffffffff80273bb7>] badness+0x188/0x1c7 [262764.939065] [<ffffffff80273deb>] out_of_memory+0x1f5/0x28e [262764.939069] [<ffffffff80276b3c>] __alloc_pages_internal+0x31d/0x3bf [262764.939074] [<ffffffff802787f2>] __do_page_cache_readahead+0x79/0x183 [262764.939078] [<ffffffff802730a1>] filemap_fault+0x15d/0x33c [262764.939082] [<ffffffff8027e620>] __do_fault+0x50/0x3e6 [262764.939088] [<ffffffff80281983>] handle_mm_fault+0x3f4/0x867 [262764.939091] [<ffffffff802a581e>] do_filp_open+0x3d7/0x7c4 [262764.939111] [<ffffffffa001d0c3>] :scsi_mod:scsi_device_put+0x2f/0x3e [262764.939116] [<ffffffff80221fbc>] do_page_fault+0x5d8/0x9c8 [262764.939120] [<ffffffff802bf25d>] __blkdev_put+0x12a/0x136 [262764.939125] [<ffffffff8042a869>] error_exit+0x0/0x60 [262764.939130] [262764.939131] Mem-info: [262764.939133] Node 0 DMA per-cpu: [262764.939135] CPU 0: hi: 0, btch: 1 usd: 0 [262764.939136] CPU 1: hi: 0, btch: 1 usd: 0 [262764.939138] CPU 2: hi: 0, btch: 1 usd: 0 [262764.939139] CPU 3: hi: 0, btch: 1 usd: 0 [262764.939141] CPU 4: hi: 0, btch: 1 usd: 0 [262764.939142] CPU 5: hi: 0, btch: 1 usd: 0 [262764.939144] CPU 6: hi: 0, btch: 1 usd: 0 [262764.939145] CPU 7: hi: 0, btch: 1 usd: 0 [262764.939146] Node 0 DMA32 per-cpu: [262764.939148] CPU 0: hi: 186, btch: 31 usd: 167 [262764.939150] CPU 1: hi: 186, btch: 31 usd: 155 [262764.939151] CPU 2: hi: 186, btch: 31 usd: 158 [262764.939153] CPU 3: hi: 186, btch: 31 usd: 172 [262764.939154] CPU 4: hi: 186, btch: 31 usd: 178 [262764.939156] CPU 5: hi: 186, btch: 31 usd: 178 [262764.939157] CPU 6: hi: 186, btch: 31 usd: 176 [262764.939159] CPU 7: hi: 186, btch: 31 usd: 170 [262764.939160] Node 0 Normal per-cpu: [262764.939161] CPU 0: hi: 186, btch: 31 usd: 174 [262764.939163] CPU 1: hi: 186, btch: 31 usd: 150 [262764.939164] CPU 2: hi: 186, btch: 31 usd: 106 [262764.939166] CPU 3: hi: 186, btch: 31 usd: 170 [262764.939167] CPU 4: hi: 186, btch: 31 usd: 135 [262764.939168] CPU 5: hi: 186, btch: 31 usd: 113 [262764.939170] CPU 6: hi: 186, btch: 31 usd: 184 [262764.939171] CPU 7: hi: 186, btch: 31 usd: 162 [262764.939174] Active:950363 inactive:1044511 dirty:0 writeback:0 unstable:0 [262764.939175] free:10037 slab:6516 mapped:46 pagetables:8159 bounce:0 [262764.939177] Node 0 DMA free:11160kB min:12kB low:12kB high:16kB active:0kB inactive:0kB present:10764kB pages_scanned:0 all_unreclaimable? yes [262764.939180] lowmem_reserve[]: 0 3251 8049 8049 [262764.939183] Node 0 DMA32 free:23776kB min:4632kB low:5788kB high:6948kB active:1578332kB inactive:1578132kB present:3329568kB pages_scanned:5723622 all_unreclaimable? yes [262764.939187] lowmem_reserve[]: 0 0 4797 4797 [262764.939189] Node 0 Normal free:5212kB min:6836kB low:8544kB high:10252kB active:2223120kB inactive:2599912kB present:4912640kB pages_scanned:11245406 all_unreclaimable? yes [262764.939193] lowmem_reserve[]: 0 0 0 0 [262764.939195] Node 0 DMA: 6*4kB 4*8kB 4*16kB 7*32kB 5*64kB 2*128kB 2*256kB 1*512kB 3*1024kB 1*2048kB 1*4096kB = 11160kB [262764.939202] Node 0 DMA32: 4372*4kB 22*8kB 0*16kB 1*32kB 1*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 1*4096kB = 23776kB [262764.939209] Node 0 Normal: 139*4kB 18*8kB 4*16kB 5*32kB 1*64kB 1*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 1*4096kB = 5212kB [262764.939215] 322 total pagecache pages [262764.939217] Swap cache: add 976692, delete 976692, find 4551397/4578680 [262764.939219] Free swap = 0kB [262764.939220] Total swap = 2955952kB [262764.982835] 2097152 pages of RAM [262764.982838] 48186 reserved pages [262764.982839] 2731 pages shared [262764.982841] 0 pages swap cached [262764.982844] Out of memory: kill process 24308 (asterisk) score 2864686 or a child [262764.982883] Killed process 24308 (asterisk) ****** ADDITIONAL INFORMATION ****** all 1.4 and 1.6 asterisk have the same Problem ! Dell Server Power Edge 2900 with 8GB Ram Dialogic Card E1/T1 and newest driver 9.5 with Chan-Capi 1.1.4 after 3000 calls out of memory | ||
| Comments: | By: Leif Madsen (lmadsen) 2010-07-08 09:56:41 Additional information is required: * a backtrace is probably useful * additional information about deadlocks and such might also be useful Also, can you reproduce this without chan_capi? We can't support third-party tools here. ---- We require a complete debug log to help triage the issue. This document will provide instructions on how to collect debugging logs from an Asterisk machine for the purpose of helping bug marshals troubleshoot an issue: http://svn.digium.com/svn/asterisk/trunk/doc/HOWTO_collect_debug_information.txt ---- Debugging deadlocks: Please select DEBUG_THREADS and DONT_OPTIMIZE in the Compiler Flags section of menuselect. Recompile and install Asterisk (i.e. make install) This will then give you the console command: core show locks When the symptoms of the deadlock present themselves again, please provide output of the deadlock via: # asterisk -rx "core show locks" | tee /tmp/core-show-locks.txt # gdb -se "asterisk" <pid of asterisk> | tee /tmp/backtrace.txt gdb> bt gdb> bt full gdb> thread apply all bt Then attach the core-show-locks.txt and backtrace.txt files to this issue. Thanks! By: Paul Belanger (pabelanger) 2010-07-19 10:24:21 Suspended due to lack of activity. Please request a bug marshal in #asterisk-bugs on the IRC network irc.freenode.net to reopen the issue should you have the additional information requested. Further information can be found at http://www.asterisk.org/developers/bug-guidelines By: Marco Loewl (marco_wc) 2010-07-20 03:36:14 bug is fixed with new Chan_Capi ! Please Close this Case, Thanks ! | ||