Summary:	ASTERISK-05634: Asterisk 1.2 frequent crashes in queue_destroy
Reporter:	Carey Jung (careyj)	Labels:
Date Opened:	2005-11-17 17:06:41.000-0600	Date Closed:	2011-06-07 14:01:06
Priority:	Critical	Regression?	No
Status:	Closed/Complete	Components:	Core/General
Versions:		Frequency of Occurrence
Related Issues:
Environment:		Attachments:
Description:	Since upgrading to 1.2 last night, we've had 2 crashes on a production system, both in the queue cleanup code.  See add'l info below for backtrace. ****** ADDITIONAL INFORMATION ****** Asterisk on sip.itfreedom.com exited with signal 9 (automatically restarting...) GDB output from core.5103: Using host libthread_db library "/lib/obsolete/linuxthreads/libthread_db.so.1". Core was generated by `/usr/sbin/asterisk -vvvg -c'. Program terminated with signal 6, Aborted. #0  0x00ef4311 in kill () from /lib/obsolete/linuxthreads/i686/libc.so.6 BACKTRACE: #0  0x00ef4311 in kill () from /lib/obsolete/linuxthreads/i686/libc.so.6 #1  0x00dadb4c in pthread_kill ()   from /lib/obsolete/linuxthreads/i686/libpthread.so.0 #2  0x00dadee1 in raise () from /lib/obsolete/linuxthreads/i686/libpthread.so.0 #3  0x00ef3f8d in raise () from /lib/obsolete/linuxthreads/i686/libc.so.6 #4  0x00ef54f3 in abort () from /lib/obsolete/linuxthreads/i686/libc.so.6 ASTERISK-1  0x00f28e4e in __libc_message ()   from /lib/obsolete/linuxthreads/i686/libc.so.6 ASTERISK-2  0x00f2f75b in _int_free () from /lib/obsolete/linuxthreads/i686/libc.so.6 ASTERISK-3  0x00f2fcc5 in free () from /lib/obsolete/linuxthreads/i686/libc.so.6 ASTERISK-4  0x00dfebd7 in destroy_queue (q=0xb7e36ab8) at app_queue.c:1017 ASTERISK-5  0x00e05395 in queue_exec (chan=0xb7d0e390, data=0x1185a98)    at app_queue.c:1227 ASTERISK-6 0x0808cdd1 in pbx_extension_helper (c=0xb7d0e390, con=) at pbx.c:544 ASTERISK-7 0x0808e384 in __ast_pbx_run (c=0xb7d0e390) at pbx.c:2220 ASTERISK-8 0x0808ef7c in pbx_thread (data=0x0) at pbx.c:2507 ASTERISK-9 0x00daa9a0 in pthread_start_thread ()   from /lib/obsolete/linuxthreads/i686/libpthread.so.0 ASTERISK-10 0x00f95cea in clone () from /lib/obsolete/linuxthreads/i686/libc.so.6 ALTERNATIVE BACKTRACE: #0  0x00ef4311 in kill () from /lib/obsolete/linuxthreads/i686/libc.so.6 No symbol table info available. #1  0x00dadb4c in pthread_kill ()   from /lib/obsolete/linuxthreads/i686/libpthread.so.0 No symbol table info available. #2  0x00dadee1 in raise () from /lib/obsolete/linuxthreads/i686/libpthread.so.0 No symbol table info available. #3  0x00ef3f8d in raise () from /lib/obsolete/linuxthreads/i686/libc.so.6 No symbol table info available. #4  0x00ef54f3 in abort () from /lib/obsolete/linuxthreads/i686/libc.so.6 No symbol table info available. ASTERISK-1  0x00f28e4e in __libc_message ()   from /lib/obsolete/linuxthreads/i686/libc.so.6 No symbol table info available. ASTERISK-2  0x00f2f75b in _int_free () from /lib/obsolete/linuxthreads/i686/libc.so.6 No symbol table info available. ASTERISK-3  0x00f2fcc5 in free () from /lib/obsolete/linuxthreads/i686/libc.so.6 No symbol table info available. ASTERISK-4  0x00dfebd7 in destroy_queue (q=0xb7e36ab8) at app_queue.c:1017 cur = (struct ast_call_queue *) 0x0 prev =
Comments:	By: Serge Vecher (serge-v) 2005-11-17 18:00:07.000-0600 careyj: please confirm that this is a backtrace from a non-optimized build as per doc\README.backtrace. If not, you will have to recompile Asterisk with make dont-optimize and produce a backtrace with that. By: Carey Jung (careyj) 2005-11-18 06:15:13.000-0600 Unfortunately, this was a production system, with optimization turned on.  We've rebuilt non-optimized, but have reverted back to RC1, since we had no crashes on it for the several days we ran it.  I can't risk any more crashes by running the final release. It seems pretty clear, though, that there's some memory management issues in the queue cleanup code.  There were changes to this code between RC1 and the final release, according to the release notes, and the backtrace on both crashes showed an attempt to free a null pointer.  As mentioned above, RC1 (optimized) did not crash; 1.2 (optimized) did, twice. Here, by the way, is the dump output from the first crash.  (We've modified safe_restart to include the dump output in email notification, by the way.) Asterisk on sip.itfreedom.com exited with signal 9 (automatically restarting...) GDB output from core.5103: Using host libthread_db library "/lib/obsolete/linuxthreads/libthread_db.so.1". Core was generated by `/usr/sbin/asterisk -vvvg -c'. Program terminated with signal 6, Aborted. #0  0x00ef4311 in kill () from /lib/obsolete/linuxthreads/i686/libc.so.6 BACKTRACE: #0  0x00ef4311 in kill () from /lib/obsolete/linuxthreads/i686/libc.so.6 #1  0x00dadb4c in pthread_kill () from /lib/obsolete/linuxthreads/i686/libpthread.so.0 #2  0x00dadee1 in raise () from /lib/obsolete/linuxthreads/i686/libpthread.so.0 #3  0x00ef3f8d in raise () from /lib/obsolete/linuxthreads/i686/libc.so.6 #4  0x00ef54f3 in abort () from /lib/obsolete/linuxthreads/i686/libc.so.6 ASTERISK-1  0x00f28e4e in __libc_message () from /lib/obsolete/linuxthreads/i686/libc.so.6 ASTERISK-2  0x00f2f75b in _int_free () from /lib/obsolete/linuxthreads/i686/libc.so.6 ASTERISK-3  0x00f2fcc5 in free () from /lib/obsolete/linuxthreads/i686/libc.so.6 ASTERISK-4  0x00dfebd7 in destroy_queue (q=0xb7e36ab8) at app_queue.c:1017 ASTERISK-5  0x00e05395 in queue_exec (chan=0xb7d0e390, data=0x1185a98) at app_queue.c:1227 ASTERISK-6 0x0808cdd1 in pbx_extension_helper (c=0xb7d0e390, con=) at pbx.c:544 ASTERISK-7 0x0808e384 in __ast_pbx_run (c=0xb7d0e390) at pbx.c:2220 ASTERISK-8 0x0808ef7c in pbx_thread (data=0x0) at pbx.c:2507 ASTERISK-9 0x00daa9a0 in pthread_start_thread () from /lib/obsolete/linuxthreads/i686/libpthread.so.0 ASTERISK-10 0x00f95cea in clone () from /lib/obsolete/linuxthreads/i686/libc.so.6 ALTERNATIVE BACKTRACE: #0  0x00ef4311 in kill () from /lib/obsolete/linuxthreads/i686/libc.so.6 No symbol table info available. #1  0x00dadb4c in pthread_kill () from /lib/obsolete/linuxthreads/i686/libpthread.so.0 No symbol table info available. #2  0x00dadee1 in raise () from /lib/obsolete/linuxthreads/i686/libpthread.so.0 No symbol table info available. #3  0x00ef3f8d in raise () from /lib/obsolete/linuxthreads/i686/libc.so.6 No symbol table info available. #4  0x00ef54f3 in abort () from /lib/obsolete/linuxthreads/i686/libc.so.6 No symbol table info available. ASTERISK-1  0x00f28e4e in __libc_message () from /lib/obsolete/linuxthreads/i686/libc.so.6 No symbol table info available. ASTERISK-2  0x00f2f75b in _int_free () from /lib/obsolete/linuxthreads/i686/libc.so.6 No symbol table info available. ASTERISK-3  0x00f2fcc5 in free () from /lib/obsolete/linuxthreads/i686/libc.so.6 No symbol table info available. ASTERISK-4  0x00dfebd7 in destroy_queue (q=0xb7e36ab8) at app_queue.c:1017 cur = (struct ast_call_queue *) 0x0 prev = By: Tilghman Lesher (tilghman) 2005-11-18 08:53:47.000-0600 I'm curious as to why you think the backtrace was caused by attempting to free a NULL pointer?  I don't see that in either of the backtraces you've posted.  I see a possible double-free indication (without support for that in the code), but the only thing NULL in your backtrace is "cur", which isn't being freed ("q" is being freed, which is not NULL). By: Mark Spencer (markster) 2005-11-18 11:46:25.000-0600 Can you at least test RC2?  If you don't help us track down the problem, we won't have a way to get it fixed in the future.  I'm guessing you don't want to be running RC1 forever :) By: Carey Jung (careyj) 2005-11-18 16:17:23.000-0600 We're going to go to 1.2 non-optimized tonight and try to reproduce the crash.   I don't know if it's a coincidence, but we're having serious voice quality issues with a new customer for whom we've set up a fairly involved queue setup for their main menu  (main # rings 3 people in Q1, then 6-8 people in Q2, then more people in Q3, etc.  Polycom phones.  The receptionists have IP601s with multiple registrations.  We're getting steady complaints, primarily from the receptionists, of people calling and getting cut off, momentary periods of silence or one-way audio, etc.  Also, lots of "Internal server errors" spit back from the Polycoms.  We're going to be doing extensive testing on it this weekend, trying to reproduce the problem.   Troubleshooting suggestions welcome. By: Carey Jung (careyj) 2005-11-18 16:21:26.000-0600 By the way, I'm willing to pay Digium (hint, Mark) to help t/s this.  This is a critical customer for us, and we need to isolate these queue issues.  We have some prepaid support in place. By: Olle Johansson (oej) 2005-11-22 10:38:05.000-0600 Contact Digium support directly if needed - the bug tracker is not the best way to file an issue with support ;-) By: Carey Jung (careyj) 2005-11-22 10:52:47.000-0600 Update:  We rebuilt 1.2 with optimization off last Friday night, tested all weekend long, and left the build in place.  We have not had any crashes so far. By: Olle Johansson (oej) 2005-11-22 11:08:46.000-0600 Good to hear! By: Mark Spencer (markster) 2005-11-25 13:27:54.000-0600 So is this just a rebuild issue?  If you go back to optimizations does the problem still occur? By: Carey Jung (careyj) 2005-11-27 11:07:34.000-0600 I'm sure if we turned optimization back on, the problem would reoccur.  There was nothing wrong with the build, to my knowledge, just a typical asterisk build. By: Carey Jung (careyj) 2005-12-05 18:27:52.000-0600 We have had three crashes today, occurring after reloads.  I'm not sure if they're related to the crashes previously reported, but they are in queue code as before.  Here is a core dump -- optimization off. Asterisk on sip.itfreedom.com exited with signal 9 (automatically restarting...) GDB output from core.9040 core.19604: Using host libthread_db library "/lib/obsolete/linuxthreads/libthread_db.so.1". Core was generated by `/usr/sbin/asterisk -vvvg -c'. Program terminated with signal 11, Segmentation fault. #0  0x00fc15d1 in update_queue (q=0x8d5ed80, member=0x8d4c848)    at app_queue.c:1926 1926 cur = cur->next; BACKTRACE: #0  0x00fc15d1 in update_queue (q=0x8d5ed80, member=0x8d4c848)    at app_queue.c:1926 #1  0x00fc3149 in try_calling (qe=0x332d55c, options=0x332d6ef "",    announceoverride=0x332d6f1 "", url=0x332d6f0 "", go_on=0x332d6cc)    at app_queue.c:2285 #2  0x00fc6568 in queue_exec (chan=0xb7e649a0, data=0x3331b18)    at app_queue.c:2986 #3  0x0808ba21 in pbx_exec (c=0xb7e649a0, app=0xb7e22fc8, data=0x3331b18,    newstack=1) at pbx.c:544 #4  0x0808fa06 in pbx_extension_helper (c=0xb7e649a0, con=0x0,    context=0xb7e64af0 "itfreedom-open", exten=0xb7e64be4 "s", priority=1,    label=0x0, callerid=0xb7d11ce8 "7139778787", action=1) at pbx.c:1687 ASTERISK-1  0x08090f39 in ast_spawn_extension (c=0xb7e649a0,    context=0xb7e64af0 "itfreedom-open", exten=0xb7e64be4 "s", priority=1,    callerid=0xb7d11ce8 "7139778787") at pbx.c:2220 ASTERISK-2  0x08091453 in __ast_pbx_run (c=0xb7e649a0) at pbx.c:2286 ASTERISK-3  0x0809248e in pbx_thread (data=0xb7e649a0) at pbx.c:2507 ASTERISK-4  0x004e29a0 in pthread_start_thread ()   from /lib/obsolete/linuxthreads/i686/libpthread.so.0 ASTERISK-5  0x001dbcea in clone () from /lib/obsolete/linuxthreads/i686/libc.so.6 ALTERNATIVE BACKTRACE: #0  0x00fc15d1 in update_queue (q=0x8d5ed80, member=0x8d4c848)    at app_queue.c:1926 cur = (struct member *) 0x77656e20 #1  0x00fc3149 in try_calling (qe=0x332d55c, options=0x332d6ef "",    announceoverride=0x332d6f1 "", url=0x332d6f0 "", go_on=0x332d6cc)    at app_queue.c:2285 cur = (struct member *) 0x0 outgoing = (struct localuser *) 0x0 tmp = (struct localuser *) 0xb7d03a40 to = 17090 restofit = "\000\000\000\000\177\017\177\003ô¿N\000jt\224CðJæ· \017", '\0' <repeats 14 times>, "3\034\000\000\000\000\000\000\200U\022\b-\000\000\000tÑü\000O\023ü\000\000\000\000\000ß\226ü\000:\a\000\000,Ôü\000ܵü" oldexten = "s", '\0' <repeats 78 times> oldcontext = "itfreedom-open", '\0' <repeats 65 times> queuename = "itfreedom-answer", '\0' <repeats 239 times> newnum = 0x0 monitorfilename = 0xfcd174 "\2300\001" peer = (struct ast_channel *) 0xb7d242e0 which = (struct ast_channel *) 0x332d55c lpeer = (struct localuser *) 0xb7d22b70 member = (struct member *) 0x8d4c848 res = 0 bridge = -1 numbusies = 0 x = 3 announce = 0x0 digit = 0 '\0' callstart = 1133802605 now = 1133802602 bridge_config = {features_caller = {flags = 0}, features_callee = {    flags = 2}, start_time = {tv_sec = 1133802605, tv_usec = 690183},  feature_timer = 0, timelimit = 0, play_warning = 0, warning_freq = 0,  warning_sound = 0x0, end_sound = 0x0, start_sound = 0x0, firstpass = 0,  flags = 2} nondataquality = 1 '\001' __PRETTY_FUNCTION__ = "try_calling" #2  0x00fc6568 in queue_exec (chan=0xb7e649a0, data=0x3331b18)    at app_queue.c:2986 stat = QUEUE_NO_MEMBERS makeannouncement = 1 res = 0 ringing = 1 u = (struct localuser *) 0xb7d0f368 queuename = 0x332d6dc "itfreedom-answer" info = "itfreedom-answer\000tr\000\000\00015", '\0' <repeats 472 times>, "Æî\n\bÈ(Ô\b0\0333\0038\000\000" info_ptr = 0x332d6f2 "15" options = 0x332d6ed "tr" url = 0x332d6f0 "" announceoverride = 0x332d6f1 "" user_priority = 0x0 prio = 0 queuetimeoutstr = 0x332d6f2 "15" reason = QUEUE_UNKNOWN go_on = 0 qe = {parent = 0x8d5ed80, moh = "itfreedom", '\0' <repeats 70 times>,  announce = '\0' <repeats 79 times>,  context = "itfreedom-mainmenu", '\0' <repeats 61 times>,  digits = '\0' <repeats 79 times>, pos = 1, prio = 0, last_pos_said = 0,  last_periodic_announce_time = 1133802602, last_pos = 0, opos = 1,  handled = 1, start = 1133802602, expire = 1133802617, chan = 0xb7e649a0,  next = 0x0} __PRETTY_FUNCTION__ = "queue_exec" #3  0x0808ba21 in pbx_exec (c=0xb7e649a0, app=0xb7e22fc8, data=0x3331b18,    newstack=1) at pbx.c:544 res = -1209643672 saved_c_appl = 0x0 saved_c_data = 0x0 execute = (int (*)(struct ast_channel *, void *)) 0xfc5b79 <queue_exec> __PRETTY_FUNCTION__ = "pbx_exec" #4  0x0808fa06 in pbx_extension_helper (c=0xb7e649a0, con=0x0,    context=0xb7e64af0 "itfreedom-open", exten=0xb7e64be4 "s", priority=1,    label=0x0, callerid=0xb7d11ce8 "7139778787", action=1) at pbx.c:1687 e = (struct ast_exten *) 0x8d51248 app = (struct ast_app *) 0xb7e22fc8 sw = (struct ast_switch *) 0x0 data = 0x0 foundcontext = 0xb7e64af0 "itfreedom-open" newstack = 1 res = 0 status = 5 incstack = {0xb7e039d8 ",1,Goto(itfreedom-extensions,${EXTEN:6},`",  0xb7e01680 ",1,Goto(itfreedom-test,sP", 0x0 <repeats 16 times>,  0x172217 "\201ÃÝM\f", 0x0, 0x0, 0x236ff4 "\034]\022", 0x0, 0x0,  0x173107 "\213E\f\211G\020\211G\f\211G\004\213E\024\205Àt5\213U\024\211W\024\211w\030\211W\bÇ\207\230",  0x3333bbc "\001\200­û\034=3\003\034=3\003\034=3\003\034=3\003.=3\003k=3\003\034=3\003k=3\003", 0x3333d1c "ðJæ·", 0x3333d6b "·\001",  0x3333cdc " ®â·Ø\217ê·\020", 0x236ff4 "\034]\022",  0x3333bbc "\001\200­û\034=3\003\034=3\003\034=3\003\034=3\003.=3\003k=3\003\034=3\003k=3\003", 0x3333d1c "ðJæ·", 0x3333ca8 "È<3\003õ\\\025",  0x16e02b "\211Â\213\205\fÿÿÿ;\2050ÿÿÿt\t\213\205(ÿÿÿÆ",  0x3333bbc "\001\200­û\034=3\003\034=3\003\034=3\003\034=3\003.=3\003k=3\003\034=3\003k=3\003", 0x810b145 "\"%s\" <%s>", 0x3333ce4 "\020", 0x3333d1c "ðJæ·",  0x0, 0x3333c5c "", 0x4f <Address 0x4f out of bounds>,  0xfbad8001 <Address 0xfbad8001 out of bounds>, 0x3333d1c "ðJæ·",  0x3333d1c "ðJæ·", 0x3333d1c "ðJæ·", 0x3333d1c "ðJæ·", 0x3333d2e "â·\001",  0x3333d6b "·\001", 0x3333d1c "ðJæ·", 0x3333d6b "·\001",  0x0 <repeats 14 times>, 0xffffffff <Address 0xffffffff out of bounds>, 0x0,  0x0, 0x0, 0x0, 0x1744ba "\201Ã:+\f", 0x0, 0x0, 0x0, 0x0, 0x0,  0x22ad8b "corrupted double-linked list", 0x0,  0x22ad8b "corrupted double-linked list", 0x236a00 "", 0x0, 0x238a78 "", 0x0,  0x238a8c "", 0x38 <Address 0x38 out of bounds>,  0x10 <Address 0x10 out of bounds>, 0x0, 0x0, 0x0, 0x0, 0x0,  0x236ff4 "\034]\022", 0x238a40 "", 0x0, 0x3333d34 "",  0x176478 "\213u\b\203ÆL\211u\210\211òé\030üÿÿ\211ÐÁè\022\203ø\002w7\215H|\215\004\téúýÿÿ\213E\220Áè\f\203ø\nv0\213E\220Áè\017\203ø\004\017\207\222\001",  0x0, 0x0, 0x236ff4 "\034]\022", 0x4ee468 "", 0x0,  0x3333cc8 "è?3\003\237ô\n\bO)Ô\bSMæ·\021",  0x155cf5 "\203Ä\024[]Ã\220U\211åS\203ì\020è\230\004ýÿ\201Ãì\022\016",  0x3333d1c "ðJæ·", 0x50 <Address 0x50 out of bounds>,  0x810b145 "\"%s\" <%s>", 0x3333cdc " ®â·Ø\217ê·\020",  0x3333cdc " ®â·Ø\217ê·\020", 0x4ebff4 "pî", 0x3333fe8 "",  0x80af49f "\213\204$°", 0x8d4294f "", 0xb7e64d53 "",  0x11 <Address 0x11 out of bounds>, 0xb7e2aea0 "6602", 0xb7ea8fd8 "",  0x10 <Address 0x10 out of bounds>, 0x4e6bce "\201Ã&T", 0x0,  0x810b079 "<unknown>", 0xb7ea8fd8 "", 0xb7ea8fd8 "",  0x1 <Address 0x1 out of bounds>, 0x3 <Address 0x3 out of bounds>,  0x1 <Address 0x1 out of bounds>, 0x1 <Address 0x1 out of bounds>,  0x80d3d7c "\213D$\020\213T$\024\211\003\211S\004\211Ø\203Ä\030[Â\004",  0x3333d20 "", 0x0} passdata = "itfreedom-answer|tr|||15", '\0' <repeats 8167 times> stacklen = 0 tmp = "\033[1;36;40mQueue\033[0;37;40m\000;40m\00040m", '\0' <repeats 45 times> tmp2 = "\033[1;35;40mSIP/zephyrenv_7356-1226\033[0;37;40m", '\0' <repeats 36 times> tmp3 = "\033[1;35;40mitfreedom-answer|tr|||15\033[0;37;40m\000pen|s|1\033[0;37;40m\000\033[0;37;40m", '\0' <repeats 8118 times> atmp = "STACK-itfreedom-open-s-1\000s-8\000nal-611-2", '\0' <repeats 41 times> atmp2 = "Queue(\"SIP/zephyrenv_7356-1226\", \"itfreedom-answer|tr|||15\") in new stack\000pen|s|1\") in new stack\000stack", '\0' <repeats 8189 times> __PRETTY_FUNCTION__ = "pbx_extension_helper" ASTERISK-1  0x08090f39 in ast_spawn_extension (c=0xb7e649a0,    context=0xb7e64af0 "itfreedom-open", exten=0xb7e64be4 "s", priority=1,    callerid=0xb7d11ce8 "7139778787") at pbx.c:2220 No locals. ASTERISK-2  0x08091453 in __ast_pbx_run (c=0xb7e649a0) at pbx.c:2286 firstpass = 0 digit = 0 exten = '\0' <repeats 255 times> pos = 0 waittime = 0 res = 0 autoloopflag = 0 __PRETTY_FUNCTION__ = "__ast_pbx_run" ASTERISK-3  0x0809248e in pbx_thread (data=0xb7e649a0) at pbx.c:2507 c = (struct ast_channel *) 0xb7e649a0 ASTERISK-4  0x004e29a0 in pthread_start_thread ()   from /lib/obsolete/linuxthreads/i686/libpthread.so.0 No symbol table info available. ASTERISK-5  0x001dbcea in clone () from /lib/obsolete/linuxthreads/i686/libc.so.6 No symbol table info available. By: Tilghman Lesher (tilghman) 2005-12-05 20:13:42.000-0600 What's the platform/architecture/distribution this is running on? By: Carey Jung (careyj) 2005-12-05 21:50:19.000-0600 Dual proc Athlon, 4GB RAM, Fedora Core 4. By: Tilghman Lesher (tilghman) 2005-12-05 22:16:51.000-0600 What the latest backtrace is telling me is that you're getting some severe memory corruption.  This could be due to a programming error, although I doubt it, as you're the only one reporting this error.  The error you're getting simply can't occur as the code is written.  Might you be able to a) run a memory test on this machine, b) swap out machines, or c) swap out the memory in this machine? The other thing that concerns me is that your libraries are all running out of /lib/obsolete.  Would it be possible to remove the setting of LD_ASSUME_KERNEL= line from your startup script? The third thing I'm seeing is that sometimes your process is getting killed by Signal 11, but sometimes it is also getting killed by signal 9.  Unless something is seriously wrong with your system, or you're killing the process with a kill -KILL <pid>, you shouldn't ever be getting Signal 9 killing your Asterisk process. By: Mark Spencer (markster) 2005-12-20 02:26:55.000-0600 Does the crash occur during, immediately after, or some time after a reload? By: Carey Jung (careyj) 2005-12-20 09:49:15.000-0600 It's been a while....  The most recent crashes have occurred right during or after a reload. By: Russell Bryant (russell) 2005-12-20 14:01:51.000-0600 Is there anything in the kernel log after this crash occurs? After reading Corydon's observation that Asterisk is receiving signal 9, I am wondering if something like ExecShield (which is included in Fedora) is killing Asterisk. http://www.redhat.com/f/pdf/rhel/WHP0006US_Execshield.pdf http://cvs.fedora.redhat.com/viewcvs/rpms/kernel/devel/linux-2.6-execshield.patch?rev=1.4&view=log By: Tilghman Lesher (tilghman) 2006-01-05 17:16:00.000-0600 Suspended due to lack of response.