Summary:	ASTERISK-09106: all queues disappeared
Reporter:	Peng Yong (ppyy)	Labels:
Date Opened:	2007-03-26 09:05:05	Date Closed:	2011-06-07 14:01:04
Priority:	Blocker	Regression?	No
Status:	Closed/Complete	Components:	Applications/app_queue
Versions:		Frequency of Occurrence
Related Issues:
Environment:		Attachments:	( 0) full.2007.9.16
Description:	our call center was blocked several times these days. we can't find any queues when we use "show queues", and reload also don't get back the queues. we must restart the asterisk. ****** ADDITIONAL INFORMATION ****** 1. there are some error message in the log(we only got these log just when the asterisk blocked, and we find such log every time when it is blocked): Mar 26 18:55:39 DEBUG[14786] channel.c: Dropping voice to exceptionally long queue on Local/3021@default-5bbd,1 Mar 26 18:55:39 DEBUG[14786] channel.c: Dropping voice to exceptionally long queue on Local/3021@default-5bbd,1 Mar 26 18:55:39 DEBUG[14786] channel.c: Dropping voice to exceptionally long queue on Local/3021@default-5bbd,1 Mar 26 18:55:39 DEBUG[14786] channel.c: Dropping voice to exceptionally long queue on Local/3021@default-5bbd,1 Mar 26 18:55:39 DEBUG[14786] channel.c: Dropping voice to exceptionally long queue on Local/3021@default-5bbd,1 Mar 26 18:55:39 DEBUG[14786] channel.c: Dropping voice to exceptionally long queue on Local/3021@default-5bbd,1 Mar 26 18:55:39 DEBUG[14786] channel.c: Dropping voice to exceptionally long queue on Local/3021@default-5bbd,1 Mar 26 18:55:39 DEBUG[14786] channel.c: Dropping voice to exceptionally long queue on Local/3021@default-5bbd,1 Mar 26 18:55:39 DEBUG[14786] channel.c: Dropping voice to exceptionally long queue on Local/3021@default-5bbd,1 Mar 26 18:55:39 DEBUG[14786] channel.c: Dropping voice to exceptionally long queue on Local/3021@default-5bbd,1 Mar 26 18:55:39 DEBUG[14786] channel.c: Dropping voice to exceptionally long queue on Local/3021@default-5bbd,1 Mar 26 18:55:39 DEBUG[14786] channel.c: Dropping voice to exceptionally long queue on Local/3021@default-5bbd,1 Mar 26 18:55:39 DEBUG[14786] channel.c: Dropping voice to exceptionally long queue on Local/3021@default-5bbd,1 Mar 26 18:55:40 DEBUG[14786] channel.c: Dropping voice to exceptionally long queue on Local/3021@default-5bbd,1 Mar 26 18:55:40 DEBUG[14786] channel.c: Dropping voice to exceptionally long queue on Local/3021@default-5bbd,1 Mar 26 18:55:40 DEBUG[14786] channel.c: Dropping voice to exceptionally long queue on Local/3021@default-5bbd,1 Mar 26 18:55:40 DEBUG[14786] channel.c: Dropping voice to exceptionally long queue on Local/3021@default-5bbd,1 Mar 26 18:55:40 DEBUG[14786] channel.c: Dropping voice to exceptionally long queue on Local/3021@default-5bbd,1 2. we produce the latest issue when we do a cpu tensive job, the CPU is 100%, and then the asterisk was blocked. (this is a production call center, i will try to reproduce the problem by useing 100% CPU )
Comments:	By: Serge Vecher (serge-v) 2007-03-26 10:36:31 Ok, since file is looking at something similar in 7011, please produce the following info as he requested there: " Okay, I'm going to try to get the information we need to try to track this down. Can you please open the main Makefile (assuming 1.2), locate the DEBUG_THREADS line and put in the following one: DEBUG_THREADS = -DDEBUG_THREADS -DDETECT_DEADLOCKS Also ensure it is built via make dont-optimize It would also be very helpful to know whether it would be possible to get access to the machine where this is happening so we can look at it when it occurs. Thanks! " By: Erik Johnson (erikatvsfx) 2007-06-13 18:45:12 Hello.  We are running a 1.2.18 and have exactly the same issue approximately twice per day, intermittently, only when seeing "channel.c: Dropping voice to exceptionally long queue on Local/10001@from-internal-xxxxxx" in our logs.  "Show queue 10001" and "show agents" returns nothing and a full restart is the only way to bring the system back up. This machine is a totally stock implementation of asterisk 1.2.18 with the exception of the autofill patch for app_queue.c (bug id 0005577) I have set "DEBUG_THREADS = -DDEBUG_THREADS -DDETECT_DEADLOCKS" and built via make dont-optimize. You can definitely have access to this machine, if it would help. By: Paul W (kwakwaversal) 2007-06-29 03:30:45 I have had the same issue also with this recently on asterisk 1.4.5.  We have an overflow call centre and as such many calls are sent over in the same second and when it's particularly busy the voice does indeed drop.  It didn't affect the other dynamic members so I think its one particular channel affected or possibly the phone(?). I'm trying to reproduce the problem by sending many simultaneous calls over at once.  I will update you with my findings or open a new bug. (I apologise if sending this message is wrong, I read the guidelines but didn't see anything about posting to an old post) By: Paul W (kwakwaversal) 2007-06-29 06:00:42 Ok, I managed to repeat this bug and repeatedly lock the queues. I wrote a script which sent 13 calls over IAX2 to our overflow call centre.  The overflow call centre is running * 1.4.5 and zaptel 1.4.3 for our two E1 PRI's. When everything was loaded normally, every time I sent over the calls it crashed the queue. When I unloaded zap and sent the calls over it was stable and the queue was fine. The call centre used to run asterisk 1.4.4 and the same problem happened which is why we upgraded to 1.4.5, after still encountering the same problem I took the call centre down so I could debug it "properly". I do apologise for my lack of information to debug this, if someone could be so kind as to tell me how to get useful logs to help the project I will do it (but will need to be quick because I have to bring it back up again VERY soon). I took a look at the full log I've created and nothing stands out about a possible problem. By: Alvaro Ivan Parres Peredo (arabe) 2007-07-06 19:44:24 We have this same problem on one of our call centers. We have: Asteisk 1.2.17 LIBUNICALL(MFR2) IAX Agents But we have also other that didn't have IAX agents, instead have SIP agents. By: Joshua C. Colp (jcolp) 2007-07-08 22:34:00 Okay everyone let's try to all make sense here and make sure this is all the same bug... here's what is needed: 1. Description of the setup 2. Console output with debug level set to 9, and debug set to console in logger.conf 3. If it crashes (as in segfaults) a backtrace. By: Joshua C. Colp (jcolp) 2007-08-06 12:23:36 It has been a month and nobody has given the information I listed so I'm suspending this since I can go nowhere. Feel free to reopen this issue when it is available. By: Peng Yong (ppyy) 2007-09-16 23:09:50 today our system frozone again: asterisk*CLI> show version Asterisk 1.2.18 built by root @ asterisk.yaako.org on a i686 running Linux on 2007-05-14 08:04:49 UTC By: Mark Michelson (mmichelson) 2007-09-17 09:51:43 ppyy: Version 1.2 is now in security maintenance mode, meaning that only security vulnerabilities are being fixed now. Is this issue happening in the latest 1.4? By: Mark Michelson (mmichelson) 2007-10-15 14:31:34 It's been another month with no response. Suspending again.