[Home]

Summary:ASTERISK-14834: Console flood & CPU load 100% when IAX2 channel falls
Reporter:newborn (newborn)Labels:
Date Opened:2009-09-15 06:44:48Date Closed:2011-06-04 10:12:08
Priority:MajorRegression?No
Status:Closed/CompleteComponents:Channels/chan_iax2
Versions:Frequency of
Occurrence
Related
Issues:
Environment:Attachments:
Description:Detected 100% CPU Load and console errors flooding when IAX2 connection failed (due to a telecommunication problem between offices)

****** ADDITIONAL INFORMATION ******

[Sep 15 15:17:08] WARNING[4825]: chan_iax2.c:2442 __attempt_transmit: Max retries exceeded to host 192.168.7.10 on IAX2/msk02-929 (type = 6, subclass = 11, ts=340023, seqno=76)
[Sep 15 15:17:08] WARNING[3948]: channel.c:1038 __ast_queue_frame: Exceptionally long voice queue length queuing to Local/11709@internal-ee8b;2
[Sep 15 15:17:08] WARNING[3948]: channel.c:1038 __ast_queue_frame: Exceptionally long voice queue length queuing to Local/11709@internal-ee8b;2
[Sep 15 15:17:08] WARNING[3948]: channel.c:1038 __ast_queue_frame: Exceptionally long voice queue length queuing to Local/11709@internal-ee8b;2
[Sep 15 15:17:08] WARNING[3948]: channel.c:1038 __ast_queue_frame: Exceptionally long voice queue length queuing to Local/11709@internal-ee8b;2
[Sep 15 15:17:08] WARNING[3948]: channel.c:1038 __ast_queue_frame: Exceptionally long voice queue length queuing to Local/11709@internal-ee8b;2
[Sep 15 15:17:08] WARNING[3948]: channel.c:1038 __ast_queue_frame: Exceptionally long voice queue length queuing to Local/11709@internal-ee8b;2
[Sep 15 15:17:08] WARNING[3948]: channel.c:1038 __ast_queue_frame: Exceptionally long voice queue length queuing to Local/11709@internal-ee8b;2
[Sep 15 15:17:08] WARNING[3948]: channel.c:1038 __ast_queue_frame: Exceptionally long voice queue length queuing to Local/11709@internal-ee8b;2
[Sep 15 15:17:08] WARNING[3948]: channel.c:1038 __ast_queue_frame: Exceptionally long voice queue length queuing to Local/11709@internal-ee8b;2
[Sep 15 15:17:08] WARNING[3948]: channel.c:1038 __ast_queue_frame: Exceptionally long voice queue length queuing to Local/11709@internal-ee8b;2
[Sep 15 15:17:08] WARNING[3948]: channel.c:1038 __ast_queue_frame: Exceptionally long voice queue length queuing to Local/11709@internal-ee8b;2
[Sep 15 15:17:08] WARNING[3948]: channel.c:1038 __ast_queue_frame: Exceptionally long voice queue length queuing to Local/11709@internal-ee8b;2
[Sep 15 15:17:08] WARNING[3948]: channel.c:1038 __ast_queue_frame: Exceptionally long voice queue length queuing to Local/11709@internal-ee8b;2
[Sep 15 15:17:08] WARNING[3948]: channel.c:1038 __ast_queue_frame: Exceptionally long voice queue length queuing to Local/11709@internal-ee8b;2
[Sep 15 15:17:08] WARNING[3948]: channel.c:1038 __ast_queue_frame: Exceptionally long voice queue length queuing to Local/11709@internal-ee8b;2
[Sep 15 15:17:08] WARNING[4786]: chan_iax2.c:2442 __attempt_transmit: Max retries exceeded to host 192.168.7.10 on IAX2/msk02-3894 (type = 6, subclass = 11, ts=289992, seqno=62)
[Sep 15 15:17:08] WARNING[3948]: channel.c:1038 __ast_queue_frame: Exceptionally long voice queue length queuing to Local/11709@internal-ee8b;2
[Sep 15 15:17:08] WARNING[3948]: channel.c:1038 __ast_queue_frame: Exceptionally long voice queue length queuing to Local/11709@internal-ee8b;2
[Sep 15 15:17:08] WARNING[3948]: channel.c:1038 __ast_queue_frame: Exceptionally long voice queue length queuing to Local/11709@internal-ee8b;2
[Sep 15 15:17:08] WARNING[3948]: channel.c:1038 __ast_queue_frame: Exceptionally long voice queue length queuing to Local/11709@internal-ee8b;2
[Sep 15 15:17:08] WARNING[3948]: channel.c:1038 __ast_queue_frame: Exceptionally long voice queue length queuing to Local/11709@internal-ee8b;2


and so on.
Comments:By: Leif Madsen (lmadsen) 2009-09-15 12:00:21

Are you able to reproduce this easily? If so, can you provide the exact steps, iax.conf configuration, and relative dialplan in order to make this easy to reproduce?

Thanks!

By: newborn (newborn) 2009-09-16 00:43:05

I cannot reproduce it because it's in production.

Here is iax.conf

[msk02]
type=friend
username=msk01
secret=34v1m9
auth=md5
host=192.168.7.10
context=iaxpeer
peercontext=iaxpeer
qualify=yes
;trunk=yes
disallow=all
allow=alaw;ulaw
;allow=g722
;ipaddr=192.168.1.110
accountcode=iax
port=4569
forcejitterbuffer=yes
;trunk=yes
;trunkfreq=20
;trunktimestamps=yes
iaxthreads=10
iaxmaxthreads=100
maxjitterbuffer=500
maxjitterinterps=10
resyncthresold=1000
mohinterpret=default

By: superbeef (superbeef) 2009-09-16 12:55:03

I'm having a similar issue with 1.4.26.1.

The dialplan calls a ringgroup, which dials an extension remote 1.2.x PBX's via IAX.   Happens every hour or two.    System load gets so intense that logging stops.

16 12:45:50] WARNING[18964] channel.c: Exceptionally long voice queue length queuing to Local/5742@from-i
nternal-bb9e,2
[Sep 16 12:45:50] WARNING[18964] channel.c: Exceptionally long voice queue length queuing to Local/5742@from-i
nternal-bb9e,2
[Sep 16 12:45:50] WARNING[19382] channel.c: Exceptionally long voice queue length queuing to Local/5527@from-i
nternal-e2ad,2
[Sep 16 12:45:50] WARNING[19480] channel.c: Exceptionally long voice queue length queuing to Local/5828@from-i
nternal-aa7e,2
[Sep 16 12:45:50] WARNING[19382] channel.c: Exceptionally long voice queue length queuing to Local/5527@from-i
nternal-e2ad,2
[Sep 16 12:45:50] WARNING[19480] channel.c: Exceptionally long voice queue length queuing to Local/5828@from-i
nternal-aa7e,2
[Sep 16 12:45:50] WARNING[19382] channel.c: Exceptionally long voice queue length queuing to Local/5527@from-i
nternal-e2ad,2
[Sep 16 12:45:50] WARNING[19480] channel.c: Exceptionally long voice queue length queuing to Local/5828@from-i
nternal-aa7e,2
[Sep 16 12:45:50] WARNING[19382] channel.c: Exceptionally long voice queue length queuing to Local/5527@from-i
nternal-e2ad,2
[Sep 16 12:45:50] WARNING[19480] channel.c: Exceptionally long voice queue length queuing to Local/5828@from-i
nternal-aa7e,2
[Sep 16 12:45:50] WARNING[19382] channel.c: Exceptionally long voice queue length queuing to Local/5527@from-i
nternal-e2ad,2
[Sep 16 12:45:50] WARNING[19480] channel.c: Exceptionally long voice queue length queuing to Local/5828@from-i
nternal-aa7e,2
[Sep 16 12:45:50] WARNING[19382] channel.c: Exceptionally long voice queue length queuing to Local/5527@from-i
nternal-e2ad,2
[Sep 16 12:45:50] WARNING[19480] channel.c: Exceptionally long voice queue length queuing to Local/5828@from-i
nternal-aa7e,2
[Sep 16 12:45:50] WARNING[19382] channel.c: Exceptionally long voice queue length queuing to Local/5527@from-i
nternal-e2ad,2

By: Julien Leboeuf (yuenk) 2009-09-18 09:50:06

Same issue on 1.6.0.15
There were no such messages before upgrade from 1.6.0.10.

Both IAX end-points are in 1.6.0.15 without calltoken
1/ External Call => DAHDI => iaxaswna01
2/ iaxaswna01 => IAX2 => iaxasatna01 (Errors on iaxaswna01)
..

IAX.conf - iaxaswna01

[general]
bindport=4569
bindaddr=0.0.0.0
language=fr
bandwidth=high
disallow=all
calltokenoptional = 0.0.0.0/0.0.0.0
maxcallnumbers = 16382
allow=alaw
allow=gsm
allow=slin
allow=ulaw
codecpriority=host

[iaxasatna01]
type=friend
username=iaxaswna01
secret=xxxxxxxx
auth=plaintext
context=fromiax
peercontext=fromiax
qualify=yes
trunk=no
host=1.10.0.2
bindport=4569
requirecalltoken=no

****

[Sep 18 15:34:23] WARNING[3287] channel.c: Exceptionally long voice queue length queuing to IAX2/iaxasatna01-8583
[Sep 18 15:34:23] WARNING[3285] channel.c: Exceptionally long voice queue length queuing to IAX2/iaxasatna01-8583
[Sep 18 15:34:23] WARNING[3290] channel.c: Exceptionally long voice queue length queuing to IAX2/iaxasatna01-8583
[Sep 18 15:34:23] WARNING[3281] channel.c: Exceptionally long voice queue length queuing to IAX2/iaxasatna01-8583
[Sep 18 15:34:23] WARNING[3286] channel.c: Exceptionally long voice queue length queuing to IAX2/iaxasatna01-8583
[Sep 18 15:35:54] WARNING[3286] channel.c: Exceptionally long voice queue length queuing to IAX2/iaxasatna01-1187
[Sep 18 15:35:54] WARNING[3286] channel.c: Exceptionally long voice queue length queuing to IAX2/iaxasatna01-1187
[Sep 18 15:35:55] WARNING[3286] channel.c: Exceptionally long voice queue length queuing to IAX2/iaxasatna01-1187
[Sep 18 15:35:55] WARNING[3284] channel.c: Exceptionally long voice queue length queuing to IAX2/iaxasatna01-1187
[Sep 18 15:35:55] WARNING[3289] channel.c: Exceptionally long voice queue length queuing to IAX2/iaxasatna01-1187
[Sep 18 15:35:55] WARNING[3282] channel.c: Exceptionally long voice queue length queuing to IAX2/iaxasatna01-1187
[Sep 18 15:37:03] WARNING[3283] channel.c: Exceptionally long voice queue length queuing to IAX2/iaxasatna01-7546
[Sep 18 15:37:03] WARNING[3284] channel.c: Exceptionally long voice queue length queuing to IAX2/iaxasatna01-7546
[Sep 18 15:37:03] WARNING[3281] channel.c: Exceptionally long voice queue length queuing to IAX2/iaxasatna01-7546
[Sep 18 15:37:03] WARNING[3286] channel.c: Exceptionally long voice queue length queuing to IAX2/iaxasatna01-7546
[Sep 18 15:37:03] WARNING[3288] channel.c: Exceptionally long voice queue length queuing to IAX2/iaxasatna01-7546

... And lots lots more...

I don't know how to reproduce these warnings, it happens really randomly.



By: Leif Madsen (lmadsen) 2009-09-18 09:51:24

Can ANYONE reproduce this issue in a lab environment and explain how to reproduce it? That is going to be the easiest way of getting this issue resolved.

By: David Brillert (aragon) 2009-09-22 15:00:07

I have a similar open ticket ASTERISK-14558
I disabled IAX2 in Asterisk and get the same WARNING messages over SIP trunk.
This is not specifically related to IAX2 as far as I can tell.

I don't know how to reproduce.

By: Leif Madsen (lmadsen) 2009-09-23 09:44:21

I'm closing this as a duplicate of 15609. Please follow any additional debugging there. Thanks!