Summary: | ASTERISK-16351: "I should never be called!" message printed from channels/chan_iax2.c | ||
Reporter: | vieri (vieri) | Labels: | |
Date Opened: | 2010-07-12 04:21:29 | Date Closed: | 2011-07-26 15:04:53 |
Priority: | Major | Regression? | No |
Status: | Closed/Complete | Components: | Channels/chan_iax2 |
Versions: | Frequency of Occurrence | ||
Related Issues: | |||
Environment: | Attachments: | ||
Description: | Hi, Recently, one of my Asterisk servers stopped connecting calls and required a reboot to "fix it" (did not try to restart or reload). The log showed loads of this message: NOTICE[302] chan_iax2.c: I should never be called! This highly repeated message seems to be preceded by something like: WARNING[10767] channel.c: Exceptionally long voice queue length queuing to IAX2/coinbound-15879 When this happens it also seems that SIP peers on a gigabit LAN start going on/offline frequently. So that seems to explain why calls start to fail. There is absolutely nothing wrong with the network (and switches). I don't know if it can be a NIC problem on the server but it's strange because I have SIP peers on different local subnets connected to different NICs and switches. It would be a terrific coincidence that all 3 NICs I have on the server failed as well as the 3 switches... The fact that all went back to normal after rebooting the Asterisk server led me to file a bug report. I'd like to know in what circumstances chan_iax2 can log the "I should never be called!" message in 1.4.31. When that happens I usually have a lot of messages such as: NOTICE[10756] chan_sip.c: Peer '7054' is now Lagged. (2819ms / 2000ms) NOTICE[10756] chan_sip.c: Peer '7054' is now Reachable. (860ms / 2000ms) NOTICE[10756] chan_sip.c: Peer '7054' is now Lagged. (2003ms / 2000ms) NOTICE[10756] chan_sip.c: Peer '7054' is now UNREACHABLE! Last qualify: 3096 NOTICE[10756] chan_sip.c: Peer '7054' is now Lagged. (2131ms / 2000ms) Any ideas as to what may be happening and what I should do the next time it does? Thanks, Vieri | ||
Comments: | By: Leif Madsen (lmadsen) 2010-07-12 11:20:24 I'm thinking this might actually be a duplicate of issue ASTERISK-16258 -- can you confirm? By: vieri (vieri) 2010-07-12 12:49:05 Bug 17521 seems to imply that: - it happens only on "slow" connections (slow networks) - it may disappear on faster servers - it happens when transcoding G722 In my case: - all IAX2 connections are on a gigabit LAN. SIP clients are also on a gigabit LAN except for a remote SIP provider. - I'm using recent quad-core AMD processors which is more than enough for my setups. - In most cases, I'm using IAX2 to link several Asterisk boxes. SIP clients use these IAX2 trunks to place calls. They are usually alaw, ulaw and gsm. I'm not sure if my report is a duplicate. I can't easily reproduce it. If my system were to freak out again, what sys/asterisk stats ("core show locks", etc.) should I gather before rebooting (should do it quickly because it happens only on my production servers)? Thanks By: vieri (vieri) 2010-07-12 12:50:46 By the way, nobody is reporting the "I should never be called!" IAX2 message... By: Leif Madsen (lmadsen) 2010-07-12 15:18:28 I'd suggest you get console output leading up to that message, a backtrace from the running process, and 'core show locks' I suppose. Basically the more information the better. By: vieri (vieri) 2010-07-13 03:41:24 For now, I can only post console output leading to this message. If it happens again, I hope I can post more info. This is what happened on July 9th at 07:09 am: a call came in through an ISDN line (via Digium, Inc. Wildcard B410 quad-BRI card (rev 01)) to an Asterisk 1.4.31 server. The call was automatically sent to another Asterisk 1.4.31 box (the "failing" server reported here) over a IAX2 trunk (IAX2/coinbound) on a gigabit LAN. This box then dialed an external extension via a PRI link (g1/7060 below). This was the first time the "I should never be called!" message came up (it then happened over and over for more than 1 hour, accompanied by the "lagged" messages until someone eventually rebooted the server because people were noticing long delays in their conversations and some peers started to be unreachable). In this case, Zap/1-1 actually managed to answer IAX2/coinbound so the call was established. [Jul 9 07:09:44] VERBOSE[19371] logger.c: -- Called g1/7060 [Jul 9 07:09:44] VERBOSE[19371] logger.c: -- Zap/1-1 is proceeding passing it to IAX2/coinbound-16087 [Jul 9 07:09:44] WARNING[10761] channel.c: Exceptionally long voice queue length queuing to IAX2/coinbound-16087 [Jul 9 07:09:44] VERBOSE[19371] logger.c: -- Zap/1-1 is ringing [Jul 9 07:09:44] VERBOSE[19371] logger.c: -- IAX2/coinbound-16087 requested special control 20, passing it to Zap/1-1 [Jul 9 07:09:44] VERBOSE[19371] logger.c: -- IAX2/coinbound-16087 requested special control 20, passing it to Zap/1-1 [Jul 9 07:09:44] NOTICE[19371] chan_iax2.c: I should never be called! [Jul 9 07:09:44] NOTICE[19371] chan_iax2.c: I should never be called! [Jul 9 07:09:44] NOTICE[19371] chan_iax2.c: I should never be called! [Jul 9 07:09:44] NOTICE[19371] chan_iax2.c: I should never be called! [Jul 9 07:09:44] NOTICE[19371] chan_iax2.c: I should never be called! [Jul 9 07:09:44] NOTICE[19371] chan_iax2.c: I should never be called! [Jul 9 07:09:44] NOTICE[19371] chan_iax2.c: I should never be called! [Jul 9 07:09:44] NOTICE[19371] chan_iax2.c: I should never be called! [Jul 9 07:09:44] NOTICE[19371] chan_iax2.c: I should never be called! [Jul 9 07:09:44] NOTICE[19371] chan_iax2.c: I should never be called! [Jul 9 07:09:44] NOTICE[19371] chan_iax2.c: I should never be called! [Jul 9 07:09:44] NOTICE[19371] chan_iax2.c: I should never be called! [Jul 9 07:09:44] NOTICE[19371] chan_iax2.c: I should never be called! [Jul 9 07:09:44] NOTICE[19371] chan_iax2.c: I should never be called! [Jul 9 07:09:44] NOTICE[19371] chan_iax2.c: I should never be called! [Jul 9 07:09:44] NOTICE[19371] chan_iax2.c: I should never be called! [Jul 9 07:09:44] NOTICE[19371] chan_iax2.c: I should never be called! [Jul 9 07:09:44] NOTICE[19371] chan_iax2.c: I should never be called! [Jul 9 07:09:44] NOTICE[19371] chan_iax2.c: I should never be called! [Jul 9 07:09:44] NOTICE[19371] chan_iax2.c: I should never be called! [Jul 9 07:09:44] NOTICE[19371] chan_iax2.c: I should never be called! [Jul 9 07:09:44] NOTICE[19371] chan_iax2.c: I should never be called! [Jul 9 07:09:44] NOTICE[19371] chan_iax2.c: I should never be called! [Jul 9 07:09:44] NOTICE[19371] chan_iax2.c: I should never be called! [Jul 9 07:09:44] NOTICE[19371] chan_iax2.c: I should never be called! [Jul 9 07:09:44] NOTICE[19371] chan_iax2.c: I should never be called! [Jul 9 07:09:44] NOTICE[19371] chan_iax2.c: I should never be called! [Jul 9 07:09:44] NOTICE[19371] chan_iax2.c: I should never be called! [Jul 9 07:09:44] NOTICE[19371] chan_iax2.c: I should never be called! [Jul 9 07:09:44] NOTICE[19371] chan_iax2.c: I should never be called! [Jul 9 07:09:44] NOTICE[19371] chan_iax2.c: I should never be called! [Jul 9 07:09:44] NOTICE[19371] chan_iax2.c: I should never be called! [Jul 9 07:09:44] NOTICE[19371] chan_iax2.c: I should never be called! [Jul 9 07:09:44] NOTICE[19371] chan_iax2.c: I should never be called! [Jul 9 07:09:44] NOTICE[19371] chan_iax2.c: I should never be called! [Jul 9 07:09:44] NOTICE[19371] chan_iax2.c: I should never be called! [Jul 9 07:09:44] NOTICE[19371] chan_iax2.c: I should never be called! [Jul 9 07:09:44] NOTICE[19371] chan_iax2.c: I should never be called! [Jul 9 07:09:44] NOTICE[19371] chan_iax2.c: I should never be called! [Jul 9 07:09:44] NOTICE[19371] chan_iax2.c: I should never be called! [Jul 9 07:09:44] NOTICE[19371] chan_iax2.c: I should never be called! [Jul 9 07:09:44] VERBOSE[19371] logger.c: -- IAX2/coinbound-16087 requested special control 20, passing it to Zap/1-1 [Jul 9 07:09:44] VERBOSE[19371] logger.c: -- IAX2/coinbound-16087 requested special control 20, passing it to Zap/1-1 [Jul 9 07:09:50] DEBUG[10775] chan_dahdi.c: Echo cancellation already on [Jul 9 07:09:50] VERBOSE[19371] logger.c: -- Zap/1-1 answered IAX2/coinbound-16087 By the way, Asterisk 1.4.31 was compiled with "DONT_OPTIMIZE DEBUG_CHANNEL_LOCKS DEBUG_THREADS MALLOC_DEBUG DEBUG_FD_LEAKS". By: vieri (vieri) 2010-07-16 03:17:34 I got the famous messages again: "Exceptionally long voice queue length queuing to IAX2!" and "chan_iax2.c: I should never be called!" However, this time it just happened once and did not affect overall performance. I'm posting this to see if someone can tell me if there's something I should worry about. This time the scenario was simple: a fax call went in through an ISDN line connected to Asterisk. The call was bridged to a local IAX2 extension (iaxmodem). No trunks involved so no network latency. I realize that in this case iaxmodem may be the culprit but in my previous post, iaxmodem was not involved. Anyway, I still get the "chan_iax2.c: I should never be called!" message (repeated several times as you can see below). Recorded at Thu Jul 15 17:28:42 CEST 2010: Asterisk log: [Jul 15 17:25:16] VERBOSE[25149] logger.c: -- Called 10001/<NUMBER> [Jul 15 17:25:16] VERBOSE[11163] logger.c: -- Call accepted by 127.0.0.1 (format alaw) [Jul 15 17:25:16] VERBOSE[11163] logger.c: -- Format for call is alaw [Jul 15 17:25:16] VERBOSE[25149] logger.c: -- IAX2/10001-4937 is ringing [Jul 15 17:25:16] VERBOSE[25149] logger.c: -- IAX2/10001-4937 answered mISDN/2-u2680 [Jul 15 17:25:18] DEBUG[25149] chan_misdn.c: Detected inband DTMF digit: f [Jul 15 17:25:18] DEBUG[25149] chan_misdn.c: Already in a fax extension, not redirecting [Jul 15 17:25:47] WARNING[11165] channel.c: Exceptionally long voice queue length queuing to IAX2/10001-4937 [Jul 15 17:25:47] NOTICE[25149] chan_iax2.c: I should never be called! [Jul 15 17:25:47] NOTICE[25149] chan_iax2.c: I should never be called! [Jul 15 17:25:47] NOTICE[25149] chan_iax2.c: I should never be called! [Jul 15 17:25:47] NOTICE[25149] chan_iax2.c: I should never be called! [Jul 15 17:25:47] NOTICE[25149] chan_iax2.c: I should never be called! [Jul 15 17:25:47] NOTICE[25149] chan_iax2.c: I should never be called! [Jul 15 17:25:47] NOTICE[25149] chan_iax2.c: I should never be called! [Jul 15 17:25:47] NOTICE[25149] chan_iax2.c: I should never be called! [Jul 15 17:25:47] NOTICE[25149] chan_iax2.c: I should never be called! [Jul 15 17:25:47] NOTICE[25149] chan_iax2.c: I should never be called! [Jul 15 17:25:47] NOTICE[25149] chan_iax2.c: I should never be called! [Jul 15 17:25:47] NOTICE[25149] chan_iax2.c: I should never be called! [Jul 15 17:25:47] NOTICE[25149] chan_iax2.c: I should never be called! [Jul 15 17:25:47] NOTICE[25149] chan_iax2.c: I should never be called! [Jul 15 17:25:47] NOTICE[25149] chan_iax2.c: I should never be called! [Jul 15 17:25:47] NOTICE[25149] chan_iax2.c: I should never be called! [Jul 15 17:25:47] NOTICE[25149] chan_iax2.c: I should never be called! [Jul 15 17:25:47] NOTICE[25149] chan_iax2.c: I should never be called! [Jul 15 17:25:47] NOTICE[25149] chan_iax2.c: I should never be called! [Jul 15 17:25:47] NOTICE[25149] chan_iax2.c: I should never be called! [Jul 15 17:25:47] NOTICE[25149] chan_iax2.c: I should never be called! [Jul 15 17:25:47] NOTICE[25149] chan_iax2.c: I should never be called! [Jul 15 17:25:47] NOTICE[25149] chan_iax2.c: I should never be called! [Jul 15 17:25:47] NOTICE[25149] chan_iax2.c: I should never be called! [Jul 15 17:25:47] NOTICE[25149] chan_iax2.c: I should never be called! [Jul 15 17:25:47] NOTICE[25149] chan_iax2.c: I should never be called! [Jul 15 17:25:47] NOTICE[25149] chan_iax2.c: I should never be called! [Jul 15 17:25:47] NOTICE[25149] chan_iax2.c: I should never be called! [Jul 15 17:25:47] NOTICE[25149] chan_iax2.c: I should never be called! [Jul 15 17:25:47] NOTICE[25149] chan_iax2.c: I should never be called! [Jul 15 17:25:47] NOTICE[25149] chan_iax2.c: I should never be called! [Jul 15 17:25:47] NOTICE[25149] chan_iax2.c: I should never be called! [Jul 15 17:25:47] NOTICE[25149] chan_iax2.c: I should never be called! [Jul 15 17:25:47] NOTICE[25149] chan_iax2.c: I should never be called! [Jul 15 17:25:47] NOTICE[25149] chan_iax2.c: I should never be called! [Jul 15 17:25:47] NOTICE[25149] chan_iax2.c: I should never be called! [Jul 15 17:25:47] NOTICE[25149] chan_iax2.c: I should never be called! [Jul 15 17:25:47] NOTICE[25149] chan_iax2.c: I should never be called! [Jul 15 17:25:47] NOTICE[25149] chan_iax2.c: I should never be called! [Jul 15 17:25:47] NOTICE[25149] chan_iax2.c: I should never be called! [Jul 15 17:25:47] NOTICE[25149] chan_iax2.c: I should never be called! [Jul 15 17:25:47] NOTICE[25149] chan_iax2.c: I should never be called! [Jul 15 17:25:47] NOTICE[25149] chan_iax2.c: I should never be called! [Jul 15 17:25:47] NOTICE[25149] chan_iax2.c: I should never be called! [Jul 15 17:25:47] NOTICE[25149] chan_iax2.c: I should never be called! [Jul 15 17:25:47] NOTICE[25149] chan_iax2.c: I should never be called! [Jul 15 17:25:47] NOTICE[25149] chan_iax2.c: I should never be called! [Jul 15 17:25:47] NOTICE[25149] chan_iax2.c: I should never be called! [Jul 15 17:25:47] NOTICE[25149] chan_iax2.c: I should never be called! [Jul 15 17:25:47] NOTICE[25149] chan_iax2.c: I should never be called! [Jul 15 17:25:47] NOTICE[25149] chan_iax2.c: I should never be called! [Jul 15 17:25:47] NOTICE[25149] chan_iax2.c: I should never be called! [Jul 15 17:25:47] NOTICE[25149] chan_iax2.c: I should never be called! [Jul 15 17:25:47] NOTICE[25149] chan_iax2.c: I should never be called! [Jul 15 17:25:47] NOTICE[25149] chan_iax2.c: I should never be called! [Jul 15 17:25:47] NOTICE[25149] chan_iax2.c: I should never be called! [Jul 15 17:25:47] NOTICE[25149] chan_iax2.c: I should never be called! [Jul 15 17:25:47] NOTICE[25149] chan_iax2.c: I should never be called! [Jul 15 17:25:47] NOTICE[25149] chan_iax2.c: I should never be called! [Jul 15 17:25:47] NOTICE[25149] chan_iax2.c: I should never be called! [Jul 15 17:25:47] NOTICE[25149] chan_iax2.c: I should never be called! [Jul 15 17:25:47] NOTICE[25149] chan_iax2.c: I should never be called! [Jul 15 17:25:47] NOTICE[25149] chan_iax2.c: I should never be called! ... [Jul 15 17:27:00] VERBOSE[25149] logger.c: -- Hungup 'IAX2/10001-4937' [Jul 15 17:27:00] VERBOSE[25149] logger.c: == Spawn extension (from-pstn, fax, 56) exited non-zero on 'mISDN/2-u2680' [Jul 15 17:27:00] DEBUG[25149] chan_misdn.c: misdn_hangup(mISDN/2-u2680) CORE SHOW LOCKS: ======================================================================= === Currently Held Locks ============================================== ======================================================================= === === <file> <line num> <function> <lock name> <lock addr> (times locked) === ======================================================================= CORE SHOW FD: Current maxfiles: unlimited 3 asterisk.c:1071 (ast_makesocket ): socket(PF_UNIX,SOCK_STREAM,"tcp") 4 logger.c:267 (make_logchannel ): fopen("/var/log/asterisk/full","a") 5 logger.c:435 (reload_logger ): fopen("/var/log/asterisk/event_log","a") 6 logger.c:463 (reload_logger ): fopen("/var/log/asterisk/queue_log","a") 7 manager.c:3292 (init_manager ): socket(PF_INET,SOCK_STREAM,"tcp") 10 chan_iax2.c:12715 (load_module ): open("/dev/zap/timer",2) 11 netsock.c:132 (ast_netsock_bindaddr ): socket(PF_INET,SOCK_DGRAM,"udp") 12 chan_skinny.c:4824 (reload_config ): socket(PF_INET,SOCK_STREAM,"tcp") 24 pbx_dundi.c:4643 (load_module ): socket(PF_INET,SOCK_DGRAM,"udp") 27 chan_sip.c:18789 (reload_config ): socket(PF_INET,SOCK_DGRAM,"udp") 28 chan_dahdi.c:1225 (dahdi_open ): open("/dev/zap/channel",2050) 29 chan_dahdi.c:1225 (dahdi_open ): open("/dev/zap/channel",2050) 30 chan_dahdi.c:1225 (dahdi_open ): open("/dev/zap/channel",2050) 31 chan_dahdi.c:1225 (dahdi_open ): open("/dev/zap/channel",2050) 32 chan_dahdi.c:1225 (dahdi_open ): open("/dev/zap/channel",2050) 33 chan_dahdi.c:1225 (dahdi_open ): open("/dev/zap/channel",2050) 34 chan_dahdi.c:1225 (dahdi_open ): open("/dev/zap/channel",2050) 35 chan_dahdi.c:1225 (dahdi_open ): open("/dev/zap/channel",2050) 36 chan_dahdi.c:1225 (dahdi_open ): open("/dev/zap/channel",2050) 37 chan_dahdi.c:1225 (dahdi_open ): open("/dev/zap/channel",2050) 38 chan_dahdi.c:1225 (dahdi_open ): open("/dev/zap/channel",2050) 39 chan_dahdi.c:1225 (dahdi_open ): open("/dev/zap/channel",2050) 40 chan_dahdi.c:1225 (dahdi_open ): open("/dev/zap/channel",2050) 41 chan_dahdi.c:1225 (dahdi_open ): open("/dev/zap/channel",2050) 42 chan_dahdi.c:1225 (dahdi_open ): open("/dev/zap/channel",2050) 43 chan_dahdi.c:1225 (dahdi_open ): open("/dev/zap/channel",2050) 44 chan_dahdi.c:1225 (dahdi_open ): open("/dev/zap/channel",2050) 45 chan_dahdi.c:1225 (dahdi_open ): open("/dev/zap/channel",2050) 46 chan_dahdi.c:1225 (dahdi_open ): open("/dev/zap/channel",2050) 47 chan_dahdi.c:1225 (dahdi_open ): open("/dev/zap/channel",2050) 48 chan_dahdi.c:1225 (dahdi_open ): open("/dev/zap/channel",2050) 49 chan_dahdi.c:1225 (dahdi_open ): open("/dev/zap/channel",2050) 50 chan_dahdi.c:1225 (dahdi_open ): open("/dev/zap/channel",2050) 51 chan_dahdi.c:1225 (dahdi_open ): open("/dev/zap/channel",2050) 52 chan_dahdi.c:1225 (dahdi_open ): open("/dev/zap/channel",2050) 53 chan_dahdi.c:1225 (dahdi_open ): open("/dev/zap/channel",2050) 54 chan_dahdi.c:1225 (dahdi_open ): open("/dev/zap/channel",2050) 55 chan_dahdi.c:1225 (dahdi_open ): open("/dev/zap/channel",2050) 56 chan_dahdi.c:1225 (dahdi_open ): open("/dev/zap/channel",2050) 57 chan_dahdi.c:1225 (dahdi_open ): open("/dev/zap/channel",2050) 58 chan_dahdi.c:10060 (start_pri ): open("/dev/zap/channel",2) 59 chan_mgcp.c:4262 (reload_config ): socket(PF_INET,SOCK_DGRAM,"udp") 60 asterisk.c:3191 (main ): pipe({60,61}) 61 asterisk.c:3191 (main ): pipe({60,61}) 62 astmm.c:498 (__ast_mm_init ): fopen("/var/log/asterisk/mmlog","a+") 64 rtp.c:1950 (rtp_socket ): socket(PF_INET,SOCK_DGRAM,"udp") 65 rtp.c:1950 (rtp_socket ): socket(PF_INET,SOCK_DGRAM,"udp") 66 udptl.c:786 (_udptl_new_with_bindaddr ): socket(PF_INET,SOCK_DGRAM,"udp") 67 channel.c:761 (ast_channel_alloc ): pipe({67,68}) 68 channel.c:761 (ast_channel_alloc ): pipe({67,68}) 69 rtp.c:1950 (rtp_socket ): socket(PF_INET,SOCK_DGRAM,"udp") 70 rtp.c:1950 (rtp_socket ): socket(PF_INET,SOCK_DGRAM,"udp") 71 udptl.c:786 (_udptl_new_with_bindaddr ): socket(PF_INET,SOCK_DGRAM,"udp") 72 channel.c:761 (ast_channel_alloc ): pipe({72,73}) 73 channel.c:761 (ast_channel_alloc ): pipe({72,73}) SHOW CHANNELS: SIP/sipprovider-0000068d!from-trunk-sip-sipprovider!!1!Up!AppDial!(Outgoing Line)!<NUMBER>!!3!34!Zap/24-1 Zap/24-1!macro-dialout-trunk!s!19!Up!Dial!SIP/sipprovider/<NUMBER>|300|TWf!6135!!3!34!SIP/sipprovider-0000068d SIP/sipprovider-0000068c!from-trunk-sip-sipprovider!!1!Up!AppDial!(Outgoing Line)!<NUMBER2>!!3!75!Zap/23-1 Zap/23-1!macro-dialout-trunk!s!19!Up!Dial!SIP/sipprovider/<NUMBER2>|300|TWf!6079!!3!75!SIP/sipprovider-0000068c IAX2 SHOW NETSTATS: -------- LOCAL --------------------- -------- REMOTE -------------------- Channel RTT Jit Del Lost % Drop OOO Kpkts Jit Del Lost % Drop OOO Kpkts FirstMsg LastMsg 0 active IAX channels IAX2 SHOW STATS: IAX Statistics --------------------- Outstanding frames: 0 (0 ingress, 0 egress) Packets in transmit queue: 0 dead, 0 final, 0 total IAX2 SHOW THREADS: IAX2 Thread Information Idle Threads: Thread 6: state=0, update=4, actions=1073139, func ='' Thread 9: state=0, update=4, actions=1073197, func ='' Thread 8: state=0, update=4, actions=1073177, func ='' Thread 7: state=0, update=4, actions=1073020, func ='' Thread 5: state=0, update=4, actions=1073278, func ='' Thread 3: state=0, update=4, actions=1073200, func ='' Thread 4: state=0, update=4, actions=1073232, func ='' Thread 2: state=0, update=4, actions=1073098, func ='' Thread 1: state=0, update=4, actions=1073204, func ='' Thread 10: state=0, update=4, actions=1073100, func ='' Active Threads: Dynamic Threads: Thread 2001: state=0, update=28, actions=2, func ='' 10 of 10 threads accounted for with 1 dynamic threads SYS PROCESSES: USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND root 1 0.0 0.0 1676 588 ? Ss Jul13 0:04 init [3] root 2 0.0 0.0 0 0 ? S< Jul13 0:00 [kthreadd] root 3 0.0 0.0 0 0 ? S< Jul13 0:00 [migration/0] root 4 0.0 0.0 0 0 ? S< Jul13 0:00 [ksoftirqd/0] root 5 0.0 0.0 0 0 ? S< Jul13 0:00 [migration/1] root 6 0.0 0.0 0 0 ? S< Jul13 0:00 [ksoftirqd/1] root 7 0.0 0.0 0 0 ? S< Jul13 0:00 [migration/2] root 8 0.0 0.0 0 0 ? S< Jul13 0:00 [ksoftirqd/2] root 9 0.0 0.0 0 0 ? S< Jul13 0:00 [migration/3] root 10 0.0 0.0 0 0 ? S< Jul13 0:00 [ksoftirqd/3] root 11 0.0 0.0 0 0 ? S< Jul13 0:03 [events/0] root 12 0.0 0.0 0 0 ? S< Jul13 0:04 [events/1] root 13 0.0 0.0 0 0 ? S< Jul13 0:03 [events/2] root 14 0.0 0.0 0 0 ? S< Jul13 0:03 [events/3] root 15 0.0 0.0 0 0 ? S< Jul13 0:00 [khelper] root 64 0.0 0.0 0 0 ? S< Jul13 0:02 [kblockd/0] root 65 0.0 0.0 0 0 ? S< Jul13 0:02 [kblockd/1] root 66 0.0 0.0 0 0 ? S< Jul13 0:00 [kblockd/2] root 67 0.0 0.0 0 0 ? S< Jul13 0:00 [kblockd/3] root 71 0.0 0.0 0 0 ? S< Jul13 0:00 [kacpid] root 72 0.0 0.0 0 0 ? S< Jul13 0:00 [kacpi_notify] root 206 0.0 0.0 0 0 ? S< Jul13 0:00 [kseriod] root 253 0.0 0.0 0 0 ? S Jul13 0:00 [pdflush] root 254 0.0 0.0 0 0 ? S Jul13 0:01 [pdflush] root 255 0.0 0.0 0 0 ? S< Jul13 0:00 [kswapd0] root 256 0.0 0.0 0 0 ? S< Jul13 0:00 [aio/0] root 257 0.0 0.0 0 0 ? S< Jul13 0:00 [aio/1] root 258 0.0 0.0 0 0 ? S< Jul13 0:00 [aio/2] root 259 0.0 0.0 0 0 ? S< Jul13 0:00 [aio/3] root 260 0.0 0.0 0 0 ? S< Jul13 0:00 [xfslogd/0] root 261 0.0 0.0 0 0 ? S< Jul13 0:00 [xfslogd/1] root 262 0.0 0.0 0 0 ? S< Jul13 0:00 [xfslogd/2] root 263 0.0 0.0 0 0 ? S< Jul13 0:00 [xfslogd/3] root 264 0.0 0.0 0 0 ? S< Jul13 0:00 [xfsdatad/0] root 265 0.0 0.0 0 0 ? S< Jul13 0:00 [xfsdatad/1] root 266 0.0 0.0 0 0 ? S< Jul13 0:00 [xfsdatad/2] root 267 0.0 0.0 0 0 ? S< Jul13 0:00 [xfsdatad/3] root 268 0.0 0.0 0 0 ? S< Jul13 0:00 [xfs_mru_cache] root 435 0.0 0.0 0 0 ? S< Jul13 0:00 [kpsmoused] root 442 0.0 0.0 0 0 ? S< Jul13 0:01 [kirqd] root 916 0.0 0.0 0 0 ? S< Jul13 0:00 [ksuspend_usbd] root 922 0.0 0.0 0 0 ? S< Jul13 0:00 [khubd] root 1405 0.0 0.0 0 0 ? S< Jul13 0:00 [khpsbpkt] root 1892 0.0 0.0 0 0 ? S< Jul13 0:00 [ata/0] root 1893 0.0 0.0 0 0 ? S< Jul13 0:00 [ata/1] root 1894 0.0 0.0 0 0 ? S< Jul13 0:00 [ata/2] root 1895 0.0 0.0 0 0 ? S< Jul13 0:00 [ata/3] root 1896 0.0 0.0 0 0 ? S< Jul13 0:00 [ata_aux] asterisk 2317 0.0 0.2 31780 8548 ? S 03:12 0:00 /usr/sbin/apache2 -D DEFAULT_VHOST -D INFO -D LANGUAGE -D MANUAL -D SSL -D SSL_DEFAULT_VHOST -D SUEXEC -D PHP5 -d /usr/lib/apache2 -f /etc/apache2/httpd.conf -k start asterisk 2324 0.0 0.5 263088 22912 ? Sl 03:12 0:00 /usr/sbin/apache2 -D DEFAULT_VHOST -D INFO -D LANGUAGE -D MANUAL -D SSL -D SSL_DEFAULT_VHOST -D SUEXEC -D PHP5 -d /usr/lib/apache2 -f /etc/apache2/httpd.conf -k start asterisk 2325 0.0 0.5 263096 22904 ? Sl 03:12 0:00 /usr/sbin/apache2 -D DEFAULT_VHOST -D INFO -D LANGUAGE -D MANUAL -D SSL -D SSL_DEFAULT_VHOST -D SUEXEC -D PHP5 -d /usr/lib/apache2 -f /etc/apache2/httpd.conf -k start root 3020 0.0 0.0 0 0 ? S< Jul13 0:00 [scsi_eh_0] root 3022 0.0 0.0 0 0 ? S< Jul13 0:00 [scsi_eh_1] root 3024 0.0 0.0 0 0 ? S< Jul13 0:00 [scsi_eh_2] root 3026 0.0 0.0 0 0 ? S< Jul13 0:00 [scsi_eh_3] root 3646 0.0 0.0 0 0 ? S< Jul13 0:00 [ksnapd] root 3797 0.0 0.0 0 0 ? S< Jul13 0:00 [dm-bbr/0] root 3798 0.0 0.0 0 0 ? S< Jul13 0:00 [dm-bbr/1] root 3799 0.0 0.0 0 0 ? S< Jul13 0:00 [dm-bbr/2] root 3800 0.0 0.0 0 0 ? S< Jul13 0:00 [dm-bbr/3] root 4033 0.0 0.0 0 0 ? S< Jul13 0:00 [jfsIO] root 4034 0.0 0.0 0 0 ? S< Jul13 0:00 [jfsCommit] root 4035 0.0 0.0 0 0 ? S< Jul13 0:00 [jfsCommit] root 4036 0.0 0.0 0 0 ? S< Jul13 0:00 [jfsCommit] root 4037 0.0 0.0 0 0 ? S< Jul13 0:00 [jfsCommit] root 4038 0.0 0.0 0 0 ? S< Jul13 0:00 [jfsSync] root 4237 0.0 0.0 0 0 ? S< Jul13 0:00 [rpciod/0] root 4238 0.0 0.0 0 0 ? S< Jul13 0:00 [rpciod/1] root 4239 0.0 0.0 0 0 ? S< Jul13 0:00 [rpciod/2] root 4240 0.0 0.0 0 0 ? S< Jul13 0:00 [rpciod/3] root 4576 0.0 0.0 0 0 ? S< Jul13 0:25 [kmirrord] root 4577 0.0 0.0 0 0 ? S< Jul13 0:00 [kcopyd] root 4619 0.0 0.0 0 0 ? S< Jul13 0:12 [kjournald] root 4740 0.0 0.0 2096 676 ? S<s Jul13 0:01 /sbin/udevd --daemon root 7207 0.0 0.0 2188 648 ? Ss Jul13 0:10 /usr/sbin/syslog-ng root 8760 0.0 0.0 5356 1072 ? Ss Jul13 0:00 /usr/sbin/sshd root 8820 0.0 0.0 1688 364 ? Ss Jul13 0:00 /usr/bin/svscan /service root 8824 0.0 0.0 1528 320 ? S Jul13 0:00 supervise axfrdns root 8825 0.0 0.0 1528 316 ? S Jul13 0:00 supervise log root 8826 0.0 0.0 1528 316 ? S Jul13 0:00 supervise tinydns root 8827 0.0 0.0 1528 316 ? S Jul13 0:00 supervise log root 8828 0.0 0.0 1528 316 ? S Jul13 0:00 supervise dnscachex root 8829 0.0 0.0 1528 316 ? S Jul13 0:00 supervise log dnscache 8830 0.0 0.0 2960 1616 ? S Jul13 0:00 /usr/bin/dnscache dnslog 8833 0.0 0.0 1668 376 ? S Jul13 0:00 multilog t ./main tinydns 8835 0.0 0.0 1648 344 ? S Jul13 0:00 /usr/bin/tinydns dnslog 8836 0.0 0.0 1668 376 ? S Jul13 0:00 multilog t ./main dnslog 8837 0.0 0.0 1668 376 ? S Jul13 0:00 multilog t ./main root 8838 0.0 0.0 1548 316 ? S Jul13 0:00 tcpserver -vDRHl0 -x tcp.cdb -- 127.0.0.1 53 /usr/bin/axfrdns root 8902 0.0 0.3 39920 14792 ? Ss Jul13 0:02 /usr/sbin/apache2 -D DEFAULT_VHOST -D INFO -D LANGUAGE -D MANUAL -D SSL -D SSL_DEFAULT_VHOST -D SUEXEC -D PHP5 -d /usr/lib/apache2 -f /etc/apache2/httpd.conf -k start festival 8962 0.0 0.4 22992 19832 ? Ss Jul13 0:00 /usr/bin/festival --server -b /etc/festival/server.scm uucp 9025 0.0 0.0 6732 2068 ? Ss Jul13 0:00 /usr/sbin/faxq -q /var/spool/fax -D uucp 9037 0.0 0.0 4816 1704 ? Ss Jul13 0:00 /usr/sbin/hfaxd -l 0.0.0.0 -q /var/spool/fax -i hylafax -d ntp 9294 0.0 0.0 9344 2592 ? Ss Jul13 0:02 /usr/sbin/ntpd -p /var/run/ntpd.pid -u ntp:ntp root 9354 0.0 0.1 12276 4212 ? Ss Jul13 0:00 /usr/sbin/smbd -D root 9363 0.0 0.0 8452 1476 ? Ss Jul13 0:04 /usr/sbin/nmbd -D root 9367 0.0 0.0 12276 1132 ? S Jul13 0:00 /usr/sbin/smbd -D root 9373 0.0 0.0 10652 3592 ? Ss Jul13 0:01 /usr/sbin/winbindd root 9377 0.0 0.0 10432 3888 ? S Jul13 0:00 /usr/sbin/winbindd root 10067 0.0 0.0 3488 708 ? Ss Jul13 0:00 /usr/sbin/cron root 10901 0.0 0.0 0 0 ? S Jul13 0:00 [mISDNd] root 11059 0.0 0.0 0 0 ? S Jul13 0:03 [mISDNStackd] root 11060 0.1 0.0 0 0 ? S Jul13 3:57 [mISDNStackd] root 11061 0.1 0.0 0 0 ? S Jul13 4:33 [mISDNStackd] root 11068 0.0 0.0 0 0 ? S Jul13 0:02 [mISDNStackd] root 11069 0.1 0.0 0 0 ? S Jul13 3:58 [mISDNStackd] root 11070 0.1 0.0 0 0 ? S Jul13 4:03 [mISDNStackd] root 11077 0.0 0.0 0 0 ? S Jul13 0:02 [mISDNStackd] root 11078 0.1 0.0 0 0 ? S Jul13 4:09 [mISDNStackd] root 11079 0.1 0.0 0 0 ? S Jul13 3:20 [mISDNStackd] root 11086 0.0 0.0 0 0 ? S Jul13 0:01 [mISDNStackd] root 11087 0.0 0.0 0 0 ? S Jul13 2:25 [mISDNStackd] root 11088 0.0 0.0 0 0 ? S Jul13 2:14 [mISDNStackd] root 11145 0.0 0.0 4384 680 ? S Jul13 0:00 /bin/sh /usr/sbin/safe_asterisk -U asterisk -G asterisk asterisk 11153 1.1 1.4 102056 58984 ? Sl Jul13 30:05 /usr/sbin/asterisk -f -U asterisk -G asterisk -vvvg asterisk 11210 0.0 0.0 2604 572 ? S Jul13 0:00 /bin/bash -c cd /var/www/localhost/htdocs/freepbx/panel && /var/www/localhost/htdocs/freepbx/panel/safe_opserver & asterisk 11211 0.0 0.0 2860 1096 ? S Jul13 0:00 sh /var/www/localhost/htdocs/freepbx/panel/safe_opserver asterisk 11213 0.2 0.2 13712 12072 ? S Jul13 5:58 /usr/bin/perl /var/www/localhost/htdocs/freepbx/panel/op_server.pl -l=/var/log/asterisk/FOP root 11281 0.0 0.0 1716 684 tty2 Ss+ Jul13 0:00 /sbin/agetty 38400 tty2 linux root 11282 0.0 0.0 1716 684 tty3 Ss+ Jul13 0:00 /sbin/agetty 38400 tty3 linux root 11283 0.0 0.0 1716 684 tty4 Ss+ Jul13 0:00 /sbin/agetty 38400 tty4 linux root 11284 0.0 0.0 1716 688 tty5 Ss+ Jul13 0:00 /sbin/agetty 38400 tty5 linux root 11285 0.0 0.0 1716 684 tty6 Ss+ Jul13 0:00 /sbin/agetty 38400 tty6 linux uucp 11288 0.0 0.0 3584 1276 pts/10 Ss+ Jul13 0:00 /usr/sbin/iaxmodem iaxmodem-cfg.ttyIAX10000 uucp 11289 0.0 0.0 3580 1312 pts/7 Ss+ Jul13 0:02 /usr/sbin/iaxmodem iaxmodem-cfg.ttyIAX10001 uucp 11290 0.0 0.0 3584 1280 pts/11 Ss+ Jul13 0:00 /usr/sbin/iaxmodem iaxmodem-cfg.ttyIAX10002 uucp 11291 0.0 0.0 3580 1276 pts/6 Ss+ Jul13 0:00 /usr/sbin/iaxmodem iaxmodem-cfg.ttyIAX10003 uucp 11292 0.0 0.0 3584 1284 pts/15 Ss+ Jul13 0:00 /usr/sbin/iaxmodem iaxmodem-cfg.ttyIAX10004 uucp 11293 0.0 0.0 3580 1272 pts/5 Ss+ Jul13 0:00 /usr/sbin/iaxmodem iaxmodem-cfg.ttyIAX10005 uucp 11294 0.0 0.0 3580 1272 pts/12 Ss+ Jul13 0:00 /usr/sbin/iaxmodem iaxmodem-cfg.ttyIAX10006 uucp 11295 0.0 0.0 3584 1276 pts/13 Ss+ Jul13 0:00 /usr/sbin/iaxmodem iaxmodem-cfg.ttyIAX10007 uucp 11296 0.0 0.0 3584 1276 pts/8 Ss+ Jul13 0:00 /usr/sbin/iaxmodem iaxmodem-cfg.ttyIAX10008 uucp 11297 0.0 0.0 3580 1272 pts/9 Ss+ Jul13 0:00 /usr/sbin/iaxmodem iaxmodem-cfg.ttyIAX10009 uucp 11298 0.0 0.0 3580 1268 pts/4 Ss+ Jul13 0:00 /usr/sbin/iaxmodem iaxmodem-cfg.ttyIAX10010 uucp 11299 0.0 0.0 3588 1280 pts/3 Ss+ Jul13 0:00 /usr/sbin/iaxmodem iaxmodem-cfg.ttyIAX10011 uucp 11300 0.0 0.0 3588 1284 pts/2 Ss+ Jul13 0:00 /usr/sbin/iaxmodem iaxmodem-cfg.ttyIAX10012 uucp 11301 0.0 0.0 3580 1272 pts/14 Ss+ Jul13 0:00 /usr/sbin/iaxmodem iaxmodem-cfg.ttyIAX10013 uucp 11302 0.0 0.0 3588 1316 pts/1 Ss+ Jul13 0:00 /usr/sbin/iaxmodem iaxmodem-cfg.ttyIAX10014 uucp 11303 0.0 0.0 3580 1268 pts/0 Ss+ Jul13 0:00 /usr/sbin/iaxmodem iaxmodem-cfg.ttyIAX10015 uucp 11304 0.0 0.0 5300 2108 ? Ss Jul13 0:00 /usr/sbin/faxgetty ttyIAX10000 uucp 11305 0.0 0.0 5300 2324 ? Ss Jul13 0:01 /usr/sbin/faxgetty ttyIAX10001 uucp 11306 0.0 0.0 5300 2104 ? Ss Jul13 0:00 /usr/sbin/faxgetty ttyIAX10002 uucp 11307 0.0 0.0 5300 2104 ? Ss Jul13 0:00 /usr/sbin/faxgetty ttyIAX10003 uucp 11308 0.0 0.0 5300 2104 ? Ss Jul13 0:00 /usr/sbin/faxgetty ttyIAX10004 uucp 11309 0.0 0.0 5300 2108 ? Ss Jul13 0:00 /usr/sbin/faxgetty ttyIAX10005 uucp 11310 0.0 0.0 5300 2108 ? Ss Jul13 0:00 /usr/sbin/faxgetty ttyIAX10006 uucp 11311 0.0 0.0 5300 2104 ? Ss Jul13 0:00 /usr/sbin/faxgetty ttyIAX10007 uucp 11312 0.0 0.0 5300 2108 ? Ss Jul13 0:00 /usr/sbin/faxgetty ttyIAX10008 uucp 11313 0.0 0.0 5300 2112 ? Ss Jul13 0:00 /usr/sbin/faxgetty ttyIAX10009 uucp 11314 0.0 0.0 5300 2104 ? Ss Jul13 0:00 /usr/sbin/faxgetty ttyIAX10010 uucp 11315 0.0 0.0 5300 2108 ? Ss Jul13 0:00 /usr/sbin/faxgetty ttyIAX10011 uucp 11316 0.0 0.0 5300 2104 ? Ss Jul13 0:00 /usr/sbin/faxgetty ttyIAX10012 uucp 11317 0.0 0.0 5300 2104 ? Ss Jul13 0:00 /usr/sbin/faxgetty ttyIAX10013 uucp 11318 0.0 0.0 5300 2428 ? Ss Jul13 0:00 /usr/sbin/faxgetty ttyIAX10014 uucp 11319 0.0 0.0 5300 2112 ? Ss Jul13 0:00 /usr/sbin/faxgetty ttyIAX10015 root 11320 0.0 0.0 2820 1308 ? Ss Jul13 0:01 /bin/bash /root/FHM-scripts/SMS/FHM_SMS.sh root 11321 0.0 0.0 2820 1312 ? Ss Jul13 0:01 /bin/bash /root/FHM-scripts/analyzer/check_checker mysql 11817 0.0 0.6 247172 27692 ? Ssl Jul13 2:30 /usr/sbin/mysqld --defaults-file=/etc/mysql/my.cnf --basedir=/usr --datadir=/var/lib/mysql --pid-file=/var/run/mysqld/mysqld.pid --socket=/var/run/mysqld/mysqld.sock root 11967 0.0 0.0 16276 2000 ? Ss Jul13 0:00 ndbd root 11969 0.1 2.6 439960 109156 ? Sl Jul13 4:14 ndbd root 15358 0.0 0.0 1716 688 tty1 Ss+ Jul14 0:00 /sbin/agetty 38400 tty1 linux root 18204 0.0 0.0 2948 1428 ? Ss 16:58 0:00 /bin/bash /var/lib/asterisk/agi-bin/FHM_dns_update_inittab_v3.sh root 21275 0.0 0.0 10672 1700 ? S Jul14 0:00 /usr/sbin/winbindd root 25900 0.0 0.0 1660 404 ? S 17:27 0:00 sleep 60 root 25907 0.0 0.0 4024 1028 ? S 17:28 0:00 /usr/sbin/cron root 25909 0.0 0.0 2736 1392 ? Ss 17:28 0:00 /bin/bash /root/FHM-scripts/analyzer/check_ast_service root 26157 0.5 0.2 34128 10272 ? Ss 17:28 0:00 /usr/bin/php /var/lib/asterisk/agi-bin/FHM_callbacks_listen.php root 26163 0.0 0.0 1660 400 ? S 17:28 0:00 sleep 15 root 26211 0.0 0.0 1660 400 ? S 17:28 0:00 sleep 23 root 26214 0.0 0.0 2320 908 ? R 17:28 0:00 ps aux MPSTAT: Linux 2.6.23-gentoo-r8 (inf-voip2) 07/15/10 _i686_ (4 CPU) 17:28:53 CPU %usr %nice %sys %iowait %irq %soft %steal %guest %idle 17:28:53 all 0.63 0.00 0.67 0.80 2.24 0.08 0.00 0.00 95.57 MPSTAT: Linux 2.6.23-gentoo-r8 (inf-voip2) 07/15/10 _i686_ (4 CPU) 17:28:54 CPU %usr %nice %sys %iowait %irq %soft %steal %guest %idle 17:28:54 all 0.63 0.00 0.67 0.80 2.24 0.08 0.00 0.00 95.57 17:28:54 0 0.27 0.00 0.44 1.31 1.95 0.05 0.00 0.00 95.97 17:28:54 1 0.87 0.00 0.80 1.12 2.09 0.12 0.00 0.00 95.00 17:28:54 2 0.71 0.00 0.75 0.60 2.79 0.08 0.00 0.00 95.08 17:28:54 3 0.68 0.00 0.70 0.19 2.11 0.08 0.00 0.00 96.25 17:28:54 CPU intr/s 17:28:54 all 1492.13 17:28:54 0 387.96 17:28:54 1 366.06 17:28:54 2 347.48 17:28:54 3 322.63 17:28:54 CPU 0/s 1/s 8/s 9/s 12/s 14/s 16/s 17/s 18/s 20/s 21/s 22/s NMI/s LOC/s ERR/s MIS/s 17:28:54 0 0.00 0.00 0.00 0.00 0.00 0.00 1.01 47.48 39.12 9.58 255.68 35.08 0.00 99.99 0.00 0.00 17:28:54 1 0.00 0.00 0.00 0.00 0.00 0.00 1.55 36.51 43.18 10.59 257.44 16.79 0.00 99.99 0.00 0.00 17:28:54 2 0.00 0.00 0.00 0.00 0.00 0.00 4.26 32.73 27.25 4.21 255.65 23.39 0.00 99.99 0.00 0.00 17:28:54 3 0.00 0.00 0.00 0.00 0.00 0.00 2.27 25.75 42.47 2.04 233.53 16.56 0.00 99.99 0.00 0.00 IO STAT: Linux 2.6.23-gentoo-r8 (inf-voip2) 07/15/10 _i686_ (4 CPU) avg-cpu: %user %nice %system %iowait %steal %idle 0.63 0.00 2.99 0.80 0.00 95.57 Device: tps Blk_read/s Blk_wrtn/s Blk_read Blk_wrtn hda 0.00 0.02 0.00 2810 0 sda 13.78 11.21 217.05 1710938 33132096 sdb 13.15 0.00 217.05 739 33132096 dm-0 27.95 11.20 217.05 1710199 33132096 dm-1 0.01 0.01 0.00 2110 0 dm-2 0.00 0.00 0.00 531 0 dm-3 27.94 11.18 217.05 1706902 33132096 ETH0: 4: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast qlen 1000 link/ether 90:e6:ba:8c:4b:d2 brd ff:ff:ff:ff:ff:ff ETH1: 2: eth1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast qlen 1000 link/ether 00:15:17:d3:60:ba brd ff:ff:ff:ff:ff:ff ETH2: 3: eth2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast qlen 1000 link/ether 00:15:17:d3:60:bb brd ff:ff:ff:ff:ff:ff By: Leif Madsen (lmadsen) 2011-07-26 15:04:47.924-0500 Per the Asterisk maintenance timeline page at http://www.asterisk.org/asterisk-versions maintenance (bug) support for the 1.4 and 1.6.x branches has ended. For continued maintenance support please move to the 1.8 branch which is a long term support (LTS) branch. For more information about branch support, please see https://wiki.asterisk.org/wiki/display/AST/Asterisk+Versions If this is still an issue, please open a new issue so it can be re-triaged appropriately. Thanks! |